2024-09-10T14:15:14.733 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T14:15:15.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T14:15:15.317 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116 branch: wip-tejas-testing-2024-09-09-1611-squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: tchandra@redhat.com first_in_suite: false job_id: '7899116' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-tejas-testing-2024-09-09-1611-squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-tejas-testing-2024-09-09-1611-squid sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 owner: scheduled_tchandra@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 1683 sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 sleep_before_teardown: 0 suite: rgw suite_branch: wip-tejas-testing-2024-09-09-1611-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHs9cjhdDYH/JDbGZs1wWrPq5gqjY+jAq/ObJcd1uXBaDpS8z+n+GiqZmKzKSs9s0h36ngcEapAaTgUZE17A8h8= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5bwbmr6K0SfLTGm1XutY6mA1cSX/paaJwhlH5fzjaYOq6OGblwpgnUxUsr/IcKtFQfN6f1DNBkNrFxUFTSrZ4= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_07:44:33 tube: smithi user: tchandra verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T14:15:15.317 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa; will attempt to use it 2024-09-10T14:15:15.318 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa/tasks 2024-09-10T14:15:15.318 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T14:15:15.320 INFO:teuthology.task.internal:Checking packages... 2024-09-10T14:15:15.341 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7162ca8a22368558b9ec845c47e93c7afc45e8c3' 2024-09-10T14:15:15.342 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T14:15:15.342 INFO:teuthology.packaging:ref: None 2024-09-10T14:15:15.342 INFO:teuthology.packaging:tag: None 2024-09-10T14:15:15.342 INFO:teuthology.packaging:branch: wip-tejas-testing-2024-09-09-1611-squid 2024-09-10T14:15:15.342 INFO:teuthology.packaging:sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T14:15:15.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-tejas-testing-2024-09-09-1611-squid 2024-09-10T14:15:15.483 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:15:15.485 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T14:15:15.495 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T14:15:15.496 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T14:15:15.536 INFO:teuthology.task.internal:Saving configuration 2024-09-10T14:15:15.549 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T14:15:15.598 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T14:15:15.623 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 14:09:31.446081', 'locked_by': 'scheduled_tchandra@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIENaXCVy47o/aFvrNFxAceEAaGorSXwavkK+6+NnhwzV'} 2024-09-10T14:15:15.641 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 14:09:31.448078', 'locked_by': 'scheduled_tchandra@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICRjQlzYUwo+zuNGkwndY+eZE7LBYY8hgSUXJrKW9WWI'} 2024-09-10T14:15:15.641 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T14:15:15.652 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-10T14:15:15.652 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-10T14:15:15.652 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T14:15:15.743 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd818b33be0>, signals=[15]) 2024-09-10T14:15:15.744 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T14:15:15.754 INFO:teuthology.task.internal:Opening connections... 2024-09-10T14:15:15.755 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T14:15:15.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:15:15.853 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:15:15.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:15:15.933 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T14:15:15.944 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-10T14:15:15.949 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-10T14:15:15.950 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-10T14:15:15.998 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T14:15:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2024-09-10T14:15:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="22.04" 2024-09-10T14:15:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T14:15:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=jammy 2024-09-10T14:15:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2024-09-10T14:15:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2024-09-10T14:15:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T14:15:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T14:15:16.000 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T14:15:16.000 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T14:15:16.000 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=jammy 2024-09-10T14:15:16.000 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-10T14:15:16.030 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-09-10T14:15:16.035 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-09-10T14:15:16.035 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-09-10T14:15:16.080 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T14:15:16.080 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-09-10T14:15:16.080 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-09-10T14:15:16.080 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T14:15:16.080 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-09-10T14:15:16.080 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-09-10T14:15:16.080 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-09-10T14:15:16.081 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T14:15:16.081 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T14:15:16.081 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T14:15:16.081 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T14:15:16.081 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-09-10T14:15:16.081 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-09-10T14:15:16.095 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T14:15:16.105 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T14:15:16.153 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T14:15:16.153 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-10T14:15:16.156 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-09-10T14:15:16.161 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T14:15:16.198 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T14:15:16.198 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-10T14:15:16.205 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-09-10T14:15:16.274 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T14:15:16.321 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T14:15:16.358 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T14:15:16.359 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T14:15:16.359 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T14:15:16.359 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T14:15:16.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T14:15:16.364 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-10T14:15:16.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T14:15:16.365 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-10T14:15:16.411 INFO:teuthology.orchestra.run.smithi052.stdout:5.15.0-56-generic 2024-09-10T14:15:16.411 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.15.0-56-generic 2024-09-10T14:15:16.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2024-09-10T14:15:16.413 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-56-generic 2024-09-10T14:15:16.413 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.15.0-56-generic 2024-09-10T14:15:16.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-10T14:15:16.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-10T14:15:16.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-10T14:15:16.822 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T14:15:16.822 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T14:15:16.836 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T14:15:16.837 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T14:15:16.885 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T14:15:16.895 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T14:15:17.241 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T14:15:17.251 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T14:15:17.268 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T14:15:17.268 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T14:15:17.382 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T14:15:17.390 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T14:15:17.558 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T14:15:17.576 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T14:15:17.699 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T14:15:17.711 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T14:15:17.715 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T14:15:17.723 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T14:15:17.724 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T14:15:17.731 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T14:15:17.733 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T14:15:17.744 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T14:15:17.745 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T14:15:17.746 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T14:15:17.748 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T14:15:17.748 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T14:15:17.749 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T14:15:17.749 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T14:15:17.765 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T14:15:17.766 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T14:15:17.817 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T14:15:17.820 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T14:15:17.821 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T14:15:17.833 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T14:15:17.833 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T14:15:17.862 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [730 kB] 2024-09-10T14:15:17.862 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T14:15:17.869 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T14:15:17.869 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T14:15:17.870 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T14:15:17.870 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T14:15:17.870 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T14:15:17.875 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T14:15:17.878 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T14:15:17.878 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [730 kB] 2024-09-10T14:15:17.881 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T14:15:17.885 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T14:15:17.891 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T14:15:17.895 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T14:15:17.896 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T14:15:17.896 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T14:15:17.899 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T14:15:17.899 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T14:15:17.900 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T14:15:17.900 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T14:15:17.900 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T14:15:17.901 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T14:15:17.901 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T14:15:17.901 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T14:15:17.901 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T14:15:17.902 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T14:15:17.902 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T14:15:17.909 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T14:15:17.913 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T14:15:17.915 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T14:15:17.916 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T14:15:17.957 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T14:15:17.958 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T14:15:17.964 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T14:15:17.965 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T14:15:17.979 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T14:15:17.980 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T14:15:17.980 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T14:15:17.982 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T14:15:17.983 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T14:15:17.998 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T14:15:17.999 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T14:15:18.000 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T14:15:18.001 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T14:15:18.001 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T14:15:18.039 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T14:15:18.039 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T14:15:18.040 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T14:15:18.061 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T14:15:18.062 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T14:15:18.062 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T14:15:18.063 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T14:15:18.064 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T14:15:24.033 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 15.8 MB in 3s (5,821 kB/s) 2024-09-10T14:15:24.370 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 15.8 MB in 3s (5,661 kB/s) 2024-09-10T14:15:25.506 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-10T14:15:25.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T14:15:25.584 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-10T14:15:25.782 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-10T14:15:25.792 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-10T14:15:25.792 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-10T14:15:25.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T14:15:25.870 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-10T14:15:25.971 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T14:15:25.971 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T14:15:25.971 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T14:15:25.972 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T14:15:25.972 INFO:teuthology.orchestra.run.smithi151.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T14:15:25.972 INFO:teuthology.orchestra.run.smithi151.stdout: python2.7-minimal 2024-09-10T14:15:25.972 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T14:15:25.973 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-10T14:15:25.973 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T14:15:25.973 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T14:15:25.974 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T14:15:25.975 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-10T14:15:25.975 INFO:teuthology.orchestra.run.smithi151.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T14:15:25.975 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-10T14:15:25.975 INFO:teuthology.orchestra.run.smithi151.stdout: thermald 2024-09-10T14:15:26.031 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-10T14:15:26.031 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T14:15:26.031 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T14:15:26.032 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T14:15:26.033 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-09-10T14:15:26.033 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T14:15:26.083 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-10T14:15:26.083 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-10T14:15:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T14:15:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 113 MB of archives. 2024-09-10T14:15:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T14:15:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T14:15:26.276 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T14:15:26.276 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T14:15:26.276 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T14:15:26.277 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T14:15:26.277 INFO:teuthology.orchestra.run.smithi052.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T14:15:26.277 INFO:teuthology.orchestra.run.smithi052.stdout: python2.7-minimal 2024-09-10T14:15:26.277 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T14:15:26.278 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-09-10T14:15:26.278 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T14:15:26.278 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T14:15:26.279 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T14:15:26.280 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-09-10T14:15:26.280 INFO:teuthology.orchestra.run.smithi052.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T14:15:26.280 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2024-09-10T14:15:26.281 INFO:teuthology.orchestra.run.smithi052.stdout: thermald 2024-09-10T14:15:26.325 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-09-10T14:15:26.325 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T14:15:26.325 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T14:15:26.325 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T14:15:26.327 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2024-09-10T14:15:26.327 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T14:15:26.508 INFO:teuthology.orchestra.run.smithi052.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T14:15:26.508 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 113 MB of archives. 2024-09-10T14:15:26.508 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T14:15:26.508 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T14:15:26.645 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T14:15:26.747 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T14:15:27.544 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T14:15:27.544 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T14:15:27.544 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T14:15:27.665 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T14:15:27.687 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T14:15:27.922 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T14:15:28.061 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 113 MB in 2s (68.8 MB/s) 2024-09-10T14:15:28.239 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T14:15:28.277 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T14:15:30.297 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T14:15:30.304 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T14:15:30.461 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:30.508 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T14:15:30.539 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T14:15:30.543 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T14:15:30.890 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T14:15:30.972 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T14:15:31.399 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2024-09-10T14:15:31.589 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T14:15:32.721 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T14:15:32.743 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T14:15:32.842 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:33.283 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T14:15:33.303 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T14:15:33.332 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:33.557 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T14:15:33.561 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T14:15:33.636 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:35.621 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T14:15:35.643 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T14:15:35.746 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:36.307 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T14:15:36.329 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T14:15:36.365 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:39.935 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T14:15:40.059 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T14:15:40.383 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T14:15:40.504 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T14:15:40.774 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T14:15:40.785 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T14:15:40.815 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T14:15:42.795 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T14:15:42.903 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T14:15:43.220 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T14:15:43.348 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T14:15:43.643 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T14:15:43.654 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T14:15:43.692 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T14:15:45.967 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T14:15:46.003 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T14:15:46.033 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:48.744 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T14:15:48.869 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T14:15:49.044 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T14:15:49.081 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T14:15:49.118 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:49.186 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T14:15:49.291 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:49.392 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T14:15:49.521 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:50.838 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T14:15:50.839 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T14:15:50.839 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T14:15:50.839 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T14:15:50.997 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:51.783 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T14:15:51.914 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T14:15:52.656 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T14:15:53.107 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:53.219 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:53.345 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T14:15:53.482 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:54.551 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T14:15:54.676 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T14:15:54.811 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:54.843 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T14:15:54.843 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T14:15:54.843 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T14:15:54.843 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T14:15:54.880 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T14:15:54.881 INFO:teuthology.orchestra.run.smithi151.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T14:15:54.977 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:56.412 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:57.880 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T14:15:58.005 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T14:15:58.140 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T14:15:58.205 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T14:15:58.205 INFO:teuthology.orchestra.run.smithi052.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T14:16:09.462 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T14:16:09.462 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub' 2024-09-10T14:16:09.471 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T14:16:09.488 INFO:teuthology.orchestra.run.smithi151.stdout:Generating grub configuration file ... 2024-09-10T14:16:09.763 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T14:16:09.778 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T14:16:10.079 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T14:16:10.086 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T14:16:10.158 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T14:16:10.163 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T14:16:10.321 INFO:teuthology.orchestra.run.smithi151.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T14:16:10.321 INFO:teuthology.orchestra.run.smithi151.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T14:16:10.321 INFO:teuthology.orchestra.run.smithi151.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T14:16:10.364 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-09-10T14:16:10.821 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-10T14:16:10.843 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-10T14:16:10.843 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-10T14:16:10.843 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-10T14:16:10.843 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-10T14:16:10.843 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.119.119 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-10T14:16:10.844 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-10T14:16:10.844 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T14:16:10.845 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T14:16:10.845 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T14:16:10.845 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-10T14:16:10.845 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T14:16:10.845 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-10T14:16:10.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-10T14:16:11.075 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T14:16:11.201 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T14:16:11.302 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T14:16:11.363 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T14:16:12.575 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-10T14:16:12.595 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T14:16:12.649 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-10T14:16:12.651 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T14:16:12.651 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub' 2024-09-10T14:16:12.659 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T14:16:12.685 INFO:teuthology.orchestra.run.smithi052.stdout:Generating grub configuration file ... 2024-09-10T14:16:12.842 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-10T14:16:12.849 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-10T14:16:13.015 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T14:16:13.017 INFO:teuthology.orchestra.run.smithi151.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T14:16:13.017 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T14:16:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T14:16:13.017 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T14:16:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T14:16:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T14:16:13.018 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T14:16:13.018 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T14:16:13.037 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T14:16:13.058 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T14:16:13.060 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-10T14:16:13.119 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-10T14:16:13.119 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-10T14:16:13.119 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-10T14:16:13.119 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-10T14:16:13.119 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-10T14:16:13.119 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T14:16:13.119 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-10T14:16:13.119 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-10T14:16:13.120 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.119.119 2024-09-10T14:16:13.120 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T14:16:13.120 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T14:16:13.120 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-10T14:16:13.120 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-10T14:16:13.120 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-10T14:16:13.120 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-10T14:16:13.121 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-09-10T14:16:13.164 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.TybEI1HhHK 2024-09-10T14:16:13.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub/grub.cfg /tmp/tmp.TybEI1HhHK 2024-09-10T14:16:13.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.TybEI1HhHK 2024-09-10T14:16:13.340 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.TybEI1HhHK is 10KB 2024-09-10T14:16:13.353 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.TybEI1HhHK 2024-09-10T14:16:13.359 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T14:16:13.389 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T14:16:13.395 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T14:16:13.412 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:16:13.412 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T14:16:13.412 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T14:16:13.464 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T14:16:13.470 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T14:16:13.513 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T14:16:13.514 DEBUG:teuthology.orchestra.run.smithi151:> sudo update-grub 2024-09-10T14:16:13.619 INFO:teuthology.orchestra.run.smithi052.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T14:16:13.619 INFO:teuthology.orchestra.run.smithi052.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T14:16:13.619 INFO:teuthology.orchestra.run.smithi052.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T14:16:13.658 INFO:teuthology.orchestra.run.smithi052.stdout:done 2024-09-10T14:16:14.110 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2024-09-10T14:16:14.134 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2024-09-10T14:16:14.134 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2024-09-10T14:16:14.134 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2024-09-10T14:16:14.134 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2024-09-10T14:16:14.134 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 21 2024-09-10T14:16:14.134 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T14:16:14.134 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2024-09-10T14:16:14.134 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2024-09-10T14:16:14.135 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.15.0.119.119 2024-09-10T14:16:14.135 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T14:16:14.135 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T14:16:14.135 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2024-09-10T14:16:14.135 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2024-09-10T14:16:14.135 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2024-09-10T14:16:14.135 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2024-09-10T14:16:14.135 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T14:16:14.135 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T14:16:14.135 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T14:16:14.135 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T14:16:14.136 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T14:16:14.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2024-09-10T14:16:14.290 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-10T14:16:14.542 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T14:16:14.543 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T14:16:14.614 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T14:16:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub' 2024-09-10T14:16:14.687 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T14:16:14.688 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-09-10T14:16:14.695 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T14:16:14.864 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T14:16:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T14:16:15.112 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T14:16:15.117 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T14:16:15.157 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T14:16:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T14:16:15.271 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T14:16:15.271 INFO:teuthology.orchestra.run.smithi151.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T14:16:15.271 INFO:teuthology.orchestra.run.smithi151.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T14:16:15.281 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-09-10T14:16:15.294 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-09-10T14:16:16.014 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-10T14:16:16.034 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T14:16:16.099 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-10T14:16:16.326 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-10T14:16:16.326 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-10T14:16:16.520 INFO:teuthology.orchestra.run.smithi052.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T14:16:16.520 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T14:16:16.520 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T14:16:16.520 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T14:16:16.521 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T14:16:16.521 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T14:16:16.521 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T14:16:16.521 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T14:16:16.568 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T14:16:16.570 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2024-09-10T14:16:16.586 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 21 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.15.0.119.119 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2024-09-10T14:16:16.587 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2024-09-10T14:16:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2024-09-10T14:16:16.588 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2024-09-10T14:16:16.588 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-10T14:16:16.636 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.FiQGsUEHQG 2024-09-10T14:16:16.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub/grub.cfg /tmp/tmp.FiQGsUEHQG 2024-09-10T14:16:16.692 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.FiQGsUEHQG 2024-09-10T14:16:16.813 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.FiQGsUEHQG is 10KB 2024-09-10T14:16:16.826 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.FiQGsUEHQG 2024-09-10T14:16:16.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T14:16:16.887 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:16:16.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T14:16:16.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T14:16:16.955 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T14:16:16.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo update-grub 2024-09-10T14:16:18.150 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub' 2024-09-10T14:16:18.152 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T14:16:18.153 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-09-10T14:16:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T14:16:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T14:16:18.674 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T14:16:18.679 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T14:16:18.722 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T14:16:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T14:16:18.850 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T14:16:18.850 INFO:teuthology.orchestra.run.smithi052.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T14:16:18.851 INFO:teuthology.orchestra.run.smithi052.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T14:16:18.862 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-09-10T14:16:18.876 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-09-10T14:16:45.333 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-10T14:16:45.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-10T14:16:45.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:16:48.881 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T14:16:48.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T14:16:48.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:17:19.933 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-10T14:17:28.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-10T14:17:28.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:17:47.325 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-10T14:17:48.883 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T14:17:57.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T14:17:57.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:17:58.726 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-10T14:17:59.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-10T14:17:59.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:17:59.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T14:17:59.575 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-10T14:17:59.575 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-10T14:17:59.580 INFO:teuthology.orchestra.run.smithi052.stdout:5.15.0-119-generic 2024-09-10T14:17:59.580 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T14:17:59.581 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T14:17:59.581 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T14:18:00.226 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-10T14:18:00.581 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T14:18:00.582 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T14:18:00.740 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-09-10T14:18:00.774 DEBUG:teuthology.parallel:result is None 2024-09-10T14:18:15.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-10T14:18:15.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:18:15.510 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-10T14:18:16.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-10T14:18:16.060 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-119-generic"... 2024-09-10T14:18:16.061 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-10T14:18:16.107 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-119-generic 2024-09-10T14:18:16.108 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T14:18:16.108 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T14:18:16.108 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T14:18:17.108 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-10T14:18:17.109 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T14:18:17.468 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-09-10T14:18:17.505 DEBUG:teuthology.parallel:result is None 2024-09-10T14:18:17.506 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T14:18:17.514 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T14:18:17.514 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T14:18:17.516 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T14:18:17.522 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T14:18:17.550 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T14:18:17.558 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T14:18:17.558 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T14:18:17.565 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T14:18:17.590 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T14:18:17.598 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T14:18:17.598 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T14:18:17.621 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T14:18:17.646 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T14:18:17.651 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T14:18:17.654 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T14:18:17.658 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T14:18:17.660 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T14:18:17.668 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T14:18:17.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T14:18:17.701 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T14:18:17.725 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T14:18:17.735 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T14:18:17.735 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T14:18:17.760 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T14:18:17.772 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T14:18:17.810 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T14:18:17.860 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:18:17.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T14:18:17.941 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T14:18:17.947 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T14:18:17.992 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:18:17.992 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T14:18:18.058 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-10T14:18:18.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-09-10T14:18:18.130 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T14:18:18.138 INFO:teuthology.task.internal:Starting timer... 2024-09-10T14:18:18.138 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T14:18:18.156 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T14:18:18.169 DEBUG:teuthology.task.selinux:Excluding smithi052: OS 'ubuntu' does not support SELinux 2024-09-10T14:18:18.169 DEBUG:teuthology.task.selinux:Excluding smithi151: OS 'ubuntu' does not support SELinux 2024-09-10T14:18:18.170 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T14:18:18.170 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T14:18:18.170 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T14:18:18.170 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T14:18:18.184 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T14:18:18.195 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T14:18:18.197 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T14:25:50.887 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-09-10T14:25:50.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T14:25:50.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:25:50.971 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-10T14:25:51.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T14:25:51.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-10T14:25:51.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T14:25:51.127 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-10T14:25:51.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-10T14:25:51.205 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T14:25:51.216 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T14:25:51.217 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T14:25:51.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T14:25:51.220 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T14:25:51.220 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T14:25:51.250 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T14:25:51.250 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Command line: ntpd -gq 2024-09-10T14:25:51.250 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: ---------------------------------------------------- 2024-09-10T14:25:51.251 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T14:25:51.251 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T14:25:51.251 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: corporation. Support and training for ntp-4 are 2024-09-10T14:25:51.251 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: available at https://www.nwtime.org/support 2024-09-10T14:25:51.251 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: ---------------------------------------------------- 2024-09-10T14:25:51.251 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: proto: precision = 0.066 usec (-24) 2024-09-10T14:25:51.252 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: basedate set to 2022-02-04 2024-09-10T14:25:51.252 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: gps base set to 2022-02-06 (week 2196) 2024-09-10T14:25:51.252 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T14:25:51.252 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T14:25:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T14:25:51.253 INFO:teuthology.orchestra.run.smithi052.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T14:25:51.254 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T14:25:51.254 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T14:25:51.254 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T14:25:51.254 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Listen normally on 3 ens1f0 172.21.15.52:123 2024-09-10T14:25:51.254 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Listen normally on 4 lo [::1]:123 2024-09-10T14:25:51.254 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15de%4]:123 2024-09-10T14:25:51.254 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:51 ntpd[18378]: Listening on routing socket on fd #22 for interface updates 2024-09-10T14:25:51.276 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T14:25:51.276 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Command line: ntpd -gq 2024-09-10T14:25:51.276 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: ---------------------------------------------------- 2024-09-10T14:25:51.277 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T14:25:51.277 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T14:25:51.277 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: corporation. Support and training for ntp-4 are 2024-09-10T14:25:51.277 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: available at https://www.nwtime.org/support 2024-09-10T14:25:51.277 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: ---------------------------------------------------- 2024-09-10T14:25:51.277 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: proto: precision = 0.051 usec (-24) 2024-09-10T14:25:51.277 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: basedate set to 2022-02-04 2024-09-10T14:25:51.278 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: gps base set to 2022-02-06 (week 2196) 2024-09-10T14:25:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T14:25:51.278 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T14:25:51.278 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T14:25:51.279 INFO:teuthology.orchestra.run.smithi151.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T14:25:51.279 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T14:25:51.279 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T14:25:51.279 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T14:25:51.280 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Listen normally on 3 enp3s0f1 172.21.15.151:123 2024-09-10T14:25:51.280 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Listen normally on 4 lo [::1]:123 2024-09-10T14:25:51.280 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f63%5]:123 2024-09-10T14:25:51.280 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:51 ntpd[18464]: Listening on routing socket on fd #22 for interface updates 2024-09-10T14:25:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:52.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:52 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:52.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:52.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:52 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:53.250 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:53 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:53.250 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:53 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:53.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:53.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:53 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:53.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:53.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:53 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:53.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:53 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:53.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:53 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:54.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:54.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:54 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:54 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:55 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:55 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:55 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:55 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:55 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:55 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:55.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:55.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:55 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:55.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:55.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:55 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:55.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:55 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:55.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:55 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:56.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:56.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:56 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:56.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:56.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:56 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:57 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:57 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:57 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:57 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:57 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:57 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:57 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:57 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:57 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:57 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:57 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:57 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:58.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:58.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:58.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:58.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:58.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:58.251 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:58.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:58.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:58.252 INFO:teuthology.orchestra.run.smithi052.stdout:10 Sep 14:25:58 ntpd[18378]: ntpd: time slew -0.000308 s 2024-09-10T14:25:58.252 INFO:teuthology.orchestra.run.smithi052.stdout:ntpd: time slew -0.000308s 2024-09-10T14:25:58.252 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T14:25:58.253 INFO:teuthology.orchestra.run.smithi052.stderr:10 Sep 14:25:58 ntpd[18378]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T14:25:58.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:58.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:58.277 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T14:25:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T14:25:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T14:25:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T14:25:58.278 INFO:teuthology.orchestra.run.smithi151.stdout:10 Sep 14:25:58 ntpd[18464]: ntpd: time slew -0.000123 s 2024-09-10T14:25:58.278 INFO:teuthology.orchestra.run.smithi151.stdout:ntpd: time slew -0.000123s 2024-09-10T14:25:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T14:25:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:10 Sep 14:25:58 ntpd[18464]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T14:25:58.300 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T14:25:58.300 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2024-09-10T14:25:58.300 INFO:teuthology.orchestra.run.smithi052.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:25:58.300 INFO:teuthology.orchestra.run.smithi052.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:25:58.300 INFO:teuthology.orchestra.run.smithi052.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:25:58.300 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:25:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T14:25:58.328 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-10T14:25:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:25:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:25:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:25:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:25:58.329 INFO:teuthology.run_tasks:Running task install... 2024-09-10T14:25:58.338 DEBUG:teuthology.task.install:project ceph 2024-09-10T14:25:58.338 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}} 2024-09-10T14:25:58.339 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'} 2024-09-10T14:25:58.339 INFO:teuthology.task.install:Using flavor: default 2024-09-10T14:25:58.344 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T14:25:58.344 INFO:teuthology.task.install:extra packages: [] 2024-09-10T14:25:58.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-key list | grep Ceph 2024-09-10T14:25:58.345 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-key list | grep Ceph 2024-09-10T14:25:58.408 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T14:25:58.437 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T14:25:58.438 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T14:25:58.438 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T14:25:58.439 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T14:25:58.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T14:25:58.462 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T14:25:58.462 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T14:25:58.462 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T14:25:58.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T14:25:58.587 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default/ 2024-09-10T14:25:58.587 INFO:teuthology.task.install.deb:Package version is 19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:25:58.601 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default/ 2024-09-10T14:25:58.601 INFO:teuthology.task.install.deb:Package version is 19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:25:58.701 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:25:58.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T14:25:58.711 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:25:58.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T14:25:58.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-10T14:25:58.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-10T14:25:58.889 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T14:25:58.899 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T14:25:58.917 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T14:25:58.947 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T14:25:58.971 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-10T14:25:58.984 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T14:25:58.993 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T14:25:59.006 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-10T14:25:59.012 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T14:25:59.014 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-10T14:25:59.028 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T14:25:59.042 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-10T14:25:59.050 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-10T14:25:59.069 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T14:25:59.069 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T14:25:59.090 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-10T14:25:59.133 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T14:25:59.215 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T14:25:59.260 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 28.9 kB in 0s (81.0 kB/s) 2024-09-10T14:25:59.444 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 28.9 kB in 1s (57.8 kB/s) 2024-09-10T14:26:00.308 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-10T14:26:00.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-304-g7162ca8a-1jammy cephadm=19.1.1-304-g7162ca8a-1jammy ceph-mds=19.1.1-304-g7162ca8a-1jammy ceph-mgr=19.1.1-304-g7162ca8a-1jammy ceph-common=19.1.1-304-g7162ca8a-1jammy ceph-fuse=19.1.1-304-g7162ca8a-1jammy ceph-test=19.1.1-304-g7162ca8a-1jammy ceph-volume=19.1.1-304-g7162ca8a-1jammy radosgw=19.1.1-304-g7162ca8a-1jammy python3-rados=19.1.1-304-g7162ca8a-1jammy python3-rgw=19.1.1-304-g7162ca8a-1jammy python3-cephfs=19.1.1-304-g7162ca8a-1jammy python3-rbd=19.1.1-304-g7162ca8a-1jammy libcephfs2=19.1.1-304-g7162ca8a-1jammy libcephfs-dev=19.1.1-304-g7162ca8a-1jammy librados2=19.1.1-304-g7162ca8a-1jammy librbd1=19.1.1-304-g7162ca8a-1jammy rbd-fuse=19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:26:00.381 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-10T14:26:00.440 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-10T14:26:00.456 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-304-g7162ca8a-1jammy cephadm=19.1.1-304-g7162ca8a-1jammy ceph-mds=19.1.1-304-g7162ca8a-1jammy ceph-mgr=19.1.1-304-g7162ca8a-1jammy ceph-common=19.1.1-304-g7162ca8a-1jammy ceph-fuse=19.1.1-304-g7162ca8a-1jammy ceph-test=19.1.1-304-g7162ca8a-1jammy ceph-volume=19.1.1-304-g7162ca8a-1jammy radosgw=19.1.1-304-g7162ca8a-1jammy python3-rados=19.1.1-304-g7162ca8a-1jammy python3-rgw=19.1.1-304-g7162ca8a-1jammy python3-cephfs=19.1.1-304-g7162ca8a-1jammy python3-rbd=19.1.1-304-g7162ca8a-1jammy libcephfs2=19.1.1-304-g7162ca8a-1jammy libcephfs-dev=19.1.1-304-g7162ca8a-1jammy librados2=19.1.1-304-g7162ca8a-1jammy librbd1=19.1.1-304-g7162ca8a-1jammy rbd-fuse=19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:26:00.518 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-10T14:26:00.570 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-10T14:26:00.570 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-10T14:26:00.727 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-10T14:26:00.728 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-10T14:26:00.758 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T14:26:00.759 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T14:26:00.759 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T14:26:00.759 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T14:26:00.760 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T14:26:00.760 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T14:26:00.760 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T14:26:00.760 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-09-10T14:26:00.760 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T14:26:00.761 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T14:26:00.761 INFO:teuthology.orchestra.run.smithi052.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T14:26:00.761 INFO:teuthology.orchestra.run.smithi052.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T14:26:00.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet zip 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T14:26:00.763 INFO:teuthology.orchestra.run.smithi052.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T14:26:00.764 INFO:teuthology.orchestra.run.smithi052.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T14:26:00.764 INFO:teuthology.orchestra.run.smithi052.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T14:26:00.764 INFO:teuthology.orchestra.run.smithi052.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T14:26:00.764 INFO:teuthology.orchestra.run.smithi052.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T14:26:00.764 INFO:teuthology.orchestra.run.smithi052.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T14:26:00.764 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2024-09-10T14:26:00.764 INFO:teuthology.orchestra.run.smithi052.stdout: btrfs-tools 2024-09-10T14:26:00.868 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-09-10T14:26:00.868 INFO:teuthology.orchestra.run.smithi052.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T14:26:00.868 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T14:26:00.869 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T14:26:00.869 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T14:26:00.869 INFO:teuthology.orchestra.run.smithi052.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T14:26:00.869 INFO:teuthology.orchestra.run.smithi052.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T14:26:00.870 INFO:teuthology.orchestra.run.smithi052.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T14:26:00.870 INFO:teuthology.orchestra.run.smithi052.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T14:26:00.870 INFO:teuthology.orchestra.run.smithi052.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T14:26:00.870 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T14:26:00.870 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T14:26:00.870 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T14:26:00.870 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T14:26:00.871 INFO:teuthology.orchestra.run.smithi052.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T14:26:00.927 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T14:26:00.927 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T14:26:00.927 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T14:26:00.927 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T14:26:00.928 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T14:26:00.928 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T14:26:00.928 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T14:26:00.928 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-10T14:26:00.928 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T14:26:00.929 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T14:26:00.929 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T14:26:00.929 INFO:teuthology.orchestra.run.smithi151.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T14:26:00.929 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T14:26:00.929 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 181 MB of archives. 2024-09-10T14:26:00.930 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-10T14:26:00.930 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T14:26:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T14:26:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet zip 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T14:26:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T14:26:00.933 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-10T14:26:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: btrfs-tools 2024-09-10T14:26:01.017 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T14:26:01.018 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-304-g7162ca8a-1jammy [3,590 kB] 2024-09-10T14:26:01.019 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T14:26:01.033 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-10T14:26:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T14:26:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T14:26:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T14:26:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T14:26:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T14:26:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T14:26:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T14:26:01.036 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T14:26:01.105 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T14:26:01.111 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T14:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T14:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T14:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T14:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T14:26:01.139 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T14:26:01.141 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T14:26:01.143 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T14:26:01.145 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T14:26:01.145 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T14:26:01.161 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T14:26:01.163 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T14:26:01.165 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T14:26:01.165 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T14:26:01.166 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T14:26:01.176 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T14:26:01.176 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 181 MB of archives. 2024-09-10T14:26:01.176 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-10T14:26:01.176 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-304-g7162ca8a-1jammy [3,590 kB] 2024-09-10T14:26:01.177 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T14:26:01.178 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T14:26:01.178 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T14:26:01.178 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T14:26:01.179 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T14:26:01.194 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T14:26:01.195 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T14:26:01.197 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T14:26:01.198 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T14:26:01.198 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T14:26:01.211 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T14:26:01.212 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T14:26:01.213 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T14:26:01.213 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T14:26:01.214 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T14:26:01.215 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-304-g7162ca8a-1jammy [3,243 kB] 2024-09-10T14:26:01.222 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T14:26:01.228 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T14:26:01.229 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T14:26:01.234 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T14:26:01.234 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T14:26:01.235 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T14:26:01.245 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T14:26:01.246 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T14:26:01.248 INFO:teuthology.orchestra.run.smithi052.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T14:26:01.249 INFO:teuthology.orchestra.run.smithi052.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T14:26:01.250 INFO:teuthology.orchestra.run.smithi052.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T14:26:01.262 INFO:teuthology.orchestra.run.smithi052.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T14:26:01.265 INFO:teuthology.orchestra.run.smithi052.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T14:26:01.266 INFO:teuthology.orchestra.run.smithi052.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T14:26:01.267 INFO:teuthology.orchestra.run.smithi052.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T14:26:01.270 INFO:teuthology.orchestra.run.smithi052.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T14:26:01.286 INFO:teuthology.orchestra.run.smithi052.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-304-g7162ca8a-1jammy [720 kB] 2024-09-10T14:26:01.302 INFO:teuthology.orchestra.run.smithi052.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-304-g7162ca8a-1jammy [356 kB] 2024-09-10T14:26:01.308 INFO:teuthology.orchestra.run.smithi052.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-304-g7162ca8a-1jammy [32.8 kB] 2024-09-10T14:26:01.309 INFO:teuthology.orchestra.run.smithi052.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-304-g7162ca8a-1jammy [180 kB] 2024-09-10T14:26:01.312 INFO:teuthology.orchestra.run.smithi052.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-304-g7162ca8a-1jammy [67.6 kB] 2024-09-10T14:26:01.313 INFO:teuthology.orchestra.run.smithi052.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-304-g7162ca8a-1jammy [333 kB] 2024-09-10T14:26:01.325 INFO:teuthology.orchestra.run.smithi052.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T14:26:01.325 INFO:teuthology.orchestra.run.smithi052.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-304-g7162ca8a-1jammy [6,873 kB] 2024-09-10T14:26:01.326 INFO:teuthology.orchestra.run.smithi052.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T14:26:01.327 INFO:teuthology.orchestra.run.smithi052.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T14:26:01.327 INFO:teuthology.orchestra.run.smithi052.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T14:26:01.328 INFO:teuthology.orchestra.run.smithi052.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T14:26:01.346 INFO:teuthology.orchestra.run.smithi052.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T14:26:01.348 INFO:teuthology.orchestra.run.smithi052.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T14:26:01.348 INFO:teuthology.orchestra.run.smithi052.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T14:26:01.363 INFO:teuthology.orchestra.run.smithi052.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T14:26:01.363 INFO:teuthology.orchestra.run.smithi052.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T14:26:01.364 INFO:teuthology.orchestra.run.smithi052.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T14:26:01.364 INFO:teuthology.orchestra.run.smithi052.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T14:26:01.364 INFO:teuthology.orchestra.run.smithi052.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T14:26:01.365 INFO:teuthology.orchestra.run.smithi052.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T14:26:01.377 INFO:teuthology.orchestra.run.smithi052.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T14:26:01.378 INFO:teuthology.orchestra.run.smithi052.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T14:26:01.381 INFO:teuthology.orchestra.run.smithi052.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T14:26:01.394 INFO:teuthology.orchestra.run.smithi052.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T14:26:01.396 INFO:teuthology.orchestra.run.smithi052.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T14:26:01.396 INFO:teuthology.orchestra.run.smithi052.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T14:26:01.399 INFO:teuthology.orchestra.run.smithi052.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T14:26:01.402 INFO:teuthology.orchestra.run.smithi052.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T14:26:01.403 INFO:teuthology.orchestra.run.smithi052.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T14:26:01.403 INFO:teuthology.orchestra.run.smithi052.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T14:26:01.411 INFO:teuthology.orchestra.run.smithi052.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T14:26:01.412 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-304-g7162ca8a-1jammy [3,243 kB] 2024-09-10T14:26:01.412 INFO:teuthology.orchestra.run.smithi052.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T14:26:01.415 INFO:teuthology.orchestra.run.smithi052.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T14:26:01.428 INFO:teuthology.orchestra.run.smithi052.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T14:26:01.436 INFO:teuthology.orchestra.run.smithi052.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T14:26:01.436 INFO:teuthology.orchestra.run.smithi052.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T14:26:01.438 INFO:teuthology.orchestra.run.smithi052.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T14:26:01.439 INFO:teuthology.orchestra.run.smithi052.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T14:26:01.445 INFO:teuthology.orchestra.run.smithi052.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T14:26:01.445 INFO:teuthology.orchestra.run.smithi052.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T14:26:01.445 INFO:teuthology.orchestra.run.smithi052.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T14:26:01.447 INFO:teuthology.orchestra.run.smithi052.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T14:26:01.448 INFO:teuthology.orchestra.run.smithi052.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T14:26:01.512 INFO:teuthology.orchestra.run.smithi052.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-304-g7162ca8a-1jammy [112 kB] 2024-09-10T14:26:01.515 INFO:teuthology.orchestra.run.smithi052.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-304-g7162ca8a-1jammy [472 kB] 2024-09-10T14:26:01.524 INFO:teuthology.orchestra.run.smithi052.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-304-g7162ca8a-1jammy [25.9 MB] 2024-09-10T14:26:01.538 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-304-g7162ca8a-1jammy [720 kB] 2024-09-10T14:26:01.571 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-304-g7162ca8a-1jammy [356 kB] 2024-09-10T14:26:01.579 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-304-g7162ca8a-1jammy [32.8 kB] 2024-09-10T14:26:01.580 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-304-g7162ca8a-1jammy [180 kB] 2024-09-10T14:26:01.585 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-304-g7162ca8a-1jammy [67.6 kB] 2024-09-10T14:26:01.587 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-304-g7162ca8a-1jammy [333 kB] 2024-09-10T14:26:01.612 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-304-g7162ca8a-1jammy [6,873 kB] 2024-09-10T14:26:01.644 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T14:26:01.657 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T14:26:01.738 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T14:26:01.884 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-304-g7162ca8a-1jammy [112 kB] 2024-09-10T14:26:01.887 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-304-g7162ca8a-1jammy [472 kB] 2024-09-10T14:26:01.897 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-304-g7162ca8a-1jammy [25.9 MB] 2024-09-10T14:26:01.967 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T14:26:01.978 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T14:26:02.008 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T14:26:02.017 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T14:26:02.017 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T14:26:02.019 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T14:26:02.037 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T14:26:02.041 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T14:26:02.045 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T14:26:02.049 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T14:26:02.130 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T14:26:02.133 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T14:26:02.137 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T14:26:02.141 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T14:26:02.142 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T14:26:02.143 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T14:26:02.144 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T14:26:02.145 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T14:26:02.146 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T14:26:02.212 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T14:26:02.228 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T14:26:02.228 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T14:26:02.229 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T14:26:02.234 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T14:26:02.235 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T14:26:02.294 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T14:26:02.294 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T14:26:02.296 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T14:26:02.297 INFO:teuthology.orchestra.run.smithi151.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T14:26:02.334 INFO:teuthology.orchestra.run.smithi052.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-304-g7162ca8a-1jammy [5,145 kB] 2024-09-10T14:26:02.375 INFO:teuthology.orchestra.run.smithi151.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T14:26:02.377 INFO:teuthology.orchestra.run.smithi151.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T14:26:02.378 INFO:teuthology.orchestra.run.smithi151.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T14:26:02.379 INFO:teuthology.orchestra.run.smithi151.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T14:26:02.390 INFO:teuthology.orchestra.run.smithi151.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T14:26:02.433 INFO:teuthology.orchestra.run.smithi052.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-304-g7162ca8a-1jammy [245 kB] 2024-09-10T14:26:02.435 INFO:teuthology.orchestra.run.smithi052.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-304-g7162ca8a-1jammy [124 kB] 2024-09-10T14:26:02.438 INFO:teuthology.orchestra.run.smithi052.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-304-g7162ca8a-1jammy [1,555 kB] 2024-09-10T14:26:02.456 INFO:teuthology.orchestra.run.smithi151.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T14:26:02.457 INFO:teuthology.orchestra.run.smithi151.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T14:26:02.458 INFO:teuthology.orchestra.run.smithi151.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T14:26:02.460 INFO:teuthology.orchestra.run.smithi151.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T14:26:02.464 INFO:teuthology.orchestra.run.smithi151.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T14:26:02.537 INFO:teuthology.orchestra.run.smithi151.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T14:26:02.540 INFO:teuthology.orchestra.run.smithi151.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T14:26:02.541 INFO:teuthology.orchestra.run.smithi151.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T14:26:02.546 INFO:teuthology.orchestra.run.smithi151.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T14:26:02.547 INFO:teuthology.orchestra.run.smithi151.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T14:26:02.564 INFO:teuthology.orchestra.run.smithi052.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-304-g7162ca8a-1jammy [6,143 kB] 2024-09-10T14:26:02.619 INFO:teuthology.orchestra.run.smithi151.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T14:26:02.623 INFO:teuthology.orchestra.run.smithi151.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T14:26:02.686 INFO:teuthology.orchestra.run.smithi052.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-304-g7162ca8a-1jammy [22.8 MB] 2024-09-10T14:26:02.786 INFO:teuthology.orchestra.run.smithi151.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T14:26:02.788 INFO:teuthology.orchestra.run.smithi151.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T14:26:02.790 INFO:teuthology.orchestra.run.smithi151.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T14:26:02.791 INFO:teuthology.orchestra.run.smithi151.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T14:26:02.793 INFO:teuthology.orchestra.run.smithi151.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T14:26:02.830 INFO:teuthology.orchestra.run.smithi151.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T14:26:02.833 INFO:teuthology.orchestra.run.smithi151.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T14:26:02.833 INFO:teuthology.orchestra.run.smithi151.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T14:26:02.951 INFO:teuthology.orchestra.run.smithi151.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T14:26:02.951 INFO:teuthology.orchestra.run.smithi151.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T14:26:02.955 INFO:teuthology.orchestra.run.smithi151.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T14:26:03.049 INFO:teuthology.orchestra.run.smithi151.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T14:26:03.050 INFO:teuthology.orchestra.run.smithi151.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T14:26:03.050 INFO:teuthology.orchestra.run.smithi151.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-304-g7162ca8a-1jammy [5,145 kB] 2024-09-10T14:26:03.051 INFO:teuthology.orchestra.run.smithi151.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T14:26:03.052 INFO:teuthology.orchestra.run.smithi151.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T14:26:03.053 INFO:teuthology.orchestra.run.smithi151.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T14:26:03.062 INFO:teuthology.orchestra.run.smithi151.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T14:26:03.066 INFO:teuthology.orchestra.run.smithi151.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T14:26:03.069 INFO:teuthology.orchestra.run.smithi151.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T14:26:03.071 INFO:teuthology.orchestra.run.smithi151.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T14:26:03.133 INFO:teuthology.orchestra.run.smithi151.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T14:26:03.133 INFO:teuthology.orchestra.run.smithi151.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-304-g7162ca8a-1jammy [245 kB] 2024-09-10T14:26:03.136 INFO:teuthology.orchestra.run.smithi151.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-304-g7162ca8a-1jammy [124 kB] 2024-09-10T14:26:03.151 INFO:teuthology.orchestra.run.smithi151.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-304-g7162ca8a-1jammy [1,555 kB] 2024-09-10T14:26:03.161 INFO:teuthology.orchestra.run.smithi151.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T14:26:03.164 INFO:teuthology.orchestra.run.smithi151.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T14:26:03.165 INFO:teuthology.orchestra.run.smithi151.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T14:26:03.176 INFO:teuthology.orchestra.run.smithi151.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T14:26:03.177 INFO:teuthology.orchestra.run.smithi151.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T14:26:03.212 INFO:teuthology.orchestra.run.smithi151.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-304-g7162ca8a-1jammy [6,143 kB] 2024-09-10T14:26:03.221 INFO:teuthology.orchestra.run.smithi151.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T14:26:03.221 INFO:teuthology.orchestra.run.smithi151.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T14:26:03.223 INFO:teuthology.orchestra.run.smithi151.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T14:26:03.223 INFO:teuthology.orchestra.run.smithi151.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T14:26:03.296 INFO:teuthology.orchestra.run.smithi151.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T14:26:03.298 INFO:teuthology.orchestra.run.smithi151.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T14:26:03.317 INFO:teuthology.orchestra.run.smithi151.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T14:26:03.318 INFO:teuthology.orchestra.run.smithi151.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T14:26:03.318 INFO:teuthology.orchestra.run.smithi151.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T14:26:03.344 INFO:teuthology.orchestra.run.smithi052.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-304-g7162ca8a-1jammy [14.1 kB] 2024-09-10T14:26:03.345 INFO:teuthology.orchestra.run.smithi052.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-304-g7162ca8a-1jammy [877 kB] 2024-09-10T14:26:03.360 INFO:teuthology.orchestra.run.smithi052.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-304-g7162ca8a-1jammy [2,460 kB] 2024-09-10T14:26:03.377 INFO:teuthology.orchestra.run.smithi151.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T14:26:03.379 INFO:teuthology.orchestra.run.smithi151.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T14:26:03.403 INFO:teuthology.orchestra.run.smithi052.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-304-g7162ca8a-1jammy [794 kB] 2024-09-10T14:26:03.413 INFO:teuthology.orchestra.run.smithi052.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-304-g7162ca8a-1jammy [152 kB] 2024-09-10T14:26:03.415 INFO:teuthology.orchestra.run.smithi052.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-304-g7162ca8a-1jammy [2,284 kB] 2024-09-10T14:26:03.435 INFO:teuthology.orchestra.run.smithi151.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-304-g7162ca8a-1jammy [22.8 MB] 2024-09-10T14:26:03.463 INFO:teuthology.orchestra.run.smithi052.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-304-g7162ca8a-1jammy [8,625 kB] 2024-09-10T14:26:03.704 INFO:teuthology.orchestra.run.smithi052.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-304-g7162ca8a-1jammy [14.2 kB] 2024-09-10T14:26:03.705 INFO:teuthology.orchestra.run.smithi052.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-304-g7162ca8a-1jammy [51.4 MB] 2024-09-10T14:26:04.394 INFO:teuthology.orchestra.run.smithi151.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-304-g7162ca8a-1jammy [14.1 kB] 2024-09-10T14:26:04.395 INFO:teuthology.orchestra.run.smithi151.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-304-g7162ca8a-1jammy [877 kB] 2024-09-10T14:26:04.412 INFO:teuthology.orchestra.run.smithi151.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-304-g7162ca8a-1jammy [2,460 kB] 2024-09-10T14:26:04.478 INFO:teuthology.orchestra.run.smithi151.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-304-g7162ca8a-1jammy [794 kB] 2024-09-10T14:26:04.492 INFO:teuthology.orchestra.run.smithi151.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-304-g7162ca8a-1jammy [152 kB] 2024-09-10T14:26:04.498 INFO:teuthology.orchestra.run.smithi151.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-304-g7162ca8a-1jammy [2,284 kB] 2024-09-10T14:26:04.595 INFO:teuthology.orchestra.run.smithi151.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-304-g7162ca8a-1jammy [8,625 kB] 2024-09-10T14:26:04.930 INFO:teuthology.orchestra.run.smithi151.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-304-g7162ca8a-1jammy [14.2 kB] 2024-09-10T14:26:04.931 INFO:teuthology.orchestra.run.smithi151.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-304-g7162ca8a-1jammy [51.4 MB] 2024-09-10T14:26:05.376 INFO:teuthology.orchestra.run.smithi052.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-304-g7162ca8a-1jammy [130 kB] 2024-09-10T14:26:05.379 INFO:teuthology.orchestra.run.smithi052.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-304-g7162ca8a-1jammy [39.0 kB] 2024-09-10T14:26:05.380 INFO:teuthology.orchestra.run.smithi052.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-304-g7162ca8a-1jammy [13.6 MB] 2024-09-10T14:26:05.701 INFO:teuthology.orchestra.run.smithi052.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-304-g7162ca8a-1jammy [91.5 kB] 2024-09-10T14:26:06.296 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 181 MB in 5s (37.5 MB/s) 2024-09-10T14:26:06.359 INFO:teuthology.orchestra.run.smithi151.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-304-g7162ca8a-1jammy [130 kB] 2024-09-10T14:26:06.361 INFO:teuthology.orchestra.run.smithi151.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-304-g7162ca8a-1jammy [39.0 kB] 2024-09-10T14:26:06.362 INFO:teuthology.orchestra.run.smithi151.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-304-g7162ca8a-1jammy [13.6 MB] 2024-09-10T14:26:06.461 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T14:26:06.548 INFO:teuthology.orchestra.run.smithi151.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-304-g7162ca8a-1jammy [91.5 kB] 2024-09-10T14:26:06.564 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T14:26:06.570 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T14:26:06.651 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T14:26:07.104 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T14:26:07.123 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 181 MB in 6s (32.9 MB/s) 2024-09-10T14:26:07.131 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T14:26:07.171 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T14:26:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T14:26:07.383 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T14:26:07.388 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T14:26:07.472 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T14:26:07.499 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T14:26:07.526 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T14:26:07.565 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T14:26:07.801 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T14:26:07.827 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T14:26:07.867 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T14:26:07.969 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T14:26:07.996 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T14:26:08.044 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:26:08.205 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T14:26:08.231 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T14:26:08.272 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T14:26:08.421 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T14:26:08.449 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T14:26:08.488 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:26:08.692 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T14:26:08.719 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T14:26:08.768 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:26:08.774 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T14:26:08.801 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T14:26:08.841 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:26:09.204 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T14:26:09.205 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T14:26:09.231 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T14:26:09.231 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T14:26:09.271 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T14:26:09.271 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:26:09.574 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librados2. 2024-09-10T14:26:09.584 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T14:26:09.601 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../007-librados2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:09.610 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T14:26:09.632 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:09.642 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:26:10.021 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T14:26:10.047 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T14:26:10.059 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librbd1. 2024-09-10T14:26:10.087 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../008-librbd1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:10.087 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T14:26:10.126 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:10.408 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librados2. 2024-09-10T14:26:10.434 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../007-librados2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:10.474 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:10.571 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T14:26:10.598 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:10.637 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:10.886 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librbd1. 2024-09-10T14:26:10.898 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rados. 2024-09-10T14:26:10.912 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../008-librbd1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:10.914 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../010-python3-rados_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:10.952 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:10.956 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:11.234 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T14:26:11.250 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:11.284 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:11.398 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T14:26:11.424 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:11.464 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:11.528 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T14:26:11.555 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:11.594 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:11.759 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rados. 2024-09-10T14:26:11.785 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../010-python3-rados_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:11.826 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:11.906 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T14:26:11.932 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:11.972 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:12.129 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T14:26:12.156 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:12.196 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:12.275 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T14:26:12.302 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T14:26:12.342 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T14:26:12.449 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T14:26:12.475 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:12.507 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:12.636 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T14:26:12.663 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T14:26:12.703 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T14:26:12.827 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T14:26:12.853 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:12.894 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:12.930 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T14:26:12.949 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:12.997 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:13.206 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T14:26:13.233 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T14:26:13.273 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T14:26:13.334 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T14:26:13.360 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T14:26:13.400 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T14:26:13.593 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T14:26:13.619 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T14:26:13.659 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T14:26:13.677 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T14:26:13.693 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T14:26:13.736 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T14:26:13.921 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T14:26:13.947 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:13.980 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:14.030 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T14:26:14.046 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T14:26:14.089 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T14:26:14.341 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T14:26:14.358 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua5.1. 2024-09-10T14:26:14.367 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T14:26:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T14:26:14.408 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T14:26:14.408 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T14:26:14.686 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T14:26:14.712 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T14:26:14.752 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T14:26:14.970 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-any. 2024-09-10T14:26:14.986 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T14:26:15.028 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T14:26:15.031 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T14:26:15.047 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T14:26:15.090 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T14:26:15.272 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package zip. 2024-09-10T14:26:15.300 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T14:26:15.339 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T14:26:15.419 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua5.1. 2024-09-10T14:26:15.445 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T14:26:15.485 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T14:26:15.634 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package unzip. 2024-09-10T14:26:15.660 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T14:26:15.692 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T14:26:15.797 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-any. 2024-09-10T14:26:15.824 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T14:26:15.864 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T14:26:16.046 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package luarocks. 2024-09-10T14:26:16.073 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T14:26:16.083 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package zip. 2024-09-10T14:26:16.099 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T14:26:16.112 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T14:26:16.142 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T14:26:16.454 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package unzip. 2024-09-10T14:26:16.461 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librgw2. 2024-09-10T14:26:16.478 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../025-librgw2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:16.481 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T14:26:16.511 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:16.529 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T14:26:16.901 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package luarocks. 2024-09-10T14:26:16.928 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T14:26:16.967 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T14:26:17.089 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T14:26:17.105 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:17.147 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:17.319 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librgw2. 2024-09-10T14:26:17.345 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../025-librgw2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:17.385 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:17.484 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T14:26:17.510 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T14:26:17.550 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T14:26:17.837 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T14:26:17.863 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:17.894 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:17.939 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T14:26:17.965 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:18.005 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:18.273 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-common. 2024-09-10T14:26:18.292 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T14:26:18.300 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../029-ceph-common_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:18.318 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T14:26:18.339 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:18.359 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T14:26:18.654 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T14:26:18.680 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:18.720 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:19.133 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-common. 2024-09-10T14:26:19.160 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../029-ceph-common_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:19.433 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:20.095 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-base. 2024-09-10T14:26:20.122 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../030-ceph-base_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:20.172 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:20.733 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T14:26:20.760 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T14:26:20.799 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T14:26:20.881 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-base. 2024-09-10T14:26:20.908 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../030-ceph-base_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:20.957 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:21.094 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T14:26:21.120 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T14:26:21.160 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T14:26:21.480 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T14:26:21.507 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T14:26:21.546 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T14:26:21.562 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T14:26:21.588 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T14:26:21.628 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T14:26:21.824 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T14:26:21.851 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T14:26:21.883 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T14:26:21.907 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T14:26:21.933 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T14:26:22.007 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T14:26:22.152 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T14:26:22.179 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T14:26:22.227 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T14:26:22.310 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T14:26:22.337 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T14:26:22.377 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T14:26:22.530 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T14:26:22.557 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T14:26:22.596 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T14:26:22.689 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T14:26:22.716 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T14:26:22.756 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T14:26:22.899 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-portend. 2024-09-10T14:26:22.926 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T14:26:22.966 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T14:26:23.017 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T14:26:23.033 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T14:26:23.076 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T14:26:23.210 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T14:26:23.237 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T14:26:23.268 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T14:26:23.379 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T14:26:23.406 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T14:26:23.446 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T14:26:23.582 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T14:26:23.607 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T14:26:23.646 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T14:26:23.749 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-portend. 2024-09-10T14:26:23.776 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T14:26:23.816 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T14:26:23.958 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T14:26:23.988 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T14:26:24.016 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T14:26:24.103 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T14:26:24.129 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T14:26:24.169 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T14:26:24.319 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T14:26:24.346 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T14:26:24.386 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T14:26:24.465 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T14:26:24.491 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T14:26:24.531 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T14:26:24.697 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T14:26:24.724 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T14:26:24.764 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T14:26:24.894 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T14:26:24.921 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T14:26:24.961 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T14:26:25.242 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-mako. 2024-09-10T14:26:25.269 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T14:26:25.273 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T14:26:25.299 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T14:26:25.308 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T14:26:25.340 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T14:26:25.595 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T14:26:25.601 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T14:26:25.611 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T14:26:25.628 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T14:26:25.645 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T14:26:25.660 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T14:26:25.914 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T14:26:25.942 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T14:26:25.971 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-mako. 2024-09-10T14:26:25.981 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T14:26:25.998 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T14:26:26.040 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T14:26:26.275 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webob. 2024-09-10T14:26:26.303 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T14:26:26.342 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T14:26:26.384 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T14:26:26.399 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T14:26:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T14:26:26.678 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T14:26:26.705 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T14:26:26.712 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T14:26:26.739 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T14:26:26.747 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T14:26:26.770 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T14:26:27.023 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T14:26:27.038 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T14:26:27.060 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webob. 2024-09-10T14:26:27.072 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T14:26:27.086 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T14:26:27.125 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T14:26:27.367 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-paste. 2024-09-10T14:26:27.394 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T14:26:27.433 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T14:26:27.471 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T14:26:27.498 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T14:26:27.541 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T14:26:27.737 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T14:26:27.753 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T14:26:27.786 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T14:26:27.841 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T14:26:27.868 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T14:26:27.900 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T14:26:28.056 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T14:26:28.083 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T14:26:28.122 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T14:26:28.186 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-paste. 2024-09-10T14:26:28.213 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T14:26:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T14:26:28.459 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T14:26:28.489 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T14:26:28.525 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T14:26:28.565 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T14:26:28.581 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T14:26:28.615 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T14:26:28.828 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T14:26:28.856 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T14:26:28.895 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T14:26:28.902 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T14:26:28.929 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T14:26:28.969 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T14:26:29.267 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T14:26:29.294 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T14:26:29.309 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T14:26:29.333 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T14:26:29.333 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T14:26:29.372 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T14:26:29.603 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-idna. 2024-09-10T14:26:29.630 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T14:26:29.669 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T14:26:29.685 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T14:26:29.711 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T14:26:29.751 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T14:26:29.989 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T14:26:30.019 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T14:26:30.064 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T14:26:30.098 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T14:26:30.125 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T14:26:30.190 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T14:26:30.384 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests. 2024-09-10T14:26:30.411 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T14:26:30.450 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T14:26:30.494 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-idna. 2024-09-10T14:26:30.520 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T14:26:30.560 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T14:26:30.745 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T14:26:30.772 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T14:26:30.811 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T14:26:30.872 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T14:26:30.899 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T14:26:30.941 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T14:26:31.156 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T14:26:31.173 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:31.214 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:31.268 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests. 2024-09-10T14:26:31.295 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T14:26:31.334 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T14:26:31.594 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T14:26:31.622 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T14:26:31.661 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:31.673 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T14:26:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T14:26:31.972 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T14:26:31.999 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T14:26:32.008 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T14:26:32.035 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:32.038 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T14:26:32.083 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T14:26:32.393 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T14:26:32.441 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T14:26:32.464 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T14:26:32.491 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:32.530 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:32.727 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T14:26:32.755 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:32.785 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:32.851 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T14:26:32.878 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T14:26:32.917 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T14:26:33.180 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T14:26:33.204 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T14:26:33.207 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:33.231 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T14:26:33.246 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:33.271 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T14:26:33.599 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T14:26:33.626 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:33.666 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:33.967 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T14:26:33.994 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:34.034 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:34.053 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T14:26:34.080 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:34.120 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:35.737 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph. 2024-09-10T14:26:35.741 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T14:26:35.764 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../066-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:35.768 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:35.795 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:35.799 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:36.148 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T14:26:36.175 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:36.214 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:36.576 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T14:26:36.603 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:36.642 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:36.870 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph. 2024-09-10T14:26:36.886 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../066-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:36.928 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:36.987 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package cephadm. 2024-09-10T14:26:37.003 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../069-cephadm_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:37.037 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:37.249 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T14:26:37.276 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:37.315 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T14:26:37.315 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:37.342 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T14:26:37.381 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T14:26:37.678 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T14:26:37.701 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T14:26:37.704 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:37.717 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T14:26:37.744 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:37.759 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T14:26:38.164 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephadm. 2024-09-10T14:26:38.191 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../069-cephadm_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:38.231 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:38.593 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T14:26:38.619 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T14:26:38.659 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T14:26:38.789 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-babel. 2024-09-10T14:26:38.817 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T14:26:38.855 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T14:26:38.979 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T14:26:38.994 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T14:26:39.037 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T14:26:39.175 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T14:26:39.202 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T14:26:39.241 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T14:26:39.586 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T14:26:39.614 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:39.652 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:40.006 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T14:26:40.034 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T14:26:40.081 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T14:26:40.094 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-babel. 2024-09-10T14:26:40.121 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T14:26:40.160 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T14:26:40.359 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-routes. 2024-09-10T14:26:40.386 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T14:26:40.417 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T14:26:40.480 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T14:26:40.507 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T14:26:40.547 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T14:26:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T14:26:40.711 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:40.753 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:40.917 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T14:26:40.944 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:40.984 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:41.321 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T14:26:41.348 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T14:26:41.388 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T14:26:41.691 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-routes. 2024-09-10T14:26:41.718 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T14:26:41.757 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T14:26:41.891 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T14:26:41.908 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T14:26:41.949 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T14:26:42.095 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T14:26:42.122 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:42.161 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:42.386 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T14:26:42.402 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T14:26:42.436 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T14:26:42.798 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T14:26:42.826 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T14:26:42.864 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T14:26:43.142 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T14:26:43.159 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T14:26:43.192 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T14:26:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T14:26:43.504 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T14:26:43.543 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T14:26:43.843 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T14:26:43.870 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:43.994 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:44.013 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T14:26:44.029 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T14:26:44.063 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T14:26:44.435 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T14:26:44.462 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T14:26:44.501 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T14:26:44.805 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T14:26:44.832 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T14:26:44.871 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T14:26:44.982 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T14:26:45.009 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T14:26:45.048 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T14:26:45.292 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T14:26:45.309 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T14:26:45.342 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T14:26:45.654 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T14:26:45.682 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T14:26:45.698 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T14:26:45.714 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:45.720 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T14:26:45.834 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:46.215 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T14:26:46.243 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T14:26:46.282 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T14:26:46.602 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T14:26:46.630 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T14:26:46.668 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T14:26:46.730 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T14:26:46.746 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T14:26:46.780 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T14:26:46.972 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T14:26:46.999 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T14:26:47.038 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T14:26:47.075 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T14:26:47.103 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T14:26:47.133 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T14:26:47.352 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T14:26:47.379 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T14:26:47.418 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T14:26:47.430 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T14:26:47.457 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T14:26:47.496 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T14:26:47.755 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T14:26:47.782 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T14:26:47.808 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T14:26:47.821 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T14:26:47.835 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T14:26:47.874 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T14:26:48.221 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T14:26:48.248 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T14:26:48.287 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T14:26:48.560 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T14:26:48.566 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T14:26:48.588 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:48.593 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T14:26:48.624 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T14:26:48.626 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:48.921 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T14:26:48.928 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T14:26:48.949 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T14:26:48.955 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T14:26:48.987 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T14:26:48.995 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T14:26:49.307 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T14:26:49.308 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T14:26:49.336 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T14:26:49.336 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T14:26:49.373 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T14:26:49.374 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T14:26:49.635 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package jq. 2024-09-10T14:26:49.651 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T14:26:49.693 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T14:26:49.948 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package socat. 2024-09-10T14:26:49.974 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T14:26:50.012 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T14:26:50.081 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T14:26:50.109 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:50.147 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:50.299 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T14:26:50.326 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T14:26:50.357 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T14:26:50.467 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T14:26:50.495 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T14:26:50.526 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T14:26:50.711 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-test. 2024-09-10T14:26:50.728 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../097-ceph-test_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:50.761 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:50.888 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T14:26:50.915 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T14:26:50.954 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T14:26:51.216 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package jq. 2024-09-10T14:26:51.232 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T14:26:51.274 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T14:26:51.503 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package socat. 2024-09-10T14:26:51.530 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T14:26:51.569 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T14:26:51.874 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T14:26:51.901 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T14:26:51.940 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T14:26:52.304 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-test. 2024-09-10T14:26:52.319 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../097-ceph-test_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:52.362 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:53.141 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T14:26:53.168 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:53.199 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:53.469 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T14:26:53.486 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:53.527 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:53.814 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T14:26:53.841 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T14:26:53.880 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T14:26:54.219 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T14:26:54.247 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T14:26:54.285 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T14:26:54.664 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T14:26:54.684 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T14:26:54.692 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T14:26:54.711 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T14:26:54.730 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T14:26:54.784 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:55.072 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T14:26:55.088 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:26:55.130 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:26:55.144 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package pkg-config. 2024-09-10T14:26:55.172 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T14:26:55.227 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T14:26:55.450 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T14:26:55.477 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T14:26:55.488 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T14:26:55.516 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T14:26:55.555 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T14:26:55.653 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T14:26:56.164 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T14:26:56.175 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T14:26:56.192 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T14:26:56.204 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T14:26:56.230 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T14:26:56.241 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T14:26:56.594 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T14:26:56.621 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T14:26:56.660 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T14:26:56.778 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T14:26:56.805 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T14:26:56.835 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T14:26:57.100 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pkg-config. 2024-09-10T14:26:57.128 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T14:26:57.130 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T14:26:57.158 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T14:26:57.166 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T14:26:57.197 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T14:26:57.412 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T14:26:57.428 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T14:26:57.462 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T14:26:57.508 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T14:26:57.536 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T14:26:57.575 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T14:26:57.824 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T14:26:57.840 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T14:26:57.874 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T14:26:57.911 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-py. 2024-09-10T14:26:57.939 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T14:26:57.977 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T14:26:58.177 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T14:26:58.204 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T14:26:58.243 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T14:26:58.306 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T14:26:58.334 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T14:26:58.372 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T14:26:58.581 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T14:26:58.609 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T14:26:58.648 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T14:26:58.868 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T14:26:58.897 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T14:26:58.934 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T14:26:58.944 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T14:26:58.970 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T14:26:59.001 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T14:26:59.212 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-toml. 2024-09-10T14:26:59.229 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T14:26:59.270 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T14:26:59.305 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-py. 2024-09-10T14:26:59.321 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T14:26:59.363 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T14:26:59.573 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T14:26:59.601 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T14:26:59.640 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T14:26:59.642 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T14:26:59.670 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T14:26:59.709 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T14:26:59.944 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T14:26:59.972 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T14:27:00.010 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T14:27:00.155 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T14:27:00.183 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T14:27:00.222 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T14:27:00.271 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T14:27:00.287 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T14:27:00.329 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T14:27:00.509 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-toml. 2024-09-10T14:27:00.536 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T14:27:00.575 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T14:27:00.845 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T14:27:00.873 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T14:27:00.928 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T14:27:01.017 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package radosgw. 2024-09-10T14:27:01.045 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../116-radosgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:27:01.082 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:01.233 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T14:27:01.260 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T14:27:01.291 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T14:27:01.536 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T14:27:01.552 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T14:27:01.594 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T14:27:01.944 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T14:27:01.961 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:27:01.994 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:02.291 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T14:27:02.341 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package radosgw. 2024-09-10T14:27:02.369 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../116-radosgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:27:02.407 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:02.557 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T14:27:02.683 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T14:27:02.956 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T14:27:03.236 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T14:27:03.252 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T14:27:03.269 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T14:27:03.294 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:03.555 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T14:27:03.706 INFO:teuthology.orchestra.run.smithi052.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T14:27:03.809 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T14:27:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T14:27:04.002 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:04.184 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T14:27:04.486 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user cephadm....done 2024-09-10T14:27:04.521 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T14:27:04.634 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T14:27:04.920 INFO:teuthology.orchestra.run.smithi151.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T14:27:04.927 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T14:27:04.997 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:05.178 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T14:27:05.304 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T14:27:05.538 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user cephadm....done 2024-09-10T14:27:05.563 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T14:27:05.661 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T14:27:05.832 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T14:27:05.929 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T14:27:05.958 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T14:27:06.197 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T14:27:06.268 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T14:27:06.323 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T14:27:06.574 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T14:27:06.611 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T14:27:06.825 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T14:27:06.862 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T14:27:06.968 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T14:27:07.130 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T14:27:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T14:27:07.381 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T14:27:07.638 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T14:27:07.649 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T14:27:07.908 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T14:27:07.914 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T14:27:08.182 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T14:27:08.235 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:08.442 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T14:27:08.477 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T14:27:08.578 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T14:27:08.701 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T14:27:08.704 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T14:27:08.830 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T14:27:08.969 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T14:27:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T14:27:09.211 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:09.462 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T14:27:09.493 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T14:27:09.528 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T14:27:09.593 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T14:27:09.597 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T14:27:09.694 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T14:27:09.723 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T14:27:09.849 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T14:27:10.053 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T14:27:10.100 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T14:27:10.179 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T14:27:10.455 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T14:27:10.520 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T14:27:10.547 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T14:27:10.602 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T14:27:10.723 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T14:27:10.728 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T14:27:11.032 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T14:27:11.088 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T14:27:11.159 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T14:27:11.556 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T14:27:11.832 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T14:27:11.877 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T14:27:12.082 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T14:27:12.384 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T14:27:12.395 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T14:27:12.496 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T14:27:12.510 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T14:27:12.605 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T14:27:12.915 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T14:27:13.203 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T14:27:13.333 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T14:27:13.462 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T14:27:13.584 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T14:27:13.588 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T14:27:13.714 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T14:27:13.977 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T14:27:14.007 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T14:27:14.287 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T14:27:14.392 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T14:27:14.621 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T14:27:14.642 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T14:27:14.864 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T14:27:14.990 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:15.035 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T14:27:15.283 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T14:27:15.320 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T14:27:15.625 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T14:27:15.672 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T14:27:15.931 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T14:27:16.057 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:16.350 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T14:27:16.667 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T14:27:16.831 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T14:27:17.091 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:27:17.225 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T14:27:17.493 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T14:27:17.611 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T14:27:17.712 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T14:27:17.840 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T14:27:17.997 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T14:27:18.066 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:27:18.200 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T14:27:18.289 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T14:27:18.459 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T14:27:18.540 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:27:18.577 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T14:27:18.666 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T14:27:18.678 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T14:27:18.968 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T14:27:18.971 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T14:27:19.239 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T14:27:19.244 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T14:27:19.495 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T14:27:19.515 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:27:19.641 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T14:27:19.746 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T14:27:19.942 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T14:27:19.989 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T14:27:20.201 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T14:27:20.257 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T14:27:20.382 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T14:27:20.453 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T14:27:20.658 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T14:27:20.703 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T14:27:20.785 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T14:27:20.946 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T14:27:21.086 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T14:27:21.214 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T14:27:21.315 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T14:27:21.362 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T14:27:21.605 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T14:27:21.632 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T14:27:21.730 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T14:27:21.758 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T14:27:21.856 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T14:27:21.937 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T14:27:22.051 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T14:27:22.175 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T14:27:22.301 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T14:27:22.336 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T14:27:22.578 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T14:27:22.704 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T14:27:22.744 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T14:27:22.830 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T14:27:22.911 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T14:27:23.003 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T14:27:23.105 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T14:27:23.140 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T14:27:23.266 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T14:27:23.347 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:27:23.473 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T14:27:23.668 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T14:27:23.791 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T14:27:23.927 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T14:27:24.053 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T14:27:24.092 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T14:27:24.304 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T14:27:24.352 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T14:27:24.438 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T14:27:24.477 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T14:27:24.729 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T14:27:24.764 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T14:27:24.980 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T14:27:25.040 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T14:27:25.308 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T14:27:25.324 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T14:27:25.434 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T14:27:25.710 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T14:27:25.726 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T14:27:25.961 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T14:27:26.020 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T14:27:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T14:27:26.339 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T14:27:26.465 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:26.574 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:26.675 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T14:27:26.682 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T14:27:26.986 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:26.992 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T14:27:27.112 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:27.238 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T14:27:27.328 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T14:27:27.429 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:27.523 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:27.580 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:27.649 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:27.706 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T14:27:27.775 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:27.992 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T14:27:27.993 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T14:27:28.042 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:28.168 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:28.277 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T14:27:28.443 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:28.553 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:28.594 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:28.680 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:28.720 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:28.806 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:28.846 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T14:27:29.017 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T14:27:29.017 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T14:27:29.482 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:29.608 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:29.734 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:29.860 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T14:27:30.074 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:30.201 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:30.335 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:30.453 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:30.554 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:31.046 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:31.063 INFO:teuthology.orchestra.run.smithi052.stdout:Adding group ceph....done 2024-09-10T14:27:31.147 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:31.248 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:31.349 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:31.398 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user ceph....done 2024-09-10T14:27:31.475 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:31.567 INFO:teuthology.orchestra.run.smithi052.stdout:Setting system user ceph properties....done 2024-09-10T14:27:31.585 INFO:teuthology.orchestra.run.smithi052.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T14:27:31.732 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T14:27:32.051 INFO:teuthology.orchestra.run.smithi151.stdout:Adding group ceph....done 2024-09-10T14:27:32.105 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T14:27:32.385 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user ceph....done 2024-09-10T14:27:32.546 INFO:teuthology.orchestra.run.smithi151.stdout:Setting system user ceph properties....done 2024-09-10T14:27:32.565 INFO:teuthology.orchestra.run.smithi151.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T14:27:32.571 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:32.689 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:32.703 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T14:27:33.045 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T14:27:33.163 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T14:27:33.163 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T14:27:33.543 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:33.641 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:33.668 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:33.998 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T14:27:34.153 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T14:27:34.156 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T14:27:34.443 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:34.628 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:34.661 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T14:27:34.661 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T14:27:35.012 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T14:27:35.095 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:35.298 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T14:27:35.298 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T14:27:35.489 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:35.689 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T14:27:35.689 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T14:27:35.738 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:35.993 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T14:27:35.993 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T14:27:36.173 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:36.388 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T14:27:36.389 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T14:27:36.456 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:36.557 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:36.683 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:36.875 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:36.887 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T14:27:36.887 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T14:27:37.190 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T14:27:37.190 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T14:27:37.392 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:37.554 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:37.660 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:37.680 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:37.785 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:37.831 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:37.937 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:38.156 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T14:27:38.156 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T14:27:38.184 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T14:27:38.285 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T14:27:38.438 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T14:27:38.638 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:38.781 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:38.881 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:39.007 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T14:27:39.369 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T14:27:39.422 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T14:27:39.469 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T14:27:39.605 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T14:27:40.079 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T14:27:40.088 DEBUG:teuthology.parallel:result is None 2024-09-10T14:27:40.697 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T14:27:41.345 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T14:27:41.350 DEBUG:teuthology.parallel:result is None 2024-09-10T14:27:41.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T14:27:41.497 DEBUG:teuthology.orchestra.run.smithi052:> dpkg-query -W -f '${Version}' ceph 2024-09-10T14:27:41.517 INFO:teuthology.orchestra.run.smithi052.stdout:19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:27:41.517 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:27:41.517 INFO:teuthology.task.install:The correct ceph version 19.1.1-304-g7162ca8a-1jammy is installed. 2024-09-10T14:27:41.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T14:27:41.661 DEBUG:teuthology.orchestra.run.smithi151:> dpkg-query -W -f '${Version}' ceph 2024-09-10T14:27:41.680 INFO:teuthology.orchestra.run.smithi151.stdout:19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:27:41.680 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-304-g7162ca8a-1jammy 2024-09-10T14:27:41.680 INFO:teuthology.task.install:The correct ceph version 19.1.1-304-g7162ca8a-1jammy is installed. 2024-09-10T14:27:41.682 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T14:27:41.682 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:41.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T14:27:41.698 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:27:41.698 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T14:27:41.734 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T14:27:41.734 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:41.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T14:27:41.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T14:27:41.813 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:27:41.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T14:27:41.863 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T14:27:41.917 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T14:27:41.917 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:41.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T14:27:41.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T14:27:41.986 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:27:41.987 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T14:27:41.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T14:27:42.054 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T14:27:42.054 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:42.054 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T14:27:42.067 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T14:27:42.122 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:27:42.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T14:27:42.135 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T14:27:42.188 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T14:27:42.275 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T14:27:42.275 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-09-10T14:27:42.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-09-10T14:27:42.290 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T14:27:42.291 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T14:27:42.331 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T14:27:42.345 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T14:27:42.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T14:27:42.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T14:27:42.411 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T14:27:42.411 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T14:27:42.411 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116', 'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': 'tchandra@redhat.com', 'first_in_suite': False, 'job_id': '7899116', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'owner': 'scheduled_tchandra@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 1683, 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHs9cjhdDYH/JDbGZs1wWrPq5gqjY+jAq/ObJcd1uXBaDpS8z+n+GiqZmKzKSs9s0h36ngcEapAaTgUZE17A8h8=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5bwbmr6K0SfLTGm1XutY6mA1cSX/paaJwhlH5fzjaYOq6OGblwpgnUxUsr/IcKtFQfN6f1DNBkNrFxUFTSrZ4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_07:44:33', 'tube': 'smithi', 'user': 'tchandra', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T14:27:42.412 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T14:27:42.443 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T14:27:42.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T14:27:42.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T14:27:42.506 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:42.506 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T14:27:42.550 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T14:27:42.551 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-10T14:27:42.599 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T14:27:42.599 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T14:27:42.599 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-10T14:27:42.599 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T14:27:42.599 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 14:22:18.079119658 +0000 2024-09-10T14:27:42.599 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 14:22:17.827121909 +0000 2024-09-10T14:27:42.599 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 14:22:17.827121909 +0000 2024-09-10T14:27:42.599 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-10T14:27:42.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T14:27:42.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T14:27:42.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T14:27:42.653 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000261576 s, 2.0 MB/s 2024-09-10T14:27:42.654 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T14:27:42.704 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-10T14:27:42.750 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T14:27:42.750 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T14:27:42.751 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-10T14:27:42.751 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T14:27:42.751 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 14:22:18.323117479 +0000 2024-09-10T14:27:42.751 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 14:22:18.319117515 +0000 2024-09-10T14:27:42.751 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 14:22:18.319117515 +0000 2024-09-10T14:27:42.751 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-10T14:27:42.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T14:27:42.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T14:27:42.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T14:27:42.805 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000280592 s, 1.8 MB/s 2024-09-10T14:27:42.806 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T14:27:42.856 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-10T14:27:42.902 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T14:27:42.903 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T14:27:42.903 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-10T14:27:42.903 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T14:27:42.903 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 14:22:19.071110797 +0000 2024-09-10T14:27:42.903 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 14:22:18.823113012 +0000 2024-09-10T14:27:42.903 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 14:22:18.823113012 +0000 2024-09-10T14:27:42.903 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-10T14:27:42.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T14:27:42.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T14:27:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T14:27:42.960 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000279667 s, 1.8 MB/s 2024-09-10T14:27:42.961 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T14:27:43.009 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-10T14:27:43.054 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T14:27:43.055 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T14:27:43.055 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-10T14:27:43.055 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T14:27:43.055 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 14:22:19.299108761 +0000 2024-09-10T14:27:43.055 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 14:22:19.295108795 +0000 2024-09-10T14:27:43.055 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 14:22:19.295108795 +0000 2024-09-10T14:27:43.055 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-10T14:27:43.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T14:27:43.109 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T14:27:43.109 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T14:27:43.109 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000249589 s, 2.1 MB/s 2024-09-10T14:27:43.110 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T14:27:43.160 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T14:27:43.160 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:27:43.160 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T14:27:43.166 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T14:27:43.166 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-09-10T14:27:43.214 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T14:27:43.214 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T14:27:43.214 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-10T14:27:43.215 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T14:27:43.215 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-10 14:22:13.987244650 +0000 2024-09-10T14:27:43.215 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-10 14:22:13.727246972 +0000 2024-09-10T14:27:43.215 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-10 14:22:13.727246972 +0000 2024-09-10T14:27:43.215 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-10T14:27:43.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T14:27:43.272 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-10T14:27:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-10T14:27:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000389138 s, 1.3 MB/s 2024-09-10T14:27:43.274 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T14:27:43.323 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-09-10T14:27:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T14:27:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T14:27:43.374 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-10T14:27:43.374 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T14:27:43.374 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-10 14:22:14.427240720 +0000 2024-09-10T14:27:43.374 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-10 14:22:14.187242864 +0000 2024-09-10T14:27:43.374 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-10 14:22:14.187242864 +0000 2024-09-10T14:27:43.374 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-10T14:27:43.375 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T14:27:43.428 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-10T14:27:43.428 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-10T14:27:43.428 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000429157 s, 1.2 MB/s 2024-09-10T14:27:43.430 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T14:27:43.479 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-09-10T14:27:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T14:27:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T14:27:43.527 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-10T14:27:43.527 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T14:27:43.527 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-10 14:22:14.947236075 +0000 2024-09-10T14:27:43.527 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-10 14:22:14.675238504 +0000 2024-09-10T14:27:43.527 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-10 14:22:14.675238504 +0000 2024-09-10T14:27:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-10T14:27:43.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T14:27:43.580 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-10T14:27:43.580 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-10T14:27:43.580 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000417656 s, 1.2 MB/s 2024-09-10T14:27:43.581 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T14:27:43.631 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-09-10T14:27:43.678 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T14:27:43.678 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T14:27:43.678 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-10T14:27:43.678 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T14:27:43.678 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-10 14:22:15.443231645 +0000 2024-09-10T14:27:43.678 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-10 14:22:15.179234003 +0000 2024-09-10T14:27:43.678 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-10 14:22:15.179234003 +0000 2024-09-10T14:27:43.678 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-10T14:27:43.679 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T14:27:43.732 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-10T14:27:43.732 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-10T14:27:43.732 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000384133 s, 1.3 MB/s 2024-09-10T14:27:43.733 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T14:27:43.783 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T14:27:43.783 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T14:27:43.783 INFO:tasks.ceph:Generating config... 2024-09-10T14:27:43.785 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T14:27:43.785 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-10T14:27:43.785 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-10T14:27:43.785 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-10T14:27:43.785 INFO:tasks.ceph:[client] setuser = ceph 2024-09-10T14:27:43.785 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T14:27:43.785 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-10T14:27:43.785 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T14:27:43.785 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T14:27:43.785 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T14:27:43.785 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T14:27:43.785 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T14:27:43.786 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T14:27:43.786 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T14:27:43.786 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T14:27:43.786 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T14:27:43.786 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T14:27:43.787 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T14:27:43.787 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T14:27:43.788 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T14:27:43.824 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T14:27:43.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T14:27:43.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T14:27:43.966 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52')] 2024-09-10T14:27:43.967 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-10T14:27:43.967 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:43.968 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T14:27:44.015 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:27:44.099 INFO:teuthology.orchestra.run.smithi052.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:27:44.099 INFO:teuthology.orchestra.run.smithi052.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid e936b5de-d383-459c-816e-e37e3a1e8eca 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:fsid e936b5de-d383-459c-816e-e37e3a1e8eca 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-09-10T14:27:44.100193+0000 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-10T14:27:44.100193+0000 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-09-10T14:27:44.100 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-10T14:27:44.101 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-10T14:27:44.102 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T14:27:44.151 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e936b5de-d383-459c-816e-e37e3a1e8eca... 2024-09-10T14:27:44.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T14:27:44.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T14:27:44.225 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-09-10T14:27:44.226 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-09-10T14:27:44.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-09-10T14:27:44.228 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = 172.21.15.52 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = e936b5de-d383-459c-816e-e37e3a1e8eca 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.229 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-09-10T14:27:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: debug objclass = 20 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-09-10T14:27:44.231 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-10T14:27:44.232 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-10T14:27:44.233 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:27:44.234 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: rgw gc obj min wait = 15 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: debug rgw = 20 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: setgroup = ceph 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout: setuser = ceph 2024-09-10T14:27:44.235 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-09-10T14:27:44.237 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-09-10T14:27:44.238 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.239 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = 172.21.15.52 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = e936b5de-d383-459c-816e-e37e3a1e8eca 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-09-10T14:27:44.240 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-09-10T14:27:44.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: debug objclass = 20 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2024-09-10T14:27:44.242 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-10T14:27:44.243 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-09-10T14:27:44.244 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-09-10T14:27:44.245 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: rgw gc obj min wait = 15 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: debug rgw = 20 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: setgroup = ceph 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout: setuser = ceph 2024-09-10T14:27:44.246 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-09-10T14:27:44.247 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T14:27:44.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T14:27:44.328 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T14:27:44.329 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:44.329 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T14:27:44.334 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:44.334 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T14:27:44.382 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T14:27:44.382 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:44.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T14:27:44.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T14:27:44.448 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:27:44.449 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:27:44.499 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:27:44.499 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:27:44.499 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T14:27:44.499 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T14:27:44.522 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:27:44.522 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:27:44.570 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T14:27:44.570 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T14:27:44.571 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T14:27:44.655 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T14:27:44.670 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T14:27:44.670 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T14:27:44.670 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T14:27:44.747 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T14:27:44.758 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T14:27:44.758 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T14:27:44.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T14:27:44.772 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T14:27:44.772 INFO:tasks.ceph:role: osd.0 2024-09-10T14:27:44.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T14:27:44.772 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T14:27:44.829 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T14:27:44.829 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T14:27:44.829 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T14:27:44.829 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T14:27:44.829 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T14:27:44.829 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-10T14:27:44.829 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T14:27:44.829 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T14:27:44.830 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T14:27:44.830 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T14:27:44.853 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-10T14:27:44.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-10T14:27:44.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T14:27:44.912 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T14:27:44.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T14:27:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T14:27:44.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:27:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:27:45.075+0000 7f4f0802a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T14:27:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:27:45.075+0000 7f4f0802a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T14:27:45.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:27:45.075+0000 7f4f0802a7c0 -1 bdev(0x557861e3d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T14:27:45.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:27:45.075+0000 7f4f0802a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T14:27:48.244 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T14:27:48.259 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T14:27:48.276 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T14:27:48.276 INFO:tasks.ceph:role: osd.1 2024-09-10T14:27:48.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:27:48.277 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T14:27:48.337 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T14:27:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T14:27:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T14:27:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T14:27:48.338 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T14:27:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-10T14:27:48.338 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T14:27:48.338 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T14:27:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T14:27:48.338 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T14:27:48.793 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-10T14:27:48.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-10T14:27:48.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-10T14:27:48.897 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T14:27:48.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T14:27:48.907 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T14:27:48.907 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T14:27:48.959 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T14:27:48.959 INFO:tasks.ceph:role: osd.2 2024-09-10T14:27:48.959 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:27:48.960 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T14:27:49.020 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T14:27:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T14:27:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T14:27:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T14:27:49.021 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T14:27:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-10T14:27:49.021 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T14:27:49.021 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T14:27:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T14:27:49.021 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T14:27:49.493 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-10T14:27:49.496 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-10T14:27:49.496 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-10T14:27:49.647 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T14:27:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T14:27:49.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T14:27:49.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T14:27:49.718 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T14:27:49.718 INFO:tasks.ceph:role: osd.3 2024-09-10T14:27:49.718 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:27:49.718 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T14:27:49.781 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T14:27:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T14:27:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T14:27:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T14:27:49.782 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T14:27:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-10T14:27:49.782 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T14:27:49.782 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T14:27:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T14:27:49.782 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T14:27:50.257 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-10T14:27:50.260 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-10T14:27:50.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-10T14:27:50.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T14:27:50.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T14:27:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T14:27:50.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:27:50.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:50.512+0000 7fa7931147c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T14:27:50.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:50.516+0000 7fa7931147c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T14:27:50.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:50.516+0000 7fa7931147c0 -1 bdev(0x558e3e511800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T14:27:50.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:50.516+0000 7fa7931147c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T14:27:53.941 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T14:27:53.954 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:27:54.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:54.032+0000 7fc86da747c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T14:27:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:54.032+0000 7fc86da747c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T14:27:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:54.032+0000 7fc86da747c0 -1 bdev(0x559fafaa5800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T14:27:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:54.032+0000 7fc86da747c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T14:27:57.426 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T14:27:57.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:27:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:57.568+0000 7f5dd6ffe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T14:27:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:57.568+0000 7f5dd6ffe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T14:27:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:57.568+0000 7f5dd6ffe7c0 -1 bdev(0x55977e94f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T14:27:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:27:57.568+0000 7f5dd6ffe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T14:28:00.701 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T14:28:00.762 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T14:28:00.762 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:28:00.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T14:28:00.778 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:28:00.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T14:28:00.818 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:28:00.818 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T14:28:00.872 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:28:00.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T14:28:00.927 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:28:00.927 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T14:28:00.981 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:28:00.981 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T14:28:01.030 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T14:28:01.030 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T14:28:01.042 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-09-10T14:28:01.042 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBhV+BmPXLIBBAAOcsLOZXulkClnCl8tnqmpw== 2024-09-10T14:28:01.042 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-09-10T14:28:01.042 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgV+BmdRYpJxAA+Gi+oLMwosSxZ35NYm3y2g== 2024-09-10T14:28:01.043 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-09-10T14:28:01.043 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBmV+BmEHnsHhAATltcEELXhwMRuIK+kq0E3g== 2024-09-10T14:28:01.043 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-09-10T14:28:01.043 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBqV+Bmo9tDAhAAByCXj5PLzBhbs5R3owNlPA== 2024-09-10T14:28:01.043 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-09-10T14:28:01.043 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBtV+Bm6G0wIhAAHIZvgIL4wkIBq1dVeoI+xA== 2024-09-10T14:28:01.043 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T14:28:01.043 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBgV+BmUCqnLBAAAk34sfCqPxjETNPTuZx1uA== 2024-09-10T14:28:01.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T14:28:01.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T14:28:01.175 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T14:28:01.260 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T14:28:01.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T14:28:01.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T14:28:01.527 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T14:28:01.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T14:28:01.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T14:28:01.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T14:28:01.644 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T14:28:01.691 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T14:28:01.691 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T14:28:01.692 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T14:28:01.739 INFO:tasks.ceph.mon.a:Started 2024-09-10T14:28:01.739 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T14:28:01.739 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T14:28:01.739 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T14:28:01.741 INFO:tasks.ceph.mgr.x:Started 2024-09-10T14:28:01.742 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T14:28:01.742 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T14:28:01.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5403614640 1 Processor -- start 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5403614640 1 -- start start 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5403614640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 0x7f53fc130800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5403614640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53fc127f00 con 0x7f53fc1283a0 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5403614640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f53fc073360 con 0x7f53fc0702c0 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f54013b0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f53fc1283a0 0x7f53fc128780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57884/0 (socket says 172.21.15.52:57884) 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f54013b0640 1 -- 172.21.15.52:0/2888866335 learned_addr learned my addr 172.21.15.52:0/2888866335 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5400baf640 1 --2- 172.21.15.52:0/2888866335 >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 0x7f53fc130800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5400baf640 1 -- 172.21.15.52:0/2888866335 >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 msgr2=0x7f53fc130800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5400baf640 1 -- 172.21.15.52:0/2888866335 >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 msgr2=0x7f53fc130800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5400baf640 1 --2- 172.21.15.52:0/2888866335 >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 0x7f53fc130800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T14:28:01.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.863+0000 7f5400baf640 1 --2- 172.21.15.52:0/2888866335 >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 0x7f53fc130800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109139324 0 0) 0x7f53fc127f00 con 0x7f53fc1283a0 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e8005740 con 0x7f53fc1283a0 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 499231602 0 0) 0x7f53e8005740 con 0x7f53fc1283a0 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 msgr2=0x7f53fc130800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 --2- 172.21.15.52:0/2888866335 >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 0x7f53fc130800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc1281a0 con 0x7f53fc1283a0 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2797159469 0 0) 0x7f53f80015b0 con 0x7f53fc1283a0 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 >> v1:172.21.15.52:6789/0 conn(0x7f53fc1283a0 legacy=0x7f53fc128780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 --2- 172.21.15.52:0/2888866335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53e8005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:01.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc073360 con 0x7f53e8005bd0 2024-09-10T14:28:01.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.875+0000 7f54013b0640 1 --2- 172.21.15.52:0/2888866335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53e8005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:01.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.879+0000 7f54013b0640 1 -- 172.21.15.52:0/2888866335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e8005740 con 0x7f53e8005bd0 2024-09-10T14:28:01.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f54013b0640 1 --2- 172.21.15.52:0/2888866335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53e8005fd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c110 tx=0x7f53f801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff90e8a986f6176d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:01.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8007cb0 con 0x7f53e8005bd0 2024-09-10T14:28:01.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f80a9070 con 0x7f53e8005bd0 2024-09-10T14:28:01.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f53f3fff640 1 -- 172.21.15.52:0/2888866335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8005ba0 con 0x7f53e8005bd0 2024-09-10T14:28:01.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 -- 172.21.15.52:0/2888866335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 msgr2=0x7f53e8005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 --2- 172.21.15.52:0/2888866335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53e8005fd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c110 tx=0x7f53f801ccc0 comp rx=0 tx=0).stop 2024-09-10T14:28:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 -- 172.21.15.52:0/2888866335 shutdown_connections 2024-09-10T14:28:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 --2- 172.21.15.52:0/2888866335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53e8005fd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 --2- 172.21.15.52:0/2888866335 >> v2:172.21.15.52:3300/0 conn(0x7f53fc0702c0 0x7f53fc130800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 -- 172.21.15.52:0/2888866335 >> 172.21.15.52:0/2888866335 conn(0x7f53fc09a8a0 msgr2=0x7f53fc09acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 -- 172.21.15.52:0/2888866335 shutdown_connections 2024-09-10T14:28:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 -- 172.21.15.52:0/2888866335 wait complete. 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 Processor -- start 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 -- start start 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.895+0000 7f5403614640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53fc1c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f5403614640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc06e510 con 0x7f53e8005bd0 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f54013b0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53fc1c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f54013b0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53fc1c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56386/0 (socket says 172.21.15.52:56386) 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f54013b0640 1 -- 172.21.15.52:0/1222441821 learned_addr learned my addr 172.21.15.52:0/1222441821 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f54013b0640 1 -- 172.21.15.52:0/1222441821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc08d510 con 0x7f53e8005bd0 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f54013b0640 1 --2- 172.21.15.52:0/1222441821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53fc1c5dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c110 tx=0x7f53e8007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:01.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f53f1ffb640 1 -- 172.21.15.52:0/1222441821 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f8001010 con 0x7f53e8005bd0 2024-09-10T14:28:01.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f53f1ffb640 1 -- 172.21.15.52:0/1222441821 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f8001440 con 0x7f53e8005bd0 2024-09-10T14:28:01.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f53f1ffb640 1 -- 172.21.15.52:0/1222441821 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53f80047f0 con 0x7f53e8005bd0 2024-09-10T14:28:01.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc125060 con 0x7f53e8005bd0 2024-09-10T14:28:01.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc08cc70 con 0x7f53e8005bd0 2024-09-10T14:28:01.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f53f1ffb640 1 -- 172.21.15.52:0/1222441821 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53f80070c0 con 0x7f53e8005bd0 2024-09-10T14:28:01.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f53f1ffb640 1 -- 172.21.15.52:0/1222441821 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f53f80ae9c0 con 0x7f53e8005bd0 2024-09-10T14:28:01.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.899+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53fc096e70 con 0x7f53e8005bd0 2024-09-10T14:28:01.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.907+0000 7f53f1ffb640 1 -- 172.21.15.52:0/1222441821 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f53fc08d510 con 0x7f53e8005bd0 2024-09-10T14:28:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.971+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f53fc06bc50 con 0x7f53e8005bd0 2024-09-10T14:28:01.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.971+0000 7f53f1ffb640 1 -- 172.21.15.52:0/1222441821 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f53f80b4070 con 0x7f53e8005bd0 2024-09-10T14:28:01.977 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-09-10T14:28:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.975+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 msgr2=0x7f53fc1c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.975+0000 7f5403614640 1 --2- 172.21.15.52:0/1222441821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53fc1c5dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c110 tx=0x7f53e8007a50 comp rx=0 tx=0).stop 2024-09-10T14:28:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.975+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 shutdown_connections 2024-09-10T14:28:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.975+0000 7f5403614640 1 --2- 172.21.15.52:0/1222441821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8005bd0 0x7f53fc1c5dc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.975+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 >> 172.21.15.52:0/1222441821 conn(0x7f53fc09a8a0 msgr2=0x7f53fc0973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.975+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 shutdown_connections 2024-09-10T14:28:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:01.975+0000 7f5403614640 1 -- 172.21.15.52:0/1222441821 wait complete. 2024-09-10T14:28:01.995 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T14:28:01.995 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T14:28:01.996 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T14:28:01.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T14:28:02.008 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:28:02.008 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T14:28:02.023 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:28:02.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T14:28:02.078 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-10T14:28:02.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T14:28:02.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 45802472-5778-4765-8d57-a58c831fe5dc 0 2024-09-10T14:28:02.153 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:02.148+0000 7fb5cd76b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T14:28:02.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2f9a0640 1 Processor -- start 2024-09-10T14:28:02.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2f9a0640 1 -- start start 2024-09-10T14:28:02.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2f9a0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc28110b60 0x7fcc2806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:02.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2f9a0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc2806d030 con 0x7fcc2806cb10 2024-09-10T14:28:02.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2f9a0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcc2806d200 con 0x7fcc28110b60 2024-09-10T14:28:02.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2d73c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc28110b60 0x7fcc2806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:02.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2d73c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc28110b60 0x7fcc2806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52154/0 (socket says 172.21.15.151:52154) 2024-09-10T14:28:02.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2d73c640 1 -- 172.21.15.151:0/654440629 learned_addr learned my addr 172.21.15.151:0/654440629 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:02.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2d73c640 1 -- 172.21.15.151:0/654440629 >> v1:172.21.15.52:6789/0 conn(0x7fcc2806cb10 legacy=0x7fcc2811c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.272+0000 7fcc2d73c640 1 -- 172.21.15.151:0/654440629 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2811eb30 con 0x7fcc28110b60 2024-09-10T14:28:02.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc2d73c640 1 --2- 172.21.15.151:0/654440629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc28110b60 0x7fcc2806c4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc200097f0 tx=0x7fcc2001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e71ab79d79c5654 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:02.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc1ffff640 1 -- 172.21.15.151:0/654440629 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc200ab580 con 0x7fcc28110b60 2024-09-10T14:28:02.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc1ffff640 1 -- 172.21.15.151:0/654440629 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc200b0070 con 0x7fcc28110b60 2024-09-10T14:28:02.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc1ffff640 1 -- 172.21.15.151:0/654440629 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc200ab870 con 0x7fcc28110b60 2024-09-10T14:28:02.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/654440629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc28110b60 msgr2=0x7fcc2806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc2f9a0640 1 --2- 172.21.15.151:0/654440629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc28110b60 0x7fcc2806c4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc200097f0 tx=0x7fcc2001c430 comp rx=0 tx=0).stop 2024-09-10T14:28:02.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/654440629 shutdown_connections 2024-09-10T14:28:02.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc2f9a0640 1 --2- 172.21.15.151:0/654440629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc28110b60 0x7fcc2806c4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:02.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/654440629 >> 172.21.15.151:0/654440629 conn(0x7fcc2806fff0 msgr2=0x7fcc28072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:02.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/654440629 shutdown_connections 2024-09-10T14:28:02.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.276+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/654440629 wait complete. 2024-09-10T14:28:02.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2f9a0640 1 Processor -- start 2024-09-10T14:28:02.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2f9a0640 1 -- start start 2024-09-10T14:28:02.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2f9a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2806cb10 0x7fcc281aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:02.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2f9a0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2811e6f0 con 0x7fcc2806cb10 2024-09-10T14:28:02.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2d73c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2806cb10 0x7fcc281aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:02.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2d73c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2806cb10 0x7fcc281aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52166/0 (socket says 172.21.15.151:52166) 2024-09-10T14:28:02.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2d73c640 1 -- 172.21.15.151:0/3511006892 learned_addr learned my addr 172.21.15.151:0/3511006892 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2d73c640 1 -- 172.21.15.151:0/3511006892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc281af460 con 0x7fcc2806cb10 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2d73c640 1 --2- 172.21.15.151:0/3511006892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2806cb10 0x7fcc281aee90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcc2001a060 tx=0x7fcc2001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc1dffb640 1 -- 172.21.15.151:0/3511006892 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc200abe10 con 0x7fcc2806cb10 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc1dffb640 1 -- 172.21.15.151:0/3511006892 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc200aa870 con 0x7fcc2806cb10 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc1dffb640 1 -- 172.21.15.151:0/3511006892 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc200aab90 con 0x7fcc2806cb10 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc281af690 con 0x7fcc2806cb10 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc281a8fb0 con 0x7fcc2806cb10 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc1dffb640 1 -- 172.21.15.151:0/3511006892 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcc200c77d0 con 0x7fcc2806cb10 2024-09-10T14:28:02.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc1dffb640 1 -- 172.21.15.151:0/3511006892 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fcc200be800 con 0x7fcc2806cb10 2024-09-10T14:28:02.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.280+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2806c560 con 0x7fcc2806cb10 2024-09-10T14:28:02.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.284+0000 7fcc1dffb640 1 -- 172.21.15.151:0/3511006892 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcc200160b0 con 0x7fcc2806cb10 2024-09-10T14:28:02.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.352+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45802472-5778-4765-8d57-a58c831fe5dc", "id": 0} v 0) -- 0x7fcc28110b60 con 0x7fcc2806cb10 2024-09-10T14:28:02.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.356+0000 7fcc1dffb640 1 -- 172.21.15.151:0/3511006892 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45802472-5778-4765-8d57-a58c831fe5dc", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fcc200cc020 con 0x7fcc2806cb10 2024-09-10T14:28:02.359 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-09-10T14:28:02.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.356+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2806cb10 msgr2=0x7fcc281aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.356+0000 7fcc2f9a0640 1 --2- 172.21.15.151:0/3511006892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2806cb10 0x7fcc281aee90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcc2001a060 tx=0x7fcc2001ac70 comp rx=0 tx=0).stop 2024-09-10T14:28:02.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.356+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 shutdown_connections 2024-09-10T14:28:02.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.356+0000 7fcc2f9a0640 1 --2- 172.21.15.151:0/3511006892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc2806cb10 0x7fcc281aee90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:02.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.356+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 >> 172.21.15.151:0/3511006892 conn(0x7fcc2806fff0 msgr2=0x7fcc28119bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:02.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.356+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 shutdown_connections 2024-09-10T14:28:02.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.356+0000 7fcc2f9a0640 1 -- 172.21.15.151:0/3511006892 wait complete. 2024-09-10T14:28:02.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 7c018fda-e9f2-4c52-93f6-a59ac120be0b 1 2024-09-10T14:28:02.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f175d90d640 1 Processor -- start 2024-09-10T14:28:02.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f175d90d640 1 -- start start 2024-09-10T14:28:02.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f175d90d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f175811ac90 0x7f175811d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:02.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f175d90d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f175811d650 con 0x7f1758117ed0 2024-09-10T14:28:02.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f175d90d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f175811e830 con 0x7f175811ac90 2024-09-10T14:28:02.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f174ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f175811ac90 0x7f175811d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:02.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f174ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f175811ac90 0x7f175811d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52170/0 (socket says 172.21.15.151:52170) 2024-09-10T14:28:02.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f174ffff640 1 -- 172.21.15.151:0/1471733996 learned_addr learned my addr 172.21.15.151:0/1471733996 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:02.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f174ffff640 1 -- 172.21.15.151:0/1471733996 >> v1:172.21.15.52:6789/0 conn(0x7f1758117ed0 legacy=0x7f17581182b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.484+0000 7f174ffff640 1 -- 172.21.15.151:0/1471733996 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175811e9b0 con 0x7f175811ac90 2024-09-10T14:28:02.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f174ffff640 1 --2- 172.21.15.151:0/1471733996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175811ac90 0x7f175811d080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17400097f0 tx=0x7f174001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b775c55e4c727e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:02.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f17567fc640 1 -- 172.21.15.151:0/1471733996 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17400ab580 con 0x7f175811ac90 2024-09-10T14:28:02.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f17567fc640 1 -- 172.21.15.151:0/1471733996 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17400b0070 con 0x7f175811ac90 2024-09-10T14:28:02.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f17567fc640 1 -- 172.21.15.151:0/1471733996 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17400ab870 con 0x7f175811ac90 2024-09-10T14:28:02.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 -- 172.21.15.151:0/1471733996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175811ac90 msgr2=0x7f175811d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 --2- 172.21.15.151:0/1471733996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175811ac90 0x7f175811d080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f17400097f0 tx=0x7f174001c430 comp rx=0 tx=0).stop 2024-09-10T14:28:02.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 -- 172.21.15.151:0/1471733996 shutdown_connections 2024-09-10T14:28:02.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 --2- 172.21.15.151:0/1471733996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175811ac90 0x7f175811d080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:02.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 -- 172.21.15.151:0/1471733996 >> 172.21.15.151:0/1471733996 conn(0x7f175806e740 msgr2=0x7f175806eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:02.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 -- 172.21.15.151:0/1471733996 shutdown_connections 2024-09-10T14:28:02.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 -- 172.21.15.151:0/1471733996 wait complete. 2024-09-10T14:28:02.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 Processor -- start 2024-09-10T14:28:02.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 -- start start 2024-09-10T14:28:02.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758117ed0 0x7f17581aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:02.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.488+0000 7f175d90d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f175811e510 con 0x7f1758117ed0 2024-09-10T14:28:02.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1756ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758117ed0 0x7f17581aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:02.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1756ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758117ed0 0x7f17581aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52174/0 (socket says 172.21.15.151:52174) 2024-09-10T14:28:02.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1756ffd640 1 -- 172.21.15.151:0/1025119415 learned_addr learned my addr 172.21.15.151:0/1025119415 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:02.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1756ffd640 1 -- 172.21.15.151:0/1025119415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17581af4b0 con 0x7f1758117ed0 2024-09-10T14:28:02.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1756ffd640 1 --2- 172.21.15.151:0/1025119415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758117ed0 0x7f17581aeee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f174800c450 tx=0x7f174800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:02.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1754ff9640 1 -- 172.21.15.151:0/1025119415 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1748005150 con 0x7f1758117ed0 2024-09-10T14:28:02.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1754ff9640 1 -- 172.21.15.151:0/1025119415 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17480052f0 con 0x7f1758117ed0 2024-09-10T14:28:02.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17581af740 con 0x7f1758117ed0 2024-09-10T14:28:02.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1754ff9640 1 -- 172.21.15.151:0/1025119415 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1748007030 con 0x7f1758117ed0 2024-09-10T14:28:02.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17581a9150 con 0x7f1758117ed0 2024-09-10T14:28:02.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1754ff9640 1 -- 172.21.15.151:0/1025119415 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1748019020 con 0x7f1758117ed0 2024-09-10T14:28:02.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f1754ff9640 1 -- 172.21.15.151:0/1025119415 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1748003a80 con 0x7f1758117ed0 2024-09-10T14:28:02.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.492+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1758118330 con 0x7f1758117ed0 2024-09-10T14:28:02.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.500+0000 7f1754ff9640 1 -- 172.21.15.151:0/1025119415 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1748003d20 con 0x7f1758117ed0 2024-09-10T14:28:02.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.568+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c018fda-e9f2-4c52-93f6-a59ac120be0b", "id": 1} v 0) -- 0x7f17581af970 con 0x7f1758117ed0 2024-09-10T14:28:02.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.572+0000 7f1754ff9640 1 -- 172.21.15.151:0/1025119415 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c018fda-e9f2-4c52-93f6-a59ac120be0b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f17480067e0 con 0x7f1758117ed0 2024-09-10T14:28:02.574 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-09-10T14:28:02.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.572+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758117ed0 msgr2=0x7f17581aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.572+0000 7f175d90d640 1 --2- 172.21.15.151:0/1025119415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758117ed0 0x7f17581aeee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f174800c450 tx=0x7f174800c910 comp rx=0 tx=0).stop 2024-09-10T14:28:02.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.572+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 shutdown_connections 2024-09-10T14:28:02.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.572+0000 7f175d90d640 1 --2- 172.21.15.151:0/1025119415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758117ed0 0x7f17581aeee0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:02.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.572+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 >> 172.21.15.151:0/1025119415 conn(0x7f175806e740 msgr2=0x7f175811bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:02.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.572+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 shutdown_connections 2024-09-10T14:28:02.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.572+0000 7f175d90d640 1 -- 172.21.15.151:0/1025119415 wait complete. 2024-09-10T14:28:02.592 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new a41e1739-74f0-4db9-b9f3-99660c90654a 2 2024-09-10T14:28:02.658 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:02.656+0000 7fb5cd76b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T14:28:02.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29d50a3640 1 Processor -- start 2024-09-10T14:28:02.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29d50a3640 1 -- start start 2024-09-10T14:28:02.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29d50a3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29d0110990 0x7f29d0119f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:02.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29d50a3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d011a460 con 0x7f29d010fea0 2024-09-10T14:28:02.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29d50a3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f29d011b640 con 0x7f29d0110990 2024-09-10T14:28:02.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29ced9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f29d010fea0 0x7f29d0110280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:42158/0 (socket says 172.21.15.151:42158) 2024-09-10T14:28:02.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29ced9d640 1 -- 172.21.15.151:0/1451288388 learned_addr learned my addr 172.21.15.151:0/1451288388 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:02.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29ce59c640 1 --2- 172.21.15.151:0/1451288388 >> v2:172.21.15.52:3300/0 conn(0x7f29d0110990 0x7f29d0119f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:02.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29cdd9b640 1 -- 172.21.15.151:0/1451288388 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513095668 0 0) 0x7f29d011a460 con 0x7f29d010fea0 2024-09-10T14:28:02.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29cdd9b640 1 -- 172.21.15.151:0/1451288388 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29bc003530 con 0x7f29d010fea0 2024-09-10T14:28:02.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29ce59c640 1 -- 172.21.15.151:0/1451288388 >> v1:172.21.15.52:6789/0 conn(0x7f29d010fea0 legacy=0x7f29d0110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.704+0000 7f29ce59c640 1 -- 172.21.15.151:0/1451288388 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d011b7c0 con 0x7f29d0110990 2024-09-10T14:28:02.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29ce59c640 1 --2- 172.21.15.151:0/1451288388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d0110990 0x7f29d0119f20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009740 tx=0x7f29c001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17529e6c04f368cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:02.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29cdd9b640 1 -- 172.21.15.151:0/1451288388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29c00b1070 con 0x7f29d0110990 2024-09-10T14:28:02.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29cdd9b640 1 -- 172.21.15.151:0/1451288388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c00ac520 con 0x7f29d0110990 2024-09-10T14:28:02.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29cdd9b640 1 -- 172.21.15.151:0/1451288388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29c00ac820 con 0x7f29d0110990 2024-09-10T14:28:02.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 -- 172.21.15.151:0/1451288388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d0110990 msgr2=0x7f29d0119f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 --2- 172.21.15.151:0/1451288388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d0110990 0x7f29d0119f20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009740 tx=0x7f29c001c370 comp rx=0 tx=0).stop 2024-09-10T14:28:02.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 -- 172.21.15.151:0/1451288388 shutdown_connections 2024-09-10T14:28:02.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 --2- 172.21.15.151:0/1451288388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d0110990 0x7f29d0119f20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:02.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 -- 172.21.15.151:0/1451288388 >> 172.21.15.151:0/1451288388 conn(0x7f29d006f840 msgr2=0x7f29d0071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:02.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 -- 172.21.15.151:0/1451288388 shutdown_connections 2024-09-10T14:28:02.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 -- 172.21.15.151:0/1451288388 wait complete. 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 Processor -- start 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.708+0000 7f29d50a3640 1 -- start start 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29d50a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d010fea0 0x7f29d01acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29d50a3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f29d011b360 con 0x7f29d010fea0 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29ced9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d010fea0 0x7f29d01acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29ced9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d010fea0 0x7f29d01acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52430/0 (socket says 172.21.15.151:52430) 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29ced9d640 1 -- 172.21.15.151:0/1028684321 learned_addr learned my addr 172.21.15.151:0/1028684321 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29ced9d640 1 -- 172.21.15.151:0/1028684321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d01ad0d0 con 0x7f29d010fea0 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29ced9d640 1 --2- 172.21.15.151:0/1028684321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d010fea0 0x7f29d01acb00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c3a0 tx=0x7f29b800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29c77fe640 1 -- 172.21.15.151:0/1028684321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b8017070 con 0x7f29d010fea0 2024-09-10T14:28:02.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29c77fe640 1 -- 172.21.15.151:0/1028684321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b8005c40 con 0x7f29d010fea0 2024-09-10T14:28:02.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d01ad360 con 0x7f29d010fea0 2024-09-10T14:28:02.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29c77fe640 1 -- 172.21.15.151:0/1028684321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b80070d0 con 0x7f29d010fea0 2024-09-10T14:28:02.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d01a6df0 con 0x7f29d010fea0 2024-09-10T14:28:02.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29c77fe640 1 -- 172.21.15.151:0/1028684321 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29b801a070 con 0x7f29d010fea0 2024-09-10T14:28:02.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29c77fe640 1 -- 172.21.15.151:0/1028684321 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f29b8012820 con 0x7f29d010fea0 2024-09-10T14:28:02.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.712+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d0110280 con 0x7f29d010fea0 2024-09-10T14:28:02.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.720+0000 7f29c77fe640 1 -- 172.21.15.151:0/1028684321 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f29b8021070 con 0x7f29d010fea0 2024-09-10T14:28:02.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.784+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a41e1739-74f0-4db9-b9f3-99660c90654a", "id": 2} v 0) -- 0x7f29d01ad530 con 0x7f29d010fea0 2024-09-10T14:28:02.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.788+0000 7f29c77fe640 1 -- 172.21.15.151:0/1028684321 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a41e1739-74f0-4db9-b9f3-99660c90654a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f29b80125d0 con 0x7f29d010fea0 2024-09-10T14:28:02.791 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-09-10T14:28:02.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.788+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d010fea0 msgr2=0x7f29d01acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.788+0000 7f29d50a3640 1 --2- 172.21.15.151:0/1028684321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d010fea0 0x7f29d01acb00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c3a0 tx=0x7f29b800c860 comp rx=0 tx=0).stop 2024-09-10T14:28:02.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.788+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 shutdown_connections 2024-09-10T14:28:02.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.788+0000 7f29d50a3640 1 --2- 172.21.15.151:0/1028684321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29d010fea0 0x7f29d01acb00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:02.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.788+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 >> 172.21.15.151:0/1028684321 conn(0x7f29d006f840 msgr2=0x7f29d01174b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:02.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.788+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 shutdown_connections 2024-09-10T14:28:02.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.788+0000 7f29d50a3640 1 -- 172.21.15.151:0/1028684321 wait complete. 2024-09-10T14:28:02.806 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new a7ff38f7-1d09-4389-b358-dfbc9302cd16 3 2024-09-10T14:28:02.901 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:02.900+0000 7fb5cd76b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T14:28:02.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26c3e1640 1 Processor -- start 2024-09-10T14:28:02.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26c3e1640 1 -- start start 2024-09-10T14:28:02.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26c3e1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd26410ed90 0x7fd26410f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:02.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26c3e1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26410fb60 con 0x7fd26410f6b0 2024-09-10T14:28:02.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26c3e1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd26411c840 con 0x7fd26410ed90 2024-09-10T14:28:02.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26a17d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd26410ed90 0x7fd26410f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:02.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26a17d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd26410ed90 0x7fd26410f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52438/0 (socket says 172.21.15.151:52438) 2024-09-10T14:28:02.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26a17d640 1 -- 172.21.15.151:0/1659650404 learned_addr learned my addr 172.21.15.151:0/1659650404 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:02.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26a17d640 1 -- 172.21.15.151:0/1659650404 >> v1:172.21.15.52:6789/0 conn(0x7fd26410f6b0 legacy=0x7fd26411a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.920+0000 7fd26a17d640 1 -- 172.21.15.151:0/1659650404 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26411c9c0 con 0x7fd26410ed90 2024-09-10T14:28:02.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26a17d640 1 --2- 172.21.15.151:0/1659650404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd26410f170 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd2600097f0 tx=0x7fd26001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9218641db64a6a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:02.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26917b640 1 -- 172.21.15.151:0/1659650404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2600b0070 con 0x7fd26410ed90 2024-09-10T14:28:02.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26917b640 1 -- 172.21.15.151:0/1659650404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2600ab530 con 0x7fd26410ed90 2024-09-10T14:28:02.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26917b640 1 -- 172.21.15.151:0/1659650404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2600ab830 con 0x7fd26410ed90 2024-09-10T14:28:02.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 -- 172.21.15.151:0/1659650404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 msgr2=0x7fd26410f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 --2- 172.21.15.151:0/1659650404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd26410f170 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd2600097f0 tx=0x7fd26001c430 comp rx=0 tx=0).stop 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 -- 172.21.15.151:0/1659650404 shutdown_connections 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 --2- 172.21.15.151:0/1659650404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd26410f170 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 -- 172.21.15.151:0/1659650404 >> 172.21.15.151:0/1659650404 conn(0x7fd26406f8b0 msgr2=0x7fd264071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 -- 172.21.15.151:0/1659650404 shutdown_connections 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 -- 172.21.15.151:0/1659650404 wait complete. 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 Processor -- start 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 -- start start 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd2641ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:02.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26c3e1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd26411c4c0 con 0x7fd26410ed90 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26a17d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd2641ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26a17d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd2641ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52454/0 (socket says 172.21.15.151:52454) 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.924+0000 7fd26a17d640 1 -- 172.21.15.151:0/3724437624 learned_addr learned my addr 172.21.15.151:0/3724437624 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd26a17d640 1 -- 172.21.15.151:0/3724437624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2641ad430 con 0x7fd26410ed90 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd26a17d640 1 --2- 172.21.15.151:0/3724437624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd2641ace60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd26001a060 tx=0x7fd2600191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd25affd640 1 -- 172.21.15.151:0/3724437624 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2600b0040 con 0x7fd26410ed90 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd25affd640 1 -- 172.21.15.151:0/3724437624 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2600aa840 con 0x7fd26410ed90 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2641ad660 con 0x7fd26410ed90 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd25affd640 1 -- 172.21.15.151:0/3724437624 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2600aab20 con 0x7fd26410ed90 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2641a6f00 con 0x7fd26410ed90 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd25affd640 1 -- 172.21.15.151:0/3724437624 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2600aacc0 con 0x7fd26410ed90 2024-09-10T14:28:02.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd25affd640 1 -- 172.21.15.151:0/3724437624 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fd2600b48c0 con 0x7fd26410ed90 2024-09-10T14:28:02.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.928+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26410f170 con 0x7fd26410ed90 2024-09-10T14:28:02.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:02.936+0000 7fd25affd640 1 -- 172.21.15.151:0/3724437624 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd2600160b0 con 0x7fd26410ed90 2024-09-10T14:28:03.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.004+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7ff38f7-1d09-4389-b358-dfbc9302cd16", "id": 3} v 0) -- 0x7fd26410f6b0 con 0x7fd26410ed90 2024-09-10T14:28:03.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.004+0000 7fd25affd640 1 -- 172.21.15.151:0/3724437624 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7ff38f7-1d09-4389-b358-dfbc9302cd16", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fd2600b4d40 con 0x7fd26410ed90 2024-09-10T14:28:03.008 INFO:teuthology.orchestra.run.smithi151.stdout:3 2024-09-10T14:28:03.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.004+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 msgr2=0x7fd2641ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:03.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.004+0000 7fd26c3e1640 1 --2- 172.21.15.151:0/3724437624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd2641ace60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd26001a060 tx=0x7fd2600191d0 comp rx=0 tx=0).stop 2024-09-10T14:28:03.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.004+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 shutdown_connections 2024-09-10T14:28:03.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.004+0000 7fd26c3e1640 1 --2- 172.21.15.151:0/3724437624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd26410ed90 0x7fd2641ace60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:03.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.004+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 >> 172.21.15.151:0/3724437624 conn(0x7fd26406f8b0 msgr2=0x7fd2641177b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:03.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.004+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 shutdown_connections 2024-09-10T14:28:03.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:03.008+0000 7fd26c3e1640 1 -- 172.21.15.151:0/3724437624 wait complete. 2024-09-10T14:28:03.025 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T14:28:03.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T14:28:03.030 INFO:tasks.ceph.osd.0:Started 2024-09-10T14:28:03.031 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T14:28:03.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T14:28:03.033 INFO:tasks.ceph.osd.1:Started 2024-09-10T14:28:03.034 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T14:28:03.034 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T14:28:03.036 INFO:tasks.ceph.osd.2:Started 2024-09-10T14:28:03.036 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T14:28:03.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T14:28:03.038 INFO:tasks.ceph.osd.3:Started 2024-09-10T14:28:03.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T14:28:03.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f3166c1f640 1 Processor -- start 2024-09-10T14:28:03.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f3166c1f640 1 -- start start 2024-09-10T14:28:03.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f3166c1f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3160070870 0x7f3160131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:03.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f3166c1f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316009e860 con 0x7f316012cd50 2024-09-10T14:28:03.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f3166c1f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f316012d840 con 0x7f3160070870 2024-09-10T14:28:03.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f31649bb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f316012cd50 0x7f316012d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57910/0 (socket says 172.21.15.52:57910) 2024-09-10T14:28:03.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f31649bb640 1 -- 172.21.15.52:0/4294571153 learned_addr learned my addr 172.21.15.52:0/4294571153 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:03.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f315ffff640 1 --2- 172.21.15.52:0/4294571153 >> v2:172.21.15.52:3300/0 conn(0x7f3160070870 0x7f3160131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:03.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f315f7fe640 1 -- 172.21.15.52:0/4294571153 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990948079 0 0) 0x7f316009e860 con 0x7f316012cd50 2024-09-10T14:28:03.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f315f7fe640 1 -- 172.21.15.52:0/4294571153 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3148003530 con 0x7f316012cd50 2024-09-10T14:28:03.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f315ffff640 1 -- 172.21.15.52:0/4294571153 >> v1:172.21.15.52:6789/0 conn(0x7f316012cd50 legacy=0x7f316012d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:03.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.159+0000 7f315ffff640 1 -- 172.21.15.52:0/4294571153 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3160071c60 con 0x7f3160070870 2024-09-10T14:28:03.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f315ffff640 1 --2- 172.21.15.52:0/4294571153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f3160131dc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3154009740 tx=0x7f315401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec288df504612c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:03.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f315f7fe640 1 -- 172.21.15.52:0/4294571153 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31540ab550 con 0x7f3160070870 2024-09-10T14:28:03.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f315f7fe640 1 -- 172.21.15.52:0/4294571153 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31540b0070 con 0x7f3160070870 2024-09-10T14:28:03.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f315f7fe640 1 -- 172.21.15.52:0/4294571153 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31540ab840 con 0x7f3160070870 2024-09-10T14:28:03.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 -- 172.21.15.52:0/4294571153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 msgr2=0x7f3160131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:03.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 --2- 172.21.15.52:0/4294571153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f3160131dc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3154009740 tx=0x7f315401c400 comp rx=0 tx=0).stop 2024-09-10T14:28:03.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 -- 172.21.15.52:0/4294571153 shutdown_connections 2024-09-10T14:28:03.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 --2- 172.21.15.52:0/4294571153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f3160131dc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:03.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 -- 172.21.15.52:0/4294571153 >> 172.21.15.52:0/4294571153 conn(0x7f316009cd30 msgr2=0x7f316009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:03.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 -- 172.21.15.52:0/4294571153 shutdown_connections 2024-09-10T14:28:03.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 -- 172.21.15.52:0/4294571153 wait complete. 2024-09-10T14:28:03.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 Processor -- start 2024-09-10T14:28:03.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 -- start start 2024-09-10T14:28:03.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f31600986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:03.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f3166c1f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3160134d30 con 0x7f3160070870 2024-09-10T14:28:03.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.163+0000 7f31649bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f31600986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:03.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f31649bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f31600986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56416/0 (socket says 172.21.15.52:56416) 2024-09-10T14:28:03.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f31649bb640 1 -- 172.21.15.52:0/793228637 learned_addr learned my addr 172.21.15.52:0/793228637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:03.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f31649bb640 1 -- 172.21.15.52:0/793228637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316012a170 con 0x7f3160070870 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f31649bb640 1 --2- 172.21.15.52:0/793228637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f31600986d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f315000c450 tx=0x7f315000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f315d7fa640 1 -- 172.21.15.52:0/793228637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3150017070 con 0x7f3160070870 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f315d7fa640 1 -- 172.21.15.52:0/793228637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3150005c20 con 0x7f3160070870 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316012ad20 con 0x7f3160070870 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f315d7fa640 1 -- 172.21.15.52:0/793228637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3150007070 con 0x7f3160070870 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3160098de0 con 0x7f3160070870 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f315d7fa640 1 -- 172.21.15.52:0/793228637 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f315001a070 con 0x7f3160070870 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f315d7fa640 1 -- 172.21.15.52:0/793228637 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f315001cba0 con 0x7f3160070870 2024-09-10T14:28:03.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3160129cb0 con 0x7f3160070870 2024-09-10T14:28:03.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.167+0000 7f315d7fa640 1 -- 172.21.15.52:0/793228637 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f315001c440 con 0x7f3160070870 2024-09-10T14:28:03.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.227+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3160070e10 con 0x7f3160070870 2024-09-10T14:28:03.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.227+0000 7f315d7fa640 1 -- 172.21.15.52:0/793228637 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f315001c620 con 0x7f3160070870 2024-09-10T14:28:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:28:03.234 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"fsid":"e936b5de-d383-459c-816e-e37e3a1e8eca","created":"2024-09-10T14:28:01.875404+0000","modified":"2024-09-10T14:28:03.007882+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T14:28:03.007882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45802472-5778-4765-8d57-a58c831fe5dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c018fda-e9f2-4c52-93f6-a59ac120be0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a41e1739-74f0-4db9-b9f3-99660c90654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7ff38f7-1d09-4389-b358-dfbc9302cd16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T14:28:03.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.231+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 msgr2=0x7f31600986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.231+0000 7f3166c1f640 1 --2- 172.21.15.52:0/793228637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f31600986d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f315000c450 tx=0x7f315000c910 comp rx=0 tx=0).stop 2024-09-10T14:28:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.231+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 shutdown_connections 2024-09-10T14:28:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.231+0000 7f3166c1f640 1 --2- 172.21.15.52:0/793228637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3160070870 0x7f31600986d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.231+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 >> 172.21.15.52:0/793228637 conn(0x7f316009cd30 msgr2=0x7f31601308d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.231+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 shutdown_connections 2024-09-10T14:28:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:03.231+0000 7f3166c1f640 1 -- 172.21.15.52:0/793228637 wait complete. 2024-09-10T14:28:03.253 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T14:28:03.253 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T14:28:03.463 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:03.460+0000 7fb5cd76b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T14:28:03.517 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:03.512+0000 7fb5cd76b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T14:28:03.569 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:03.564+0000 7fb5cd76b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T14:28:03.645 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:03.640+0000 7fb5cd76b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T14:28:03.656 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T14:28:03.697 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:03.692+0000 7fb5cd76b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T14:28:03.773 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:03.768+0000 7fb5cd76b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T14:28:03.783 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadfb95640 1 Processor -- start 2024-09-10T14:28:03.783 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadfb95640 1 -- start start 2024-09-10T14:28:03.785 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadfb95640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcad812ece0 0x7fcad812f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:03.785 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadfb95640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad812e890 con 0x7fcad806d150 2024-09-10T14:28:03.785 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadfb95640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcad8073c80 con 0x7fcad812ece0 2024-09-10T14:28:03.785 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadd931640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcad812ece0 0x7fcad812f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:03.786 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadd931640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcad812ece0 0x7fcad812f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56420/0 (socket says 172.21.15.52:56420) 2024-09-10T14:28:03.786 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadd931640 1 -- 172.21.15.52:0/976909373 learned_addr learned my addr 172.21.15.52:0/976909373 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:03.786 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadd931640 1 -- 172.21.15.52:0/976909373 >> v1:172.21.15.52:6789/0 conn(0x7fcad806d150 legacy=0x7fcad806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:03.786 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadd931640 1 -- 172.21.15.52:0/976909373 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad8073960 con 0x7fcad812ece0 2024-09-10T14:28:03.786 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.779+0000 7fcadc92f640 1 -- 172.21.15.52:0/976909373 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848065633 0 0) 0x7fcad812e890 con 0x7fcad806d150 2024-09-10T14:28:03.793 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadd931640 1 --2- 172.21.15.52:0/976909373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad812ece0 0x7fcad812f0c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcad40097f0 tx=0x7fcad401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c13d8c0c5ab606 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:03.793 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadc92f640 1 -- 172.21.15.52:0/976909373 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad40b2070 con 0x7fcad812ece0 2024-09-10T14:28:03.793 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadc92f640 1 -- 172.21.15.52:0/976909373 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad40a9070 con 0x7fcad812ece0 2024-09-10T14:28:03.794 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadc92f640 1 -- 172.21.15.52:0/976909373 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad40ad5b0 con 0x7fcad812ece0 2024-09-10T14:28:03.794 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- 172.21.15.52:0/976909373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad812ece0 msgr2=0x7fcad812f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:03.794 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 --2- 172.21.15.52:0/976909373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad812ece0 0x7fcad812f0c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcad40097f0 tx=0x7fcad401c430 comp rx=0 tx=0).stop 2024-09-10T14:28:03.794 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- 172.21.15.52:0/976909373 shutdown_connections 2024-09-10T14:28:03.795 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 --2- 172.21.15.52:0/976909373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad812ece0 0x7fcad812f0c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:03.795 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- 172.21.15.52:0/976909373 >> 172.21.15.52:0/976909373 conn(0x7fcad809deb0 msgr2=0x7fcad809e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:03.795 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- 172.21.15.52:0/976909373 shutdown_connections 2024-09-10T14:28:03.795 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- 172.21.15.52:0/976909373 wait complete. 2024-09-10T14:28:03.795 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 Processor -- start 2024-09-10T14:28:03.796 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- start start 2024-09-10T14:28:03.796 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad806d150 0x7fcad8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:03.796 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcad80954b0 con 0x7fcad806d150 2024-09-10T14:28:03.796 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadd931640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad806d150 0x7fcad8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:03.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadd931640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad806d150 0x7fcad8122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56422/0 (socket says 172.21.15.52:56422) 2024-09-10T14:28:03.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadd931640 1 -- 172.21.15.52:0/4262668447 learned_addr learned my addr 172.21.15.52:0/4262668447 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:03.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadd931640 1 -- 172.21.15.52:0/4262668447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad81341a0 con 0x7fcad806d150 2024-09-10T14:28:03.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadd931640 1 --2- 172.21.15.52:0/4262668447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad806d150 0x7fcad8122da0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcad4019040 tx=0x7fcad401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:03.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcaca7fc640 1 -- 172.21.15.52:0/4262668447 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad40bc020 con 0x7fcad806d150 2024-09-10T14:28:03.798 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcaca7fc640 1 -- 172.21.15.52:0/4262668447 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad40add80 con 0x7fcad806d150 2024-09-10T14:28:03.798 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad8133890 con 0x7fcad806d150 2024-09-10T14:28:03.798 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcaca7fc640 1 -- 172.21.15.52:0/4262668447 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcad40b2040 con 0x7fcad806d150 2024-09-10T14:28:03.798 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad81232e0 con 0x7fcad806d150 2024-09-10T14:28:03.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcaca7fc640 1 -- 172.21.15.52:0/4262668447 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcad40bf020 con 0x7fcad806d150 2024-09-10T14:28:03.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.783+0000 7fcaca7fc640 1 -- 172.21.15.52:0/4262668447 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fcad40c1af0 con 0x7fcad806d150 2024-09-10T14:28:03.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.787+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad8124ec0 con 0x7fcad806d150 2024-09-10T14:28:03.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.787+0000 7fcaca7fc640 1 -- 172.21.15.52:0/4262668447 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcad8124ec0 con 0x7fcad806d150 2024-09-10T14:28:03.826 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:03.824+0000 7fb5cd76b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T14:28:03.852 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.847+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcad8133a60 con 0x7fcad806d150 2024-09-10T14:28:03.853 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.847+0000 7fcaca7fc640 1 -- 172.21.15.52:0/4262668447 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fcad40c6030 con 0x7fcad806d150 2024-09-10T14:28:03.853 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-10T14:28:03.853 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":6,"fsid":"e936b5de-d383-459c-816e-e37e3a1e8eca","created":"2024-09-10T14:28:01.875404+0000","modified":"2024-09-10T14:28:03.007882+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T14:28:03.007882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45802472-5778-4765-8d57-a58c831fe5dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c018fda-e9f2-4c52-93f6-a59ac120be0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a41e1739-74f0-4db9-b9f3-99660c90654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7ff38f7-1d09-4389-b358-dfbc9302cd16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T14:28:03.855 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.851+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad806d150 msgr2=0x7fcad8122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:03.855 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.851+0000 7fcadfb95640 1 --2- 172.21.15.52:0/4262668447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad806d150 0x7fcad8122da0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcad4019040 tx=0x7fcad401ac70 comp rx=0 tx=0).stop 2024-09-10T14:28:03.855 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.851+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 shutdown_connections 2024-09-10T14:28:03.855 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.851+0000 7fcadfb95640 1 --2- 172.21.15.52:0/4262668447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad806d150 0x7fcad8122da0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:03.855 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.851+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 >> 172.21.15.52:0/4262668447 conn(0x7fcad809deb0 msgr2=0x7fcad8129290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:03.855 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.851+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 shutdown_connections 2024-09-10T14:28:03.855 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:03.851+0000 7fcadfb95640 1 -- 172.21.15.52:0/4262668447 wait complete. 2024-09-10T14:28:03.871 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T14:28:03.976 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:03.972+0000 7fb5cd76b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T14:28:04.037 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:04.036+0000 7fb5cd76b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T14:28:04.616 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-10T14:28:04.611+0000 7f974d7917c0 -1 Falling back to public interface 2024-09-10T14:28:04.660 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-10T14:28:04.656+0000 7f620cb407c0 -1 Falling back to public interface 2024-09-10T14:28:04.661 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-10T14:28:04.656+0000 7efe6b00d7c0 -1 Falling back to public interface 2024-09-10T14:28:04.736 INFO:tasks.ceph.mgr.x.smithi151.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T14:28:04.737 INFO:tasks.ceph.mgr.x.smithi151.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T14:28:04.737 INFO:tasks.ceph.mgr.x.smithi151.stderr: from numpy import show_config as show_numpy_config 2024-09-10T14:28:04.788 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:04.784+0000 7fb5cd76b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T14:28:04.955 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:04.952+0000 7fb5cd76b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T14:28:04.966 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-10T14:28:04.964+0000 7f99e55b77c0 -1 Falling back to public interface 2024-09-10T14:28:05.134 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:05.132+0000 7fb5cd76b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T14:28:05.204 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:05.200+0000 7fb5cd76b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T14:28:05.352 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:05.348+0000 7fb5cd76b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T14:28:05.964 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:05.960+0000 7fb5cd76b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T14:28:06.038 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:06.036+0000 7fb5cd76b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T14:28:06.221 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:06.216+0000 7fb5cd76b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T14:28:06.293 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:06.292+0000 7fb5cd76b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T14:28:06.583 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:06.580+0000 7fb5cd76b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T14:28:06.644 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:06.640+0000 7fb5cd76b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T14:28:07.678 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:28:07.676+0000 7fb5743a0640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-10T14:28:09.102 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-10T14:28:09.100+0000 7f620cb407c0 -1 osd.1 0 log_to_monitors true 2024-09-10T14:28:09.153 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-10T14:28:09.147+0000 7f974d7917c0 -1 osd.0 0 log_to_monitors true 2024-09-10T14:28:09.274 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-10T14:28:09.272+0000 7efe6b00d7c0 -1 osd.3 0 log_to_monitors true 2024-09-10T14:28:09.776 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-10T14:28:09.772+0000 7f99e55b77c0 -1 osd.2 0 log_to_monitors true 2024-09-10T14:28:10.275 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T14:28:10.402 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4674398640 1 Processor -- start 2024-09-10T14:28:10.403 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4674398640 1 -- start start 2024-09-10T14:28:10.403 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4674398640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f466c097780 0x7f466c097b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:10.404 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4674398640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466c09b440 con 0x7f466c12e500 2024-09-10T14:28:10.404 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4674398640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f466c09af60 con 0x7f466c097780 2024-09-10T14:28:10.404 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4672134640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f466c097780 0x7f466c097b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:10.404 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4671933640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f466c12e500 0x7f466c12e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58630/0 (socket says 172.21.15.52:58630) 2024-09-10T14:28:10.404 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4671933640 1 -- 172.21.15.52:0/4034465692 learned_addr learned my addr 172.21.15.52:0/4034465692 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:10.404 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4672134640 1 -- 172.21.15.52:0/4034465692 >> v1:172.21.15.52:6789/0 conn(0x7f466c12e500 legacy=0x7f466c12e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:10.404 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.399+0000 7f4672134640 1 -- 172.21.15.52:0/4034465692 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c098650 con 0x7f466c097780 2024-09-10T14:28:10.406 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4672134640 1 --2- 172.21.15.52:0/4034465692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c097b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4668009740 tx=0x7f466801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675963471da5b9c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:10.406 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4671132640 1 -- 172.21.15.52:0/4034465692 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46680b0070 con 0x7f466c097780 2024-09-10T14:28:10.407 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4671132640 1 -- 172.21.15.52:0/4034465692 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46680ab530 con 0x7f466c097780 2024-09-10T14:28:10.407 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4671132640 1 -- 172.21.15.52:0/4034465692 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46680ab830 con 0x7f466c097780 2024-09-10T14:28:10.408 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 -- 172.21.15.52:0/4034465692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 msgr2=0x7f466c097b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:10.408 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 --2- 172.21.15.52:0/4034465692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c097b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4668009740 tx=0x7f466801c400 comp rx=0 tx=0).stop 2024-09-10T14:28:10.408 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 -- 172.21.15.52:0/4034465692 shutdown_connections 2024-09-10T14:28:10.408 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 --2- 172.21.15.52:0/4034465692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c097b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:10.408 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 -- 172.21.15.52:0/4034465692 >> 172.21.15.52:0/4034465692 conn(0x7f466c0a0fd0 msgr2=0x7f466c0a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:10.408 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 -- 172.21.15.52:0/4034465692 shutdown_connections 2024-09-10T14:28:10.408 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 -- 172.21.15.52:0/4034465692 wait complete. 2024-09-10T14:28:10.410 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 Processor -- start 2024-09-10T14:28:10.410 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 -- start start 2024-09-10T14:28:10.410 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c1c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:10.410 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4674398640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f466c1371d0 con 0x7f466c097780 2024-09-10T14:28:10.410 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4672134640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c1c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:10.410 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4672134640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c1c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38826/0 (socket says 172.21.15.52:38826) 2024-09-10T14:28:10.410 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4672134640 1 -- 172.21.15.52:0/1143351361 learned_addr learned my addr 172.21.15.52:0/1143351361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:10.411 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4672134640 1 -- 172.21.15.52:0/1143351361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c073ab0 con 0x7f466c097780 2024-09-10T14:28:10.411 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.403+0000 7f4672134640 1 --2- 172.21.15.52:0/1143351361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c1c69a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f466801a030 tx=0x7f46680191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:10.411 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4662ffd640 1 -- 172.21.15.52:0/1143351361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46680b0050 con 0x7f466c097780 2024-09-10T14:28:10.411 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4662ffd640 1 -- 172.21.15.52:0/1143351361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46680b1040 con 0x7f466c097780 2024-09-10T14:28:10.411 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c06e100 con 0x7f466c097780 2024-09-10T14:28:10.411 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4662ffd640 1 -- 172.21.15.52:0/1143351361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46680b5740 con 0x7f466c097780 2024-09-10T14:28:10.411 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c1c70b0 con 0x7f466c097780 2024-09-10T14:28:10.412 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466c097be0 con 0x7f466c097780 2024-09-10T14:28:10.412 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4662ffd640 1 -- 172.21.15.52:0/1143351361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f46680be030 con 0x7f466c097780 2024-09-10T14:28:10.412 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4662ffd640 1 --2- 172.21.15.52:0/1143351361 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4650035d20 0x7f46500381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:10.412 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4662ffd640 1 -- 172.21.15.52:0/1143351361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1318+0+0 (secure 0 0 0) 0x7f46680bc070 con 0x7f466c097780 2024-09-10T14:28:10.412 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4671933640 1 --2- 172.21.15.52:0/1143351361 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4650035d20 0x7f46500381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:10.412 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.407+0000 7f4671933640 1 --2- 172.21.15.52:0/1143351361 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4650035d20 0x7f46500381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f465c005890 tx=0x7f465c007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:10.416 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.411+0000 7f4662ffd640 1 -- 172.21.15.52:0/1143351361 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f46680c5020 con 0x7f466c097780 2024-09-10T14:28:10.578 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f466c06e2d0 con 0x7f466c097780 2024-09-10T14:28:10.579 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4662ffd640 1 -- 172.21.15.52:0/1143351361 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4153 (secure 0 0 0) 0x7f4668015ff0 con 0x7f466c097780 2024-09-10T14:28:10.579 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-10T14:28:10.579 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":7,"fsid":"e936b5de-d383-459c-816e-e37e3a1e8eca","created":"2024-09-10T14:28:01.875404+0000","modified":"2024-09-10T14:28:09.723746+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T14:28:03.007882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45802472-5778-4765-8d57-a58c831fe5dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7c018fda-e9f2-4c52-93f6-a59ac120be0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a41e1739-74f0-4db9-b9f3-99660c90654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7ff38f7-1d09-4389-b358-dfbc9302cd16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T14:28:10.581 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4650035d20 msgr2=0x7f46500381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:10.581 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 --2- 172.21.15.52:0/1143351361 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4650035d20 0x7f46500381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f465c005890 tx=0x7f465c007a90 comp rx=0 tx=0).stop 2024-09-10T14:28:10.582 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 msgr2=0x7f466c1c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:10.582 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 --2- 172.21.15.52:0/1143351361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c1c69a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f466801a030 tx=0x7f46680191a0 comp rx=0 tx=0).stop 2024-09-10T14:28:10.582 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 shutdown_connections 2024-09-10T14:28:10.582 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 --2- 172.21.15.52:0/1143351361 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4650035d20 0x7f46500381e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:10.582 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 --2- 172.21.15.52:0/1143351361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f466c097780 0x7f466c1c69a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:10.582 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 >> 172.21.15.52:0/1143351361 conn(0x7f466c0a0fd0 msgr2=0x7f466c09d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:10.582 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 shutdown_connections 2024-09-10T14:28:10.582 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:10.575+0000 7f4674398640 1 -- 172.21.15.52:0/1143351361 wait complete. 2024-09-10T14:28:10.596 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T14:28:11.545 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-10T14:28:11.539+0000 7f9749f4c640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T14:28:11.563 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-10T14:28:11.559+0000 7f974155e640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T14:28:12.159 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-10T14:28:12.155+0000 7efe66793640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T14:28:12.169 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-10T14:28:12.167+0000 7f62082c6640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T14:28:12.179 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-10T14:28:12.175+0000 7efe5edda640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T14:28:12.208 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-10T14:28:12.203+0000 7f620090d640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T14:28:12.777 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-10T14:28:12.771+0000 7f99e0d3d640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T14:28:12.806 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-10T14:28:12.803+0000 7f99d9384640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T14:28:17.001 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T14:28:17.121 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f00531dd640 1 Processor -- start 2024-09-10T14:28:17.121 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f00531dd640 1 -- start start 2024-09-10T14:28:17.121 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f00531dd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f004c12e4d0 0x7f004c12e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:17.122 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f00531dd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f004c12f340 con 0x7f004c12ef30 2024-09-10T14:28:17.122 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f00531dd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f004c06f890 con 0x7f004c12e4d0 2024-09-10T14:28:17.122 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f0050f79640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f004c12e4d0 0x7f004c12e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:17.122 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f004bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f004c12ef30 0x7f004c12af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58642/0 (socket says 172.21.15.52:58642) 2024-09-10T14:28:17.122 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f004bfff640 1 -- 172.21.15.52:0/1998449526 learned_addr learned my addr 172.21.15.52:0/1998449526 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:17.122 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f0050f79640 1 -- 172.21.15.52:0/1998449526 >> v1:172.21.15.52:6789/0 conn(0x7f004c12ef30 legacy=0x7f004c12af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:17.122 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.115+0000 7f0050f79640 1 -- 172.21.15.52:0/1998449526 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004c06fd70 con 0x7f004c12e4d0 2024-09-10T14:28:17.124 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f0050f79640 1 --2- 172.21.15.52:0/1998449526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c12e9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0044009740 tx=0x7f004401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d288c1245660ea7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:17.124 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f004b7fe640 1 -- 172.21.15.52:0/1998449526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00440b1070 con 0x7f004c12e4d0 2024-09-10T14:28:17.125 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f004b7fe640 1 -- 172.21.15.52:0/1998449526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00440ac530 con 0x7f004c12e4d0 2024-09-10T14:28:17.125 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f004b7fe640 1 -- 172.21.15.52:0/1998449526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00440ac830 con 0x7f004c12e4d0 2024-09-10T14:28:17.130 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 -- 172.21.15.52:0/1998449526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 msgr2=0x7f004c12e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:17.130 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 --2- 172.21.15.52:0/1998449526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c12e9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0044009740 tx=0x7f004401c490 comp rx=0 tx=0).stop 2024-09-10T14:28:17.130 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 -- 172.21.15.52:0/1998449526 shutdown_connections 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 --2- 172.21.15.52:0/1998449526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c12e9f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 -- 172.21.15.52:0/1998449526 >> 172.21.15.52:0/1998449526 conn(0x7f004c0713e0 msgr2=0x7f004c0717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 -- 172.21.15.52:0/1998449526 shutdown_connections 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 -- 172.21.15.52:0/1998449526 wait complete. 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 Processor -- start 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.119+0000 7f00531dd640 1 -- start start 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00531dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c132780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00531dd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f004c12b7e0 con 0x7f004c12e4d0 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f0050f79640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f0050f79640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c132780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38840/0 (socket says 172.21.15.52:38840) 2024-09-10T14:28:17.131 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f0050f79640 1 -- 172.21.15.52:0/1790051885 learned_addr learned my addr 172.21.15.52:0/1790051885 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f0050f79640 1 -- 172.21.15.52:0/1790051885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004c1178d0 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f0050f79640 1 --2- 172.21.15.52:0/1790051885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c132780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f00440af040 tx=0x7f0044019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00497fa640 1 -- 172.21.15.52:0/1790051885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00440b9020 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00497fa640 1 -- 172.21.15.52:0/1790051885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00440b5410 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004c134130 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00497fa640 1 -- 172.21.15.52:0/1790051885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00440b1040 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f004c1167e0 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00497fa640 1 -- 172.21.15.52:0/1790051885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f00440bc020 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004c12e9f0 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00497fa640 1 --2- 172.21.15.52:0/1790051885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0038035d20 0x7f00380381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f00497fa640 1 -- 172.21.15.52:0/1790051885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f00440e31f0 con 0x7f004c12e4d0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.123+0000 7f004bfff640 1 --2- 172.21.15.52:0/1790051885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0038035d20 0x7f00380381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:17.132 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.127+0000 7f004bfff640 1 --2- 172.21.15.52:0/1790051885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0038035d20 0x7f00380381e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f00400012f0 tx=0x7f0040001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:17.134 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.131+0000 7f00497fa640 1 -- 172.21.15.52:0/1790051885 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00440c3030 con 0x7f004c12e4d0 2024-09-10T14:28:17.293 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.287+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f004c133980 con 0x7f004c12e4d0 2024-09-10T14:28:17.294 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00497fa640 1 -- 172.21.15.52:0/1790051885 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8002 (secure 0 0 0) 0x7f0044015ff0 con 0x7f004c12e4d0 2024-09-10T14:28:17.295 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-10T14:28:17.295 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":14,"fsid":"e936b5de-d383-459c-816e-e37e3a1e8eca","created":"2024-09-10T14:28:01.875404+0000","modified":"2024-09-10T14:28:16.791701+0000","last_up_change":"2024-09-10T14:28:13.779450+0000","last_in_change":"2024-09-10T14:28:03.007882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T14:28:14.755514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45802472-5778-4765-8d57-a58c831fe5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6801","nonce":2968015226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6803","nonce":2968015226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6807","nonce":2968015226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6805","nonce":2968015226}]},"public_addr":"172.21.15.52:6801/2968015226","cluster_addr":"172.21.15.52:6803/2968015226","heartbeat_back_addr":"172.21.15.52:6807/2968015226","heartbeat_front_addr":"172.21.15.52:6805/2968015226","state":["exists","up"]},{"osd":1,"uuid":"7c018fda-e9f2-4c52-93f6-a59ac120be0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6801","nonce":103268966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6804","nonce":103268966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6812","nonce":103268966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6808","nonce":103268966}]},"public_addr":"172.21.15.151:6801/103268966","cluster_addr":"172.21.15.151:6804/103268966","heartbeat_back_addr":"172.21.15.151:6812/103268966","heartbeat_front_addr":"172.21.15.151:6808/103268966","state":["exists","up"]},{"osd":2,"uuid":"a41e1739-74f0-4db9-b9f3-99660c90654a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6817","nonce":2885613778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6819","nonce":2885613778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6823","nonce":2885613778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6821","nonce":2885613778}]},"public_addr":"172.21.15.151:6817/2885613778","cluster_addr":"172.21.15.151:6819/2885613778","heartbeat_back_addr":"172.21.15.151:6823/2885613778","heartbeat_front_addr":"172.21.15.151:6821/2885613778","state":["exists","up"]},{"osd":3,"uuid":"a7ff38f7-1d09-4389-b358-dfbc9302cd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6805","nonce":3136276598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6809","nonce":3136276598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6815","nonce":3136276598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6811","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6813","nonce":3136276598}]},"public_addr":"172.21.15.151:6805/3136276598","cluster_addr":"172.21.15.151:6809/3136276598","heartbeat_back_addr":"172.21.15.151:6815/3136276598","heartbeat_front_addr":"172.21.15.151:6813/3136276598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.162035+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.133963+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.782040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.263429+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0038035d20 msgr2=0x7f00380381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 --2- 172.21.15.52:0/1790051885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0038035d20 0x7f00380381e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f00400012f0 tx=0x7f0040001640 comp rx=0 tx=0).stop 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 msgr2=0x7f004c132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 --2- 172.21.15.52:0/1790051885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c132780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f00440af040 tx=0x7f0044019230 comp rx=0 tx=0).stop 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 shutdown_connections 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 --2- 172.21.15.52:0/1790051885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0038035d20 0x7f00380381e0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f00400012f0 tx=0x7f0040001640 comp rx=0 tx=0).stop 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 --2- 172.21.15.52:0/1790051885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f004c12e4d0 0x7f004c132780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 >> 172.21.15.52:0/1790051885 conn(0x7f004c0713e0 msgr2=0x7f004c099a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:17.297 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 shutdown_connections 2024-09-10T14:28:17.298 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T14:28:17.291+0000 7f00531dd640 1 -- 172.21.15.52:0/1790051885 wait complete. 2024-09-10T14:28:17.311 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-10T14:28:17.312 INFO:tasks.ceph:Creating RBD pool 2024-09-10T14:28:17.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T14:28:17.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f35260e1640 1 Processor -- start 2024-09-10T14:28:17.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f35260e1640 1 -- start start 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f35260e1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f352006fe70 0x7f35201315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f35260e1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3520071ac0 con 0x7f352006f380 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f35260e1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f352009e8f0 con 0x7f352006fe70 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f351f7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f352006f380 0x7f352006f760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58654/0 (socket says 172.21.15.52:58654) 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f351f7fe640 1 -- 172.21.15.52:0/3653213126 learned_addr learned my addr 172.21.15.52:0/3653213126 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f351effd640 1 --2- 172.21.15.52:0/3653213126 >> v2:172.21.15.52:3300/0 conn(0x7f352006fe70 0x7f35201315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f351e7fc640 1 -- 172.21.15.52:0/3653213126 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830362711 0 0) 0x7f3520071ac0 con 0x7f352006f380 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f351e7fc640 1 -- 172.21.15.52:0/3653213126 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3508003530 con 0x7f352006f380 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f351effd640 1 -- 172.21.15.52:0/3653213126 >> v1:172.21.15.52:6789/0 conn(0x7f352006f380 legacy=0x7f352006f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.431+0000 7f351effd640 1 -- 172.21.15.52:0/3653213126 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3520071680 con 0x7f352006fe70 2024-09-10T14:28:17.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351effd640 1 --2- 172.21.15.52:0/3653213126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006fe70 0x7f35201315e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3514009740 tx=0x7f351401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6521cff3895e890 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:17.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351e7fc640 1 -- 172.21.15.52:0/3653213126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35140b1070 con 0x7f352006fe70 2024-09-10T14:28:17.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351e7fc640 1 -- 172.21.15.52:0/3653213126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35140ac570 con 0x7f352006fe70 2024-09-10T14:28:17.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351e7fc640 1 -- 172.21.15.52:0/3653213126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35140ac870 con 0x7f352006fe70 2024-09-10T14:28:17.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- 172.21.15.52:0/3653213126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006fe70 msgr2=0x7f35201315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:17.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 --2- 172.21.15.52:0/3653213126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006fe70 0x7f35201315e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3514009740 tx=0x7f351401c400 comp rx=0 tx=0).stop 2024-09-10T14:28:17.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- 172.21.15.52:0/3653213126 shutdown_connections 2024-09-10T14:28:17.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 --2- 172.21.15.52:0/3653213126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006fe70 0x7f35201315e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:17.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- 172.21.15.52:0/3653213126 >> 172.21.15.52:0/3653213126 conn(0x7f352009c9a0 msgr2=0x7f352009cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:17.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- 172.21.15.52:0/3653213126 shutdown_connections 2024-09-10T14:28:17.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- 172.21.15.52:0/3653213126 wait complete. 2024-09-10T14:28:17.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 Processor -- start 2024-09-10T14:28:17.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- start start 2024-09-10T14:28:17.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006f380 0x7f352012e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:17.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3520134550 con 0x7f352006f380 2024-09-10T14:28:17.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006f380 0x7f352012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:17.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006f380 0x7f352012e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38858/0 (socket says 172.21.15.52:38858) 2024-09-10T14:28:17.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351f7fe640 1 -- 172.21.15.52:0/1772503608 learned_addr learned my addr 172.21.15.52:0/1772503608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:17.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351f7fe640 1 -- 172.21.15.52:0/1772503608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3520130e00 con 0x7f352006f380 2024-09-10T14:28:17.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f351f7fe640 1 --2- 172.21.15.52:0/1772503608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006f380 0x7f352012e960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f351000c3a0 tx=0x7f351000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:17.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f3507fff640 1 -- 172.21.15.52:0/1772503608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3510017070 con 0x7f352006f380 2024-09-10T14:28:17.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f3507fff640 1 -- 172.21.15.52:0/1772503608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510005c20 con 0x7f352006f380 2024-09-10T14:28:17.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3520130200 con 0x7f352006f380 2024-09-10T14:28:17.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f3507fff640 1 -- 172.21.15.52:0/1772503608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35100070d0 con 0x7f352006f380 2024-09-10T14:28:17.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.435+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f352012f070 con 0x7f352006f380 2024-09-10T14:28:17.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.439+0000 7f3507fff640 1 -- 172.21.15.52:0/1772503608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f351001a070 con 0x7f352006f380 2024-09-10T14:28:17.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.439+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f352006f7e0 con 0x7f352006f380 2024-09-10T14:28:17.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.439+0000 7f3507fff640 1 --2- 172.21.15.52:0/1772503608 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f350c035cd0 0x7f350c038190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:17.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.439+0000 7f3507fff640 1 -- 172.21.15.52:0/1772503608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f35100477b0 con 0x7f352006f380 2024-09-10T14:28:17.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.439+0000 7f351effd640 1 --2- 172.21.15.52:0/1772503608 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f350c035cd0 0x7f350c038190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:17.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.439+0000 7f351effd640 1 --2- 172.21.15.52:0/1772503608 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f350c035cd0 0x7f350c038190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f35140ae000 tx=0x7f35140a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:17.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.443+0000 7f3507fff640 1 -- 172.21.15.52:0/1772503608 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3510019e10 con 0x7f352006f380 2024-09-10T14:28:17.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:17.611+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f352008b9a0 con 0x7f352006f380 2024-09-10T14:28:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.295+0000 7f3507fff640 1 -- 172.21.15.52:0/1772503608 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f3510010e00 con 0x7f352006f380 2024-09-10T14:28:18.298 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2024-09-10T14:28:18.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f350c035cd0 msgr2=0x7f350c038190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:18.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 --2- 172.21.15.52:0/1772503608 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f350c035cd0 0x7f350c038190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f35140ae000 tx=0x7f35140a6070 comp rx=0 tx=0).stop 2024-09-10T14:28:18.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006f380 msgr2=0x7f352012e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:18.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 --2- 172.21.15.52:0/1772503608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006f380 0x7f352012e960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f351000c3a0 tx=0x7f351000c860 comp rx=0 tx=0).stop 2024-09-10T14:28:18.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 shutdown_connections 2024-09-10T14:28:18.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 --2- 172.21.15.52:0/1772503608 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f350c035cd0 0x7f350c038190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:18.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 --2- 172.21.15.52:0/1772503608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f352006f380 0x7f352012e960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:18.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 >> 172.21.15.52:0/1772503608 conn(0x7f352009c9a0 msgr2=0x7f352012c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:18.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 shutdown_connections 2024-09-10T14:28:18.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.299+0000 7f35260e1640 1 -- 172.21.15.52:0/1772503608 wait complete. 2024-09-10T14:28:18.326 DEBUG:teuthology.orchestra.run.smithi052:> rbd --cluster ceph pool init rbd 2024-09-10T14:28:18.379 INFO:teuthology.orchestra.run.smithi052.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:18.379 INFO:teuthology.orchestra.run.smithi052.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:18.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.375+0000 7fea87396f80 1 Processor -- start 2024-09-10T14:28:18.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.375+0000 7fea87396f80 1 -- start start 2024-09-10T14:28:18.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.375+0000 7fea87396f80 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d4c7105480 0x55d4c7105860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:18.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.375+0000 7fea87396f80 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d4c6fa3ea0 con 0x55d4c7106920 2024-09-10T14:28:18.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.375+0000 7fea87396f80 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55d4c6f98e20 con 0x55d4c7105480 2024-09-10T14:28:18.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.375+0000 7fea856a9640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d4c7106920 0x55d4c7105da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58666/0 (socket says 172.21.15.52:58666) 2024-09-10T14:28:18.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.375+0000 7fea85eaa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d4c7105480 0x55d4c7105860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:18.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.375+0000 7fea856a9640 1 -- 172.21.15.52:0/2777259231 learned_addr learned my addr 172.21.15.52:0/2777259231 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:18.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea84ea8640 1 -- 172.21.15.52:0/2777259231 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278663674 0 0) 0x55d4c6fa3ea0 con 0x55d4c7106920 2024-09-10T14:28:18.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea85eaa640 1 -- 172.21.15.52:0/2777259231 >> v1:172.21.15.52:6789/0 conn(0x55d4c7106920 legacy=0x55d4c7105da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:18.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea85eaa640 1 -- 172.21.15.52:0/2777259231 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c6f8a180 con 0x55d4c7105480 2024-09-10T14:28:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea85eaa640 1 --2- 172.21.15.52:0/2777259231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c7105860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea7800a480 tx=0x7fea7801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473cfa6d4bc77a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea84ea8640 1 -- 172.21.15.52:0/2777259231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea780af070 con 0x55d4c7105480 2024-09-10T14:28:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea84ea8640 1 -- 172.21.15.52:0/2777259231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea780aa530 con 0x55d4c7105480 2024-09-10T14:28:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea84ea8640 1 -- 172.21.15.52:0/2777259231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea780aa830 con 0x55d4c7105480 2024-09-10T14:28:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea87396f80 1 -- 172.21.15.52:0/2777259231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 msgr2=0x55d4c7105860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea87396f80 1 --2- 172.21.15.52:0/2777259231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c7105860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea7800a480 tx=0x7fea7801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea87396f80 1 -- 172.21.15.52:0/2777259231 shutdown_connections 2024-09-10T14:28:18.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea87396f80 1 --2- 172.21.15.52:0/2777259231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c7105860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:18.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea87396f80 1 -- 172.21.15.52:0/2777259231 >> 172.21.15.52:0/2777259231 conn(0x55d4c711e870 msgr2=0x55d4c711c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:18.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea87396f80 1 -- 172.21.15.52:0/2777259231 shutdown_connections 2024-09-10T14:28:18.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.379+0000 7fea87396f80 1 -- 172.21.15.52:0/2777259231 wait complete. 2024-09-10T14:28:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea87396f80 1 Processor -- start 2024-09-10T14:28:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea87396f80 1 -- start start 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea87396f80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c71a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea87396f80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d4c6fef800 con 0x55d4c7105480 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea85eaa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c71a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea85eaa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c71a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38872/0 (socket says 172.21.15.52:38872) 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea85eaa640 1 -- 172.21.15.52:0/2081341281 learned_addr learned my addr 172.21.15.52:0/2081341281 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea85eaa640 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c6f74990 con 0x55d4c7105480 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea85eaa640 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c71a05b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea78018eb0 tx=0x7fea78018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea780ba070 con 0x55d4c7105480 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea780b5840 con 0x55d4c7105480 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea780af040 con 0x55d4c7105480 2024-09-10T14:28:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4c711b540 con 0x55d4c7105480 2024-09-10T14:28:18.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c71a37c0 con 0x55d4c7105480 2024-09-10T14:28:18.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7fea780bd070 con 0x55d4c7105480 2024-09-10T14:28:18.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea75ffb640 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea68034610 0x7fea68036ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7fea780e2a80 con 0x55d4c7105480 2024-09-10T14:28:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55d4c71a0e20 con 0x55d4c7105480 2024-09-10T14:28:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.383+0000 7fea856a9640 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea68034610 0x7fea68036ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:18.387+0000 7fea856a9640 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea68034610 0x7fea68036ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fea7c004180 tx=0x7fea7c001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.299+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x7fea780a3e20 con 0x55d4c7105480 2024-09-10T14:28:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.299+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea780aa530 con 0x55d4c7105480 2024-09-10T14:28:19.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.307+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fea780b5b20 con 0x55d4c7105480 2024-09-10T14:28:19.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.307+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fea78006cb0 con 0x55d4c7105480 2024-09-10T14:28:19.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.307+0000 7fea77fff640 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7fea6c002af0 con 0x55d4c7105480 2024-09-10T14:28:19.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.307+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 9 ==== osd_map(16..16 src has 1..16) ==== 650+0+0 (secure 0 0 0) 0x7fea780e5050 con 0x55d4c7105480 2024-09-10T14:28:19.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.311+0000 7fea87396f80 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d4c7106920 0x55d4c71c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:19.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.311+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x55d4c71c7e40 con 0x55d4c7106920 2024-09-10T14:28:19.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.311+0000 7fea8710c640 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d4c7106920 0x55d4c71c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:19.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.311+0000 7fea8710c640 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d4c7106920 0x55d4c71c7900 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:19.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.323+0000 7fea8710c640 1 -- 172.21.15.52:0/2081341281 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fea8000a4d0 con 0x55d4c7106920 2024-09-10T14:28:19.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.331+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x55d4c7218ef0 con 0x55d4c7106920 2024-09-10T14:28:19.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.331+0000 7fea8710c640 1 -- 172.21.15.52:0/2081341281 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fea8000a4d0 con 0x55d4c7106920 2024-09-10T14:28:19.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.331+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x55d4c7218000 con 0x55d4c7106920 2024-09-10T14:28:19.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.331+0000 7fea8710c640 1 -- 172.21.15.52:0/2081341281 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fea8000a4d0 con 0x55d4c7106920 2024-09-10T14:28:19.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:19.331+0000 7fea777fe640 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fea60001f10 con 0x55d4c7105480 2024-09-10T14:28:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:20.307+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7fea78014f00 con 0x55d4c7105480 2024-09-10T14:28:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:20.307+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7fea6803a2d0 con 0x55d4c7105480 2024-09-10T14:28:20.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:20.307+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 11 ==== osd_map(17..17 src has 1..17) ==== 626+0+0 (secure 0 0 0) 0x7fea780a99d0 con 0x55d4c7105480 2024-09-10T14:28:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:20.307+0000 7fea77fff640 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7fea6c005690 con 0x55d4c7106920 2024-09-10T14:28:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:20.315+0000 7fea8710c640 1 -- 172.21.15.52:0/2081341281 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fea8000a4d0 con 0x55d4c7106920 2024-09-10T14:28:20.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:20.315+0000 7fea777fe640 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7fea60003360 con 0x55d4c7105480 2024-09-10T14:28:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.311+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7fea780da020 con 0x55d4c7105480 2024-09-10T14:28:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.311+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7fea6803a4a0 con 0x55d4c7105480 2024-09-10T14:28:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.311+0000 7fea75ffb640 1 -- 172.21.15.52:0/2081341281 <== mon.0 v2:172.21.15.52:3300/0 13 ==== osd_map(18..18 src has 1..18) ==== 654+0+0 (secure 0 0 0) 0x7fea780a9c90 con 0x55d4c7105480 2024-09-10T14:28:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.311+0000 7fea77fff640 1 -- 172.21.15.52:0/2081341281 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7fea6c005a30 con 0x55d4c7106920 2024-09-10T14:28:21.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.319+0000 7fea8710c640 1 -- 172.21.15.52:0/2081341281 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea8000a4d0 con 0x55d4c7106920 2024-09-10T14:28:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.319+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d4c7106920 msgr2=0x55d4c71c7900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.319+0000 7fea87396f80 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d4c7106920 0x55d4c71c7900 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.319+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea68034610 msgr2=0x7fea68036ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.319+0000 7fea87396f80 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea68034610 0x7fea68036ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fea7c004180 tx=0x7fea7c001340 comp rx=0 tx=0).stop 2024-09-10T14:28:21.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.319+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 msgr2=0x55d4c71a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.319+0000 7fea87396f80 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c71a05b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea78018eb0 tx=0x7fea78018020 comp rx=0 tx=0).stop 2024-09-10T14:28:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.323+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 shutdown_connections 2024-09-10T14:28:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.323+0000 7fea87396f80 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d4c7106920 0x55d4c71c7900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.323+0000 7fea87396f80 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea68034610 0x7fea68036ad0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.323+0000 7fea87396f80 1 --2- 172.21.15.52:0/2081341281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4c7105480 0x55d4c71a05b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.323+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 >> 172.21.15.52:0/2081341281 conn(0x55d4c711e870 msgr2=0x55d4c71b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.323+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 shutdown_connections 2024-09-10T14:28:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.323+0000 7fea87396f80 1 -- 172.21.15.52:0/2081341281 wait complete. 2024-09-10T14:28:21.335 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T14:28:21.335 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T14:28:21.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T14:28:21.336 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T14:28:21.336 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T14:28:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.463+0000 7f99c0e89640 1 Processor -- start 2024-09-10T14:28:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.463+0000 7f99c0e89640 1 -- start start 2024-09-10T14:28:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.463+0000 7f99c0e89640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99bc072760 0x7f99bc072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.463+0000 7f99c0e89640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99bc06fa30 con 0x7f99bc06f190 2024-09-10T14:28:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.463+0000 7f99c0e89640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f99bc06e800 con 0x7f99bc072760 2024-09-10T14:28:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99ba59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99bc072760 0x7f99bc072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99ba59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99bc072760 0x7f99bc072b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33760/0 (socket says 172.21.15.52:33760) 2024-09-10T14:28:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99b9d9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f99bc06f190 0x7f99bc06d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47714/0 (socket says 172.21.15.52:47714) 2024-09-10T14:28:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99ba59c640 1 -- 172.21.15.52:0/2341269181 learned_addr learned my addr 172.21.15.52:0/2341269181 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99ba59c640 1 -- 172.21.15.52:0/2341269181 >> v1:172.21.15.52:6789/0 conn(0x7f99bc06f190 legacy=0x7f99bc06d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99ba59c640 1 -- 172.21.15.52:0/2341269181 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc06fd40 con 0x7f99bc072760 2024-09-10T14:28:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99b959a640 1 -- 172.21.15.52:0/2341269181 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008060903 0 0) 0x7f99bc06fa30 con 0x7f99bc06f190 2024-09-10T14:28:21.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99ba59c640 1 --2- 172.21.15.52:0/2341269181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc072760 0x7f99bc072b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f99b00097f0 tx=0x7f99b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70bf567680ca58d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99b959a640 1 -- 172.21.15.52:0/2341269181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b00b0070 con 0x7f99bc072760 2024-09-10T14:28:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99b959a640 1 -- 172.21.15.52:0/2341269181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b00ab530 con 0x7f99bc072760 2024-09-10T14:28:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99b959a640 1 -- 172.21.15.52:0/2341269181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b00ab830 con 0x7f99bc072760 2024-09-10T14:28:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99c0e89640 1 -- 172.21.15.52:0/2341269181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc072760 msgr2=0x7f99bc072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99c0e89640 1 --2- 172.21.15.52:0/2341269181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc072760 0x7f99bc072b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f99b00097f0 tx=0x7f99b001c430 comp rx=0 tx=0).stop 2024-09-10T14:28:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99c0e89640 1 -- 172.21.15.52:0/2341269181 shutdown_connections 2024-09-10T14:28:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99c0e89640 1 --2- 172.21.15.52:0/2341269181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc072760 0x7f99bc072b40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99c0e89640 1 -- 172.21.15.52:0/2341269181 >> 172.21.15.52:0/2341269181 conn(0x7f99bc099a50 msgr2=0x7f99bc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99c0e89640 1 -- 172.21.15.52:0/2341269181 shutdown_connections 2024-09-10T14:28:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.467+0000 7f99c0e89640 1 -- 172.21.15.52:0/2341269181 wait complete. 2024-09-10T14:28:21.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99c0e89640 1 Processor -- start 2024-09-10T14:28:21.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99c0e89640 1 -- start start 2024-09-10T14:28:21.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99c0e89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc06f190 0x7f99bc121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:21.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99c0e89640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc137620 con 0x7f99bc06f190 2024-09-10T14:28:21.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99ba59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc06f190 0x7f99bc121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99ba59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc06f190 0x7f99bc121db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33768/0 (socket says 172.21.15.52:33768) 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99ba59c640 1 -- 172.21.15.52:0/1118252154 learned_addr learned my addr 172.21.15.52:0/1118252154 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99ba59c640 1 -- 172.21.15.52:0/1118252154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc124b30 con 0x7f99bc06f190 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99ba59c640 1 --2- 172.21.15.52:0/1118252154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc06f190 0x7f99bc121db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99b00ae040 tx=0x7f99b001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99aaffd640 1 -- 172.21.15.52:0/1118252154 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b00ba020 con 0x7f99bc06f190 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99aaffd640 1 -- 172.21.15.52:0/1118252154 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b00b6630 con 0x7f99bc06f190 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99bc124390 con 0x7f99bc06f190 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99aaffd640 1 -- 172.21.15.52:0/1118252154 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b00b0040 con 0x7f99bc06f190 2024-09-10T14:28:21.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99bc1222f0 con 0x7f99bc06f190 2024-09-10T14:28:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99bc122fb0 con 0x7f99bc06f190 2024-09-10T14:28:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99aaffd640 1 -- 172.21.15.52:0/1118252154 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f99b00bd020 con 0x7f99bc06f190 2024-09-10T14:28:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99aaffd640 1 --2- 172.21.15.52:0/1118252154 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f999c035db0 0x7f999c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99aaffd640 1 -- 172.21.15.52:0/1118252154 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f99b00e2c40 con 0x7f99bc06f190 2024-09-10T14:28:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.471+0000 7f99b9d9b640 1 --2- 172.21.15.52:0/1118252154 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f999c035db0 0x7f999c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:21.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.475+0000 7f99b9d9b640 1 --2- 172.21.15.52:0/1118252154 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f999c035db0 0x7f999c038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f99ac007fd0 tx=0x7f99ac007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.475+0000 7f99aaffd640 1 -- 172.21.15.52:0/1118252154 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f99b00c4030 con 0x7f99bc06f190 2024-09-10T14:28:21.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.679+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f99bc123720 con 0x7f99bc06f190 2024-09-10T14:28:21.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.683+0000 7f99aaffd640 1 -- 172.21.15.52:0/1118252154 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84180 (secure 0 0 0) 0x7f99b00160b0 con 0x7f99bc06f190 2024-09-10T14:28:21.689 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f999c035db0 msgr2=0x7f999c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 --2- 172.21.15.52:0/1118252154 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f999c035db0 0x7f999c038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f99ac007fd0 tx=0x7f99ac007940 comp rx=0 tx=0).stop 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc06f190 msgr2=0x7f99bc121db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 --2- 172.21.15.52:0/1118252154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc06f190 0x7f99bc121db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99b00ae040 tx=0x7f99b001ac70 comp rx=0 tx=0).stop 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 shutdown_connections 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 --2- 172.21.15.52:0/1118252154 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f999c035db0 0x7f999c038270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 --2- 172.21.15.52:0/1118252154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99bc06f190 0x7f99bc121db0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 >> 172.21.15.52:0/1118252154 conn(0x7f99bc099a50 msgr2=0x7f99bc070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:21.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 shutdown_connections 2024-09-10T14:28:21.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.687+0000 7f99c0e89640 1 -- 172.21.15.52:0/1118252154 wait complete. 2024-09-10T14:28:21.705 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3605021146},{"type":"v1","addr":"172.21.15.151:6825","nonce":3605021146}]},"active_addr":"172.21.15.151:6825/3605021146","active_change":"2024-09-10T14:28:06.664780+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1797240732}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":687995391}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1230332049}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":2048401199}]}]} 2024-09-10T14:28:21.707 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T14:28:21.707 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T14:28:21.708 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T14:28:21.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.819+0000 7f6627383640 1 Processor -- start 2024-09-10T14:28:21.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.819+0000 7f6627383640 1 -- start start 2024-09-10T14:28:21.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f662006ece0 0x7f6620130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:21.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662006f750 con 0x7f662006e1f0 2024-09-10T14:28:21.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6620070c10 con 0x7f662006ece0 2024-09-10T14:28:21.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f662511f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f662006e1f0 0x7f662006e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47726/0 (socket says 172.21.15.52:47726) 2024-09-10T14:28:21.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f662511f640 1 -- 172.21.15.52:0/1086861733 learned_addr learned my addr 172.21.15.52:0/1086861733 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:21.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f662491e640 1 --2- 172.21.15.52:0/1086861733 >> v2:172.21.15.52:3300/0 conn(0x7f662006ece0 0x7f6620130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:21.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f661ffff640 1 -- 172.21.15.52:0/1086861733 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035512340 0 0) 0x7f662006f750 con 0x7f662006e1f0 2024-09-10T14:28:21.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f661ffff640 1 -- 172.21.15.52:0/1086861733 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6608003530 con 0x7f662006e1f0 2024-09-10T14:28:21.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f662491e640 1 -- 172.21.15.52:0/1086861733 >> v1:172.21.15.52:6789/0 conn(0x7f662006e1f0 legacy=0x7f662006e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f662491e640 1 -- 172.21.15.52:0/1086861733 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66200703f0 con 0x7f662006ece0 2024-09-10T14:28:21.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f662491e640 1 --2- 172.21.15.52:0/1086861733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006ece0 0x7f6620130e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6614009740 tx=0x7f661401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92178122420f7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:21.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f661ffff640 1 -- 172.21.15.52:0/1086861733 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66140b0070 con 0x7f662006ece0 2024-09-10T14:28:21.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f661ffff640 1 -- 172.21.15.52:0/1086861733 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66140ab530 con 0x7f662006ece0 2024-09-10T14:28:21.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f661ffff640 1 -- 172.21.15.52:0/1086861733 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66140ab810 con 0x7f662006ece0 2024-09-10T14:28:21.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 -- 172.21.15.52:0/1086861733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006ece0 msgr2=0x7f6620130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:21.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 --2- 172.21.15.52:0/1086861733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006ece0 0x7f6620130e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6614009740 tx=0x7f661401c370 comp rx=0 tx=0).stop 2024-09-10T14:28:21.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 -- 172.21.15.52:0/1086861733 shutdown_connections 2024-09-10T14:28:21.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 --2- 172.21.15.52:0/1086861733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006ece0 0x7f6620130e50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:21.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 -- 172.21.15.52:0/1086861733 >> 172.21.15.52:0/1086861733 conn(0x7f6620099a50 msgr2=0x7f66200972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:21.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 -- 172.21.15.52:0/1086861733 shutdown_connections 2024-09-10T14:28:21.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.823+0000 7f6627383640 1 -- 172.21.15.52:0/1086861733 wait complete. 2024-09-10T14:28:21.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f6627383640 1 Processor -- start 2024-09-10T14:28:21.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f6627383640 1 -- start start 2024-09-10T14:28:21.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f6627383640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006e1f0 0x7f6620092b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f6627383640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f662006d260 con 0x7f662006e1f0 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f662511f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006e1f0 0x7f6620092b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f662511f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006e1f0 0x7f6620092b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33778/0 (socket says 172.21.15.52:33778) 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f662511f640 1 -- 172.21.15.52:0/835078991 learned_addr learned my addr 172.21.15.52:0/835078991 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f662511f640 1 -- 172.21.15.52:0/835078991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662008f260 con 0x7f662006e1f0 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f662511f640 1 --2- 172.21.15.52:0/835078991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006e1f0 0x7f6620092b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f661000cb40 tx=0x7f66100021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f661dffb640 1 -- 172.21.15.52:0/835078991 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610017070 con 0x7f662006e1f0 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f661dffb640 1 -- 172.21.15.52:0/835078991 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661000ab80 con 0x7f662006e1f0 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662008f540 con 0x7f662006e1f0 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f661dffb640 1 -- 172.21.15.52:0/835078991 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6610012400 con 0x7f662006e1f0 2024-09-10T14:28:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662008d900 con 0x7f662006e1f0 2024-09-10T14:28:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662006e5d0 con 0x7f662006e1f0 2024-09-10T14:28:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f661dffb640 1 -- 172.21.15.52:0/835078991 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f661001a070 con 0x7f662006e1f0 2024-09-10T14:28:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f661dffb640 1 --2- 172.21.15.52:0/835078991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f660c035db0 0x7f660c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f661dffb640 1 -- 172.21.15.52:0/835078991 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f66100484e0 con 0x7f662006e1f0 2024-09-10T14:28:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.827+0000 7f662491e640 1 --2- 172.21.15.52:0/835078991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f660c035db0 0x7f660c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.831+0000 7f662491e640 1 --2- 172.21.15.52:0/835078991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f660c035db0 0x7f660c038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f66140ad000 tx=0x7f66140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:21.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.831+0000 7f661dffb640 1 -- 172.21.15.52:0/835078991 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f661001b3b0 con 0x7f662006e1f0 2024-09-10T14:28:22.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.999+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6620073790 con 0x7f662006e1f0 2024-09-10T14:28:22.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:21.999+0000 7f661dffb640 1 -- 172.21.15.52:0/835078991 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9902 (secure 0 0 0) 0x7f6610010300 con 0x7f662006e1f0 2024-09-10T14:28:22.004 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:28:22.004 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"e936b5de-d383-459c-816e-e37e3a1e8eca","created":"2024-09-10T14:28:01.875404+0000","modified":"2024-09-10T14:28:21.310217+0000","last_up_change":"2024-09-10T14:28:13.779450+0000","last_in_change":"2024-09-10T14:28:03.007882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T14:28:14.755514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T14:28:17.647233+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45802472-5778-4765-8d57-a58c831fe5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6801","nonce":2968015226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6803","nonce":2968015226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6807","nonce":2968015226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6805","nonce":2968015226}]},"public_addr":"172.21.15.52:6801/2968015226","cluster_addr":"172.21.15.52:6803/2968015226","heartbeat_back_addr":"172.21.15.52:6807/2968015226","heartbeat_front_addr":"172.21.15.52:6805/2968015226","state":["exists","up"]},{"osd":1,"uuid":"7c018fda-e9f2-4c52-93f6-a59ac120be0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6801","nonce":103268966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6804","nonce":103268966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6812","nonce":103268966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6808","nonce":103268966}]},"public_addr":"172.21.15.151:6801/103268966","cluster_addr":"172.21.15.151:6804/103268966","heartbeat_back_addr":"172.21.15.151:6812/103268966","heartbeat_front_addr":"172.21.15.151:6808/103268966","state":["exists","up"]},{"osd":2,"uuid":"a41e1739-74f0-4db9-b9f3-99660c90654a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6817","nonce":2885613778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6819","nonce":2885613778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6823","nonce":2885613778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6821","nonce":2885613778}]},"public_addr":"172.21.15.151:6817/2885613778","cluster_addr":"172.21.15.151:6819/2885613778","heartbeat_back_addr":"172.21.15.151:6823/2885613778","heartbeat_front_addr":"172.21.15.151:6821/2885613778","state":["exists","up"]},{"osd":3,"uuid":"a7ff38f7-1d09-4389-b358-dfbc9302cd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6805","nonce":3136276598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6809","nonce":3136276598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6815","nonce":3136276598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6811","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6813","nonce":3136276598}]},"public_addr":"172.21.15.151:6805/3136276598","cluster_addr":"172.21.15.151:6809/3136276598","heartbeat_back_addr":"172.21.15.151:6815/3136276598","heartbeat_front_addr":"172.21.15.151:6813/3136276598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.162035+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.133963+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.782040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.263429+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T14:28:22.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f660c035db0 msgr2=0x7f660c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 --2- 172.21.15.52:0/835078991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f660c035db0 0x7f660c038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f66140ad000 tx=0x7f66140a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006e1f0 msgr2=0x7f6620092b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 --2- 172.21.15.52:0/835078991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006e1f0 0x7f6620092b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f661000cb40 tx=0x7f66100021f0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 shutdown_connections 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 --2- 172.21.15.52:0/835078991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f660c035db0 0x7f660c038270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 --2- 172.21.15.52:0/835078991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f662006e1f0 0x7f6620092b50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 >> 172.21.15.52:0/835078991 conn(0x7f6620099a50 msgr2=0x7f6620096390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 shutdown_connections 2024-09-10T14:28:22.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.003+0000 7f6627383640 1 -- 172.21.15.52:0/835078991 wait complete. 2024-09-10T14:28:22.023 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T14:28:22.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T14:28:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.135+0000 7fc973a3f640 1 Processor -- start 2024-09-10T14:28:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.135+0000 7fc973a3f640 1 -- start start 2024-09-10T14:28:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.135+0000 7fc973a3f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc96c06d0e0 0x7fc96c06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.135+0000 7fc973a3f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c071c10 con 0x7fc96c06da00 2024-09-10T14:28:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.135+0000 7fc973a3f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc96c072230 con 0x7fc96c06d0e0 2024-09-10T14:28:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.135+0000 7fc9717db640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc96c06d0e0 0x7fc96c06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.135+0000 7fc970fda640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc96c06da00 0x7fc96c12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47730/0 (socket says 172.21.15.52:47730) 2024-09-10T14:28:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.135+0000 7fc970fda640 1 -- 172.21.15.52:0/70777897 learned_addr learned my addr 172.21.15.52:0/70777897 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc9717db640 1 -- 172.21.15.52:0/70777897 >> v1:172.21.15.52:6789/0 conn(0x7fc96c06da00 legacy=0x7fc96c12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc9717db640 1 -- 172.21.15.52:0/70777897 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c0709e0 con 0x7fc96c06d0e0 2024-09-10T14:28:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc963fff640 1 -- 172.21.15.52:0/70777897 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91994668 0 0) 0x7fc96c071c10 con 0x7fc96c06da00 2024-09-10T14:28:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc9717db640 1 --2- 172.21.15.52:0/70777897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c06d4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc968009740 tx=0x7fc96801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706f2909622374d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc963fff640 1 -- 172.21.15.52:0/70777897 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9680b0070 con 0x7fc96c06d0e0 2024-09-10T14:28:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc963fff640 1 -- 172.21.15.52:0/70777897 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680ab530 con 0x7fc96c06d0e0 2024-09-10T14:28:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc963fff640 1 -- 172.21.15.52:0/70777897 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9680ab830 con 0x7fc96c06d0e0 2024-09-10T14:28:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc973a3f640 1 -- 172.21.15.52:0/70777897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 msgr2=0x7fc96c06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc973a3f640 1 --2- 172.21.15.52:0/70777897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c06d4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc968009740 tx=0x7fc96801c370 comp rx=0 tx=0).stop 2024-09-10T14:28:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc973a3f640 1 -- 172.21.15.52:0/70777897 shutdown_connections 2024-09-10T14:28:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc973a3f640 1 --2- 172.21.15.52:0/70777897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c06d4c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc973a3f640 1 -- 172.21.15.52:0/70777897 >> 172.21.15.52:0/70777897 conn(0x7fc96c099a50 msgr2=0x7fc96c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc973a3f640 1 -- 172.21.15.52:0/70777897 shutdown_connections 2024-09-10T14:28:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.139+0000 7fc973a3f640 1 -- 172.21.15.52:0/70777897 wait complete. 2024-09-10T14:28:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc973a3f640 1 Processor -- start 2024-09-10T14:28:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc973a3f640 1 -- start start 2024-09-10T14:28:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc973a3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c1279b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc973a3f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c134e80 con 0x7fc96c06d0e0 2024-09-10T14:28:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc9717db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c1279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc9717db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c1279b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33798/0 (socket says 172.21.15.52:33798) 2024-09-10T14:28:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc9717db640 1 -- 172.21.15.52:0/2433828995 learned_addr learned my addr 172.21.15.52:0/2433828995 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc9717db640 1 -- 172.21.15.52:0/2433828995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c129e40 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc9717db640 1 --2- 172.21.15.52:0/2433828995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c1279b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc968019fa0 tx=0x7fc96801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc961ffb640 1 -- 172.21.15.52:0/2433828995 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9680b0050 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc961ffb640 1 -- 172.21.15.52:0/2433828995 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680b1040 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc96c072710 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc961ffb640 1 -- 172.21.15.52:0/2433828995 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9680b5740 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc96c12a4d0 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96c06d4c0 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc961ffb640 1 -- 172.21.15.52:0/2433828995 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc9680be030 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc961ffb640 1 --2- 172.21.15.52:0/2433828995 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc950035db0 0x7fc950038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc961ffb640 1 -- 172.21.15.52:0/2433828995 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc9680bc070 con 0x7fc96c06d0e0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.143+0000 7fc970fda640 1 --2- 172.21.15.52:0/2433828995 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc950035db0 0x7fc950038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.147+0000 7fc970fda640 1 --2- 172.21.15.52:0/2433828995 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc950035db0 0x7fc950038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc95c007fd0 tx=0x7fc95c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.147+0000 7fc961ffb640 1 -- 172.21.15.52:0/2433828995 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc9680c5020 con 0x7fc96c06d0e0 2024-09-10T14:28:22.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.307+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc96c073790 con 0x7fc96c06d0e0 2024-09-10T14:28:22.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc961ffb640 1 -- 172.21.15.52:0/2433828995 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9902 (secure 0 0 0) 0x7fc968015ff0 con 0x7fc96c06d0e0 2024-09-10T14:28:22.318 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:28:22.318 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"e936b5de-d383-459c-816e-e37e3a1e8eca","created":"2024-09-10T14:28:01.875404+0000","modified":"2024-09-10T14:28:21.310217+0000","last_up_change":"2024-09-10T14:28:13.779450+0000","last_in_change":"2024-09-10T14:28:03.007882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T14:28:14.755514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T14:28:17.647233+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45802472-5778-4765-8d57-a58c831fe5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6801","nonce":2968015226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6803","nonce":2968015226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6807","nonce":2968015226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6805","nonce":2968015226}]},"public_addr":"172.21.15.52:6801/2968015226","cluster_addr":"172.21.15.52:6803/2968015226","heartbeat_back_addr":"172.21.15.52:6807/2968015226","heartbeat_front_addr":"172.21.15.52:6805/2968015226","state":["exists","up"]},{"osd":1,"uuid":"7c018fda-e9f2-4c52-93f6-a59ac120be0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6801","nonce":103268966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6804","nonce":103268966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6812","nonce":103268966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6808","nonce":103268966}]},"public_addr":"172.21.15.151:6801/103268966","cluster_addr":"172.21.15.151:6804/103268966","heartbeat_back_addr":"172.21.15.151:6812/103268966","heartbeat_front_addr":"172.21.15.151:6808/103268966","state":["exists","up"]},{"osd":2,"uuid":"a41e1739-74f0-4db9-b9f3-99660c90654a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6817","nonce":2885613778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6819","nonce":2885613778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6823","nonce":2885613778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6821","nonce":2885613778}]},"public_addr":"172.21.15.151:6817/2885613778","cluster_addr":"172.21.15.151:6819/2885613778","heartbeat_back_addr":"172.21.15.151:6823/2885613778","heartbeat_front_addr":"172.21.15.151:6821/2885613778","state":["exists","up"]},{"osd":3,"uuid":"a7ff38f7-1d09-4389-b358-dfbc9302cd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6805","nonce":3136276598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6809","nonce":3136276598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6815","nonce":3136276598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6811","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6813","nonce":3136276598}]},"public_addr":"172.21.15.151:6805/3136276598","cluster_addr":"172.21.15.151:6809/3136276598","heartbeat_back_addr":"172.21.15.151:6815/3136276598","heartbeat_front_addr":"172.21.15.151:6813/3136276598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.162035+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.133963+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.782040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.263429+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T14:28:22.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc950035db0 msgr2=0x7fc950038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 --2- 172.21.15.52:0/2433828995 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc950035db0 0x7fc950038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc95c007fd0 tx=0x7fc95c007980 comp rx=0 tx=0).stop 2024-09-10T14:28:22.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 msgr2=0x7fc96c1279b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 --2- 172.21.15.52:0/2433828995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c1279b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc968019fa0 tx=0x7fc96801abb0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 shutdown_connections 2024-09-10T14:28:22.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 --2- 172.21.15.52:0/2433828995 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc950035db0 0x7fc950038270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 --2- 172.21.15.52:0/2433828995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c06d0e0 0x7fc96c1279b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 >> 172.21.15.52:0/2433828995 conn(0x7fc96c099a50 msgr2=0x7fc96c131c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 shutdown_connections 2024-09-10T14:28:22.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.315+0000 7fc973a3f640 1 -- 172.21.15.52:0/2433828995 wait complete. 2024-09-10T14:28:22.336 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T14:28:22.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T14:28:22.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T14:28:22.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T14:28:22.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5d6fbc640 1 Processor -- start 2024-09-10T14:28:22.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4608375640 1 Processor -- start 2024-09-10T14:28:22.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5d6fbc640 1 -- start start 2024-09-10T14:28:22.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4608375640 1 -- start start 2024-09-10T14:28:22.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5d6fbc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe5d012f390 0x7fe5d0133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5d6fbc640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d00984f0 con 0x7fe5d012e760 2024-09-10T14:28:22.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5d6fbc640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d0098dc0 con 0x7fe5d012f390 2024-09-10T14:28:22.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4608375640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f460012f390 0x7f4600133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4608375640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46000984f0 con 0x7f460012e760 2024-09-10T14:28:22.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4608375640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4600098dc0 con 0x7f460012f390 2024-09-10T14:28:22.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4605910640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f460012f390 0x7f4600133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4605910640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f460012f390 0x7f4600133a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33822/0 (socket says 172.21.15.52:33822) 2024-09-10T14:28:22.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4605910640 1 -- 172.21.15.52:0/1298459825 learned_addr learned my addr 172.21.15.52:0/1298459825 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fafda59d640 1 Processor -- start 2024-09-10T14:28:22.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5cffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe5d012f390 0x7fe5d0133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5d4d58640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe5d012e760 0x7fe5d012ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47738/0 (socket says 172.21.15.52:47738) 2024-09-10T14:28:22.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5d4d58640 1 -- 172.21.15.52:0/922657902 learned_addr learned my addr 172.21.15.52:0/922657902 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:22.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fafda59d640 1 -- start start 2024-09-10T14:28:22.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4605910640 1 -- 172.21.15.52:0/1298459825 >> v1:172.21.15.52:6789/0 conn(0x7f460012e760 legacy=0x7f460012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7f4605910640 1 -- 172.21.15.52:0/1298459825 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46000981a0 con 0x7f460012f390 2024-09-10T14:28:22.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5cf7fe640 1 -- 172.21.15.52:0/922657902 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865566213 0 0) 0x7fe5d00984f0 con 0x7fe5d012e760 2024-09-10T14:28:22.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5cf7fe640 1 -- 172.21.15.52:0/922657902 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5c0003530 con 0x7fe5d012e760 2024-09-10T14:28:22.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5cffff640 1 -- 172.21.15.52:0/922657902 >> v1:172.21.15.52:6789/0 conn(0x7fe5d012e760 legacy=0x7fe5d012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fe5cffff640 1 -- 172.21.15.52:0/922657902 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d00981a0 con 0x7fe5d012f390 2024-09-10T14:28:22.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fafda59d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fafd406d680 0x7fafd406da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fafda59d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd40985e0 con 0x7fafd406dfa0 2024-09-10T14:28:22.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fafda59d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fafd4098a20 con 0x7fafd406d680 2024-09-10T14:28:22.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fafd3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fafd406d680 0x7fafd406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fafd3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fafd406d680 0x7fafd406da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33836/0 (socket says 172.21.15.52:33836) 2024-09-10T14:28:22.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.439+0000 7fafd3fff640 1 -- 172.21.15.52:0/885319107 learned_addr learned my addr 172.21.15.52:0/885319107 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fafd3fff640 1 -- 172.21.15.52:0/885319107 >> v1:172.21.15.52:6789/0 conn(0x7fafd406dfa0 legacy=0x7fafd412e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fafd3fff640 1 -- 172.21.15.52:0/885319107 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd406e3c0 con 0x7fafd406d680 2024-09-10T14:28:22.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fafd2ffd640 1 -- 172.21.15.52:0/885319107 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2794526742 0 0) 0x7fafd40985e0 con 0x7fafd406dfa0 2024-09-10T14:28:22.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4605910640 1 --2- 172.21.15.52:0/1298459825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012f390 0x7f4600133a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45f00097f0 tx=0x7f45f001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b812112874271e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5cffff640 1 --2- 172.21.15.52:0/922657902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012f390 0x7fe5d0133a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009740 tx=0x7fe5bc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69f164cd2682ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f460510f640 1 -- 172.21.15.52:0/1298459825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00b1070 con 0x7f460012f390 2024-09-10T14:28:22.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5cf7fe640 1 -- 172.21.15.52:0/922657902 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5bc0b1070 con 0x7fe5d012f390 2024-09-10T14:28:22.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5cf7fe640 1 -- 172.21.15.52:0/922657902 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0ac570 con 0x7fe5d012f390 2024-09-10T14:28:22.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5cf7fe640 1 -- 172.21.15.52:0/922657902 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5bc0ac870 con 0x7fe5d012f390 2024-09-10T14:28:22.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/922657902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012f390 msgr2=0x7fe5d0133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 --2- 172.21.15.52:0/922657902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012f390 0x7fe5d0133a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009740 tx=0x7fe5bc01c420 comp rx=0 tx=0).stop 2024-09-10T14:28:22.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f460510f640 1 -- 172.21.15.52:0/1298459825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f00ac560 con 0x7f460012f390 2024-09-10T14:28:22.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f460510f640 1 -- 172.21.15.52:0/1298459825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45f00a8050 con 0x7f460012f390 2024-09-10T14:28:22.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 -- 172.21.15.52:0/1298459825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012f390 msgr2=0x7f4600133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 --2- 172.21.15.52:0/1298459825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012f390 0x7f4600133a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45f00097f0 tx=0x7f45f001c4c0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/922657902 shutdown_connections 2024-09-10T14:28:22.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 --2- 172.21.15.52:0/922657902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012f390 0x7fe5d0133a80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/922657902 >> 172.21.15.52:0/922657902 conn(0x7fe5d00a10a0 msgr2=0x7fe5d00a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/922657902 shutdown_connections 2024-09-10T14:28:22.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/922657902 wait complete. 2024-09-10T14:28:22.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 -- 172.21.15.52:0/1298459825 shutdown_connections 2024-09-10T14:28:22.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 --2- 172.21.15.52:0/1298459825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012f390 0x7f4600133a80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 -- 172.21.15.52:0/1298459825 >> 172.21.15.52:0/1298459825 conn(0x7f46000a10a0 msgr2=0x7f46000a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 -- 172.21.15.52:0/1298459825 shutdown_connections 2024-09-10T14:28:22.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 -- 172.21.15.52:0/1298459825 wait complete. 2024-09-10T14:28:22.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fafd3fff640 1 --2- 172.21.15.52:0/885319107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd406da60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafc40097f0 tx=0x7fafc401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fa61bb6263f178 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 Processor -- start 2024-09-10T14:28:22.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fafd2ffd640 1 -- 172.21.15.52:0/885319107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc40b0070 con 0x7fafd406d680 2024-09-10T14:28:22.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fafd2ffd640 1 -- 172.21.15.52:0/885319107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc40ab530 con 0x7fafd406d680 2024-09-10T14:28:22.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fafd2ffd640 1 -- 172.21.15.52:0/885319107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc40ab830 con 0x7fafd406d680 2024-09-10T14:28:22.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 -- start start 2024-09-10T14:28:22.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 Processor -- start 2024-09-10T14:28:22.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012e760 0x7fe5d012f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7fe5d6fbc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d0136b70 con 0x7fe5d012e760 2024-09-10T14:28:22.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.443+0000 7f4608375640 1 -- start start 2024-09-10T14:28:22.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- 172.21.15.52:0/885319107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 msgr2=0x7fafd406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 --2- 172.21.15.52:0/885319107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd406da60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafc40097f0 tx=0x7fafc401c430 comp rx=0 tx=0).stop 2024-09-10T14:28:22.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- 172.21.15.52:0/885319107 shutdown_connections 2024-09-10T14:28:22.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 --2- 172.21.15.52:0/885319107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd406da60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- 172.21.15.52:0/885319107 >> 172.21.15.52:0/885319107 conn(0x7fafd409f0b0 msgr2=0x7fafd409f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- 172.21.15.52:0/885319107 shutdown_connections 2024-09-10T14:28:22.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4608375640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012e760 0x7f46000937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4608375640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4600136b70 con 0x7f460012e760 2024-09-10T14:28:22.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4606111640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012e760 0x7f46000937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d4d58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012e760 0x7fe5d012f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d4d58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012e760 0x7fe5d012f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33840/0 (socket says 172.21.15.52:33840) 2024-09-10T14:28:22.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d4d58640 1 -- 172.21.15.52:0/3255704394 learned_addr learned my addr 172.21.15.52:0/3255704394 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4606111640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012e760 0x7f46000937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33848/0 (socket says 172.21.15.52:33848) 2024-09-10T14:28:22.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4606111640 1 -- 172.21.15.52:0/1697380156 learned_addr learned my addr 172.21.15.52:0/1697380156 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- 172.21.15.52:0/885319107 wait complete. 2024-09-10T14:28:22.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d4d58640 1 -- 172.21.15.52:0/3255704394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d0131380 con 0x7fe5d012e760 2024-09-10T14:28:22.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4606111640 1 -- 172.21.15.52:0/1697380156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4600094980 con 0x7f460012e760 2024-09-10T14:28:22.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d4d58640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012e760 0x7fe5d012f850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c450 tx=0x7fe5c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c4017070 con 0x7fe5d012e760 2024-09-10T14:28:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c4005c20 con 0x7fe5d012e760 2024-09-10T14:28:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d0131ff0 con 0x7fe5d012e760 2024-09-10T14:28:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5c4007070 con 0x7fe5d012e760 2024-09-10T14:28:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d0097e60 con 0x7fe5d012e760 2024-09-10T14:28:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4606111640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012e760 0x7f46000937e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00c3a0 tx=0x7f45fc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 Processor -- start 2024-09-10T14:28:22.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- start start 2024-09-10T14:28:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5d012ec80 con 0x7fe5d012e760 2024-09-10T14:28:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd40972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4137440 con 0x7fafd406d680 2024-09-10T14:28:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45fc005150 con 0x7f460012e760 2024-09-10T14:28:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4600095150 con 0x7f460012e760 2024-09-10T14:28:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460012b5e0 con 0x7f460012e760 2024-09-10T14:28:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45fc0052f0 con 0x7f460012e760 2024-09-10T14:28:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45fc0067e0 con 0x7f460012e760 2024-09-10T14:28:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe5c401a070 con 0x7fe5d012e760 2024-09-10T14:28:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7effcb925640 1 Processor -- start 2024-09-10T14:28:22.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe5b4035db0 0x7fe5b4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe5c4047a10 con 0x7fe5d012e760 2024-09-10T14:28:22.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe5b403b530 0x7fe5b403d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5c4013e50 con 0x7fe5b403b530 2024-09-10T14:28:22.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe5c40198b0 con 0x7fe5d012e760 2024-09-10T14:28:22.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7effcb925640 1 -- start start 2024-09-10T14:28:22.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d5559640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe5b403b530 0x7fe5b403d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cffff640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe5b4035db0 0x7fe5b4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45e8000f90 con 0x7f460012e760 2024-09-10T14:28:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f45fc019020 con 0x7f460012e760 2024-09-10T14:28:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd40972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd40972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33856/0 (socket says 172.21.15.52:33856) 2024-09-10T14:28:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7effcb925640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7effc4096500 0x7effc40968e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafd3fff640 1 -- 172.21.15.52:0/1098823545 learned_addr learned my addr 172.21.15.52:0/1098823545 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafd3fff640 1 -- 172.21.15.52:0/1098823545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd4128ea0 con 0x7fafd406d680 2024-09-10T14:28:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7effcb925640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc409cbe0 con 0x7effc4096e20 2024-09-10T14:28:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7effcb925640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7effc409deb0 con 0x7effc4096500 2024-09-10T14:28:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5d5559640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe5b403b530 0x7fe5b403d9b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7effc8ec0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7effc4096e20 0x7effc40930c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47780/0 (socket says 172.21.15.52:47780) 2024-09-10T14:28:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7effc8ec0640 1 -- 172.21.15.52:0/1876093870 learned_addr learned my addr 172.21.15.52:0/1876093870 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafd3fff640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd40972f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafc401a060 tx=0x7fafc401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f45e4035d60 0x7f45e4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f45fc047990 con 0x7f460012e760 2024-09-10T14:28:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f45e403b4e0 0x7f45e403d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45fc012e50 con 0x7f45e403b4e0 2024-09-10T14:28:22.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f45fc006a90 con 0x7f460012e760 2024-09-10T14:28:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fe5cffff640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe5b4035db0 0x7fe5b4038270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0ae000 tx=0x7fe5bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7effc96c1640 1 --2- 172.21.15.52:0/1876093870 >> v2:172.21.15.52:3300/0 conn(0x7effc4096500 0x7effc40968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc40ba020 con 0x7fafd406d680 2024-09-10T14:28:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc40aa800 con 0x7fafd406d680 2024-09-10T14:28:22.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd4133f30 con 0x7fafd406d680 2024-09-10T14:28:22.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effc96c1640 1 -- 172.21.15.52:0/1876093870 >> v1:172.21.15.52:6789/0 conn(0x7effc4096e20 legacy=0x7effc40930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effc96c1640 1 -- 172.21.15.52:0/1876093870 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc409c5d0 con 0x7effc4096500 2024-09-10T14:28:22.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd4133070 con 0x7fafd406d680 2024-09-10T14:28:22.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.447+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc40b0040 con 0x7fafd406d680 2024-09-10T14:28:22.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5c4013e50 con 0x7fe5b403b530 2024-09-10T14:28:22.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fafb4000f90 con 0x7fafd406d680 2024-09-10T14:28:22.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fafc40bd020 con 0x7fafd406d680 2024-09-10T14:28:22.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd0ff9640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fafc0035e50 0x7fafc0038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7f4605910640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f45e4035d60 0x7f45e4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fafc40e2d70 con 0x7fafd406d680 2024-09-10T14:28:22.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7f4606912640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f45e403b4e0 0x7f45e403d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd0ff9640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fafc003b5d0 0x7fafc003da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafc40bae80 con 0x7fafc003b5d0 2024-09-10T14:28:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fafc40b5ac0 con 0x7fafd406d680 2024-09-10T14:28:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd37fe640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fafc0035e50 0x7fafc0038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd8b3a640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fafc003b5d0 0x7fafc003da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7f4606912640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f45e403b4e0 0x7f45e403d960 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7f4605910640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f45e4035d60 0x7f45e4038220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f45f00ae000 tx=0x7f45f00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd8b3a640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fafc003b5d0 0x7fafc003da50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effc96c1640 1 --2- 172.21.15.52:0/1876093870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096500 0x7effc40968e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7effb4009740 tx=0x7effb401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a859431659c85a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7fafd37fe640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fafc0035e50 0x7fafc0038310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fafc8000f70 tx=0x7fafc8007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effbbfff640 1 -- 172.21.15.52:0/1876093870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb40b0070 con 0x7effc4096500 2024-09-10T14:28:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effbbfff640 1 -- 172.21.15.52:0/1876093870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb40ab530 con 0x7effc4096500 2024-09-10T14:28:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effbbfff640 1 -- 172.21.15.52:0/1876093870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb40ab830 con 0x7effc4096500 2024-09-10T14:28:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effcb925640 1 -- 172.21.15.52:0/1876093870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096500 msgr2=0x7effc40968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effcb925640 1 --2- 172.21.15.52:0/1876093870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096500 0x7effc40968e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7effb4009740 tx=0x7effb401c370 comp rx=0 tx=0).stop 2024-09-10T14:28:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effcb925640 1 -- 172.21.15.52:0/1876093870 shutdown_connections 2024-09-10T14:28:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effcb925640 1 --2- 172.21.15.52:0/1876093870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096500 0x7effc40968e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effcb925640 1 -- 172.21.15.52:0/1876093870 >> 172.21.15.52:0/1876093870 conn(0x7effc409b450 msgr2=0x7effc409b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effcb925640 1 -- 172.21.15.52:0/1876093870 shutdown_connections 2024-09-10T14:28:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.451+0000 7effcb925640 1 -- 172.21.15.52:0/1876093870 wait complete. 2024-09-10T14:28:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45fc012e50 con 0x7f45e403b4e0 2024-09-10T14:28:22.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafc40bae80 con 0x7fafc003b5d0 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effcb925640 1 Processor -- start 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effcb925640 1 -- start start 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effcb925640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096e20 0x7effc40717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effcb925640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7effc4133d90 con 0x7effc4096e20 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effc96c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096e20 0x7effc40717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effc96c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096e20 0x7effc40717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33880/0 (socket says 172.21.15.52:33880) 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effc96c1640 1 -- 172.21.15.52:0/1390503458 learned_addr learned my addr 172.21.15.52:0/1390503458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effc96c1640 1 -- 172.21.15.52:0/1390503458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc4124300 con 0x7effc4096e20 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effc96c1640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096e20 0x7effc40717f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effb40ae040 tx=0x7effb4019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb40b8020 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb40b4410 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc41238a0 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb40b0040 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc4122e90 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effc4122620 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.455+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7effb40bb020 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effb9ffb640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7effa8035db0 0x7effa8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7effb40e2310 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effb9ffb640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7effa803b530 0x7effa803d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effb40ace50 con 0x7effa803b530 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7effb40e9050 con 0x7effc4096e20 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effc8ec0640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7effa8035db0 0x7effa8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effc9ec2640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7effa803b530 0x7effa803d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effc9ec2640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7effa803b530 0x7effa803d9b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effc8ec0640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7effa8035db0 0x7effa8038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7effc0001610 tx=0x7effc0007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.459+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effb40ace50 con 0x7effa803b530 2024-09-10T14:28:22.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5d0133280 con 0x7fe5b403b530 2024-09-10T14:28:22.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5cd7fa640 1 -- 172.21.15.52:0/3255704394 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe5d0133280 con 0x7fe5b403b530 2024-09-10T14:28:22.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe5b403b530 msgr2=0x7fe5b403d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe5b403b530 0x7fe5b403d9b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe5b4035db0 msgr2=0x7fe5b4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe5b4035db0 0x7fe5b4038270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0ae000 tx=0x7fe5bc008040 comp rx=0 tx=0).stop 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012e760 msgr2=0x7fe5d012f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012e760 0x7fe5d012f850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c450 tx=0x7fe5c400c910 comp rx=0 tx=0).stop 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 shutdown_connections 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe5b403b530 0x7fe5b403d9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe5b4035db0 0x7fe5b4038270 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 --2- 172.21.15.52:0/3255704394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5d012e760 0x7fe5d012f850 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 >> 172.21.15.52:0/3255704394 conn(0x7fe5d00a10a0 msgr2=0x7fe5d0128010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 shutdown_connections 2024-09-10T14:28:22.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7fe5d6fbc640 1 -- 172.21.15.52:0/3255704394 wait complete. 2024-09-10T14:28:22.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.467+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45e8002c80 con 0x7f45e403b4e0 2024-09-10T14:28:22.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f45f6ffd640 1 -- 172.21.15.52:0/1697380156 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f45e8002c80 con 0x7f45e403b4e0 2024-09-10T14:28:22.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f45e403b4e0 msgr2=0x7f45e403d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f45e403b4e0 0x7f45e403d960 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f45e4035d60 msgr2=0x7f45e4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f45e4035d60 0x7f45e4038220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f45f00ae000 tx=0x7f45f00a7000 comp rx=0 tx=0).stop 2024-09-10T14:28:22.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012e760 msgr2=0x7f46000937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012e760 0x7f46000937e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00c3a0 tx=0x7f45fc00c860 comp rx=0 tx=0).stop 2024-09-10T14:28:22.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fafb4002c80 con 0x7fafc003b5d0 2024-09-10T14:28:22.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 shutdown_connections 2024-09-10T14:28:22.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f45e403b4e0 0x7f45e403d960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f45e4035d60 0x7f45e4038220 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 --2- 172.21.15.52:0/1697380156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460012e760 0x7f46000937e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 >> 172.21.15.52:0/1697380156 conn(0x7f46000a10a0 msgr2=0x7f46000972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 shutdown_connections 2024-09-10T14:28:22.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7f4608375640 1 -- 172.21.15.52:0/1697380156 wait complete. 2024-09-10T14:28:22.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafd0ff9640 1 -- 172.21.15.52:0/1098823545 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fafb4002c80 con 0x7fafc003b5d0 2024-09-10T14:28:22.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fafc003b5d0 msgr2=0x7fafc003da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fafc003b5d0 0x7fafc003da50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fafc0035e50 msgr2=0x7fafc0038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fafc0035e50 0x7fafc0038310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fafc8000f70 tx=0x7fafc8007910 comp rx=0 tx=0).stop 2024-09-10T14:28:22.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 msgr2=0x7fafd40972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd40972f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafc401a060 tx=0x7fafc401ac70 comp rx=0 tx=0).stop 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 shutdown_connections 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fafc003b5d0 0x7fafc003da50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fafc0035e50 0x7fafc0038310 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 --2- 172.21.15.52:0/1098823545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafd406d680 0x7fafd40972f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 >> 172.21.15.52:0/1098823545 conn(0x7fafd409f0b0 msgr2=0x7fafd4127e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 shutdown_connections 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.471+0000 7fafda59d640 1 -- 172.21.15.52:0/1098823545 wait complete. 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.475+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7effc4123640 con 0x7effa803b530 2024-09-10T14:28:22.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.475+0000 7effb9ffb640 1 -- 172.21.15.52:0/1390503458 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7effc4123640 con 0x7effa803b530 2024-09-10T14:28:22.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.475+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7effa803b530 msgr2=0x7effa803d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.475+0000 7effcb925640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7effa803b530 0x7effa803d9b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.475+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7effa8035db0 msgr2=0x7effa8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.475+0000 7effcb925640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7effa8035db0 0x7effa8038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7effc0001610 tx=0x7effc0007ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.475+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096e20 msgr2=0x7effc40717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.475+0000 7effcb925640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096e20 0x7effc40717f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effb40ae040 tx=0x7effb4019130 comp rx=0 tx=0).stop 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.479+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 shutdown_connections 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.479+0000 7effcb925640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7effa803b530 0x7effa803d9b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.479+0000 7effcb925640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7effa8035db0 0x7effa8038270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.479+0000 7effcb925640 1 --2- 172.21.15.52:0/1390503458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc4096e20 0x7effc40717f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.479+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 >> 172.21.15.52:0/1390503458 conn(0x7effc409b450 msgr2=0x7effc4097950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.479+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 shutdown_connections 2024-09-10T14:28:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.479+0000 7effcb925640 1 -- 172.21.15.52:0/1390503458 wait complete. 2024-09-10T14:28:22.495 INFO:teuthology.orchestra.run.smithi052.stdout:42949672966 2024-09-10T14:28:22.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T14:28:22.498 INFO:teuthology.orchestra.run.smithi052.stdout:38654705668 2024-09-10T14:28:22.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T14:28:22.501 INFO:teuthology.orchestra.run.smithi052.stdout:42949672966 2024-09-10T14:28:22.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T14:28:22.503 INFO:teuthology.orchestra.run.smithi052.stdout:47244640262 2024-09-10T14:28:22.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T14:28:22.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29ca9c5640 1 Processor -- start 2024-09-10T14:28:22.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29ca9c5640 1 -- start start 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29ca9c5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29c406bc50 0x7f29c412ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29ca9c5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c4097c50 con 0x7f29c412f2c0 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29ca9c5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f29c40500e0 con 0x7f29c406bc50 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29c3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29c406bc50 0x7f29c412ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29c37fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f29c412f2c0 0x7f29c4096400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47786/0 (socket says 172.21.15.52:47786) 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29c37fe640 1 -- 172.21.15.52:0/1442319788 learned_addr learned my addr 172.21.15.52:0/1442319788 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29c3fff640 1 -- 172.21.15.52:0/1442319788 >> v1:172.21.15.52:6789/0 conn(0x7f29c412f2c0 legacy=0x7f29c4096400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29c2ffd640 1 -- 172.21.15.52:0/1442319788 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571315358 0 0) 0x7f29c4097c50 con 0x7f29c412f2c0 2024-09-10T14:28:22.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.599+0000 7f29c3fff640 1 -- 172.21.15.52:0/1442319788 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c406c440 con 0x7f29c406bc50 2024-09-10T14:28:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29c3fff640 1 --2- 172.21.15.52:0/1442319788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c412ed80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009740 tx=0x7f29b401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b576604d07820495 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29c2ffd640 1 -- 172.21.15.52:0/1442319788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b40b1070 con 0x7f29c406bc50 2024-09-10T14:28:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29c2ffd640 1 -- 172.21.15.52:0/1442319788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b40ac570 con 0x7f29c406bc50 2024-09-10T14:28:22.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29c2ffd640 1 -- 172.21.15.52:0/1442319788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b40ac870 con 0x7f29c406bc50 2024-09-10T14:28:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 -- 172.21.15.52:0/1442319788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 msgr2=0x7f29c412ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 --2- 172.21.15.52:0/1442319788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c412ed80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009740 tx=0x7f29b401c400 comp rx=0 tx=0).stop 2024-09-10T14:28:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 -- 172.21.15.52:0/1442319788 shutdown_connections 2024-09-10T14:28:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 --2- 172.21.15.52:0/1442319788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c412ed80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 -- 172.21.15.52:0/1442319788 >> 172.21.15.52:0/1442319788 conn(0x7f29c409ab00 msgr2=0x7f29c409af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 -- 172.21.15.52:0/1442319788 shutdown_connections 2024-09-10T14:28:22.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 -- 172.21.15.52:0/1442319788 wait complete. 2024-09-10T14:28:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7fcfa2afe640 1 Processor -- start 2024-09-10T14:28:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7fcfa2afe640 1 -- start start 2024-09-10T14:28:22.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 Processor -- start 2024-09-10T14:28:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.603+0000 7f29ca9c5640 1 -- start start 2024-09-10T14:28:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcfa2afe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcf9c12eba0 0x7fcf9c12ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcfa2afe640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf9c073090 con 0x7fcf9c12f4c0 2024-09-10T14:28:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcfa2afe640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcf9c06f260 con 0x7fcf9c12eba0 2024-09-10T14:28:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcfa089a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcf9c12eba0 0x7fcf9c12ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcf9bfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcf9c12f4c0 0x7fcf9c06e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47794/0 (socket says 172.21.15.52:47794) 2024-09-10T14:28:22.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcf9bfff640 1 -- 172.21.15.52:0/2966494889 learned_addr learned my addr 172.21.15.52:0/2966494889 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:22.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29ca9c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29ca9c5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f29c41371f0 con 0x7f29c406bc50 2024-09-10T14:28:22.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c406de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33922/0 (socket says 172.21.15.52:33922) 2024-09-10T14:28:22.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c3fff640 1 -- 172.21.15.52:0/3358575947 learned_addr learned my addr 172.21.15.52:0/3358575947 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcfa089a640 1 -- 172.21.15.52:0/2966494889 >> v1:172.21.15.52:6789/0 conn(0x7fcf9c12f4c0 legacy=0x7fcf9c06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcfa089a640 1 -- 172.21.15.52:0/2966494889 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c06beb0 con 0x7fcf9c12eba0 2024-09-10T14:28:22.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c3fff640 1 -- 172.21.15.52:0/3358575947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c40943f0 con 0x7f29c406bc50 2024-09-10T14:28:22.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c3fff640 1 --2- 172.21.15.52:0/3358575947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c406de80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f29b401a030 tx=0x7f29b401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c0ff9640 1 -- 172.21.15.52:0/3358575947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b40b1050 con 0x7f29c406bc50 2024-09-10T14:28:22.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c0ff9640 1 -- 172.21.15.52:0/3358575947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b40b2040 con 0x7f29c406bc50 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c4070d80 con 0x7f29c406bc50 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c0ff9640 1 -- 172.21.15.52:0/3358575947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b40aaae0 con 0x7f29c406bc50 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c406e3c0 con 0x7f29c406bc50 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c0ff9640 1 -- 172.21.15.52:0/3358575947 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f29b40bf030 con 0x7f29c406bc50 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c0ff9640 1 --2- 172.21.15.52:0/3358575947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f29b0035db0 0x7f29b0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c0ff9640 1 -- 172.21.15.52:0/3358575947 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f29b40bd070 con 0x7f29c406bc50 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c37fe640 1 --2- 172.21.15.52:0/3358575947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f29b0035db0 0x7f29b0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c412ed80 con 0x7f29c406bc50 2024-09-10T14:28:22.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7fcfa089a640 1 --2- 172.21.15.52:0/2966494889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c12ef80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009740 tx=0x7fcf9001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38b936ad2cb234a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.607+0000 7f29c37fe640 1 --2- 172.21.15.52:0/3358575947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f29b0035db0 0x7f29b0038270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29b8007fd0 tx=0x7f29b8007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcf9b7fe640 1 -- 172.21.15.52:0/2966494889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf900b1070 con 0x7fcf9c12eba0 2024-09-10T14:28:22.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcf9b7fe640 1 -- 172.21.15.52:0/2966494889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf900ac520 con 0x7fcf9c12eba0 2024-09-10T14:28:22.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcf9b7fe640 1 -- 172.21.15.52:0/2966494889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf900ac820 con 0x7fcf9c12eba0 2024-09-10T14:28:22.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7f29c0ff9640 1 -- 172.21.15.52:0/3358575947 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29b40c6020 con 0x7f29c406bc50 2024-09-10T14:28:22.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 -- 172.21.15.52:0/2966494889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 msgr2=0x7fcf9c12ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 --2- 172.21.15.52:0/2966494889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c12ef80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009740 tx=0x7fcf9001c370 comp rx=0 tx=0).stop 2024-09-10T14:28:22.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 -- 172.21.15.52:0/2966494889 shutdown_connections 2024-09-10T14:28:22.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 --2- 172.21.15.52:0/2966494889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c12ef80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 -- 172.21.15.52:0/2966494889 >> 172.21.15.52:0/2966494889 conn(0x7fcf9c09a6f0 msgr2=0x7fcf9c09ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 -- 172.21.15.52:0/2966494889 shutdown_connections 2024-09-10T14:28:22.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 -- 172.21.15.52:0/2966494889 wait complete. 2024-09-10T14:28:22.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 Processor -- start 2024-09-10T14:28:22.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 -- start start 2024-09-10T14:28:22.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c0961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa2afe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c137010 con 0x7fcf9c12eba0 2024-09-10T14:28:22.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa089a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c0961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa089a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c0961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33934/0 (socket says 172.21.15.52:33934) 2024-09-10T14:28:22.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa089a640 1 -- 172.21.15.52:0/270472060 learned_addr learned my addr 172.21.15.52:0/270472060 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.619+0000 7fcfa089a640 1 -- 172.21.15.52:0/270472060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c097210 con 0x7fcf9c12eba0 2024-09-10T14:28:22.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcfa089a640 1 --2- 172.21.15.52:0/270472060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c0961b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf9001aa20 tx=0x7fcf9001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcf997fa640 1 -- 172.21.15.52:0/270472060 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf900b1050 con 0x7fcf9c12eba0 2024-09-10T14:28:22.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcf997fa640 1 -- 172.21.15.52:0/270472060 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf900b2040 con 0x7fcf9c12eba0 2024-09-10T14:28:22.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9c095800 con 0x7fcf9c12eba0 2024-09-10T14:28:22.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcf997fa640 1 -- 172.21.15.52:0/270472060 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf900b6740 con 0x7fcf9c12eba0 2024-09-10T14:28:22.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9c0966f0 con 0x7fcf9c12eba0 2024-09-10T14:28:22.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcf997fa640 1 -- 172.21.15.52:0/270472060 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf900bf030 con 0x7fcf9c12eba0 2024-09-10T14:28:22.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9c12ef80 con 0x7fcf9c12eba0 2024-09-10T14:28:22.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcf997fa640 1 --2- 172.21.15.52:0/270472060 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcf80035db0 0x7fcf80038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcf997fa640 1 -- 172.21.15.52:0/270472060 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fcf900bd070 con 0x7fcf9c12eba0 2024-09-10T14:28:22.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcf9bfff640 1 --2- 172.21.15.52:0/270472060 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcf80035db0 0x7fcf80038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.623+0000 7fcf9bfff640 1 --2- 172.21.15.52:0/270472060 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcf80035db0 0x7fcf80038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf88001610 tx=0x7fcf88007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.631+0000 7fcf997fa640 1 -- 172.21.15.52:0/270472060 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf900c6020 con 0x7fcf9c12eba0 2024-09-10T14:28:22.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.651+0000 7f71bb0a3640 1 Processor -- start 2024-09-10T14:28:22.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.651+0000 7f71bb0a3640 1 -- start start 2024-09-10T14:28:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f71b412f390 0x7f71b4133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b40984f0 con 0x7f71b412e760 2024-09-10T14:28:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f71b4098dc0 con 0x7f71b412f390 2024-09-10T14:28:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f71b412f390 0x7f71b4133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b8e3f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f71b412e760 0x7f71b412ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47808/0 (socket says 172.21.15.52:47808) 2024-09-10T14:28:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b8e3f640 1 -- 172.21.15.52:0/1681459691 learned_addr learned my addr 172.21.15.52:0/1681459691 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:22.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f71b412f390 0x7f71b4133a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33948/0 (socket says 172.21.15.52:33948) 2024-09-10T14:28:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b3fff640 1 -- 172.21.15.52:0/1681459691 >> v1:172.21.15.52:6789/0 conn(0x7f71b412e760 legacy=0x7f71b412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b3fff640 1 -- 172.21.15.52:0/1681459691 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b40981a0 con 0x7f71b412f390 2024-09-10T14:28:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b3fff640 1 --2- 172.21.15.52:0/1681459691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412f390 0x7f71b4133a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009740 tx=0x7f71a001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b6fb5fe7898400 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b37fe640 1 -- 172.21.15.52:0/1681459691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a00b1070 con 0x7f71b412f390 2024-09-10T14:28:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b37fe640 1 -- 172.21.15.52:0/1681459691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a00ac570 con 0x7f71b412f390 2024-09-10T14:28:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71b37fe640 1 -- 172.21.15.52:0/1681459691 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a00ac870 con 0x7f71b412f390 2024-09-10T14:28:22.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 -- 172.21.15.52:0/1681459691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412f390 msgr2=0x7f71b4133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 --2- 172.21.15.52:0/1681459691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412f390 0x7f71b4133a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009740 tx=0x7f71a001c400 comp rx=0 tx=0).stop 2024-09-10T14:28:22.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 -- 172.21.15.52:0/1681459691 shutdown_connections 2024-09-10T14:28:22.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 --2- 172.21.15.52:0/1681459691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412f390 0x7f71b4133a80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 -- 172.21.15.52:0/1681459691 >> 172.21.15.52:0/1681459691 conn(0x7f71b40a10a0 msgr2=0x7f71b40a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 -- 172.21.15.52:0/1681459691 shutdown_connections 2024-09-10T14:28:22.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.655+0000 7f71bb0a3640 1 -- 172.21.15.52:0/1681459691 wait complete. 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71bb0a3640 1 Processor -- start 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71bb0a3640 1 -- start start 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71bb0a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412e760 0x7f71b40963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71bb0a3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f71b4136b70 con 0x7f71b412e760 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b8e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412e760 0x7f71b40963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b8e3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412e760 0x7f71b40963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33950/0 (socket says 172.21.15.52:33950) 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b8e3f640 1 -- 172.21.15.52:0/42869771 learned_addr learned my addr 172.21.15.52:0/42869771 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b8e3f640 1 -- 172.21.15.52:0/42869771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b4131730 con 0x7f71b412e760 2024-09-10T14:28:22.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b8e3f640 1 --2- 172.21.15.52:0/42869771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412e760 0x7f71b40963d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c480 tx=0x7f71a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b17fa640 1 -- 172.21.15.52:0/42869771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a8017070 con 0x7f71b412e760 2024-09-10T14:28:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b17fa640 1 -- 172.21.15.52:0/42869771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a8005c20 con 0x7f71b412e760 2024-09-10T14:28:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b4128f50 con 0x7f71b412e760 2024-09-10T14:28:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b17fa640 1 -- 172.21.15.52:0/42869771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71a8007070 con 0x7f71b412e760 2024-09-10T14:28:22.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b4131da0 con 0x7f71b412e760 2024-09-10T14:28:22.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b17fa640 1 -- 172.21.15.52:0/42869771 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f71a801a070 con 0x7f71b412e760 2024-09-10T14:28:22.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b17fa640 1 --2- 172.21.15.52:0/42869771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7198035d40 0x7f7198038200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b17fa640 1 -- 172.21.15.52:0/42869771 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f71a804b120 con 0x7f71b412e760 2024-09-10T14:28:22.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b412de00 con 0x7f71b412e760 2024-09-10T14:28:22.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.659+0000 7f71b3fff640 1 --2- 172.21.15.52:0/42869771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7198035d40 0x7f7198038200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f71b3fff640 1 --2- 172.21.15.52:0/42869771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7198035d40 0x7f7198038200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f71a00ae000 tx=0x7f71a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f0492f76640 1 Processor -- start 2024-09-10T14:28:22.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f0492f76640 1 -- start start 2024-09-10T14:28:22.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f0492f76640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f048c131920 0x7f048c133d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f048bfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f048c131920 0x7f048c133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f0492f76640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c06e560 con 0x7f048c06e180 2024-09-10T14:28:22.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f0492f76640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f048c06ee90 con 0x7f048c131920 2024-09-10T14:28:22.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f0490d12640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f048c06e180 0x7f048c12ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47822/0 (socket says 172.21.15.52:47822) 2024-09-10T14:28:22.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.663+0000 7f0490d12640 1 -- 172.21.15.52:0/3952040378 learned_addr learned my addr 172.21.15.52:0/3952040378 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:22.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.667+0000 7f048bfff640 1 -- 172.21.15.52:0/3952040378 >> v1:172.21.15.52:6789/0 conn(0x7f048c06e180 legacy=0x7f048c12ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.667+0000 7f048bfff640 1 -- 172.21.15.52:0/3952040378 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c12f3d0 con 0x7f048c131920 2024-09-10T14:28:22.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.667+0000 7f71b17fa640 1 -- 172.21.15.52:0/42869771 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f71b4131730 con 0x7f71b412e760 2024-09-10T14:28:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.667+0000 7f048bfff640 1 --2- 172.21.15.52:0/3952040378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c131920 0x7f048c133d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0478009740 tx=0x7f047801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd8787a663cf6f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.667+0000 7f048b7fe640 1 -- 172.21.15.52:0/3952040378 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04780b0070 con 0x7f048c131920 2024-09-10T14:28:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.667+0000 7f048b7fe640 1 -- 172.21.15.52:0/3952040378 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04780ab530 con 0x7f048c131920 2024-09-10T14:28:22.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.667+0000 7f048b7fe640 1 -- 172.21.15.52:0/3952040378 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04780ab830 con 0x7f048c131920 2024-09-10T14:28:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- 172.21.15.52:0/3952040378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c131920 msgr2=0x7f048c133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 --2- 172.21.15.52:0/3952040378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c131920 0x7f048c133d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0478009740 tx=0x7f047801c400 comp rx=0 tx=0).stop 2024-09-10T14:28:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- 172.21.15.52:0/3952040378 shutdown_connections 2024-09-10T14:28:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 --2- 172.21.15.52:0/3952040378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c131920 0x7f048c133d10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- 172.21.15.52:0/3952040378 >> 172.21.15.52:0/3952040378 conn(0x7f048c09f010 msgr2=0x7f048c09f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- 172.21.15.52:0/3952040378 shutdown_connections 2024-09-10T14:28:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- 172.21.15.52:0/3952040378 wait complete. 2024-09-10T14:28:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 Processor -- start 2024-09-10T14:28:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- start start 2024-09-10T14:28:22.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c06e180 0x7f048c12a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f048c136c80 con 0x7f048c06e180 2024-09-10T14:28:22.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0490d12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c06e180 0x7f048c12a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0490d12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c06e180 0x7f048c12a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33962/0 (socket says 172.21.15.52:33962) 2024-09-10T14:28:22.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0490d12640 1 -- 172.21.15.52:0/1744596556 learned_addr learned my addr 172.21.15.52:0/1744596556 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:22.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0490d12640 1 -- 172.21.15.52:0/1744596556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c125550 con 0x7f048c06e180 2024-09-10T14:28:22.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0490d12640 1 --2- 172.21.15.52:0/1744596556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c06e180 0x7f048c12a150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f048000c480 tx=0x7f048000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f04897fa640 1 -- 172.21.15.52:0/1744596556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0480017070 con 0x7f048c06e180 2024-09-10T14:28:22.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f04897fa640 1 -- 172.21.15.52:0/1744596556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0480005c20 con 0x7f048c06e180 2024-09-10T14:28:22.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048c125110 con 0x7f048c06e180 2024-09-10T14:28:22.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f04897fa640 1 -- 172.21.15.52:0/1744596556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0480007070 con 0x7f048c06e180 2024-09-10T14:28:22.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.671+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048c12a860 con 0x7f048c06e180 2024-09-10T14:28:22.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.675+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048c12ecc0 con 0x7f048c06e180 2024-09-10T14:28:22.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.675+0000 7f04897fa640 1 -- 172.21.15.52:0/1744596556 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f048001a070 con 0x7f048c06e180 2024-09-10T14:28:22.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.675+0000 7f04897fa640 1 --2- 172.21.15.52:0/1744596556 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0470035db0 0x7f0470038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:22.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.675+0000 7f04897fa640 1 -- 172.21.15.52:0/1744596556 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f0480047e10 con 0x7f048c06e180 2024-09-10T14:28:22.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.675+0000 7f048bfff640 1 --2- 172.21.15.52:0/1744596556 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0470035db0 0x7f0470038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:22.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.675+0000 7f048bfff640 1 --2- 172.21.15.52:0/1744596556 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0470035db0 0x7f0470038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04780ad000 tx=0x7f04780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:22.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.683+0000 7f04897fa640 1 -- 172.21.15.52:0/1744596556 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0480045db0 con 0x7f048c06e180 2024-09-10T14:28:22.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f29c406f970 con 0x7f29c406bc50 2024-09-10T14:28:22.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29c0ff9640 1 -- 172.21.15.52:0/3358575947 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29b4015ff0 con 0x7f29c406bc50 2024-09-10T14:28:22.791 INFO:teuthology.orchestra.run.smithi052.stdout:42949672965 2024-09-10T14:28:22.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f29b0035db0 msgr2=0x7f29b0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 --2- 172.21.15.52:0/3358575947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f29b0035db0 0x7f29b0038270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f29b8007fd0 tx=0x7f29b8007980 comp rx=0 tx=0).stop 2024-09-10T14:28:22.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 msgr2=0x7f29c406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 --2- 172.21.15.52:0/3358575947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c406de80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f29b401a030 tx=0x7f29b401ac40 comp rx=0 tx=0).stop 2024-09-10T14:28:22.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 shutdown_connections 2024-09-10T14:28:22.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 --2- 172.21.15.52:0/3358575947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f29b0035db0 0x7f29b0038270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 --2- 172.21.15.52:0/3358575947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c406bc50 0x7f29c406de80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 >> 172.21.15.52:0/3358575947 conn(0x7f29c409ab00 msgr2=0x7f29c4133630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 shutdown_connections 2024-09-10T14:28:22.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.787+0000 7f29ca9c5640 1 -- 172.21.15.52:0/3358575947 wait complete. 2024-09-10T14:28:22.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.3 2024-09-10T14:28:22.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.823+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcf9c06c0d0 con 0x7fcf9c12eba0 2024-09-10T14:28:22.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcf997fa640 1 -- 172.21.15.52:0/270472060 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf900a9070 con 0x7fcf9c12eba0 2024-09-10T14:28:22.830 INFO:teuthology.orchestra.run.smithi052.stdout:38654705667 2024-09-10T14:28:22.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcf80035db0 msgr2=0x7fcf80038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 --2- 172.21.15.52:0/270472060 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcf80035db0 0x7fcf80038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf88001610 tx=0x7fcf88007ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 msgr2=0x7fcf9c0961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 --2- 172.21.15.52:0/270472060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c0961b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf9001aa20 tx=0x7fcf9001abb0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 shutdown_connections 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 --2- 172.21.15.52:0/270472060 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcf80035db0 0x7fcf80038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 --2- 172.21.15.52:0/270472060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf9c12eba0 0x7fcf9c0961b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 >> 172.21.15.52:0/270472060 conn(0x7fcf9c09a6f0 msgr2=0x7fcf9c071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 shutdown_connections 2024-09-10T14:28:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.827+0000 7fcfa2afe640 1 -- 172.21.15.52:0/270472060 wait complete. 2024-09-10T14:28:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f71b412ec80 con 0x7f71b412e760 2024-09-10T14:28:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71b17fa640 1 -- 172.21.15.52:0/42869771 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71a8046660 con 0x7f71b412e760 2024-09-10T14:28:22.835 INFO:teuthology.orchestra.run.smithi052.stdout:47244640261 2024-09-10T14:28:22.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7198035d40 msgr2=0x7f7198038200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 --2- 172.21.15.52:0/42869771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7198035d40 0x7f7198038200 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f71a00ae000 tx=0x7f71a0008040 comp rx=0 tx=0).stop 2024-09-10T14:28:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412e760 msgr2=0x7f71b40963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 --2- 172.21.15.52:0/42869771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412e760 0x7f71b40963d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c480 tx=0x7f71a800c940 comp rx=0 tx=0).stop 2024-09-10T14:28:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 shutdown_connections 2024-09-10T14:28:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 --2- 172.21.15.52:0/42869771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7198035d40 0x7f7198038200 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 --2- 172.21.15.52:0/42869771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71b412e760 0x7f71b40963d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 >> 172.21.15.52:0/42869771 conn(0x7f71b40a10a0 msgr2=0x7f71b40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 shutdown_connections 2024-09-10T14:28:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.831+0000 7f71bb0a3640 1 -- 172.21.15.52:0/42869771 wait complete. 2024-09-10T14:28:22.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-09-10T14:28:22.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.847+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f048c128d80 con 0x7f048c06e180 2024-09-10T14:28:22.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.847+0000 7f04897fa640 1 -- 172.21.15.52:0/1744596556 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f048001b3b0 con 0x7f048c06e180 2024-09-10T14:28:22.852 INFO:teuthology.orchestra.run.smithi052.stdout:42949672965 2024-09-10T14:28:22.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0470035db0 msgr2=0x7f0470038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 --2- 172.21.15.52:0/1744596556 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0470035db0 0x7f0470038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04780ad000 tx=0x7f04780a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c06e180 msgr2=0x7f048c12a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 --2- 172.21.15.52:0/1744596556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c06e180 0x7f048c12a150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f048000c480 tx=0x7f048000c940 comp rx=0 tx=0).stop 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 shutdown_connections 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 --2- 172.21.15.52:0/1744596556 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0470035db0 0x7f0470038270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 --2- 172.21.15.52:0/1744596556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f048c06e180 0x7f048c12a150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 >> 172.21.15.52:0/1744596556 conn(0x7f048c09f010 msgr2=0x7f048c095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 shutdown_connections 2024-09-10T14:28:22.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:22.851+0000 7f0492f76640 1 -- 172.21.15.52:0/1744596556 wait complete. 2024-09-10T14:28:22.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.1 2024-09-10T14:28:23.815 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T14:28:23.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T14:28:23.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T14:28:23.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T14:28:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47cc4c1640 1 Processor -- start 2024-09-10T14:28:23.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47cc4c1640 1 -- start start 2024-09-10T14:28:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47cc4c1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47c4074ef0 0x7f47c4133b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47cc4c1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c412e900 con 0x7f47c412ed50 2024-09-10T14:28:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47cc4c1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f47c4091b40 con 0x7f47c4074ef0 2024-09-10T14:28:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47c9a5c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47c4074ef0 0x7f47c4133b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47ca25d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f47c412ed50 0x7f47c412f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47826/0 (socket says 172.21.15.52:47826) 2024-09-10T14:28:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47ca25d640 1 -- 172.21.15.52:0/795904591 learned_addr learned my addr 172.21.15.52:0/795904591 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47c9a5c640 1 -- 172.21.15.52:0/795904591 >> v1:172.21.15.52:6789/0 conn(0x7f47c412ed50 legacy=0x7f47c412f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:23.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.943+0000 7f47c9a5c640 1 -- 172.21.15.52:0/795904591 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c4075320 con 0x7f47c4074ef0 2024-09-10T14:28:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47c9a5c640 1 --2- 172.21.15.52:0/795904591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4133b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009740 tx=0x7f47b401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479f6ba8482d66a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47c925b640 1 -- 172.21.15.52:0/795904591 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b40ab550 con 0x7f47c4074ef0 2024-09-10T14:28:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47c925b640 1 -- 172.21.15.52:0/795904591 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b40b0070 con 0x7f47c4074ef0 2024-09-10T14:28:23.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47c925b640 1 -- 172.21.15.52:0/795904591 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b40ab840 con 0x7f47c4074ef0 2024-09-10T14:28:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 -- 172.21.15.52:0/795904591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 msgr2=0x7f47c4133b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 --2- 172.21.15.52:0/795904591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4133b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009740 tx=0x7f47b401c400 comp rx=0 tx=0).stop 2024-09-10T14:28:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 -- 172.21.15.52:0/795904591 shutdown_connections 2024-09-10T14:28:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 --2- 172.21.15.52:0/795904591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4133b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 -- 172.21.15.52:0/795904591 >> 172.21.15.52:0/795904591 conn(0x7f47c409d4c0 msgr2=0x7f47c409d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 -- 172.21.15.52:0/795904591 shutdown_connections 2024-09-10T14:28:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 -- 172.21.15.52:0/795904591 wait complete. 2024-09-10T14:28:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 Processor -- start 2024-09-10T14:28:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.947+0000 7f47cc4c1640 1 -- start start 2024-09-10T14:28:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47cc4c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4130bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47cc4c1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4136c00 con 0x7f47c4074ef0 2024-09-10T14:28:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47ca25d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4130bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47ca25d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4130bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33968/0 (socket says 172.21.15.52:33968) 2024-09-10T14:28:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47ca25d640 1 -- 172.21.15.52:0/2450353012 learned_addr learned my addr 172.21.15.52:0/2450353012 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47ca25d640 1 -- 172.21.15.52:0/2450353012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c4073630 con 0x7f47c4074ef0 2024-09-10T14:28:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47ca25d640 1 --2- 172.21.15.52:0/2450353012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4130bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c480 tx=0x7f47c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47baffd640 1 -- 172.21.15.52:0/2450353012 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c0017070 con 0x7f47c4074ef0 2024-09-10T14:28:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47baffd640 1 -- 172.21.15.52:0/2450353012 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c0005c20 con 0x7f47c4074ef0 2024-09-10T14:28:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c4132590 con 0x7f47c4074ef0 2024-09-10T14:28:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47baffd640 1 -- 172.21.15.52:0/2450353012 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c0007070 con 0x7f47c4074ef0 2024-09-10T14:28:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c406db00 con 0x7f47c4074ef0 2024-09-10T14:28:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47baffd640 1 -- 172.21.15.52:0/2450353012 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f47c001a070 con 0x7f47c4074ef0 2024-09-10T14:28:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c4094090 con 0x7f47c4074ef0 2024-09-10T14:28:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47baffd640 1 --2- 172.21.15.52:0/2450353012 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47a8035db0 0x7f47a8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47baffd640 1 -- 172.21.15.52:0/2450353012 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f47c0047950 con 0x7f47c4074ef0 2024-09-10T14:28:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.951+0000 7f47c9a5c640 1 --2- 172.21.15.52:0/2450353012 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47a8035db0 0x7f47a8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.955+0000 7f47c9a5c640 1 --2- 172.21.15.52:0/2450353012 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47a8035db0 0x7f47a8038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47b40af000 tx=0x7f47b40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:23.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.959+0000 7f47baffd640 1 -- 172.21.15.52:0/2450353012 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47c0007210 con 0x7f47c4074ef0 2024-09-10T14:28:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f8dc2c5b640 1 Processor -- start 2024-09-10T14:28:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f8dc2c5b640 1 -- start start 2024-09-10T14:28:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f4bdb8e0640 1 Processor -- start 2024-09-10T14:28:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f4bdb8e0640 1 -- start start 2024-09-10T14:28:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f8dc2c5b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8dbc12f390 0x7f8dbc133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f4bdb8e0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bd412ed50 0x7f4bd4074ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f8dc2c5b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dbc0984f0 con 0x7f8dbc12e760 2024-09-10T14:28:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f8dc2c5b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8dbc098dc0 con 0x7f8dbc12f390 2024-09-10T14:28:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f8dc09f7640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8dbc12e760 0x7f8dbc12ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47842/0 (socket says 172.21.15.52:47842) 2024-09-10T14:28:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f8dc09f7640 1 -- 172.21.15.52:0/1959619053 learned_addr learned my addr 172.21.15.52:0/1959619053 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f4bdb8e0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd412e900 con 0x7f4bd412f130 2024-09-10T14:28:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f4bd967c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bd412ed50 0x7f4bd4074ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f4bdb8e0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd4075430 con 0x7f4bd412ed50 2024-09-10T14:28:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f8dbbfff640 1 --2- 172.21.15.52:0/1959619053 >> v2:172.21.15.52:3300/0 conn(0x7f8dbc12f390 0x7f8dbc133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f4bd967c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bd412ed50 0x7f4bd4074ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33982/0 (socket says 172.21.15.52:33982) 2024-09-10T14:28:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.975+0000 7f4bd967c640 1 -- 172.21.15.52:0/537084876 learned_addr learned my addr 172.21.15.52:0/537084876 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dbb7fe640 1 -- 172.21.15.52:0/1959619053 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241007722 0 0) 0x7f8dbc0984f0 con 0x7f8dbc12e760 2024-09-10T14:28:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dbb7fe640 1 -- 172.21.15.52:0/1959619053 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dac003530 con 0x7f8dbc12e760 2024-09-10T14:28:23.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f4bd967c640 1 -- 172.21.15.52:0/537084876 >> v1:172.21.15.52:6789/0 conn(0x7f4bd412f130 legacy=0x7f4bd408f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:23.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f4bd967c640 1 -- 172.21.15.52:0/537084876 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd4091b40 con 0x7f4bd412ed50 2024-09-10T14:28:23.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dbbfff640 1 -- 172.21.15.52:0/1959619053 >> v1:172.21.15.52:6789/0 conn(0x7f8dbc12e760 legacy=0x7f8dbc12ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:23.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dbbfff640 1 -- 172.21.15.52:0/1959619053 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc0981a0 con 0x7f8dbc12f390 2024-09-10T14:28:23.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dbbfff640 1 --2- 172.21.15.52:0/1959619053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12f390 0x7f8dbc133a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009740 tx=0x7f8da801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f27846aba2f698a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dbb7fe640 1 -- 172.21.15.52:0/1959619053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8da80b0070 con 0x7f8dbc12f390 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dbb7fe640 1 -- 172.21.15.52:0/1959619053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da80ab530 con 0x7f8dbc12f390 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dbb7fe640 1 -- 172.21.15.52:0/1959619053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8da80ab830 con 0x7f8dbc12f390 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/1959619053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12f390 msgr2=0x7f8dbc133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dc2c5b640 1 --2- 172.21.15.52:0/1959619053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12f390 0x7f8dbc133a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009740 tx=0x7f8da801c3c0 comp rx=0 tx=0).stop 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/1959619053 shutdown_connections 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dc2c5b640 1 --2- 172.21.15.52:0/1959619053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12f390 0x7f8dbc133a80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/1959619053 >> 172.21.15.52:0/1959619053 conn(0x7f8dbc0a10a0 msgr2=0x7f8dbc0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/1959619053 shutdown_connections 2024-09-10T14:28:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f4bd967c640 1 --2- 172.21.15.52:0/537084876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd4074ef0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0097f0 tx=0x7f4bcc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c4ea9bf6fb6a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:23.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/1959619053 wait complete. 2024-09-10T14:28:23.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f4bd3fff640 1 -- 172.21.15.52:0/537084876 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bcc0b0070 con 0x7f4bd412ed50 2024-09-10T14:28:23.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f4bd3fff640 1 -- 172.21.15.52:0/537084876 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc0ab530 con 0x7f4bd412ed50 2024-09-10T14:28:23.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.979+0000 7f4bd3fff640 1 -- 172.21.15.52:0/537084876 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bcc0ab830 con 0x7f4bd412ed50 2024-09-10T14:28:23.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc2c5b640 1 Processor -- start 2024-09-10T14:28:23.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc2c5b640 1 -- start start 2024-09-10T14:28:23.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/537084876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 msgr2=0x7f4bd4074ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:23.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 --2- 172.21.15.52:0/537084876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd4074ef0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0097f0 tx=0x7f4bcc01c430 comp rx=0 tx=0).stop 2024-09-10T14:28:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc2c5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12e760 0x7f8dbc12fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc2c5b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc136b70 con 0x7f8dbc12e760 2024-09-10T14:28:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/537084876 shutdown_connections 2024-09-10T14:28:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 --2- 172.21.15.52:0/537084876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd4074ef0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/537084876 >> 172.21.15.52:0/537084876 conn(0x7f4bd409d4c0 msgr2=0x7f4bd409d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc09f7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12e760 0x7f8dbc12fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/537084876 shutdown_connections 2024-09-10T14:28:23.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc09f7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12e760 0x7f8dbc12fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33992/0 (socket says 172.21.15.52:33992) 2024-09-10T14:28:23.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc09f7640 1 -- 172.21.15.52:0/784986183 learned_addr learned my addr 172.21.15.52:0/784986183 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:23.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/537084876 wait complete. 2024-09-10T14:28:23.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc09f7640 1 -- 172.21.15.52:0/784986183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc128f50 con 0x7f8dbc12e760 2024-09-10T14:28:23.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc09f7640 1 --2- 172.21.15.52:0/784986183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12e760 0x7f8dbc12fa60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8db000c4a0 tx=0x7f8db000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:23.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8db97fa640 1 -- 172.21.15.52:0/784986183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db0018070 con 0x7f8dbc12e760 2024-09-10T14:28:23.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8db97fa640 1 -- 172.21.15.52:0/784986183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db0007410 con 0x7f8dbc12e760 2024-09-10T14:28:23.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc133240 con 0x7f8dbc12e760 2024-09-10T14:28:23.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 Processor -- start 2024-09-10T14:28:23.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8db97fa640 1 -- 172.21.15.52:0/784986183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db00047f0 con 0x7f8dbc12e760 2024-09-10T14:28:23.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc132380 con 0x7f8dbc12e760 2024-09-10T14:28:23.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 -- start start 2024-09-10T14:28:23.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8db97fa640 1 -- 172.21.15.52:0/784986183 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8db001b070 con 0x7f8dbc12e760 2024-09-10T14:28:23.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8db97fa640 1 --2- 172.21.15.52:0/784986183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8da0035d40 0x7f8da0038200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8db97fa640 1 -- 172.21.15.52:0/784986183 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f8db004b120 con 0x7f8dbc12e760 2024-09-10T14:28:23.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd41c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bdb8e0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4136fe0 con 0x7f4bd412ed50 2024-09-10T14:28:23.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bd967c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd41c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bd967c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd41c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33996/0 (socket says 172.21.15.52:33996) 2024-09-10T14:28:23.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bd967c640 1 -- 172.21.15.52:0/43924959 learned_addr learned my addr 172.21.15.52:0/43924959 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:23.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dbbfff640 1 --2- 172.21.15.52:0/784986183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8da0035d40 0x7f8da0038200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dbc132670 con 0x7f8dbc12e760 2024-09-10T14:28:23.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.983+0000 7f4bd967c640 1 -- 172.21.15.52:0/43924959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd406ea90 con 0x7f4bd412ed50 2024-09-10T14:28:23.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.987+0000 7f4bd967c640 1 --2- 172.21.15.52:0/43924959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd41c6880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc019040 tx=0x7f4bcc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:23.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.987+0000 7f8dbbfff640 1 --2- 172.21.15.52:0/784986183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8da0035d40 0x7f8da0038200 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8da80ad000 tx=0x7f8da8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:23.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bd1ffb640 1 -- 172.21.15.52:0/43924959 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bcc0ba020 con 0x7f4bd412ed50 2024-09-10T14:28:23.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bd1ffb640 1 -- 172.21.15.52:0/43924959 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc0b6420 con 0x7f4bd412ed50 2024-09-10T14:28:23.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd406da60 con 0x7f4bd412ed50 2024-09-10T14:28:23.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bd1ffb640 1 -- 172.21.15.52:0/43924959 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bcc0b0040 con 0x7f4bd412ed50 2024-09-10T14:28:23.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd406ee60 con 0x7f4bd412ed50 2024-09-10T14:28:23.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f8db97fa640 1 -- 172.21.15.52:0/784986183 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8dbc132670 con 0x7f8dbc12e760 2024-09-10T14:28:23.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bd1ffb640 1 -- 172.21.15.52:0/43924959 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4bcc0bd020 con 0x7f4bd412ed50 2024-09-10T14:28:23.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bd1ffb640 1 --2- 172.21.15.52:0/43924959 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bc0035d60 0x7f4bc0038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:23.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bd1ffb640 1 -- 172.21.15.52:0/43924959 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f4bcc0e2aa0 con 0x7f4bd412ed50 2024-09-10T14:28:23.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb4005090 con 0x7f4bd412ed50 2024-09-10T14:28:23.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bd8e7b640 1 --2- 172.21.15.52:0/43924959 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bc0035d60 0x7f4bc0038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:23.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.991+0000 7f4bd8e7b640 1 --2- 172.21.15.52:0/43924959 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bc0035d60 0x7f4bc0038220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000f70 tx=0x7f4bc8007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:23.995+0000 7f4bd1ffb640 1 -- 172.21.15.52:0/43924959 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4bcc0c4030 con 0x7f4bd412ed50 2024-09-10T14:28:24.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.015+0000 7f0eeafa3640 1 Processor -- start 2024-09-10T14:28:24.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.015+0000 7f0eeafa3640 1 -- start start 2024-09-10T14:28:24.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.015+0000 7f0eeafa3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ee412f390 0x7f0ee4133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.015+0000 7f0eeafa3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee40984f0 con 0x7f0ee412e760 2024-09-10T14:28:24.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.015+0000 7f0eeafa3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee4098dc0 con 0x7f0ee412f390 2024-09-10T14:28:24.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.015+0000 7f0ee8d3f640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ee412e760 0x7f0ee412ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47864/0 (socket says 172.21.15.52:47864) 2024-09-10T14:28:24.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.015+0000 7f0ee3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0ee412f390 0x7f0ee4133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.015+0000 7f0ee8d3f640 1 -- 172.21.15.52:0/953261727 learned_addr learned my addr 172.21.15.52:0/953261727 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:24.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0ee3fff640 1 -- 172.21.15.52:0/953261727 >> v1:172.21.15.52:6789/0 conn(0x7f0ee412e760 legacy=0x7f0ee412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0ee37fe640 1 -- 172.21.15.52:0/953261727 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432922206 0 0) 0x7f0ee40984f0 con 0x7f0ee412e760 2024-09-10T14:28:24.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0ee3fff640 1 -- 172.21.15.52:0/953261727 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee40981a0 con 0x7f0ee412f390 2024-09-10T14:28:24.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0ee3fff640 1 --2- 172.21.15.52:0/953261727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412f390 0x7f0ee4133a80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009740 tx=0x7f0ed001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2e37fa6001be85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0ee37fe640 1 -- 172.21.15.52:0/953261727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed00b1070 con 0x7f0ee412f390 2024-09-10T14:28:24.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0ee37fe640 1 -- 172.21.15.52:0/953261727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed00ac570 con 0x7f0ee412f390 2024-09-10T14:28:24.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0ee37fe640 1 -- 172.21.15.52:0/953261727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed00ac870 con 0x7f0ee412f390 2024-09-10T14:28:24.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0eeafa3640 1 -- 172.21.15.52:0/953261727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412f390 msgr2=0x7f0ee4133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0eeafa3640 1 --2- 172.21.15.52:0/953261727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412f390 0x7f0ee4133a80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009740 tx=0x7f0ed001c400 comp rx=0 tx=0).stop 2024-09-10T14:28:24.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0eeafa3640 1 -- 172.21.15.52:0/953261727 shutdown_connections 2024-09-10T14:28:24.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0eeafa3640 1 --2- 172.21.15.52:0/953261727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412f390 0x7f0ee4133a80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0eeafa3640 1 -- 172.21.15.52:0/953261727 >> 172.21.15.52:0/953261727 conn(0x7f0ee40a10a0 msgr2=0x7f0ee40a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0eeafa3640 1 -- 172.21.15.52:0/953261727 shutdown_connections 2024-09-10T14:28:24.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.019+0000 7f0eeafa3640 1 -- 172.21.15.52:0/953261727 wait complete. 2024-09-10T14:28:24.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0eeafa3640 1 Processor -- start 2024-09-10T14:28:24.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0eeafa3640 1 -- start start 2024-09-10T14:28:24.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0eeafa3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412e760 0x7f0ee412fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0eeafa3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4136b70 con 0x7f0ee412e760 2024-09-10T14:28:24.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee8d3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412e760 0x7f0ee412fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee8d3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412e760 0x7f0ee412fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34016/0 (socket says 172.21.15.52:34016) 2024-09-10T14:28:24.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee8d3f640 1 -- 172.21.15.52:0/3886892969 learned_addr learned my addr 172.21.15.52:0/3886892969 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:24.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee8d3f640 1 -- 172.21.15.52:0/3886892969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee4131f30 con 0x7f0ee412e760 2024-09-10T14:28:24.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee8d3f640 1 --2- 172.21.15.52:0/3886892969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412e760 0x7f0ee412fae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800c420 tx=0x7f0ed800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee17fa640 1 -- 172.21.15.52:0/3886892969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed8018070 con 0x7f0ee412e760 2024-09-10T14:28:24.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee17fa640 1 -- 172.21.15.52:0/3886892969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed80074d0 con 0x7f0ee412e760 2024-09-10T14:28:24.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee17fa640 1 -- 172.21.15.52:0/3886892969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed8004960 con 0x7f0ee412e760 2024-09-10T14:28:24.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee41323f0 con 0x7f0ee412e760 2024-09-10T14:28:24.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee4130020 con 0x7f0ee412e760 2024-09-10T14:28:24.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee4132a20 con 0x7f0ee412e760 2024-09-10T14:28:24.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee17fa640 1 -- 172.21.15.52:0/3886892969 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0ed801b070 con 0x7f0ee412e760 2024-09-10T14:28:24.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee17fa640 1 --2- 172.21.15.52:0/3886892969 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0ec8035db0 0x7f0ec8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee17fa640 1 -- 172.21.15.52:0/3886892969 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f0ed8047a00 con 0x7f0ee412e760 2024-09-10T14:28:24.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee3fff640 1 --2- 172.21.15.52:0/3886892969 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0ec8035db0 0x7f0ec8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.023+0000 7f0ee3fff640 1 --2- 172.21.15.52:0/3886892969 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0ec8035db0 0x7f0ec8038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00ae000 tx=0x7f0ed0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.027+0000 7f0ee17fa640 1 -- 172.21.15.52:0/3886892969 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ed8011950 con 0x7f0ee412e760 2024-09-10T14:28:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4bb4005380 con 0x7f4bd412ed50 2024-09-10T14:28:24.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bd1ffb640 1 -- 172.21.15.52:0/43924959 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4bcc0160b0 con 0x7f4bd412ed50 2024-09-10T14:28:24.163 INFO:teuthology.orchestra.run.smithi052.stdout:38654705668 2024-09-10T14:28:24.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bc0035d60 msgr2=0x7f4bc0038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 --2- 172.21.15.52:0/43924959 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bc0035d60 0x7f4bc0038220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000f70 tx=0x7f4bc8007a40 comp rx=0 tx=0).stop 2024-09-10T14:28:24.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 msgr2=0x7f4bd41c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 --2- 172.21.15.52:0/43924959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd41c6880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc019040 tx=0x7f4bcc01ac70 comp rx=0 tx=0).stop 2024-09-10T14:28:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 shutdown_connections 2024-09-10T14:28:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 --2- 172.21.15.52:0/43924959 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bc0035d60 0x7f4bc0038220 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 --2- 172.21.15.52:0/43924959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd412ed50 0x7f4bd41c6880 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 >> 172.21.15.52:0/43924959 conn(0x7f4bd409d4c0 msgr2=0x7f4bd4097ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 shutdown_connections 2024-09-10T14:28:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.159+0000 7f4bdb8e0640 1 -- 172.21.15.52:0/43924959 wait complete. 2024-09-10T14:28:24.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.163+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f47c4075bf0 con 0x7f47c4074ef0 2024-09-10T14:28:24.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.163+0000 7f47baffd640 1 -- 172.21.15.52:0/2450353012 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47c0012400 con 0x7f47c4074ef0 2024-09-10T14:28:24.167 INFO:teuthology.orchestra.run.smithi052.stdout:42949672966 2024-09-10T14:28:24.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47a8035db0 msgr2=0x7f47a8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 --2- 172.21.15.52:0/2450353012 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47a8035db0 0x7f47a8038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47b40af000 tx=0x7f47b40a7000 comp rx=0 tx=0).stop 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 msgr2=0x7f47c4130bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 --2- 172.21.15.52:0/2450353012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4130bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c480 tx=0x7f47c000c940 comp rx=0 tx=0).stop 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 shutdown_connections 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 --2- 172.21.15.52:0/2450353012 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47a8035db0 0x7f47a8038270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 --2- 172.21.15.52:0/2450353012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4074ef0 0x7f47c4130bb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 >> 172.21.15.52:0/2450353012 conn(0x7f47c409d4c0 msgr2=0x7f47c4097ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 shutdown_connections 2024-09-10T14:28:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.167+0000 7f47cc4c1640 1 -- 172.21.15.52:0/2450353012 wait complete. 2024-09-10T14:28:24.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-09-10T14:28:24.181 DEBUG:teuthology.parallel:result is None 2024-09-10T14:28:24.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-09-10T14:28:24.193 DEBUG:teuthology.parallel:result is None 2024-09-10T14:28:24.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0ee412ec80 con 0x7f0ee412e760 2024-09-10T14:28:24.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0ee17fa640 1 -- 172.21.15.52:0/3886892969 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ed8011bb0 con 0x7f0ee412e760 2024-09-10T14:28:24.194 INFO:teuthology.orchestra.run.smithi052.stdout:42949672966 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0ec8035db0 msgr2=0x7f0ec8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 --2- 172.21.15.52:0/3886892969 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0ec8035db0 0x7f0ec8038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00ae000 tx=0x7f0ed0008040 comp rx=0 tx=0).stop 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412e760 msgr2=0x7f0ee412fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 --2- 172.21.15.52:0/3886892969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412e760 0x7f0ee412fae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800c420 tx=0x7f0ed800c8e0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 shutdown_connections 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 --2- 172.21.15.52:0/3886892969 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0ec8035db0 0x7f0ec8038270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 --2- 172.21.15.52:0/3886892969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ee412e760 0x7f0ee412fae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 >> 172.21.15.52:0/3886892969 conn(0x7f0ee40a10a0 msgr2=0x7f0ee4128080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 shutdown_connections 2024-09-10T14:28:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.191+0000 7f0eeafa3640 1 -- 172.21.15.52:0/3886892969 wait complete. 2024-09-10T14:28:24.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.199+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8dbc132e90 con 0x7f8dbc12e760 2024-09-10T14:28:24.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.199+0000 7f8db97fa640 1 -- 172.21.15.52:0/784986183 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8db003a020 con 0x7f8dbc12e760 2024-09-10T14:28:24.204 INFO:teuthology.orchestra.run.smithi052.stdout:47244640262 2024-09-10T14:28:24.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8da0035d40 msgr2=0x7f8da0038200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 --2- 172.21.15.52:0/784986183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8da0035d40 0x7f8da0038200 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8da80ad000 tx=0x7f8da8008040 comp rx=0 tx=0).stop 2024-09-10T14:28:24.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12e760 msgr2=0x7f8dbc12fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 --2- 172.21.15.52:0/784986183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12e760 0x7f8dbc12fa60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8db000c4a0 tx=0x7f8db000c960 comp rx=0 tx=0).stop 2024-09-10T14:28:24.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 shutdown_connections 2024-09-10T14:28:24.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 --2- 172.21.15.52:0/784986183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8da0035d40 0x7f8da0038200 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 --2- 172.21.15.52:0/784986183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dbc12e760 0x7f8dbc12fa60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 >> 172.21.15.52:0/784986183 conn(0x7f8dbc0a10a0 msgr2=0x7f8dbc12c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 shutdown_connections 2024-09-10T14:28:24.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.203+0000 7f8dc2c5b640 1 -- 172.21.15.52:0/784986183 wait complete. 2024-09-10T14:28:24.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2024-09-10T14:28:24.212 DEBUG:teuthology.parallel:result is None 2024-09-10T14:28:24.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.2 2024-09-10T14:28:24.221 DEBUG:teuthology.parallel:result is None 2024-09-10T14:28:24.222 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T14:28:24.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:28:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.363+0000 7f318187d640 1 Processor -- start 2024-09-10T14:28:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.363+0000 7f318187d640 1 -- start start 2024-09-10T14:28:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.363+0000 7f318187d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f317c12ed70 0x7f317c12f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.363+0000 7f318187d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f317c06fc40 con 0x7f317c12f690 2024-09-10T14:28:24.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.363+0000 7f318187d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f317c06f930 con 0x7f317c12ed70 2024-09-10T14:28:24.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.363+0000 7f317affd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f317c12ed70 0x7f317c12f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.363+0000 7f317a7fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f317c12f690 0x7f317c06d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47880/0 (socket says 172.21.15.52:47880) 2024-09-10T14:28:24.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.363+0000 7f317a7fc640 1 -- 172.21.15.52:0/237056418 learned_addr learned my addr 172.21.15.52:0/237056418 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:24.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f317affd640 1 -- 172.21.15.52:0/237056418 >> v1:172.21.15.52:6789/0 conn(0x7f317c12f690 legacy=0x7f317c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f317affd640 1 -- 172.21.15.52:0/237056418 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c06ea20 con 0x7f317c12ed70 2024-09-10T14:28:24.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f317affd640 1 --2- 172.21.15.52:0/237056418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c12f150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3170009740 tx=0x7f317001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ceb10af05a3677 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f3179ffb640 1 -- 172.21.15.52:0/237056418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31700b1070 con 0x7f317c12ed70 2024-09-10T14:28:24.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f3179ffb640 1 -- 172.21.15.52:0/237056418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31700ac570 con 0x7f317c12ed70 2024-09-10T14:28:24.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f3179ffb640 1 -- 172.21.15.52:0/237056418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31700ac870 con 0x7f317c12ed70 2024-09-10T14:28:24.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 -- 172.21.15.52:0/237056418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 msgr2=0x7f317c12f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 --2- 172.21.15.52:0/237056418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c12f150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3170009740 tx=0x7f317001c400 comp rx=0 tx=0).stop 2024-09-10T14:28:24.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 -- 172.21.15.52:0/237056418 shutdown_connections 2024-09-10T14:28:24.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 --2- 172.21.15.52:0/237056418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c12f150 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 -- 172.21.15.52:0/237056418 >> 172.21.15.52:0/237056418 conn(0x7f317c09cd30 msgr2=0x7f317c09d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 -- 172.21.15.52:0/237056418 shutdown_connections 2024-09-10T14:28:24.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 -- 172.21.15.52:0/237056418 wait complete. 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 Processor -- start 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 -- start start 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c092350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.367+0000 7f318187d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f317c06e420 con 0x7f317c12ed70 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f317affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c092350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f317affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c092350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34024/0 (socket says 172.21.15.52:34024) 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f317affd640 1 -- 172.21.15.52:0/646054511 learned_addr learned my addr 172.21.15.52:0/646054511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f317affd640 1 -- 172.21.15.52:0/646054511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c098500 con 0x7f317c12ed70 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f317affd640 1 --2- 172.21.15.52:0/646054511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c092350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31700af040 tx=0x7f31700191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f3163fff640 1 -- 172.21.15.52:0/646054511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31700b9020 con 0x7f317c12ed70 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f3163fff640 1 -- 172.21.15.52:0/646054511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31700aa7a0 con 0x7f317c12ed70 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317c095730 con 0x7f317c12ed70 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f3163fff640 1 -- 172.21.15.52:0/646054511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31700b1040 con 0x7f317c12ed70 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317c0950a0 con 0x7f317c12ed70 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317c093e90 con 0x7f317c12ed70 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f3163fff640 1 -- 172.21.15.52:0/646054511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f31700bc020 con 0x7f317c12ed70 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f3163fff640 1 --2- 172.21.15.52:0/646054511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3168035db0 0x7f3168038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f3163fff640 1 -- 172.21.15.52:0/646054511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f31700e27e0 con 0x7f317c12ed70 2024-09-10T14:28:24.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f317a7fc640 1 --2- 172.21.15.52:0/646054511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3168035db0 0x7f3168038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.371+0000 7f317a7fc640 1 --2- 172.21.15.52:0/646054511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3168035db0 0x7f3168038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f316c000f70 tx=0x7f316c007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.375+0000 7f3163fff640 1 -- 172.21.15.52:0/646054511 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f31700c3030 con 0x7f317c12ed70 2024-09-10T14:28:24.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.531+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f317c12f150 con 0x7f3168035db0 2024-09-10T14:28:24.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.535+0000 7f3163fff640 1 -- 172.21.15.52:0/646054511 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32250 (secure 0 0 0) 0x7f317c12f150 con 0x7f3168035db0 2024-09-10T14:28:24.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:28:24.540 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:28:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3168035db0 msgr2=0x7f3168038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 --2- 172.21.15.52:0/646054511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3168035db0 0x7f3168038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f316c000f70 tx=0x7f316c007a90 comp rx=0 tx=0).stop 2024-09-10T14:28:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 msgr2=0x7f317c092350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 --2- 172.21.15.52:0/646054511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c092350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31700af040 tx=0x7f31700191a0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 shutdown_connections 2024-09-10T14:28:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 --2- 172.21.15.52:0/646054511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3168035db0 0x7f3168038270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 --2- 172.21.15.52:0/646054511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317c12ed70 0x7f317c092350 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 >> 172.21.15.52:0/646054511 conn(0x7f317c09cd30 msgr2=0x7f317c099450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 shutdown_connections 2024-09-10T14:28:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.539+0000 7f318187d640 1 -- 172.21.15.52:0/646054511 wait complete. 2024-09-10T14:28:24.557 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-10T14:28:22.675389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":122364,"kb_used_data":1760,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377364996,"statfs":{"total":386547056640,"available":386421755904,"internally_reserved":0,"allocated":1802240,"data_stored":1375178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":123397910},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.369267"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.325258+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:28:21.325258+0000","last_peered":"2024-09-10T14:28:21.325258+0000","last_clean":"2024-09-10T14:28:21.325258+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:28:21.325258+0000","last_undegraded":"2024-09-10T14:28:21.325258+0000","last_fullsized":"2024-09-10T14:28:21.325258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:58.045195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.327784+0000","last_change":"2024-09-10T14:28:21.327784+0000","last_active":"2024-09-10T14:28:21.327784+0000","last_peered":"2024-09-10T14:28:21.327784+0000","last_clean":"2024-09-10T14:28:21.327784+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:28:21.327784+0000","last_undegraded":"2024-09-10T14:28:21.327784+0000","last_fullsized":"2024-09-10T14:28:21.327784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:00.563029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.324850+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:28:21.324850+0000","last_peered":"2024-09-10T14:28:21.324850+0000","last_clean":"2024-09-10T14:28:21.324850+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:28:21.324850+0000","last_undegraded":"2024-09-10T14:28:21.324850+0000","last_fullsized":"2024-09-10T14:28:21.324850+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:21.647103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.327700+0000","last_change":"2024-09-10T14:28:21.327700+0000","last_active":"2024-09-10T14:28:21.327700+0000","last_peered":"2024-09-10T14:28:21.327700+0000","last_clean":"2024-09-10T14:28:21.327700+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:28:21.327700+0000","last_undegraded":"2024-09-10T14:28:21.327700+0000","last_fullsized":"2024-09-10T14:28:21.327700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:52.160130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.325127+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:28:21.325127+0000","last_peered":"2024-09-10T14:28:21.325127+0000","last_clean":"2024-09-10T14:28:21.325127+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:28:21.325127+0000","last_undegraded":"2024-09-10T14:28:21.325127+0000","last_fullsized":"2024-09-10T14:28:21.325127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:08.712711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.858634+0000","last_change":"2024-09-10T14:28:21.859213+0000","last_active":"2024-09-10T14:28:21.858634+0000","last_peered":"2024-09-10T14:28:21.858634+0000","last_clean":"2024-09-10T14:28:21.858634+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:28:21.858634+0000","last_undegraded":"2024-09-10T14:28:21.858634+0000","last_fullsized":"2024-09-10T14:28:21.858634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:49.580804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.323329+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:28:21.323329+0000","last_peered":"2024-09-10T14:28:21.323329+0000","last_clean":"2024-09-10T14:28:21.323329+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:28:21.323329+0000","last_undegraded":"2024-09-10T14:28:21.323329+0000","last_fullsized":"2024-09-10T14:28:21.323329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:11.168974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.323501+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:28:21.323501+0000","last_peered":"2024-09-10T14:28:21.323501+0000","last_clean":"2024-09-10T14:28:21.323501+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:28:21.323501+0000","last_undegraded":"2024-09-10T14:28:21.323501+0000","last_fullsized":"2024-09-10T14:28:21.323501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:14.334391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.318055+0000","last_change":"2024-09-10T14:28:16.789816+0000","last_active":"2024-09-10T14:28:21.318055+0000","last_peered":"2024-09-10T14:28:21.318055+0000","last_clean":"2024-09-10T14:28:21.318055+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:28:21.318055+0000","last_undegraded":"2024-09-10T14:28:21.318055+0000","last_fullsized":"2024-09-10T14:28:21.318055+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_clean_scrub_stamp":"2024-09-10T14:28:14.781430+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:16.536869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":733184,"data_stored":632876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":641000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":50651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:28:24.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:28:24.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb911a55640 1 Processor -- start 2024-09-10T14:28:24.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb911a55640 1 -- start start 2024-09-10T14:28:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb911a55640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb90c12e760 0x7fb90c12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb911a55640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb90c0984f0 con 0x7fb90c12f1c0 2024-09-10T14:28:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb911a55640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb90c098dc0 con 0x7fb90c12e760 2024-09-10T14:28:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb90a7fc640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb90c12f1c0 0x7fb90c12b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47888/0 (socket says 172.21.15.52:47888) 2024-09-10T14:28:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb90a7fc640 1 -- 172.21.15.52:0/2891482717 learned_addr learned my addr 172.21.15.52:0/2891482717 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb90affd640 1 --2- 172.21.15.52:0/2891482717 >> v2:172.21.15.52:3300/0 conn(0x7fb90c12e760 0x7fb90c12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb90affd640 1 -- 172.21.15.52:0/2891482717 >> v1:172.21.15.52:6789/0 conn(0x7fb90c12f1c0 legacy=0x7fb90c12b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb90affd640 1 -- 172.21.15.52:0/2891482717 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90c12f5a0 con 0x7fb90c12e760 2024-09-10T14:28:24.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb90affd640 1 --2- 172.21.15.52:0/2891482717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c12ec80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009d90 tx=0x7fb8fc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec36f76e6884d5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb909ffb640 1 -- 172.21.15.52:0/2891482717 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8fc0b2070 con 0x7fb90c12e760 2024-09-10T14:28:24.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb909ffb640 1 -- 172.21.15.52:0/2891482717 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc0a56f0 con 0x7fb90c12e760 2024-09-10T14:28:24.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.671+0000 7fb909ffb640 1 -- 172.21.15.52:0/2891482717 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8fc0a59f0 con 0x7fb90c12e760 2024-09-10T14:28:24.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- 172.21.15.52:0/2891482717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 msgr2=0x7fb90c12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 --2- 172.21.15.52:0/2891482717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c12ec80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009d90 tx=0x7fb8fc01c950 comp rx=0 tx=0).stop 2024-09-10T14:28:24.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- 172.21.15.52:0/2891482717 shutdown_connections 2024-09-10T14:28:24.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 --2- 172.21.15.52:0/2891482717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c12ec80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- 172.21.15.52:0/2891482717 >> 172.21.15.52:0/2891482717 conn(0x7fb90c0a10a0 msgr2=0x7fb90c0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- 172.21.15.52:0/2891482717 shutdown_connections 2024-09-10T14:28:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- 172.21.15.52:0/2891482717 wait complete. 2024-09-10T14:28:24.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 Processor -- start 2024-09-10T14:28:24.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- start start 2024-09-10T14:28:24.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c0953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c136e30 con 0x7fb90c12e760 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb90affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c0953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb90affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c0953c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34048/0 (socket says 172.21.15.52:34048) 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb90affd640 1 -- 172.21.15.52:0/1001850842 learned_addr learned my addr 172.21.15.52:0/1001850842 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb90affd640 1 -- 172.21.15.52:0/1001850842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90c09ded0 con 0x7fb90c12e760 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb90affd640 1 --2- 172.21.15.52:0/1001850842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c0953c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc019560 tx=0x7fb8fc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb8f3fff640 1 -- 172.21.15.52:0/1001850842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8fc0bd020 con 0x7fb90c12e760 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb8f3fff640 1 -- 172.21.15.52:0/1001850842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc0b85a0 con 0x7fb90c12e760 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90c12f8d0 con 0x7fb90c12e760 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb8f3fff640 1 -- 172.21.15.52:0/1001850842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8fc0b2040 con 0x7fb90c12e760 2024-09-10T14:28:24.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb90c131a90 con 0x7fb90c12e760 2024-09-10T14:28:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb90c12ec80 con 0x7fb90c12e760 2024-09-10T14:28:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb8f3fff640 1 -- 172.21.15.52:0/1001850842 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8fc0c0020 con 0x7fb90c12e760 2024-09-10T14:28:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb8f3fff640 1 --2- 172.21.15.52:0/1001850842 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8f8035db0 0x7fb8f8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.675+0000 7fb8f3fff640 1 -- 172.21.15.52:0/1001850842 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fb8fc0e3660 con 0x7fb90c12e760 2024-09-10T14:28:24.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.679+0000 7fb90a7fc640 1 --2- 172.21.15.52:0/1001850842 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8f8035db0 0x7fb8f8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.679+0000 7fb90a7fc640 1 --2- 172.21.15.52:0/1001850842 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8f8035db0 0x7fb8f8038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb900001630 tx=0x7fb900007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.683+0000 7fb8f3fff640 1 -- 172.21.15.52:0/1001850842 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8fc0c7030 con 0x7fb90c12e760 2024-09-10T14:28:24.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.835+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb90c06e930 con 0x7fb8f8035db0 2024-09-10T14:28:24.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.839+0000 7fb8f3fff640 1 -- 172.21.15.52:0/1001850842 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32215 (secure 0 0 0) 0x7fb90c06e930 con 0x7fb8f8035db0 2024-09-10T14:28:24.845 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:28:24.845 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:28:24.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8f8035db0 msgr2=0x7fb8f8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 --2- 172.21.15.52:0/1001850842 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8f8035db0 0x7fb8f8038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb900001630 tx=0x7fb900007a90 comp rx=0 tx=0).stop 2024-09-10T14:28:24.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 msgr2=0x7fb90c0953c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 --2- 172.21.15.52:0/1001850842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c0953c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc019560 tx=0x7fb8fc0196f0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 shutdown_connections 2024-09-10T14:28:24.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 --2- 172.21.15.52:0/1001850842 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8f8035db0 0x7fb8f8038270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 --2- 172.21.15.52:0/1001850842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb90c12e760 0x7fb90c0953c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 >> 172.21.15.52:0/1001850842 conn(0x7fb90c0a10a0 msgr2=0x7fb90c12c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 shutdown_connections 2024-09-10T14:28:24.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.843+0000 7fb911a55640 1 -- 172.21.15.52:0/1001850842 wait complete. 2024-09-10T14:28:24.861 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-10T14:28:24.676068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":122364,"kb_used_data":1760,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377364996,"statfs":{"total":386547056640,"available":386421755904,"internally_reserved":0,"allocated":1802240,"data_stored":1375178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":123397910},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.369945"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.325258+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:28:21.325258+0000","last_peered":"2024-09-10T14:28:21.325258+0000","last_clean":"2024-09-10T14:28:21.325258+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:28:21.325258+0000","last_undegraded":"2024-09-10T14:28:21.325258+0000","last_fullsized":"2024-09-10T14:28:21.325258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:58.045195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.327784+0000","last_change":"2024-09-10T14:28:21.327784+0000","last_active":"2024-09-10T14:28:21.327784+0000","last_peered":"2024-09-10T14:28:21.327784+0000","last_clean":"2024-09-10T14:28:21.327784+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:28:21.327784+0000","last_undegraded":"2024-09-10T14:28:21.327784+0000","last_fullsized":"2024-09-10T14:28:21.327784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:00.563029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.324850+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:28:21.324850+0000","last_peered":"2024-09-10T14:28:21.324850+0000","last_clean":"2024-09-10T14:28:21.324850+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:28:21.324850+0000","last_undegraded":"2024-09-10T14:28:21.324850+0000","last_fullsized":"2024-09-10T14:28:21.324850+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:21.647103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.327700+0000","last_change":"2024-09-10T14:28:21.327700+0000","last_active":"2024-09-10T14:28:21.327700+0000","last_peered":"2024-09-10T14:28:21.327700+0000","last_clean":"2024-09-10T14:28:21.327700+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:28:21.327700+0000","last_undegraded":"2024-09-10T14:28:21.327700+0000","last_fullsized":"2024-09-10T14:28:21.327700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:52.160130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.325127+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:28:21.325127+0000","last_peered":"2024-09-10T14:28:21.325127+0000","last_clean":"2024-09-10T14:28:21.325127+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:28:21.325127+0000","last_undegraded":"2024-09-10T14:28:21.325127+0000","last_fullsized":"2024-09-10T14:28:21.325127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:08.712711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.858634+0000","last_change":"2024-09-10T14:28:21.859213+0000","last_active":"2024-09-10T14:28:21.858634+0000","last_peered":"2024-09-10T14:28:21.858634+0000","last_clean":"2024-09-10T14:28:21.858634+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:28:21.858634+0000","last_undegraded":"2024-09-10T14:28:21.858634+0000","last_fullsized":"2024-09-10T14:28:21.858634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:49.580804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.323329+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:28:21.323329+0000","last_peered":"2024-09-10T14:28:21.323329+0000","last_clean":"2024-09-10T14:28:21.323329+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:28:21.323329+0000","last_undegraded":"2024-09-10T14:28:21.323329+0000","last_fullsized":"2024-09-10T14:28:21.323329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:11.168974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.323501+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:28:21.323501+0000","last_peered":"2024-09-10T14:28:21.323501+0000","last_clean":"2024-09-10T14:28:21.323501+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:28:21.323501+0000","last_undegraded":"2024-09-10T14:28:21.323501+0000","last_fullsized":"2024-09-10T14:28:21.323501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:14.334391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-10T14:28:21.318055+0000","last_change":"2024-09-10T14:28:16.789816+0000","last_active":"2024-09-10T14:28:21.318055+0000","last_peered":"2024-09-10T14:28:21.318055+0000","last_clean":"2024-09-10T14:28:21.318055+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:28:21.318055+0000","last_undegraded":"2024-09-10T14:28:21.318055+0000","last_fullsized":"2024-09-10T14:28:21.318055+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_clean_scrub_stamp":"2024-09-10T14:28:14.781430+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:16.536869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":733184,"data_stored":632876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":641000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":50651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:28:24.863 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T14:28:24.863 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T14:28:24.863 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T14:28:24.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T14:28:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f86360d3640 1 Processor -- start 2024-09-10T14:28:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f86360d3640 1 -- start start 2024-09-10T14:28:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f86360d3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f863012f390 0x7f8630133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f86360d3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86300984f0 con 0x7f863012e760 2024-09-10T14:28:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f86360d3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8630098dc0 con 0x7f863012f390 2024-09-10T14:28:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f862effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f863012f390 0x7f8630133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f862f7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f863012e760 0x7f863012ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47898/0 (socket says 172.21.15.52:47898) 2024-09-10T14:28:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f862f7fe640 1 -- 172.21.15.52:0/785571903 learned_addr learned my addr 172.21.15.52:0/785571903 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:28:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f862effd640 1 -- 172.21.15.52:0/785571903 >> v1:172.21.15.52:6789/0 conn(0x7f863012e760 legacy=0x7f863012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.979+0000 7f862effd640 1 -- 172.21.15.52:0/785571903 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86300981a0 con 0x7f863012f390 2024-09-10T14:28:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862effd640 1 --2- 172.21.15.52:0/785571903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012f390 0x7f8630133a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8624009740 tx=0x7f862401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c72848dd326ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862e7fc640 1 -- 172.21.15.52:0/785571903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86240b1070 con 0x7f863012f390 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862e7fc640 1 -- 172.21.15.52:0/785571903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86240ac570 con 0x7f863012f390 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862e7fc640 1 -- 172.21.15.52:0/785571903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86240ac870 con 0x7f863012f390 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 -- 172.21.15.52:0/785571903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012f390 msgr2=0x7f8630133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 --2- 172.21.15.52:0/785571903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012f390 0x7f8630133a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8624009740 tx=0x7f862401c400 comp rx=0 tx=0).stop 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 -- 172.21.15.52:0/785571903 shutdown_connections 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 --2- 172.21.15.52:0/785571903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012f390 0x7f8630133a80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 -- 172.21.15.52:0/785571903 >> 172.21.15.52:0/785571903 conn(0x7f86300a10a0 msgr2=0x7f86300a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 -- 172.21.15.52:0/785571903 shutdown_connections 2024-09-10T14:28:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 -- 172.21.15.52:0/785571903 wait complete. 2024-09-10T14:28:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 Processor -- start 2024-09-10T14:28:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 -- start start 2024-09-10T14:28:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012e760 0x7f86301c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f86360d3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8630136b70 con 0x7f863012e760 2024-09-10T14:28:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012e760 0x7f86301c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012e760 0x7f86301c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34062/0 (socket says 172.21.15.52:34062) 2024-09-10T14:28:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862f7fe640 1 -- 172.21.15.52:0/3768888432 learned_addr learned my addr 172.21.15.52:0/3768888432 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:28:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862f7fe640 1 -- 172.21.15.52:0/3768888432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8630133560 con 0x7f863012e760 2024-09-10T14:28:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.983+0000 7f862f7fe640 1 --2- 172.21.15.52:0/3768888432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012e760 0x7f86301c6540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f862000c3a0 tx=0x7f862000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f8617fff640 1 -- 172.21.15.52:0/3768888432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8620017070 con 0x7f863012e760 2024-09-10T14:28:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f8617fff640 1 -- 172.21.15.52:0/3768888432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8620005c20 con 0x7f863012e760 2024-09-10T14:28:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f8617fff640 1 -- 172.21.15.52:0/3768888432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86200070d0 con 0x7f863012e760 2024-09-10T14:28:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86301326f0 con 0x7f863012e760 2024-09-10T14:28:24.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86301c5e90 con 0x7f863012e760 2024-09-10T14:28:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863012ec80 con 0x7f863012e760 2024-09-10T14:28:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f8617fff640 1 -- 172.21.15.52:0/3768888432 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f862001a070 con 0x7f863012e760 2024-09-10T14:28:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f8617fff640 1 --2- 172.21.15.52:0/3768888432 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f861c035e00 0x7f861c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f8617fff640 1 -- 172.21.15.52:0/3768888432 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f8620047a30 con 0x7f863012e760 2024-09-10T14:28:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f862effd640 1 --2- 172.21.15.52:0/3768888432 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f861c035e00 0x7f861c0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:24.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.987+0000 7f862effd640 1 --2- 172.21.15.52:0/3768888432 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f861c035e00 0x7f861c0382c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86240ae000 tx=0x7f8624008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:24.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:24.991+0000 7f8617fff640 1 -- 172.21.15.52:0/3768888432 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8620046840 con 0x7f863012e760 2024-09-10T14:28:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.187+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f86301312e0 con 0x7f863012e760 2024-09-10T14:28:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.187+0000 7f8617fff640 1 -- 172.21.15.52:0/3768888432 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8620007270 con 0x7f863012e760 2024-09-10T14:28:25.194 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:28:25.194 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f861c035e00 msgr2=0x7f861c0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 --2- 172.21.15.52:0/3768888432 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f861c035e00 0x7f861c0382c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86240ae000 tx=0x7f8624008040 comp rx=0 tx=0).stop 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012e760 msgr2=0x7f86301c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 --2- 172.21.15.52:0/3768888432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012e760 0x7f86301c6540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f862000c3a0 tx=0x7f862000c860 comp rx=0 tx=0).stop 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 shutdown_connections 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 --2- 172.21.15.52:0/3768888432 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f861c035e00 0x7f861c0382c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 --2- 172.21.15.52:0/3768888432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f863012e760 0x7f86301c6540 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 >> 172.21.15.52:0/3768888432 conn(0x7f86300a10a0 msgr2=0x7f863012c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 shutdown_connections 2024-09-10T14:28:25.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:28:25.191+0000 7f86360d3640 1 -- 172.21.15.52:0/3768888432 wait complete. 2024-09-10T14:28:25.212 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T14:28:25.213 INFO:teuthology.run_tasks:Running task rgw... 2024-09-10T14:28:25.229 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-10T14:28:25.230 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-10T14:28:25.230 INFO:tasks.rgw:Creating data pools 2024-09-10T14:28:25.230 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-10T14:28:25.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-10T14:28:25.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f3763640 1 Processor -- start 2024-09-10T14:28:25.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f3763640 1 -- start start 2024-09-10T14:28:25.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f3763640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f58ec117a10 0x7f58ec119e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:25.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f3763640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ec11a340 con 0x7f58ec114c30 2024-09-10T14:28:25.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f3763640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f58ec11b520 con 0x7f58ec117a10 2024-09-10T14:28:25.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f0cfe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f58ec117a10 0x7f58ec119e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:25.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f14ff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f58ec114c30 0x7f58ec115010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:48862/0 (socket says 172.21.15.151:48862) 2024-09-10T14:28:25.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f14ff640 1 -- 172.21.15.151:0/913925212 learned_addr learned my addr 172.21.15.151:0/913925212 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:25.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f0cfe640 1 -- 172.21.15.151:0/913925212 >> v1:172.21.15.52:6789/0 conn(0x7f58ec114c30 legacy=0x7f58ec115010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:25.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.363+0000 7f58f0cfe640 1 -- 172.21.15.151:0/913925212 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec11b6a0 con 0x7f58ec117a10 2024-09-10T14:28:25.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f0cfe640 1 --2- 172.21.15.151:0/913925212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec117a10 0x7f58ec119e00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009740 tx=0x7f58dc01c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61aaaeae92f04a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:25.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58e3fff640 1 -- 172.21.15.151:0/913925212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58dc0b0070 con 0x7f58ec117a10 2024-09-10T14:28:25.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58e3fff640 1 -- 172.21.15.151:0/913925212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc0ab530 con 0x7f58ec117a10 2024-09-10T14:28:25.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58e3fff640 1 -- 172.21.15.151:0/913925212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58dc0ab830 con 0x7f58ec117a10 2024-09-10T14:28:25.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 -- 172.21.15.151:0/913925212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec117a10 msgr2=0x7f58ec119e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:25.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 --2- 172.21.15.151:0/913925212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec117a10 0x7f58ec119e00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009740 tx=0x7f58dc01c200 comp rx=0 tx=0).stop 2024-09-10T14:28:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 -- 172.21.15.151:0/913925212 shutdown_connections 2024-09-10T14:28:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 --2- 172.21.15.151:0/913925212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec117a10 0x7f58ec119e00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 -- 172.21.15.151:0/913925212 >> 172.21.15.151:0/913925212 conn(0x7f58ec06f370 msgr2=0x7f58ec071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 -- 172.21.15.151:0/913925212 shutdown_connections 2024-09-10T14:28:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 -- 172.21.15.151:0/913925212 wait complete. 2024-09-10T14:28:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 Processor -- start 2024-09-10T14:28:25.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 -- start start 2024-09-10T14:28:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec114c30 0x7f58ec1accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f3763640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec11b240 con 0x7f58ec114c30 2024-09-10T14:28:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f14ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec114c30 0x7f58ec1accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f14ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec114c30 0x7f58ec1accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52176/0 (socket says 172.21.15.151:52176) 2024-09-10T14:28:25.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.367+0000 7f58f14ff640 1 -- 172.21.15.151:0/1516443478 learned_addr learned my addr 172.21.15.151:0/1516443478 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:25.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58f14ff640 1 -- 172.21.15.151:0/1516443478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec1ad2a0 con 0x7f58ec114c30 2024-09-10T14:28:25.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58f14ff640 1 --2- 172.21.15.151:0/1516443478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec114c30 0x7f58ec1accd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f58e800ca70 tx=0x7f58e800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:25.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58e1ffb640 1 -- 172.21.15.151:0/1516443478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e8018070 con 0x7f58ec114c30 2024-09-10T14:28:25.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58e1ffb640 1 -- 172.21.15.151:0/1516443478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e800a6c0 con 0x7f58ec114c30 2024-09-10T14:28:25.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec1ad530 con 0x7f58ec114c30 2024-09-10T14:28:25.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58e1ffb640 1 -- 172.21.15.151:0/1516443478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e800a8b0 con 0x7f58ec114c30 2024-09-10T14:28:25.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec1a6fc0 con 0x7f58ec114c30 2024-09-10T14:28:25.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ec115010 con 0x7f58ec114c30 2024-09-10T14:28:25.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58e1ffb640 1 -- 172.21.15.151:0/1516443478 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58e801b070 con 0x7f58ec114c30 2024-09-10T14:28:25.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58e1ffb640 1 --2- 172.21.15.151:0/1516443478 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f58d0035de0 0x7f58d00382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:25.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58e1ffb640 1 -- 172.21.15.151:0/1516443478 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f58e80482c0 con 0x7f58ec114c30 2024-09-10T14:28:25.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58f0cfe640 1 --2- 172.21.15.151:0/1516443478 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f58d0035de0 0x7f58d00382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:25.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.371+0000 7f58f0cfe640 1 --2- 172.21.15.151:0/1516443478 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f58d0035de0 0x7f58d00382a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0ad000 tx=0x7f58dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:25.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.383+0000 7f58e1ffb640 1 -- 172.21.15.151:0/1516443478 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f58e8010300 con 0x7f58ec114c30 2024-09-10T14:28:25.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:25.555+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7f58ec1ad760 con 0x7f58ec114c30 2024-09-10T14:28:26.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58e1ffb640 1 -- 172.21.15.151:0/1516443478 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v19) ==== 171+0+0 (secure 0 0 0) 0x7f58e801cda0 con 0x7f58ec114c30 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f58d0035de0 msgr2=0x7f58d00382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 --2- 172.21.15.151:0/1516443478 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f58d0035de0 0x7f58d00382a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0ad000 tx=0x7f58dc008040 comp rx=0 tx=0).stop 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec114c30 msgr2=0x7f58ec1accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 --2- 172.21.15.151:0/1516443478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec114c30 0x7f58ec1accd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f58e800ca70 tx=0x7f58e800cf30 comp rx=0 tx=0).stop 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 shutdown_connections 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 --2- 172.21.15.151:0/1516443478 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f58d0035de0 0x7f58d00382a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 --2- 172.21.15.151:0/1516443478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ec114c30 0x7f58ec1accd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 >> 172.21.15.151:0/1516443478 conn(0x7f58ec06f370 msgr2=0x7f58ec10ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:26.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 shutdown_connections 2024-09-10T14:28:26.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.327+0000 7f58f3763640 1 -- 172.21.15.151:0/1516443478 wait complete. 2024-09-10T14:28:26.353 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-10T14:28:26.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ecdcb3640 1 Processor -- start 2024-09-10T14:28:26.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ecdcb3640 1 -- start start 2024-09-10T14:28:26.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ecdcb3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ec810f880 0x7f2ec811b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:26.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ecdcb3640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec811b660 con 0x7f2ec810ed90 2024-09-10T14:28:26.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ecdcb3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec811c840 con 0x7f2ec810f880 2024-09-10T14:28:26.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ebeffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ec810f880 0x7f2ec811b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:26.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ebeffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ec810f880 0x7f2ec811b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52182/0 (socket says 172.21.15.151:52182) 2024-09-10T14:28:26.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ebeffd640 1 -- 172.21.15.151:0/1654199588 learned_addr learned my addr 172.21.15.151:0/1654199588 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:26.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ebeffd640 1 -- 172.21.15.151:0/1654199588 >> v1:172.21.15.52:6789/0 conn(0x7f2ec810ed90 legacy=0x7f2ec810f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:26.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ebeffd640 1 -- 172.21.15.151:0/1654199588 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec811c9c0 con 0x7f2ec810f880 2024-09-10T14:28:26.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.479+0000 7f2ec6ffd640 1 -- 172.21.15.151:0/1654199588 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186708437 0 0) 0x7f2ec811b660 con 0x7f2ec810ed90 2024-09-10T14:28:26.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ebeffd640 1 --2- 172.21.15.151:0/1654199588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810f880 0x7f2ec811b120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00097f0 tx=0x7f2eb001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07adc4b6241128a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:26.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ec6ffd640 1 -- 172.21.15.151:0/1654199588 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eb00ab580 con 0x7f2ec810f880 2024-09-10T14:28:26.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ec6ffd640 1 -- 172.21.15.151:0/1654199588 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb00b0070 con 0x7f2ec810f880 2024-09-10T14:28:26.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ec6ffd640 1 -- 172.21.15.151:0/1654199588 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eb00ab870 con 0x7f2ec810f880 2024-09-10T14:28:26.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/1654199588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810f880 msgr2=0x7f2ec811b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:26.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 --2- 172.21.15.151:0/1654199588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810f880 0x7f2ec811b120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00097f0 tx=0x7f2eb001c430 comp rx=0 tx=0).stop 2024-09-10T14:28:26.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/1654199588 shutdown_connections 2024-09-10T14:28:26.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 --2- 172.21.15.151:0/1654199588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810f880 0x7f2ec811b120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:26.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/1654199588 >> 172.21.15.151:0/1654199588 conn(0x7f2ec806f370 msgr2=0x7f2ec8071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:26.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/1654199588 shutdown_connections 2024-09-10T14:28:26.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/1654199588 wait complete. 2024-09-10T14:28:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 Processor -- start 2024-09-10T14:28:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 -- start start 2024-09-10T14:28:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810ed90 0x7f2ec81acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ecdcb3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec811c470 con 0x7f2ec810ed90 2024-09-10T14:28:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ec77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810ed90 0x7f2ec81acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ec77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810ed90 0x7f2ec81acc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52196/0 (socket says 172.21.15.151:52196) 2024-09-10T14:28:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ec77fe640 1 -- 172.21.15.151:0/808299885 learned_addr learned my addr 172.21.15.151:0/808299885 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.487+0000 7f2ec77fe640 1 -- 172.21.15.151:0/808299885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec81ad1d0 con 0x7f2ec810ed90 2024-09-10T14:28:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ec77fe640 1 --2- 172.21.15.151:0/808299885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810ed90 0x7f2ec81acc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c400 tx=0x7f2eb800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ec4ff9640 1 -- 172.21.15.151:0/808299885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eb8017070 con 0x7f2ec810ed90 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec81ad460 con 0x7f2ec810ed90 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ec4ff9640 1 -- 172.21.15.151:0/808299885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb8003600 con 0x7f2ec810ed90 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ec4ff9640 1 -- 172.21.15.151:0/808299885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2eb80039a0 con 0x7f2ec810ed90 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec81a6e70 con 0x7f2ec810ed90 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec810f170 con 0x7f2ec810ed90 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ec4ff9640 1 -- 172.21.15.151:0/808299885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2eb801a070 con 0x7f2ec810ed90 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ec4ff9640 1 --2- 172.21.15.151:0/808299885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ea8035d60 0x7f2ea8038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ec4ff9640 1 -- 172.21.15.151:0/808299885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3825+0+0 (secure 0 0 0) 0x7f2eb8047f00 con 0x7f2ec810ed90 2024-09-10T14:28:26.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ebeffd640 1 --2- 172.21.15.151:0/808299885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ea8035d60 0x7f2ea8038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:26.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.491+0000 7f2ebeffd640 1 --2- 172.21.15.151:0/808299885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ea8035d60 0x7f2ea8038220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00097f0 tx=0x7f2eb00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:26.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.503+0000 7f2ec4ff9640 1 -- 172.21.15.151:0/808299885 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2eb8019e10 con 0x7f2ec810ed90 2024-09-10T14:28:26.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:26.663+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f2ec81ad690 con 0x7f2ec810ed90 2024-09-10T14:28:27.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ec4ff9640 1 -- 172.21.15.151:0/808299885 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v21) ==== 227+0+0 (secure 0 0 0) 0x7f2eb8021070 con 0x7f2ec810ed90 2024-09-10T14:28:27.819 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'default.rgw.buckets.data' created 2024-09-10T14:28:27.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ea8035d60 msgr2=0x7f2ea8038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:27.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 --2- 172.21.15.151:0/808299885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ea8035d60 0x7f2ea8038220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00097f0 tx=0x7f2eb00a7000 comp rx=0 tx=0).stop 2024-09-10T14:28:27.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810ed90 msgr2=0x7f2ec81acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:27.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 --2- 172.21.15.151:0/808299885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810ed90 0x7f2ec81acc00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c400 tx=0x7f2eb800c8c0 comp rx=0 tx=0).stop 2024-09-10T14:28:27.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 shutdown_connections 2024-09-10T14:28:27.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 --2- 172.21.15.151:0/808299885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ea8035d60 0x7f2ea8038220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:27.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 --2- 172.21.15.151:0/808299885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec810ed90 0x7f2ec81acc00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:27.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 >> 172.21.15.151:0/808299885 conn(0x7f2ec806f370 msgr2=0x7f2ec811a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:27.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 shutdown_connections 2024-09-10T14:28:27.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.819+0000 7f2ecdcb3640 1 -- 172.21.15.151:0/808299885 wait complete. 2024-09-10T14:28:27.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-10T14:28:27.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac472e640 1 Processor -- start 2024-09-10T14:28:27.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac472e640 1 -- start start 2024-09-10T14:28:27.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac472e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1abc11ad80 0x7f1abc11d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:27.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac472e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1abc11d6b0 con 0x7f1abc112010 2024-09-10T14:28:27.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac472e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1abc11e890 con 0x7f1abc11ad80 2024-09-10T14:28:27.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac1cc9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1abc11ad80 0x7f1abc11d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:27.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac1cc9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1abc11ad80 0x7f1abc11d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52202/0 (socket says 172.21.15.151:52202) 2024-09-10T14:28:27.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac1cc9640 1 -- 172.21.15.151:0/3921512992 learned_addr learned my addr 172.21.15.151:0/3921512992 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:27.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac1cc9640 1 -- 172.21.15.151:0/3921512992 >> v1:172.21.15.52:6789/0 conn(0x7f1abc112010 legacy=0x7f1abc1123f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:27.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.971+0000 7f1ac1cc9640 1 -- 172.21.15.151:0/3921512992 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc11ea10 con 0x7f1abc11ad80 2024-09-10T14:28:27.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac1cc9640 1 --2- 172.21.15.151:0/3921512992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc11ad80 0x7f1abc11d170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0097f0 tx=0x7f1aac01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475ded063171e589 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:27.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac14c8640 1 -- 172.21.15.151:0/3921512992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aac0ab580 con 0x7f1abc11ad80 2024-09-10T14:28:27.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac14c8640 1 -- 172.21.15.151:0/3921512992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aac0b0070 con 0x7f1abc11ad80 2024-09-10T14:28:27.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac14c8640 1 -- 172.21.15.151:0/3921512992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1aac0ab870 con 0x7f1abc11ad80 2024-09-10T14:28:27.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 -- 172.21.15.151:0/3921512992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc11ad80 msgr2=0x7f1abc11d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:27.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 --2- 172.21.15.151:0/3921512992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc11ad80 0x7f1abc11d170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0097f0 tx=0x7f1aac01c430 comp rx=0 tx=0).stop 2024-09-10T14:28:27.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 -- 172.21.15.151:0/3921512992 shutdown_connections 2024-09-10T14:28:27.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 --2- 172.21.15.151:0/3921512992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc11ad80 0x7f1abc11d170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:27.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 -- 172.21.15.151:0/3921512992 >> 172.21.15.151:0/3921512992 conn(0x7f1abc06e5a0 msgr2=0x7f1abc06e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:27.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 -- 172.21.15.151:0/3921512992 shutdown_connections 2024-09-10T14:28:27.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 -- 172.21.15.151:0/3921512992 wait complete. 2024-09-10T14:28:27.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 Processor -- start 2024-09-10T14:28:27.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 -- start start 2024-09-10T14:28:27.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc112010 0x7f1abc1aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:27.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.975+0000 7f1ac472e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc11e580 con 0x7f1abc112010 2024-09-10T14:28:27.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac24ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc112010 0x7f1abc1aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:27.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac24ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc112010 0x7f1abc1aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52218/0 (socket says 172.21.15.151:52218) 2024-09-10T14:28:27.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac24ca640 1 -- 172.21.15.151:0/3795304084 learned_addr learned my addr 172.21.15.151:0/3795304084 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:27.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac24ca640 1 -- 172.21.15.151:0/3795304084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc1af4f0 con 0x7f1abc112010 2024-09-10T14:28:27.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac24ca640 1 --2- 172.21.15.151:0/3795304084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc112010 0x7f1abc1aef20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800c3b0 tx=0x7f1ab800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:27.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ab2ffd640 1 -- 172.21.15.151:0/3795304084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ab8005200 con 0x7f1abc112010 2024-09-10T14:28:27.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ab2ffd640 1 -- 172.21.15.151:0/3795304084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab80053c0 con 0x7f1abc112010 2024-09-10T14:28:27.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc1af720 con 0x7f1abc112010 2024-09-10T14:28:27.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ab2ffd640 1 -- 172.21.15.151:0/3795304084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ab8007190 con 0x7f1abc112010 2024-09-10T14:28:27.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc1a8fc0 con 0x7f1abc112010 2024-09-10T14:28:27.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc112470 con 0x7f1abc112010 2024-09-10T14:28:27.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ab2ffd640 1 -- 172.21.15.151:0/3795304084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ab8007330 con 0x7f1abc112010 2024-09-10T14:28:27.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ab2ffd640 1 --2- 172.21.15.151:0/3795304084 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1aa0035d60 0x7f1aa0038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:27.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ab2ffd640 1 -- 172.21.15.151:0/3795304084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4272+0+0 (secure 0 0 0) 0x7f1ab8048300 con 0x7f1abc112010 2024-09-10T14:28:27.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac1cc9640 1 --2- 172.21.15.151:0/3795304084 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1aa0035d60 0x7f1aa0038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:27.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.979+0000 7f1ac1cc9640 1 --2- 172.21.15.151:0/3795304084 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1aa0035d60 0x7f1aa0038220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0af000 tx=0x7f1aac0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:27.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:27.995+0000 7f1ab2ffd640 1 -- 172.21.15.151:0/3795304084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1ab80125e0 con 0x7f1abc112010 2024-09-10T14:28:28.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.155+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f1abc11ad80 con 0x7f1abc112010 2024-09-10T14:28:28.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.819+0000 7f1ab2ffd640 1 -- 172.21.15.151:0/3795304084 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v22) ==== 185+0+0 (secure 0 0 0) 0x7f1ab8012840 con 0x7f1abc112010 2024-09-10T14:28:28.825 INFO:teuthology.orchestra.run.smithi151.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-10T14:28:28.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.827+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1aa0035d60 msgr2=0x7f1aa0038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:28.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.827+0000 7f1ac472e640 1 --2- 172.21.15.151:0/3795304084 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1aa0035d60 0x7f1aa0038220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0af000 tx=0x7f1aac0a7000 comp rx=0 tx=0).stop 2024-09-10T14:28:28.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.827+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc112010 msgr2=0x7f1abc1aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:28.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.827+0000 7f1ac472e640 1 --2- 172.21.15.151:0/3795304084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc112010 0x7f1abc1aef20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800c3b0 tx=0x7f1ab800c870 comp rx=0 tx=0).stop 2024-09-10T14:28:28.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.827+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 shutdown_connections 2024-09-10T14:28:28.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.827+0000 7f1ac472e640 1 --2- 172.21.15.151:0/3795304084 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1aa0035d60 0x7f1aa0038220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:28.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.827+0000 7f1ac472e640 1 --2- 172.21.15.151:0/3795304084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1abc112010 0x7f1abc1aef20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:28.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.827+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 >> 172.21.15.151:0/3795304084 conn(0x7f1abc06e5a0 msgr2=0x7f1abc10f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:28.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.839+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 shutdown_connections 2024-09-10T14:28:28.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:28.839+0000 7f1ac472e640 1 -- 172.21.15.151:0/3795304084 wait complete. 2024-09-10T14:28:28.889 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-10T14:28:29.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f571723b640 1 Processor -- start 2024-09-10T14:28:29.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f571723b640 1 -- start start 2024-09-10T14:28:29.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f571723b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f571010f880 0x7f571011b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:29.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f571723b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571011b660 con 0x7f571010ed90 2024-09-10T14:28:29.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f571723b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f571011c840 con 0x7f571010f880 2024-09-10T14:28:29.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f570ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f571010f880 0x7f571011b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:29.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f570ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f571010f880 0x7f571011b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52220/0 (socket says 172.21.15.151:52220) 2024-09-10T14:28:29.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f5714fd7640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f571010ed90 0x7f571010f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:48892/0 (socket says 172.21.15.151:48892) 2024-09-10T14:28:29.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f570ffff640 1 -- 172.21.15.151:0/3870909316 learned_addr learned my addr 172.21.15.151:0/3870909316 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:29.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f570ffff640 1 -- 172.21.15.151:0/3870909316 >> v1:172.21.15.52:6789/0 conn(0x7f571010ed90 legacy=0x7f571010f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:29.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.011+0000 7f570ffff640 1 -- 172.21.15.151:0/3870909316 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571011c9c0 con 0x7f571010f880 2024-09-10T14:28:29.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f570ffff640 1 --2- 172.21.15.151:0/3870909316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010f880 0x7f571011b120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0097f0 tx=0x7f56fc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ed6b14ec6e702d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:29.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f570f7fe640 1 -- 172.21.15.151:0/3870909316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56fc0ab580 con 0x7f571010f880 2024-09-10T14:28:29.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f570f7fe640 1 -- 172.21.15.151:0/3870909316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56fc0b0070 con 0x7f571010f880 2024-09-10T14:28:29.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f570f7fe640 1 -- 172.21.15.151:0/3870909316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56fc0ab870 con 0x7f571010f880 2024-09-10T14:28:29.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f571723b640 1 -- 172.21.15.151:0/3870909316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010f880 msgr2=0x7f571011b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:29.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f571723b640 1 --2- 172.21.15.151:0/3870909316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010f880 0x7f571011b120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0097f0 tx=0x7f56fc01c430 comp rx=0 tx=0).stop 2024-09-10T14:28:29.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f571723b640 1 -- 172.21.15.151:0/3870909316 shutdown_connections 2024-09-10T14:28:29.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f571723b640 1 --2- 172.21.15.151:0/3870909316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010f880 0x7f571011b120 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:29.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f571723b640 1 -- 172.21.15.151:0/3870909316 >> 172.21.15.151:0/3870909316 conn(0x7f571006f390 msgr2=0x7f57100717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:29.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f571723b640 1 -- 172.21.15.151:0/3870909316 shutdown_connections 2024-09-10T14:28:29.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.015+0000 7f571723b640 1 -- 172.21.15.151:0/3870909316 wait complete. 2024-09-10T14:28:29.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f571723b640 1 Processor -- start 2024-09-10T14:28:29.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f571723b640 1 -- start start 2024-09-10T14:28:29.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f571723b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010ed90 0x7f571010ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:29.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f571723b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f571011c490 con 0x7f571010ed90 2024-09-10T14:28:29.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f5714fd7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010ed90 0x7f571010ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:29.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f5714fd7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010ed90 0x7f571010ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52234/0 (socket says 172.21.15.151:52234) 2024-09-10T14:28:29.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f5714fd7640 1 -- 172.21.15.151:0/1893037767 learned_addr learned my addr 172.21.15.151:0/1893037767 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:29.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f5714fd7640 1 -- 172.21.15.151:0/1893037767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57101104b0 con 0x7f571010ed90 2024-09-10T14:28:29.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f5714fd7640 1 --2- 172.21.15.151:0/1893037767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010ed90 0x7f571010ff70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f570400c3a0 tx=0x7f570400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:29.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f570d7fa640 1 -- 172.21.15.151:0/1893037767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5704007410 con 0x7f571010ed90 2024-09-10T14:28:29.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f570d7fa640 1 -- 172.21.15.151:0/1893037767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57040075b0 con 0x7f571010ed90 2024-09-10T14:28:29.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5710110740 con 0x7f571010ed90 2024-09-10T14:28:29.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f570d7fa640 1 -- 172.21.15.151:0/1893037767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5704004920 con 0x7f571010ed90 2024-09-10T14:28:29.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5710110c00 con 0x7f571010ed90 2024-09-10T14:28:29.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571010f170 con 0x7f571010ed90 2024-09-10T14:28:29.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f570d7fa640 1 -- 172.21.15.151:0/1893037767 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f570401a020 con 0x7f571010ed90 2024-09-10T14:28:29.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f570d7fa640 1 --2- 172.21.15.151:0/1893037767 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f4035d60 0x7f56f4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:29.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.019+0000 7f570d7fa640 1 -- 172.21.15.151:0/1893037767 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4283+0+0 (secure 0 0 0) 0x7f5704048a30 con 0x7f571010ed90 2024-09-10T14:28:29.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.023+0000 7f570ffff640 1 --2- 172.21.15.151:0/1893037767 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f4035d60 0x7f56f4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:29.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.023+0000 7f570ffff640 1 --2- 172.21.15.151:0/1893037767 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f4035d60 0x7f56f4038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0af000 tx=0x7f56fc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:29.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.035+0000 7f570d7fa640 1 -- 172.21.15.151:0/1893037767 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5704021070 con 0x7f571010ed90 2024-09-10T14:28:29.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.199+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f571010f880 con 0x7f571010ed90 2024-09-10T14:28:29.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.827+0000 7f570d7fa640 1 -- 172.21.15.151:0/1893037767 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v23) ==== 169+0+0 (secure 0 0 0) 0x7f570401bc30 con 0x7f571010ed90 2024-09-10T14:28:29.833 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'default.rgw.buckets.index' created 2024-09-10T14:28:29.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.831+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f4035d60 msgr2=0x7f56f4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:29.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.831+0000 7f571723b640 1 --2- 172.21.15.151:0/1893037767 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f4035d60 0x7f56f4038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0af000 tx=0x7f56fc0a7000 comp rx=0 tx=0).stop 2024-09-10T14:28:29.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.831+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010ed90 msgr2=0x7f571010ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:29.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.831+0000 7f571723b640 1 --2- 172.21.15.151:0/1893037767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010ed90 0x7f571010ff70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f570400c3a0 tx=0x7f570400c860 comp rx=0 tx=0).stop 2024-09-10T14:28:29.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.835+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 shutdown_connections 2024-09-10T14:28:29.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.835+0000 7f571723b640 1 --2- 172.21.15.151:0/1893037767 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f4035d60 0x7f56f4038220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:29.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.835+0000 7f571723b640 1 --2- 172.21.15.151:0/1893037767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f571010ed90 0x7f571010ff70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:29.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.835+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 >> 172.21.15.151:0/1893037767 conn(0x7f571006f390 msgr2=0x7f5710117650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:29.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.835+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 shutdown_connections 2024-09-10T14:28:29.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.835+0000 7f571723b640 1 -- 172.21.15.151:0/1893037767 wait complete. 2024-09-10T14:28:29.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-10T14:28:29.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6f570640 1 Processor -- start 2024-09-10T14:28:29.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6f570640 1 -- start start 2024-09-10T14:28:29.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6f570640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e68116050 0x7f1e68113f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:29.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6f570640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e681145b0 con 0x7f1e68115b80 2024-09-10T14:28:29.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6f570640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1e68122cf0 con 0x7f1e68116050 2024-09-10T14:28:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6cb0b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e68116050 0x7f1e68113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6d30c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1e68115b80 0x7f1e68113870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:48900/0 (socket says 172.21.15.151:48900) 2024-09-10T14:28:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6d30c640 1 -- 172.21.15.151:0/144614800 learned_addr learned my addr 172.21.15.151:0/144614800 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6cb0b640 1 -- 172.21.15.151:0/144614800 >> v1:172.21.15.52:6789/0 conn(0x7f1e68115b80 legacy=0x7f1e68113870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:29.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e5ffff640 1 -- 172.21.15.151:0/144614800 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180978083 0 0) 0x7f1e681145b0 con 0x7f1e68115b80 2024-09-10T14:28:29.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.983+0000 7f1e6cb0b640 1 -- 172.21.15.151:0/144614800 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e68122e70 con 0x7f1e68116050 2024-09-10T14:28:29.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6cb0b640 1 --2- 172.21.15.151:0/144614800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68116050 0x7f1e68113f80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009740 tx=0x7f1e6401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b60d2c975dc75ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:29.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e5ffff640 1 -- 172.21.15.151:0/144614800 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e640b1070 con 0x7f1e68116050 2024-09-10T14:28:29.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e5ffff640 1 -- 172.21.15.151:0/144614800 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e640ac520 con 0x7f1e68116050 2024-09-10T14:28:29.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e5ffff640 1 -- 172.21.15.151:0/144614800 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e640ac820 con 0x7f1e68116050 2024-09-10T14:28:29.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 -- 172.21.15.151:0/144614800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68116050 msgr2=0x7f1e68113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:29.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 --2- 172.21.15.151:0/144614800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68116050 0x7f1e68113f80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009740 tx=0x7f1e6401c370 comp rx=0 tx=0).stop 2024-09-10T14:28:29.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 -- 172.21.15.151:0/144614800 shutdown_connections 2024-09-10T14:28:29.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 --2- 172.21.15.151:0/144614800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68116050 0x7f1e68113f80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:29.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 -- 172.21.15.151:0/144614800 >> 172.21.15.151:0/144614800 conn(0x7f1e6806f390 msgr2=0x7f1e680717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:29.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 -- 172.21.15.151:0/144614800 shutdown_connections 2024-09-10T14:28:29.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 -- 172.21.15.151:0/144614800 wait complete. 2024-09-10T14:28:29.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 Processor -- start 2024-09-10T14:28:29.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 -- start start 2024-09-10T14:28:29.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68115b80 0x7f1e681b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:29.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6f570640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681133a0 con 0x7f1e68115b80 2024-09-10T14:28:29.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6d30c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68115b80 0x7f1e681b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:29.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6d30c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68115b80 0x7f1e681b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:52252/0 (socket says 172.21.15.151:52252) 2024-09-10T14:28:29.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.987+0000 7f1e6d30c640 1 -- 172.21.15.151:0/4278038841 learned_addr learned my addr 172.21.15.151:0/4278038841 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:29.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e6d30c640 1 -- 172.21.15.151:0/4278038841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e681b37b0 con 0x7f1e68115b80 2024-09-10T14:28:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e6d30c640 1 --2- 172.21.15.151:0/4278038841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68115b80 0x7f1e681b31e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1e580011f0 tx=0x7f1e5800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e5dffb640 1 -- 172.21.15.151:0/4278038841 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e58018070 con 0x7f1e68115b80 2024-09-10T14:28:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e5dffb640 1 -- 172.21.15.151:0/4278038841 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e58007410 con 0x7f1e68115b80 2024-09-10T14:28:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e681b3a40 con 0x7f1e68115b80 2024-09-10T14:28:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e5dffb640 1 -- 172.21.15.151:0/4278038841 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e580047f0 con 0x7f1e68115b80 2024-09-10T14:28:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e681ad450 con 0x7f1e68115b80 2024-09-10T14:28:29.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e68113870 con 0x7f1e68115b80 2024-09-10T14:28:29.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e5dffb640 1 -- 172.21.15.151:0/4278038841 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e5801b070 con 0x7f1e68115b80 2024-09-10T14:28:29.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e5dffb640 1 --2- 172.21.15.151:0/4278038841 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e4c035db0 0x7f1e4c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:29.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e5dffb640 1 -- 172.21.15.151:0/4278038841 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4647+0+0 (secure 0 0 0) 0x7f1e58048360 con 0x7f1e68115b80 2024-09-10T14:28:29.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e6cb0b640 1 --2- 172.21.15.151:0/4278038841 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e4c035db0 0x7f1e4c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:29.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:29.991+0000 7f1e6cb0b640 1 --2- 172.21.15.151:0/4278038841 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e4c035db0 0x7f1e4c038270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e640ae000 tx=0x7f1e640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:30.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.007+0000 7f1e5dffb640 1 -- 172.21.15.151:0/4278038841 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e580104c0 con 0x7f1e68115b80 2024-09-10T14:28:30.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.167+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f1e681b3c70 con 0x7f1e68115b80 2024-09-10T14:28:30.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.835+0000 7f1e5dffb640 1 -- 172.21.15.151:0/4278038841 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v24) ==== 187+0+0 (secure 0 0 0) 0x7f1e58010720 con 0x7f1e68115b80 2024-09-10T14:28:30.838 INFO:teuthology.orchestra.run.smithi151.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-10T14:28:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.843+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e4c035db0 msgr2=0x7f1e4c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.843+0000 7f1e6f570640 1 --2- 172.21.15.151:0/4278038841 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e4c035db0 0x7f1e4c038270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e640ae000 tx=0x7f1e640a7000 comp rx=0 tx=0).stop 2024-09-10T14:28:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.843+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68115b80 msgr2=0x7f1e681b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.843+0000 7f1e6f570640 1 --2- 172.21.15.151:0/4278038841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68115b80 0x7f1e681b31e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1e580011f0 tx=0x7f1e5800c930 comp rx=0 tx=0).stop 2024-09-10T14:28:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.843+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 shutdown_connections 2024-09-10T14:28:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.843+0000 7f1e6f570640 1 --2- 172.21.15.151:0/4278038841 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e4c035db0 0x7f1e4c038270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.843+0000 7f1e6f570640 1 --2- 172.21.15.151:0/4278038841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e68115b80 0x7f1e681b31e0 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1e580011f0 tx=0x7f1e5800c930 comp rx=0 tx=0).stop 2024-09-10T14:28:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.843+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 >> 172.21.15.151:0/4278038841 conn(0x7f1e6806f390 msgr2=0x7f1e681100a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:30.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.847+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 shutdown_connections 2024-09-10T14:28:30.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:30.851+0000 7f1e6f570640 1 -- 172.21.15.151:0/4278038841 wait complete. 2024-09-10T14:28:30.885 DEBUG:tasks.rgw:Pools created 2024-09-10T14:28:30.886 INFO:tasks.rgw:Starting rgw... 2024-09-10T14:28:30.886 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-10T14:28:30.886 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-10T14:28:30.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo echo -n http://smithi151.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-10T14:28:30.899 INFO:teuthology.orchestra.run.smithi151.stdout:http://smithi151.front.sepia.ceph.com:80 2024-09-10T14:28:30.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-10T14:28:30.951 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-10T14:28:30.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-10T14:28:30.995 INFO:tasks.rgw.client.0:Started 2024-09-10T14:28:30.995 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi151.front.sepia.ceph.com:80/ 2024-09-10T14:28:30.995 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-10T14:28:31.021 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T14:28:31.021 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-10T14:28:31.022 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T14:28:31.022 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T14:28:31.022 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T14:28:32.023 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-10T14:28:32.035 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T14:28:32.036 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-10T14:28:32.036 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T14:28:32.036 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T14:28:32.036 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T14:28:34.038 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-10T14:28:34.050 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T14:28:34.050 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-10T14:28:34.050 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T14:28:34.050 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T14:28:34.051 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T14:28:38.052 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-10T14:28:38.064 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T14:28:38.064 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-10T14:28:38.064 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T14:28:38.064 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T14:28:38.064 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T14:28:40.052 INFO:tasks.rgw.client.0.smithi151.stdout:2024-09-10T14:28:40.047+0000 7fb5b894fa40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-10T14:28:46.065 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-10T14:28:46.077 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T14:28:46.077 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-10T14:28:46.080 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 55407 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-10T14:28:46.081 INFO:teuthology.orchestra.run.smithi151.stdout:anonymous 2024-09-10T14:28:46.081 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-10T14:28:46.674 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-10T14:28:46.675 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T14:28:46.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T14:28:46.675 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T14:28:46.711 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:46.712 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:46.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.707+0000 7f9d57122980 1 Processor -- start 2024-09-10T14:28:46.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.707+0000 7f9d57122980 1 -- start start 2024-09-10T14:28:46.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.707+0000 7f9d57122980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564a7b214de0 0x564a7b2171d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.707+0000 7f9d57122980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564a7b09aae0 con 0x564a7b217740 2024-09-10T14:28:46.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.707+0000 7f9d57122980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x564a7b0bee30 con 0x564a7b214de0 2024-09-10T14:28:46.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.711+0000 7f9d54c32640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564a7b214de0 0x564a7b2171d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.711+0000 7f9d54c32640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564a7b214de0 0x564a7b2171d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40568/0 (socket says 172.21.15.151:40568) 2024-09-10T14:28:46.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.711+0000 7f9d54431640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564a7b217740 0x564a7b219b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34060/0 (socket says 172.21.15.151:34060) 2024-09-10T14:28:46.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.711+0000 7f9d54c32640 1 -- 172.21.15.151:0/3450143029 learned_addr learned my addr 172.21.15.151:0/3450143029 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.711+0000 7f9d53c30640 1 -- 172.21.15.151:0/3450143029 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648155581 0 0) 0x564a7b09aae0 con 0x564a7b217740 2024-09-10T14:28:46.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.711+0000 7f9d54c32640 1 -- 172.21.15.151:0/3450143029 >> v1:172.21.15.52:6789/0 conn(0x564a7b217740 legacy=0x564a7b219b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.711+0000 7f9d54c32640 1 -- 172.21.15.151:0/3450143029 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7b21c3e0 con 0x564a7b214de0 2024-09-10T14:28:46.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d54c32640 1 --2- 172.21.15.151:0/3450143029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b214de0 0x564a7b2171d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00a4e0 tx=0x7f9d4c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda4274a91923085 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d53c30640 1 -- 172.21.15.151:0/3450143029 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0aa540 con 0x564a7b214de0 2024-09-10T14:28:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d53c30640 1 -- 172.21.15.151:0/3450143029 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0aa6e0 con 0x564a7b214de0 2024-09-10T14:28:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d53c30640 1 -- 172.21.15.151:0/3450143029 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0aaa00 con 0x564a7b214de0 2024-09-10T14:28:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d57122980 1 -- 172.21.15.151:0/3450143029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b214de0 msgr2=0x564a7b2171d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d57122980 1 --2- 172.21.15.151:0/3450143029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b214de0 0x564a7b2171d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00a4e0 tx=0x7f9d4c01b090 comp rx=0 tx=0).stop 2024-09-10T14:28:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d57122980 1 -- 172.21.15.151:0/3450143029 shutdown_connections 2024-09-10T14:28:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d57122980 1 --2- 172.21.15.151:0/3450143029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b214de0 0x564a7b2171d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d57122980 1 -- 172.21.15.151:0/3450143029 >> 172.21.15.151:0/3450143029 conn(0x564a7b188270 msgr2=0x564a7b188680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d57122980 1 -- 172.21.15.151:0/3450143029 shutdown_connections 2024-09-10T14:28:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.715+0000 7f9d57122980 1 -- 172.21.15.151:0/3450143029 wait complete. 2024-09-10T14:28:46.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.731+0000 7f9d57122980 1 Processor -- start 2024-09-10T14:28:46.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.731+0000 7f9d57122980 1 -- start start 2024-09-10T14:28:46.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.731+0000 7f9d57122980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b2ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.731+0000 7f9d57122980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a7b0c0200 con 0x564a7b217740 2024-09-10T14:28:46.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b2ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b2ffb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40574/0 (socket says 172.21.15.151:40574) 2024-09-10T14:28:46.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d54c32640 1 -- 172.21.15.151:0/1529895355 learned_addr learned my addr 172.21.15.151:0/1529895355 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d54c32640 1 -- 172.21.15.151:0/1529895355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7b300120 con 0x564a7b217740 2024-09-10T14:28:46.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d54c32640 1 --2- 172.21.15.151:0/1529895355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b2ffb50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c018cc0 tx=0x7f9d4c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e209d9d461743b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9c42e0d640 1 -- 172.21.15.151:0/1529895355 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0b9030 con 0x564a7b217740 2024-09-10T14:28:46.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9c42e0d640 1 -- 172.21.15.151:0/1529895355 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0aa9e0 con 0x564a7b217740 2024-09-10T14:28:46.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9c42e0d640 1 -- 172.21.15.151:0/1529895355 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0aad00 con 0x564a7b217740 2024-09-10T14:28:46.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 -- 172.21.15.151:0/1529895355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 msgr2=0x564a7b2ffb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 --2- 172.21.15.151:0/1529895355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b2ffb50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c018cc0 tx=0x7f9d4c0033b0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 -- 172.21.15.151:0/1529895355 shutdown_connections 2024-09-10T14:28:46.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 --2- 172.21.15.151:0/1529895355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b2ffb50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 -- 172.21.15.151:0/1529895355 >> 172.21.15.151:0/1529895355 conn(0x564a7b188270 msgr2=0x564a7b2fb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 -- 172.21.15.151:0/1529895355 shutdown_connections 2024-09-10T14:28:46.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 -- 172.21.15.151:0/1529895355 wait complete. 2024-09-10T14:28:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 Processor -- start 2024-09-10T14:28:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 -- start start 2024-09-10T14:28:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b306e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d57122980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a7b21be20 con 0x564a7b217740 2024-09-10T14:28:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b306e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b306e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40588/0 (socket says 172.21.15.151:40588) 2024-09-10T14:28:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.735+0000 7f9d54c32640 1 -- 172.21.15.151:0/760893378 learned_addr learned my addr 172.21.15.151:0/760893378 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d54c32640 1 -- 172.21.15.151:0/760893378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7b307370 con 0x564a7b217740 2024-09-10T14:28:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d54c32640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b306e30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c01b570 tx=0x7f9d4c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9c4160a640 1 -- 172.21.15.151:0/760893378 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0b9070 con 0x564a7b217740 2024-09-10T14:28:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9c4160a640 1 -- 172.21.15.151:0/760893378 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0b5a70 con 0x564a7b217740 2024-09-10T14:28:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a7b307600 con 0x564a7b217740 2024-09-10T14:28:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9c4160a640 1 -- 172.21.15.151:0/760893378 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0b5d50 con 0x564a7b217740 2024-09-10T14:28:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a7b30a2e0 con 0x564a7b217740 2024-09-10T14:28:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9c4160a640 1 -- 172.21.15.151:0/760893378 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9d4c0b3040 con 0x564a7b217740 2024-09-10T14:28:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9c4160a640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c3c034650 0x7f9c3c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9c4160a640 1 -- 172.21.15.151:0/760893378 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9d4c002050 con 0x564a7b217740 2024-09-10T14:28:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d54431640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c3c034650 0x7f9c3c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d57122980 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b30bdb0 0x564a7b30e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b30e7f0 con 0x564a7b30bdb0 2024-09-10T14:28:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d55433640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b30bdb0 0x564a7b30e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d54431640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c3c034650 0x7f9c3c036b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d48000c10 tx=0x7f9d480013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d55433640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b30bdb0 0x564a7b30e1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d55433640 1 -- 172.21.15.151:0/760893378 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b30bdb0 2024-09-10T14:28:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b30b4e0 con 0x564a7b30bdb0 2024-09-10T14:28:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.739+0000 7f9d55433640 1 -- 172.21.15.151:0/760893378 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b30bdb0 2024-09-10T14:28:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b310ae0 0x564a7b312ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3135a0 con 0x564a7b310ae0 2024-09-10T14:28:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d54c32640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b310ae0 0x564a7b312ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d54c32640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b310ae0 0x564a7b312ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d54c32640 1 -- 172.21.15.151:0/760893378 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d4c0b4cc0 con 0x564a7b310ae0 2024-09-10T14:28:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b30f980 con 0x564a7b30bdb0 2024-09-10T14:28:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d55433640 1 -- 172.21.15.151:0/760893378 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b30bdb0 2024-09-10T14:28:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564a7b314a00 0x564a7b316df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3174f0 con 0x564a7b314a00 2024-09-10T14:28:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d54431640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564a7b314a00 0x564a7b316df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d54431640 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564a7b314a00 0x564a7b316df0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d54431640 1 -- 172.21.15.151:0/760893378 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d4800f680 con 0x564a7b314a00 2024-09-10T14:28:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 Processor -- start 2024-09-10T14:28:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 -- start start 2024-09-10T14:28:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b324fc0 0x564a7b3253e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.743+0000 7f9d57122980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a7b119800 con 0x564a7b324fc0 2024-09-10T14:28:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b324fc0 0x564a7b3253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b324fc0 0x564a7b3253e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40592/0 (socket says 172.21.15.151:40592) 2024-09-10T14:28:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d54c32640 1 -- 172.21.15.151:0/3234379403 learned_addr learned my addr 172.21.15.151:0/3234379403 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d54c32640 1 -- 172.21.15.151:0/3234379403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7b325920 con 0x564a7b324fc0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d54c32640 1 --2- 172.21.15.151:0/3234379403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b324fc0 0x564a7b3253e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0a9940 tx=0x7f9d4c0b4460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9c3a7fc640 1 -- 172.21.15.151:0/3234379403 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0b4730 con 0x564a7b324fc0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9c3a7fc640 1 -- 172.21.15.151:0/3234379403 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0b48d0 con 0x564a7b324fc0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d57122980 1 -- 172.21.15.151:0/3234379403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a7b325bb0 con 0x564a7b324fc0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9c3a7fc640 1 -- 172.21.15.151:0/3234379403 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0bca90 con 0x564a7b324fc0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d57122980 1 -- 172.21.15.151:0/3234379403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a7b328830 con 0x564a7b324fc0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9c3a7fc640 1 -- 172.21.15.151:0/3234379403 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9d4c0bcc30 con 0x564a7b324fc0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9c3a7fc640 1 --2- 172.21.15.151:0/3234379403 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c2c034650 0x7f9c2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9c3a7fc640 1 -- 172.21.15.151:0/3234379403 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9d4c0e6030 con 0x564a7b324fc0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d54431640 1 --2- 172.21.15.151:0/3234379403 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c2c034650 0x7f9c2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d57122980 1 Processor -- start 2024-09-10T14:28:46.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d57122980 1 -- start start 2024-09-10T14:28:46.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d54431640 1 --2- 172.21.15.151:0/3234379403 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c2c034650 0x7f9c2c036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x564a7b30f090 tx=0x7f9d48006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d57122980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b331c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.747+0000 7f9d57122980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a7b3003e0 con 0x564a7b331880 2024-09-10T14:28:46.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b331c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b331c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40606/0 (socket says 172.21.15.151:40606) 2024-09-10T14:28:46.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 -- 172.21.15.151:0/1321898516 learned_addr learned my addr 172.21.15.151:0/1321898516 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 -- 172.21.15.151:0/1321898516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7b332250 con 0x564a7b331880 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 --2- 172.21.15.151:0/1321898516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b331c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0e2180 tx=0x7f9d4c0e9660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7338a31fc9da45af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9c2bfff640 1 -- 172.21.15.151:0/1321898516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0c7a90 con 0x564a7b331880 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9c2bfff640 1 -- 172.21.15.151:0/1321898516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0d1400 con 0x564a7b331880 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9c2bfff640 1 -- 172.21.15.151:0/1321898516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0c7c30 con 0x564a7b331880 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 -- 172.21.15.151:0/1321898516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 msgr2=0x564a7b331c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 --2- 172.21.15.151:0/1321898516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b331c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0e2180 tx=0x7f9d4c0e9660 comp rx=0 tx=0).stop 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 -- 172.21.15.151:0/1321898516 shutdown_connections 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 --2- 172.21.15.151:0/1321898516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b331c80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 -- 172.21.15.151:0/1321898516 >> 172.21.15.151:0/1321898516 conn(0x564a7b32dc60 msgr2=0x564a7b32bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 -- 172.21.15.151:0/1321898516 shutdown_connections 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 -- 172.21.15.151:0/1321898516 wait complete. 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 Processor -- start 2024-09-10T14:28:46.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 -- start start 2024-09-10T14:28:46.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b338b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a7b332670 con 0x564a7b331880 2024-09-10T14:28:46.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b338b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b338b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40618/0 (socket says 172.21.15.151:40618) 2024-09-10T14:28:46.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 learned_addr learned my addr 172.21.15.151:0/1770600958 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7b339060 con 0x564a7b331880 2024-09-10T14:28:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d54c32640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b338b20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0e2210 tx=0x7f9d4c0b1ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9c2a7fc640 1 -- 172.21.15.151:0/1770600958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0d15b0 con 0x564a7b331880 2024-09-10T14:28:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9c2a7fc640 1 -- 172.21.15.151:0/1770600958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0c8420 con 0x564a7b331880 2024-09-10T14:28:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.751+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a7b339060 con 0x564a7b331880 2024-09-10T14:28:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9c2a7fc640 1 -- 172.21.15.151:0/1770600958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4c0c8740 con 0x564a7b331880 2024-09-10T14:28:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a7b3394d0 con 0x564a7b331880 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9c2a7fc640 1 -- 172.21.15.151:0/1770600958 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9d4c0be610 con 0x564a7b331880 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9c2a7fc640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c200346a0 0x7f9c20036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9c2a7fc640 1 -- 172.21.15.151:0/1770600958 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9d4c108070 con 0x564a7b331880 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d54431640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c200346a0 0x7f9c20036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b343b30 0x564a7b345fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b346720 con 0x564a7b343b30 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d55433640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b343b30 0x564a7b345fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d54431640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c200346a0 0x7f9c20036b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x564a7b3178f0 tx=0x7f9d48023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d55433640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b343b30 0x564a7b345fd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 realm 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b346b30 con 0x564a7b343b30 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3473d0 con 0x564a7b343b30 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b3484d0 0x564a7b34a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.755+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34ae00 con 0x564a7b3484d0 2024-09-10T14:28:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54c32640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b3484d0 0x564a7b34a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54c32640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b3484d0 0x564a7b34a8c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d4c112020 con 0x564a7b3484d0 2024-09-10T14:28:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d57122980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d57122980 20 searching for the correct realm 2024-09-10T14:28:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34c6a0 con 0x564a7b3484d0 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c112020 con 0x564a7b3484d0 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54c32640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x564a7b214de0 0x7f9d4c0b9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34c6a0 con 0x564a7b214de0 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54431640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x564a7b214de0 0x7f9d4c0b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54431640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x564a7b214de0 0x7f9d4c0b9970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54431640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9d4801f940 0x7f9d4803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34c6a0 con 0x7f9d4801f940 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d55433640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9d4801f940 0x7f9d4803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d55433640 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9d4801f940 0x7f9d4803a3c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.759+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x7f9d4801f940 2024-09-10T14:28:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x7f9d4801f940 2024-09-10T14:28:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b214de0 2024-09-10T14:28:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b3484d0 2024-09-10T14:28:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c112020 con 0x564a7b3484d0 2024-09-10T14:28:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x7f9d4801f940 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.763+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b214de0 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b3484d0 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d4c112020 con 0x564a7b3484d0 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b3484d0 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c112020 con 0x564a7b3484d0 2024-09-10T14:28:46.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x7f9d4801f940 2024-09-10T14:28:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b3484d0 2024-09-10T14:28:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c112020 con 0x564a7b3484d0 2024-09-10T14:28:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b3484d0 2024-09-10T14:28:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c112020 con 0x564a7b3484d0 2024-09-10T14:28:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x7f9d4801f940 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b3484d0 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.767+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b214de0 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x7f9d4801f940 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b3484d0 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x7f9d4801f940 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b214de0 2024-09-10T14:28:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b3484d0 2024-09-10T14:28:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x7f9d4801f940 2024-09-10T14:28:46.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b343b30 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.771+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b347770 con 0x564a7b214de0 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34b650 con 0x564a7b343b30 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34ba40 con 0x564a7b343b30 2024-09-10T14:28:46.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:46.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34ba40 con 0x7f9d4801f940 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 zone default found 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 4 Realm: () 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 zonegroup default 2024-09-10T14:28:46.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34be60 con 0x7f9d4801f940 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34c280 con 0x564a7b3484d0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34e550 con 0x564a7b3484d0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 started sync module instance, tier type = 2024-09-10T14:28:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:46.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.775+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34d9f0 con 0x564a7b214de0 2024-09-10T14:28:46.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.779+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.779+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94877894630928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34d650 con 0x564a7b214de0 2024-09-10T14:28:46.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.779+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34f450 con 0x564a7b343b30 2024-09-10T14:28:46.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.779+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94877894630928] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.779+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.779+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94877894633792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34f840 con 0x564a7b343b30 2024-09-10T14:28:46.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.779+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b350200 con 0x564a7b3484d0 2024-09-10T14:28:46.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.783+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94877894633792] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.783+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.783+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94877894638928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3505f0 con 0x564a7b3484d0 2024-09-10T14:28:46.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.783+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b350fb0 con 0x564a7b214de0 2024-09-10T14:28:46.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.783+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.783+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94877894644560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b214de0 2024-09-10T14:28:46.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.783+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3525e0 con 0x564a7b343b30 2024-09-10T14:28:46.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.783+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94877894638928] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.787+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94877894644560] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.787+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.787+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94877894635360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351880 con 0x564a7b343b30 2024-09-10T14:28:46.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.787+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3525e0 con 0x7f9d4801f940 2024-09-10T14:28:46.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.787+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94877894635360] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.787+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.787+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94877894650912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3525e0 con 0x7f9d4801f940 2024-09-10T14:28:46.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.791+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3536b0 con 0x7f9d4801f940 2024-09-10T14:28:46.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.791+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.791+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94877894652288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b353b20 con 0x7f9d4801f940 2024-09-10T14:28:46.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.791+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3545d0 con 0x7f9d4801f940 2024-09-10T14:28:46.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.791+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94877894650912] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94877894652288] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94877894648112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b353670 con 0x7f9d4801f940 2024-09-10T14:28:46.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 20 add_watcher() i=0 2024-09-10T14:28:46.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 20 add_watcher() i=1 2024-09-10T14:28:46.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 20 add_watcher() i=2 2024-09-10T14:28:46.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 20 add_watcher() i=3 2024-09-10T14:28:46.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 20 add_watcher() i=4 2024-09-10T14:28:46.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 20 add_watcher() i=5 2024-09-10T14:28:46.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 20 add_watcher() i=6 2024-09-10T14:28:46.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94877894648112] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 20 add_watcher() i=7 2024-09-10T14:28:46.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:46.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.795+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3576d0 con 0x564a7b343b30 2024-09-10T14:28:46.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94877894656224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b354b50 con 0x564a7b343b30 2024-09-10T14:28:46.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94877894656224] v33'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9c0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:46.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d57122980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:46.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d57122980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:46.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d57122980 5 note: GC not initialized 2024-09-10T14:28:46.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9c09fe3640 20 reqs_thread_entry: start 2024-09-10T14:28:46.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d57122980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:46.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d57122980 20 Filter name: none 2024-09-10T14:28:46.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9b7b7fe640 20 reqs_thread_entry: start 2024-09-10T14:28:46.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b37a210 con 0x564a7b3484d0 2024-09-10T14:28:46.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3505f0 con 0x564a7b3484d0 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3505f0 con 0x564a7b343b30 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34b650 con 0x564a7b343b30 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.799+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34b650 con 0x564a7b214de0 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b3484d0 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b343b30 2024-09-10T14:28:46.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b3484d0 2024-09-10T14:28:46.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b214de0 2024-09-10T14:28:46.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b3484d0 2024-09-10T14:28:46.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b343b30 2024-09-10T14:28:46.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x7f9d4801f940 2024-09-10T14:28:46.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x7f9d4801f940 2024-09-10T14:28:46.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b3484d0 2024-09-10T14:28:46.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.803+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x7f9d4801f940 2024-09-10T14:28:46.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x7f9d4801f940 2024-09-10T14:28:46.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x7f9d4801f940 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b3484d0 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b214de0 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(80 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b343b30 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b343b30 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b3484d0 2024-09-10T14:28:46.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b214de0 2024-09-10T14:28:46.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x7f9d4801f940 2024-09-10T14:28:46.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.807+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b343b30 2024-09-10T14:28:46.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x7f9d4801f940 2024-09-10T14:28:46.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b3484d0 2024-09-10T14:28:46.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b214de0 2024-09-10T14:28:46.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x7f9d4801f940 2024-09-10T14:28:46.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b343b30 2024-09-10T14:28:46.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b3484d0 2024-09-10T14:28:46.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351c20 con 0x564a7b214de0 2024-09-10T14:28:46.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.811+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.815+0000 7f9c0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:46.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.815+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94877894656224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b3505f0 con 0x564a7b343b30 2024-09-10T14:28:46.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94877894656224] v33'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94877894630928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34b650 con 0x564a7b214de0 2024-09-10T14:28:46.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94877894630928] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d57122980 20 remove_watcher() i=0 2024-09-10T14:28:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d57122980 2 removed watcher, disabling cache 2024-09-10T14:28:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94877894633792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34b650 con 0x564a7b343b30 2024-09-10T14:28:46.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94877894633792] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d57122980 20 remove_watcher() i=1 2024-09-10T14:28:46.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.819+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94877894638928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34b650 con 0x564a7b3484d0 2024-09-10T14:28:46.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.823+0000 7f9d54c32640 1 -- 172.21.15.151:0/1770600958 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94877894638928] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d4c12b040 con 0x564a7b3484d0 2024-09-10T14:28:46.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.823+0000 7f9d57122980 20 remove_watcher() i=2 2024-09-10T14:28:46.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.823+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94877894644560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34e940 con 0x564a7b214de0 2024-09-10T14:28:46.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.823+0000 7f9d54431640 1 -- 172.21.15.151:0/1770600958 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94877894644560] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d48037040 con 0x564a7b214de0 2024-09-10T14:28:46.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.823+0000 7f9d57122980 20 remove_watcher() i=3 2024-09-10T14:28:46.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.823+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94877894635360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351350 con 0x564a7b343b30 2024-09-10T14:28:46.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.827+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94877894635360] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x564a7b343b30 2024-09-10T14:28:46.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.827+0000 7f9d57122980 20 remove_watcher() i=4 2024-09-10T14:28:46.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.827+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94877894650912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34e940 con 0x7f9d4801f940 2024-09-10T14:28:46.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.827+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94877894650912] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.827+0000 7f9d57122980 20 remove_watcher() i=5 2024-09-10T14:28:46.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.827+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94877894652288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b34ef60 con 0x7f9d4801f940 2024-09-10T14:28:46.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.831+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94877894652288] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.831+0000 7f9d57122980 20 remove_watcher() i=6 2024-09-10T14:28:46.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.831+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94877894648112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564a7b351350 con 0x7f9d4801f940 2024-09-10T14:28:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94877894648112] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d440083f0 con 0x7f9d4801f940 2024-09-10T14:28:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 20 remove_watcher() i=7 2024-09-10T14:28:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9d4801f940 msgr2=0x7f9d4803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9d4801f940 0x7f9d4803a3c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b343b30 msgr2=0x564a7b345fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b343b30 0x564a7b345fd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x564a7b214de0 msgr2=0x7f9d4c0b9970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x564a7b214de0 0x7f9d4c0b9970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b3484d0 msgr2=0x564a7b34a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b3484d0 0x564a7b34a8c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c200346a0 msgr2=0x7f9c20036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c200346a0 0x7f9c20036b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x564a7b3178f0 tx=0x7f9d48023040 comp rx=0 tx=0).stop 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 msgr2=0x564a7b338b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/1770600958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b331880 0x564a7b338b20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0e2210 tx=0x7f9d4c0b1ed0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 reap_dead start 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d55433640 1 -- 172.21.15.151:0/1770600958 reap_dead start 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 shutdown_connections 2024-09-10T14:28:46.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 >> 172.21.15.151:0/1770600958 conn(0x564a7b32dc60 msgr2=0x564a7b32bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 shutdown_connections 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/1770600958 wait complete. 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/3234379403 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c2c034650 msgr2=0x7f9c2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/3234379403 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c2c034650 0x7f9c2c036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x564a7b30f090 tx=0x7f9d48006000 comp rx=0 tx=0).stop 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/3234379403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b324fc0 msgr2=0x564a7b3253e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/3234379403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b324fc0 0x564a7b3253e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c0a9940 tx=0x7f9d4c0b4460 comp rx=0 tx=0).stop 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/3234379403 shutdown_connections 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/3234379403 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c2c034650 0x7f9c2c036b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/3234379403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b324fc0 0x564a7b3253e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/3234379403 >> 172.21.15.151:0/3234379403 conn(0x564a7b31a110 msgr2=0x564a7b31cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/3234379403 shutdown_connections 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/3234379403 wait complete. 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564a7b314a00 msgr2=0x564a7b316df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564a7b314a00 0x564a7b316df0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b30bdb0 msgr2=0x564a7b30e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564a7b30bdb0 0x564a7b30e1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b310ae0 msgr2=0x564a7b312ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564a7b310ae0 0x564a7b312ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c3c034650 msgr2=0x7f9c3c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9c3c034650 0x7f9c3c036b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d48000c10 tx=0x7f9d480013c0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 msgr2=0x564a7b306e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 --2- 172.21.15.151:0/760893378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a7b217740 0x564a7b306e30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c01b570 tx=0x7f9d4c017e30 comp rx=0 tx=0).stop 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d55433640 1 -- 172.21.15.151:0/760893378 reap_dead start 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 shutdown_connections 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 >> 172.21.15.151:0/760893378 conn(0x564a7b188270 msgr2=0x564a7b2fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 shutdown_connections 2024-09-10T14:28:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.835+0000 7f9d57122980 1 -- 172.21.15.151:0/760893378 wait complete. 2024-09-10T14:28:46.850 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-10T14:28:46.850 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T14:28:46.850 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-10T14:28:46.850 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-10T14:28:46.851 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-10T14:28:46.930 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:46.930 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:46.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5815b02980 1 Processor -- start 2024-09-10T14:28:46.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5815b02980 1 -- start start 2024-09-10T14:28:46.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5815b02980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55bdd96e5ac0 0x55bdd96e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5815b02980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bdd956fae0 con 0x55bdd96e63e0 2024-09-10T14:28:46.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5815b02980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55bdd9593e30 con 0x55bdd96e5ac0 2024-09-10T14:28:46.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5813612640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55bdd96e5ac0 0x55bdd96e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5813612640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55bdd96e5ac0 0x55bdd96e5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40634/0 (socket says 172.21.15.151:40634) 2024-09-10T14:28:46.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5812e11640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55bdd96e63e0 0x55bdd96ecb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34070/0 (socket says 172.21.15.151:34070) 2024-09-10T14:28:46.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5813612640 1 -- 172.21.15.151:0/2166879715 learned_addr learned my addr 172.21.15.151:0/2166879715 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5813612640 1 -- 172.21.15.151:0/2166879715 >> v1:172.21.15.52:6789/0 conn(0x55bdd96e63e0 legacy=0x55bdd96ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.927+0000 7f5813612640 1 -- 172.21.15.151:0/2166879715 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd96ef2c0 con 0x55bdd96e5ac0 2024-09-10T14:28:46.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5813612640 1 --2- 172.21.15.151:0/2166879715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd96e5ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f580400a5c0 tx=0x7f580401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1531b3aa0f4e4488 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5812610640 1 -- 172.21.15.151:0/2166879715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040a6070 con 0x55bdd96e5ac0 2024-09-10T14:28:46.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5812610640 1 -- 172.21.15.151:0/2166879715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58040af070 con 0x55bdd96e5ac0 2024-09-10T14:28:46.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5812610640 1 -- 172.21.15.151:0/2166879715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040aa5c0 con 0x55bdd96e5ac0 2024-09-10T14:28:46.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5815b02980 1 -- 172.21.15.151:0/2166879715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 msgr2=0x55bdd96e5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5815b02980 1 --2- 172.21.15.151:0/2166879715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd96e5ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f580400a5c0 tx=0x7f580401b340 comp rx=0 tx=0).stop 2024-09-10T14:28:46.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5815b02980 1 -- 172.21.15.151:0/2166879715 shutdown_connections 2024-09-10T14:28:46.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5815b02980 1 --2- 172.21.15.151:0/2166879715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd96e5ea0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5815b02980 1 -- 172.21.15.151:0/2166879715 >> 172.21.15.151:0/2166879715 conn(0x55bdd96e17a0 msgr2=0x55bdd96e3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5815b02980 1 -- 172.21.15.151:0/2166879715 shutdown_connections 2024-09-10T14:28:46.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.931+0000 7f5815b02980 1 -- 172.21.15.151:0/2166879715 wait complete. 2024-09-10T14:28:46.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.947+0000 7f5815b02980 1 Processor -- start 2024-09-10T14:28:46.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.947+0000 7f5815b02980 1 -- start start 2024-09-10T14:28:46.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.947+0000 7f5815b02980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.947+0000 7f5815b02980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bdd9595200 con 0x55bdd96e5ac0 2024-09-10T14:28:46.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40636/0 (socket says 172.21.15.151:40636) 2024-09-10T14:28:46.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5813612640 1 -- 172.21.15.151:0/4125787509 learned_addr learned my addr 172.21.15.151:0/4125787509 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5813612640 1 -- 172.21.15.151:0/4125787509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd97d3010 con 0x55bdd96e5ac0 2024-09-10T14:28:46.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5813612640 1 --2- 172.21.15.151:0/4125787509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d2a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f580400a5c0 tx=0x7f5804003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276900f61fd9583 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f570160a640 1 -- 172.21.15.151:0/4125787509 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040aa9b0 con 0x55bdd96e5ac0 2024-09-10T14:28:46.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f570160a640 1 -- 172.21.15.151:0/4125787509 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58040aab50 con 0x55bdd96e5ac0 2024-09-10T14:28:46.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f570160a640 1 -- 172.21.15.151:0/4125787509 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040aae50 con 0x55bdd96e5ac0 2024-09-10T14:28:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 -- 172.21.15.151:0/4125787509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 msgr2=0x55bdd97d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 --2- 172.21.15.151:0/4125787509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d2a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f580400a5c0 tx=0x7f5804003030 comp rx=0 tx=0).stop 2024-09-10T14:28:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 -- 172.21.15.151:0/4125787509 shutdown_connections 2024-09-10T14:28:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 --2- 172.21.15.151:0/4125787509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d2a40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 -- 172.21.15.151:0/4125787509 >> 172.21.15.151:0/4125787509 conn(0x55bdd96e17a0 msgr2=0x55bdd97ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 -- 172.21.15.151:0/4125787509 shutdown_connections 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 -- 172.21.15.151:0/4125787509 wait complete. 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 Processor -- start 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 -- start start 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5815b02980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bdd96eedc0 con 0x55bdd96e5ac0 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40640/0 (socket says 172.21.15.151:40640) 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.951+0000 7f5813612640 1 -- 172.21.15.151:0/1577391183 learned_addr learned my addr 172.21.15.151:0/1577391183 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5813612640 1 -- 172.21.15.151:0/1577391183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd97da1d0 con 0x55bdd96e5ac0 2024-09-10T14:28:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5813612640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d9c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f580401bbe0 tx=0x7f58040180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f56ffe07640 1 -- 172.21.15.151:0/1577391183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040c6750 con 0x55bdd96e5ac0 2024-09-10T14:28:46.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f56ffe07640 1 -- 172.21.15.151:0/1577391183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58040c68f0 con 0x55bdd96e5ac0 2024-09-10T14:28:46.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdd97da460 con 0x55bdd96e5ac0 2024-09-10T14:28:46.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f56ffe07640 1 -- 172.21.15.151:0/1577391183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040c6c10 con 0x55bdd96e5ac0 2024-09-10T14:28:46.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd97dd140 con 0x55bdd96e5ac0 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f56ffe07640 1 -- 172.21.15.151:0/1577391183 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58040ce020 con 0x55bdd96e5ac0 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f56ffe07640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f8034650 0x7f56f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f56ffe07640 1 -- 172.21.15.151:0/1577391183 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58040cc020 con 0x55bdd96e5ac0 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5812e11640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f8034650 0x7f56f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5815b02980 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd96e63e0 0x55bdd97e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd97e12d0 con 0x55bdd96e63e0 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5813e13640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd96e63e0 0x55bdd97e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5812e11640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f8034650 0x7f56f8036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5808000f70 tx=0x7f5808001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5813e13640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd96e63e0 0x55bdd97e0c60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5813e13640 1 -- 172.21.15.151:0/1577391183 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd96e63e0 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.955+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd97de360 con 0x55bdd96e63e0 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5813e13640 1 -- 172.21.15.151:0/1577391183 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd96e63e0 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd97e3600 0x55bdd97e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd97e60c0 con 0x55bdd97e3600 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5813612640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd97e3600 0x55bdd97e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5813612640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd97e3600 0x55bdd97e59f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5813612640 1 -- 172.21.15.151:0/1577391183 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd97e3600 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd97e24a0 con 0x55bdd96e63e0 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5813e13640 1 -- 172.21.15.151:0/1577391183 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd96e63e0 2024-09-10T14:28:46.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bdd97e7520 0x55bdd97e9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd97ea010 con 0x55bdd97e7520 2024-09-10T14:28:46.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5812e11640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bdd97e7520 0x55bdd97e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5812e11640 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bdd97e7520 0x55bdd97e9910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5812e11640 1 -- 172.21.15.151:0/1577391183 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f580800f6a0 con 0x55bdd97e7520 2024-09-10T14:28:46.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 Processor -- start 2024-09-10T14:28:46.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 -- start start 2024-09-10T14:28:46.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd97f7ae0 0x55bdd97f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.959+0000 7f5815b02980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bdd95ee800 con 0x55bdd97f7ae0 2024-09-10T14:28:46.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd97f7ae0 0x55bdd97f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd97f7ae0 0x55bdd97f7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40654/0 (socket says 172.21.15.151:40654) 2024-09-10T14:28:46.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f5813612640 1 -- 172.21.15.151:0/3274241875 learned_addr learned my addr 172.21.15.151:0/3274241875 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f5813612640 1 -- 172.21.15.151:0/3274241875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd97f8440 con 0x55bdd97f7ae0 2024-09-10T14:28:46.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f5813612640 1 --2- 172.21.15.151:0/3274241875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd97f7ae0 0x55bdd97f7f00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f58040cf900 tx=0x7f58040bcdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f56fd602640 1 -- 172.21.15.151:0/3274241875 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040d0e60 con 0x55bdd97f7ae0 2024-09-10T14:28:46.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f56fd602640 1 -- 172.21.15.151:0/3274241875 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58040e33d0 con 0x55bdd97f7ae0 2024-09-10T14:28:46.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f56fd602640 1 -- 172.21.15.151:0/3274241875 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040d05f0 con 0x55bdd97f7ae0 2024-09-10T14:28:46.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f5815b02980 1 -- 172.21.15.151:0/3274241875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdd97f86d0 con 0x55bdd97f7ae0 2024-09-10T14:28:46.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f5815b02980 1 -- 172.21.15.151:0/3274241875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd97fb350 con 0x55bdd97f7ae0 2024-09-10T14:28:46.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.963+0000 7f56fd602640 1 -- 172.21.15.151:0/3274241875 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58040d0790 con 0x55bdd97f7ae0 2024-09-10T14:28:46.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f56fd602640 1 --2- 172.21.15.151:0/3274241875 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56ec0346f0 0x7f56ec036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f56fd602640 1 -- 172.21.15.151:0/3274241875 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58040eec50 con 0x55bdd97f7ae0 2024-09-10T14:28:46.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5812e11640 1 --2- 172.21.15.151:0/3274241875 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56ec0346f0 0x7f56ec036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 Processor -- start 2024-09-10T14:28:46.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- start start 2024-09-10T14:28:46.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5812e11640 1 --2- 172.21.15.151:0/3274241875 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56ec0346f0 0x7f56ec036bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55bdd97e1bb0 tx=0x7f580800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd98064c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bdd97d32d0 con 0x55bdd98060c0 2024-09-10T14:28:46.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd98064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd98064c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40658/0 (socket says 172.21.15.151:40658) 2024-09-10T14:28:46.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5813612640 1 -- 172.21.15.151:0/3789641602 learned_addr learned my addr 172.21.15.151:0/3789641602 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5813612640 1 -- 172.21.15.151:0/3789641602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd9806a90 con 0x55bdd98060c0 2024-09-10T14:28:46.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5813612640 1 --2- 172.21.15.151:0/3789641602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd98064c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f58040c6e90 tx=0x7f58040e5580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de883ced0a9299e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f56f6ffd640 1 -- 172.21.15.151:0/3789641602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5804006a40 con 0x55bdd98060c0 2024-09-10T14:28:46.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f56f6ffd640 1 -- 172.21.15.151:0/3789641602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804006d00 con 0x55bdd98060c0 2024-09-10T14:28:46.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f56f6ffd640 1 -- 172.21.15.151:0/3789641602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040bc3a0 con 0x55bdd98060c0 2024-09-10T14:28:46.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- 172.21.15.151:0/3789641602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 msgr2=0x55bdd98064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:46.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 --2- 172.21.15.151:0/3789641602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd98064c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f58040c6e90 tx=0x7f58040e5580 comp rx=0 tx=0).stop 2024-09-10T14:28:46.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- 172.21.15.151:0/3789641602 shutdown_connections 2024-09-10T14:28:46.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 --2- 172.21.15.151:0/3789641602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd98064c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:46.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- 172.21.15.151:0/3789641602 >> 172.21.15.151:0/3789641602 conn(0x55bdd96e6bc0 msgr2=0x55bdd96e6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- 172.21.15.151:0/3789641602 shutdown_connections 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- 172.21.15.151:0/3789641602 wait complete. 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 Processor -- start 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- start start 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd980d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5815b02980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bdd9807470 con 0x55bdd98060c0 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.967+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd980d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5813612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd980d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40660/0 (socket says 172.21.15.151:40660) 2024-09-10T14:28:46.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 learned_addr learned my addr 172.21.15.151:0/845409818 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd980dc40 con 0x55bdd98060c0 2024-09-10T14:28:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5813612640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd980d700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58040b5db0 tx=0x7f58040bfdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f56f57fa640 1 -- 172.21.15.151:0/845409818 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040bc3a0 con 0x55bdd98060c0 2024-09-10T14:28:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdd980dc40 con 0x55bdd98060c0 2024-09-10T14:28:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f56f57fa640 1 -- 172.21.15.151:0/845409818 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580410c030 con 0x55bdd98060c0 2024-09-10T14:28:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f56f57fa640 1 -- 172.21.15.151:0/845409818 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58040c9cc0 con 0x55bdd98060c0 2024-09-10T14:28:46.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd980e0b0 con 0x55bdd98060c0 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f56f57fa640 1 -- 172.21.15.151:0/845409818 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58040c11c0 con 0x55bdd98060c0 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f56f57fa640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56dc0346a0 0x7f56dc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f56f57fa640 1 -- 172.21.15.151:0/845409818 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58040fe030 con 0x55bdd98060c0 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5812e11640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56dc0346a0 0x7f56dc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5815b02980 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd9818690 0x55bdd981ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981b2a0 con 0x55bdd9818690 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5813e13640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd9818690 0x55bdd981ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.971+0000 7f5812e11640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56dc0346a0 0x7f56dc036b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f580800c010 tx=0x7f5808010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813e13640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd9818690 0x55bdd981ab50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 realm 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981b6b0 con 0x55bdd9818690 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981bf80 con 0x55bdd9818690 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd981d080 0x55bdd981f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981fa80 con 0x55bdd981d080 2024-09-10T14:28:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813612640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd981d080 0x55bdd981f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813612640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd981d080 0x55bdd981f470 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 20 searching for the correct realm 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9821350 con 0x55bdd981d080 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813612640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5804009040 0x7f58040fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9821350 con 0x7f5804009040 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5812e11640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5804009040 0x7f58040fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5812e11640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5804009040 0x7f58040fd1d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5812e11640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f580801fbe0 0x7f580803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9821350 con 0x7f580801fbe0 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.975+0000 7f5813e13640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f580801fbe0 0x7f580803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f580801fbe0 0x7f580803a3c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:46.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f580801fbe0 2024-09-10T14:28:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f580801fbe0 2024-09-10T14:28:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f5804009040 2024-09-10T14:28:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd981d080 2024-09-10T14:28:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.979+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f580801fbe0 2024-09-10T14:28:46.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f5804009040 2024-09-10T14:28:46.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd981d080 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd981d080 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f580801fbe0 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd981d080 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd981d080 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.983+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f580801fbe0 2024-09-10T14:28:46.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd981d080 2024-09-10T14:28:46.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f5804009040 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f580801fbe0 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd981d080 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f580801fbe0 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f5804009040 2024-09-10T14:28:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.987+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd981d080 2024-09-10T14:28:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f580801fbe0 2024-09-10T14:28:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x55bdd9818690 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bdd981c320 con 0x7f5804009040 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9820470 con 0x55bdd9818690 2024-09-10T14:28:46.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98200b0 con 0x55bdd9818690 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9820d90 con 0x7f580801fbe0 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 zone default found 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 4 Realm: () 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:46.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:46.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 zonegroup default 2024-09-10T14:28:46.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:46.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98211c0 con 0x7f580801fbe0 2024-09-10T14:28:47.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.991+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98211c0 con 0x55bdd981d080 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9823240 con 0x55bdd981d080 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 20 started sync module instance, tier type = 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9822600 con 0x7f5804009040 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94273886366192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9823b50 con 0x7f5804009040 2024-09-10T14:28:47.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.995+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98243a0 con 0x55bdd9818690 2024-09-10T14:28:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.999+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.999+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94273886371568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9824860 con 0x55bdd9818690 2024-09-10T14:28:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.999+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9825380 con 0x55bdd981d080 2024-09-10T14:28:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.999+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94273886366192] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.999+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94273886371568] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.999+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.999+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94273886372624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98236a0 con 0x55bdd981d080 2024-09-10T14:28:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:46.999+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9825c20 con 0x7f5804009040 2024-09-10T14:28:47.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.003+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94273886372624] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.003+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.003+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94273886375504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9826470 con 0x7f5804009040 2024-09-10T14:28:47.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.003+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9826cc0 con 0x55bdd9818690 2024-09-10T14:28:47.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.003+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94273886375504] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.007+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.007+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94273886382096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98270e0 con 0x55bdd9818690 2024-09-10T14:28:47.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.007+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9827970 con 0x7f580801fbe0 2024-09-10T14:28:47.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.007+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94273886382096] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.007+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.007+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94273886383152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9827500 con 0x7f580801fbe0 2024-09-10T14:28:47.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.007+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9828270 con 0x7f580801fbe0 2024-09-10T14:28:47.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94273886387552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98286e0 con 0x7f580801fbe0 2024-09-10T14:28:47.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98291c0 con 0x7f580801fbe0 2024-09-10T14:28:47.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94273886383152] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94273886391504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98291c0 con 0x7f580801fbe0 2024-09-10T14:28:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 20 add_watcher() i=0 2024-09-10T14:28:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 20 add_watcher() i=1 2024-09-10T14:28:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 20 add_watcher() i=2 2024-09-10T14:28:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 20 add_watcher() i=3 2024-09-10T14:28:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 20 add_watcher() i=4 2024-09-10T14:28:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 20 add_watcher() i=5 2024-09-10T14:28:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94273886387552] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.011+0000 7f5815b02980 20 add_watcher() i=6 2024-09-10T14:28:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94273886391504] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5815b02980 20 add_watcher() i=7 2024-09-10T14:28:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5815b02980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9828230 con 0x55bdd9818690 2024-09-10T14:28:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94273886388784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98295c0 con 0x55bdd9818690 2024-09-10T14:28:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94273886388784] v33'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f56c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5815b02980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5815b02980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.015+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9834a20 con 0x55bdd9818690 2024-09-10T14:28:47.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.019+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.019+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9835070 con 0x7f580801fbe0 2024-09-10T14:28:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.023+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.023+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98354b0 con 0x55bdd981d080 2024-09-10T14:28:47.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.023+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.023+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9835460 con 0x55bdd9818690 2024-09-10T14:28:47.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.027+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.027+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98359f0 con 0x7f5804009040 2024-09-10T14:28:47.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.027+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.027+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9835ea0 con 0x55bdd981d080 2024-09-10T14:28:47.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.031+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.031+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9835ea0 con 0x55bdd9818690 2024-09-10T14:28:47.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.035+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.035+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9835f30 con 0x7f580801fbe0 2024-09-10T14:28:47.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.035+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.035+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9835fc0 con 0x7f5804009040 2024-09-10T14:28:47.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.039+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.039+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836610 con 0x55bdd981d080 2024-09-10T14:28:47.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.039+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.039+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836610 con 0x7f5804009040 2024-09-10T14:28:47.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.039+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.039+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836ac0 con 0x7f580801fbe0 2024-09-10T14:28:47.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.043+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.043+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836ac0 con 0x7f5804009040 2024-09-10T14:28:47.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.043+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.043+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836b50 con 0x7f580801fbe0 2024-09-10T14:28:47.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.047+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.047+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836b50 con 0x55bdd9818690 2024-09-10T14:28:47.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.047+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.047+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836b50 con 0x55bdd981d080 2024-09-10T14:28:47.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.051+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.051+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836b50 con 0x7f5804009040 2024-09-10T14:28:47.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.051+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.051+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836be0 con 0x55bdd981d080 2024-09-10T14:28:47.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.051+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.051+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836be0 con 0x55bdd9818690 2024-09-10T14:28:47.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.055+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.055+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836be0 con 0x55bdd9818690 2024-09-10T14:28:47.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.055+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.055+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836b50 con 0x55bdd981d080 2024-09-10T14:28:47.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.059+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.059+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9836b50 con 0x7f5804009040 2024-09-10T14:28:47.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.059+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.059+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x55bdd981d080 2024-09-10T14:28:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.059+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.059+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x55bdd981d080 2024-09-10T14:28:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.063+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.063+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x55bdd981d080 2024-09-10T14:28:47.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.063+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.063+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x55bdd981d080 2024-09-10T14:28:47.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.067+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'14 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.067+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x7f580801fbe0 2024-09-10T14:28:47.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.067+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.067+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x55bdd981d080 2024-09-10T14:28:47.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.071+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.071+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x7f580801fbe0 2024-09-10T14:28:47.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.071+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.071+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x55bdd981d080 2024-09-10T14:28:47.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.075+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.075+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x7f580801fbe0 2024-09-10T14:28:47.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.079+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.079+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9837140 con 0x7f5804009040 2024-09-10T14:28:47.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.079+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.079+0000 7f56c8fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:47.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.079+0000 7f5815b02980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:47.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.079+0000 7f5815b02980 20 Filter name: none 2024-09-10T14:28:47.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f56427fc640 20 reqs_thread_entry: start 2024-09-10T14:28:47.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5815b02980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T14:28:47.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5815b02980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9852170 con 0x7f5804009040 2024-09-10T14:28:47.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5815b02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5815b02980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-10T14:28:47.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5815b02980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T14:28:47.087 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T14:28:47.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f56c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:47.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94273886388784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9832ae0 con 0x55bdd9818690 2024-09-10T14:28:47.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94273886388784] v33'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.083+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94273886366192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9828230 con 0x7f5804009040 2024-09-10T14:28:47.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.087+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94273886366192] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.087+0000 7f5815b02980 20 remove_watcher() i=0 2024-09-10T14:28:47.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.087+0000 7f5815b02980 2 removed watcher, disabling cache 2024-09-10T14:28:47.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.087+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94273886371568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98229f0 con 0x55bdd9818690 2024-09-10T14:28:47.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.087+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94273886371568] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.087+0000 7f5815b02980 20 remove_watcher() i=1 2024-09-10T14:28:47.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.087+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94273886372624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98229f0 con 0x55bdd981d080 2024-09-10T14:28:47.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.091+0000 7f5813612640 1 -- 172.21.15.151:0/845409818 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94273886372624] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58040e5050 con 0x55bdd981d080 2024-09-10T14:28:47.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.091+0000 7f5815b02980 20 remove_watcher() i=2 2024-09-10T14:28:47.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.091+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94273886375504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98229f0 con 0x7f5804009040 2024-09-10T14:28:47.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.091+0000 7f5812e11640 1 -- 172.21.15.151:0/845409818 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94273886375504] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5808037040 con 0x7f5804009040 2024-09-10T14:28:47.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.091+0000 7f5815b02980 20 remove_watcher() i=3 2024-09-10T14:28:47.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.091+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94273886382096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98229f0 con 0x55bdd9818690 2024-09-10T14:28:47.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.095+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94273886382096] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x55bdd9818690 2024-09-10T14:28:47.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.095+0000 7f5815b02980 20 remove_watcher() i=4 2024-09-10T14:28:47.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.095+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94273886383152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd9826810 con 0x7f580801fbe0 2024-09-10T14:28:47.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.095+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94273886383152] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.099+0000 7f5815b02980 20 remove_watcher() i=5 2024-09-10T14:28:47.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.099+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94273886387552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98229f0 con 0x7f580801fbe0 2024-09-10T14:28:47.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.099+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94273886387552] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.099+0000 7f5815b02980 20 remove_watcher() i=6 2024-09-10T14:28:47.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.099+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94273886391504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bdd98229f0 con 0x7f580801fbe0 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94273886391504] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c00a4d0 con 0x7f580801fbe0 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 20 remove_watcher() i=7 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f580801fbe0 msgr2=0x7f580803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f580801fbe0 0x7f580803a3c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd9818690 msgr2=0x55bdd981ab50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd9818690 0x55bdd981ab50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5804009040 msgr2=0x7f58040fd1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5804009040 0x7f58040fd1d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd981d080 msgr2=0x55bdd981f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd981d080 0x55bdd981f470 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56dc0346a0 msgr2=0x7f56dc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56dc0346a0 0x7f56dc036b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f580800c010 tx=0x7f5808010000 comp rx=0 tx=0).stop 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 msgr2=0x55bdd980d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/845409818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd98060c0 0x55bdd980d700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58040b5db0 tx=0x7f58040bfdd0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 reap_dead start 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5813e13640 1 -- 172.21.15.151:0/845409818 reap_dead start 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 shutdown_connections 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 >> 172.21.15.151:0/845409818 conn(0x55bdd96e6bc0 msgr2=0x55bdd96e6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 shutdown_connections 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/845409818 wait complete. 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/3274241875 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56ec0346f0 msgr2=0x7f56ec036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/3274241875 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56ec0346f0 0x7f56ec036bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55bdd97e1bb0 tx=0x7f580800f000 comp rx=0 tx=0).stop 2024-09-10T14:28:47.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/3274241875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd97f7ae0 msgr2=0x55bdd97f7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/3274241875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd97f7ae0 0x55bdd97f7f00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f58040cf900 tx=0x7f58040bcdc0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/3274241875 shutdown_connections 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/3274241875 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56ec0346f0 0x7f56ec036bb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/3274241875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd97f7ae0 0x55bdd97f7f00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/3274241875 >> 172.21.15.151:0/3274241875 conn(0x55bdd97ecc30 msgr2=0x55bdd97ef6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/3274241875 shutdown_connections 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/3274241875 wait complete. 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bdd97e7520 msgr2=0x55bdd97e9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bdd97e7520 0x55bdd97e9910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd96e63e0 msgr2=0x55bdd97e0c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bdd96e63e0 0x55bdd97e0c60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd97e3600 msgr2=0x55bdd97e59f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bdd97e3600 0x55bdd97e59f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f8034650 msgr2=0x7f56f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56f8034650 0x7f56f8036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5808000f70 tx=0x7f5808001380 comp rx=0 tx=0).stop 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 msgr2=0x55bdd97d9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 --2- 172.21.15.151:0/1577391183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bdd96e5ac0 0x55bdd97d9c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f580401bbe0 tx=0x7f58040180e0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5813e13640 1 -- 172.21.15.151:0/1577391183 reap_dead start 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 shutdown_connections 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 >> 172.21.15.151:0/1577391183 conn(0x55bdd96e17a0 msgr2=0x55bdd97cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 shutdown_connections 2024-09-10T14:28:47.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.103+0000 7f5815b02980 1 -- 172.21.15.151:0/1577391183 wait complete. 2024-09-10T14:28:47.119 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T14:28:47.119 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-10T14:28:47.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-10T14:28:47.120 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-10T14:28:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f5769c2a980 1 Processor -- start 2024-09-10T14:28:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f5769c2a980 1 -- start start 2024-09-10T14:28:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f5769c2a980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e1b1669650 0x55e1b1669a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f5769c2a980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e1b14f1ae0 con 0x55e1b1669fa0 2024-09-10T14:28:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f5769c2a980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55e1b1515e30 con 0x55e1b1669650 2024-09-10T14:28:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f576773a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e1b1669650 0x55e1b1669a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f5766f39640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55e1b1669fa0 0x55e1b166e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34078/0 (socket says 172.21.15.151:34078) 2024-09-10T14:28:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f576773a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e1b1669650 0x55e1b1669a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40668/0 (socket says 172.21.15.151:40668) 2024-09-10T14:28:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f5766f39640 1 -- 172.21.15.151:0/700534924 learned_addr learned my addr 172.21.15.151:0/700534924 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f576773a640 1 -- 172.21.15.151:0/700534924 >> v1:172.21.15.52:6789/0 conn(0x55e1b1669fa0 legacy=0x55e1b166e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.195+0000 7f576773a640 1 -- 172.21.15.151:0/700534924 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b1671220 con 0x55e1b1669650 2024-09-10T14:28:47.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f576773a640 1 --2- 172.21.15.151:0/700534924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b1669a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f575800a480 tx=0x7f575801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857c330ba407f84a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5766738640 1 -- 172.21.15.151:0/700534924 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580b0070 con 0x55e1b1669650 2024-09-10T14:28:47.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5766738640 1 -- 172.21.15.151:0/700534924 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57580ab540 con 0x55e1b1669650 2024-09-10T14:28:47.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5766738640 1 -- 172.21.15.151:0/700534924 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580ab840 con 0x55e1b1669650 2024-09-10T14:28:47.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5769c2a980 1 -- 172.21.15.151:0/700534924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 msgr2=0x55e1b1669a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5769c2a980 1 --2- 172.21.15.151:0/700534924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b1669a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f575800a480 tx=0x7f575801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:47.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5769c2a980 1 -- 172.21.15.151:0/700534924 shutdown_connections 2024-09-10T14:28:47.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5769c2a980 1 --2- 172.21.15.151:0/700534924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b1669a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5769c2a980 1 -- 172.21.15.151:0/700534924 >> 172.21.15.151:0/700534924 conn(0x55e1b1665170 msgr2=0x55e1b1667590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5769c2a980 1 -- 172.21.15.151:0/700534924 shutdown_connections 2024-09-10T14:28:47.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.199+0000 7f5769c2a980 1 -- 172.21.15.151:0/700534924 wait complete. 2024-09-10T14:28:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.215+0000 7f5769c2a980 1 Processor -- start 2024-09-10T14:28:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.215+0000 7f5769c2a980 1 -- start start 2024-09-10T14:28:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.215+0000 7f5769c2a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b17549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.215+0000 7f5769c2a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1b1517200 con 0x55e1b1669650 2024-09-10T14:28:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.215+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b17549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.215+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b17549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40674/0 (socket says 172.21.15.151:40674) 2024-09-10T14:28:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.215+0000 7f576773a640 1 -- 172.21.15.151:0/338111027 learned_addr learned my addr 172.21.15.151:0/338111027 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.215+0000 7f576773a640 1 -- 172.21.15.151:0/338111027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b1754fa0 con 0x55e1b1669650 2024-09-10T14:28:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f576773a640 1 --2- 172.21.15.151:0/338111027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b17549d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f57580ae040 tx=0x7f5758003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42881a9760f43f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f565560a640 1 -- 172.21.15.151:0/338111027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580b0040 con 0x55e1b1669650 2024-09-10T14:28:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f565560a640 1 -- 172.21.15.151:0/338111027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57580ab9b0 con 0x55e1b1669650 2024-09-10T14:28:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f565560a640 1 -- 172.21.15.151:0/338111027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580abc90 con 0x55e1b1669650 2024-09-10T14:28:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- 172.21.15.151:0/338111027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 msgr2=0x55e1b17549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 --2- 172.21.15.151:0/338111027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b17549d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f57580ae040 tx=0x7f5758003030 comp rx=0 tx=0).stop 2024-09-10T14:28:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- 172.21.15.151:0/338111027 shutdown_connections 2024-09-10T14:28:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 --2- 172.21.15.151:0/338111027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b17549d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- 172.21.15.151:0/338111027 >> 172.21.15.151:0/338111027 conn(0x55e1b1665170 msgr2=0x55e1b1750600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- 172.21.15.151:0/338111027 shutdown_connections 2024-09-10T14:28:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- 172.21.15.151:0/338111027 wait complete. 2024-09-10T14:28:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 Processor -- start 2024-09-10T14:28:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- start start 2024-09-10T14:28:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b175bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1b1670c60 con 0x55e1b1669650 2024-09-10T14:28:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b175bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b175bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40682/0 (socket says 172.21.15.151:40682) 2024-09-10T14:28:47.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f576773a640 1 -- 172.21.15.151:0/1563039293 learned_addr learned my addr 172.21.15.151:0/1563039293 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f576773a640 1 -- 172.21.15.151:0/1563039293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b175c1e0 con 0x55e1b1669650 2024-09-10T14:28:47.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f576773a640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b175bca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f57580ab510 tx=0x7f5758018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5653e07640 1 -- 172.21.15.151:0/1563039293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580b0070 con 0x55e1b1669650 2024-09-10T14:28:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1b175c470 con 0x55e1b1669650 2024-09-10T14:28:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5653e07640 1 -- 172.21.15.151:0/1563039293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57580b6970 con 0x55e1b1669650 2024-09-10T14:28:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5653e07640 1 -- 172.21.15.151:0/1563039293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580b6c50 con 0x55e1b1669650 2024-09-10T14:28:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.219+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b175f150 con 0x55e1b1669650 2024-09-10T14:28:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5653e07640 1 -- 172.21.15.151:0/1563039293 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57580bf3f0 con 0x55e1b1669650 2024-09-10T14:28:47.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5653e07640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f564c034650 0x7f564c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5653e07640 1 -- 172.21.15.151:0/1563039293 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f57580bc070 con 0x55e1b1669650 2024-09-10T14:28:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5766f39640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f564c034650 0x7f564c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1669fa0 0x55e1b1762c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b1763250 con 0x55e1b1669fa0 2024-09-10T14:28:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5767f3b640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1669fa0 0x55e1b1762c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5766f39640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f564c034650 0x7f564c036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f575c001da0 tx=0x7f575c001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5767f3b640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1669fa0 0x55e1b1762c30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5767f3b640 1 -- 172.21.15.151:0/1563039293 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1669fa0 2024-09-10T14:28:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b1760350 con 0x55e1b1669fa0 2024-09-10T14:28:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5767f3b640 1 -- 172.21.15.151:0/1563039293 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1669fa0 2024-09-10T14:28:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b1765580 0x55e1b1767970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b1768040 con 0x55e1b1765580 2024-09-10T14:28:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.223+0000 7f576773a640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b1765580 0x55e1b1767970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f576773a640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b1765580 0x55e1b1767970 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f576773a640 1 -- 172.21.15.151:0/1563039293 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f57580b3040 con 0x55e1b1765580 2024-09-10T14:28:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b1764420 con 0x55e1b1669fa0 2024-09-10T14:28:47.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5767f3b640 1 -- 172.21.15.151:0/1563039293 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1669fa0 2024-09-10T14:28:47.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1b1769480 0x55e1b176b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b176c000 con 0x55e1b1769480 2024-09-10T14:28:47.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5766f39640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1b1769480 0x55e1b176b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5766f39640 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1b1769480 0x55e1b176b870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5766f39640 1 -- 172.21.15.151:0/1563039293 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f575c00e6c0 con 0x55e1b1769480 2024-09-10T14:28:47.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5769c2a980 1 Processor -- start 2024-09-10T14:28:47.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5769c2a980 1 -- start start 2024-09-10T14:28:47.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5769c2a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1779a90 0x55e1b1779eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f5769c2a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1b1570800 con 0x55e1b1779a90 2024-09-10T14:28:47.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1779a90 0x55e1b1779eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1779a90 0x55e1b1779eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40698/0 (socket says 172.21.15.151:40698) 2024-09-10T14:28:47.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.227+0000 7f576773a640 1 -- 172.21.15.151:0/2698704285 learned_addr learned my addr 172.21.15.151:0/2698704285 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f576773a640 1 -- 172.21.15.151:0/2698704285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b177a3f0 con 0x55e1b1779a90 2024-09-10T14:28:47.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f576773a640 1 --2- 172.21.15.151:0/2698704285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1779a90 0x55e1b1779eb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f57580ab980 tx=0x7f57580b5dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5651602640 1 -- 172.21.15.151:0/2698704285 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580e4ac0 con 0x55e1b1779a90 2024-09-10T14:28:47.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5651602640 1 -- 172.21.15.151:0/2698704285 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57580e4c60 con 0x55e1b1779a90 2024-09-10T14:28:47.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5769c2a980 1 -- 172.21.15.151:0/2698704285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1b177a680 con 0x55e1b1779a90 2024-09-10T14:28:47.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5651602640 1 -- 172.21.15.151:0/2698704285 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580dcac0 con 0x55e1b1779a90 2024-09-10T14:28:47.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5769c2a980 1 -- 172.21.15.151:0/2698704285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b177d300 con 0x55e1b1779a90 2024-09-10T14:28:47.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5651602640 1 -- 172.21.15.151:0/2698704285 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57580dcc60 con 0x55e1b1779a90 2024-09-10T14:28:47.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5651602640 1 --2- 172.21.15.151:0/2698704285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5640034650 0x7f5640036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5651602640 1 -- 172.21.15.151:0/2698704285 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f57580a8070 con 0x55e1b1779a90 2024-09-10T14:28:47.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5766f39640 1 --2- 172.21.15.151:0/2698704285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5640034650 0x7f5640036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5769c2a980 1 Processor -- start 2024-09-10T14:28:47.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5769c2a980 1 -- start start 2024-09-10T14:28:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5769c2a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b1786830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5769c2a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1b1755260 con 0x55e1b1786430 2024-09-10T14:28:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f5766f39640 1 --2- 172.21.15.151:0/2698704285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5640034650 0x7f5640036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55e1b176c400 tx=0x7f575c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b1786830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b1786830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40710/0 (socket says 172.21.15.151:40710) 2024-09-10T14:28:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f576773a640 1 -- 172.21.15.151:0/1094627842 learned_addr learned my addr 172.21.15.151:0/1094627842 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.231+0000 7f576773a640 1 -- 172.21.15.151:0/1094627842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b1786e00 con 0x55e1b1786430 2024-09-10T14:28:47.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f576773a640 1 --2- 172.21.15.151:0/1094627842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b1786830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57580dca50 tx=0x7f57580aa720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c134012f78eaba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f564affd640 1 -- 172.21.15.151:0/1094627842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580fd070 con 0x55e1b1786430 2024-09-10T14:28:47.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f564affd640 1 -- 172.21.15.151:0/1094627842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758002d50 con 0x55e1b1786430 2024-09-10T14:28:47.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f564affd640 1 -- 172.21.15.151:0/1094627842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580bb320 con 0x55e1b1786430 2024-09-10T14:28:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- 172.21.15.151:0/1094627842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 msgr2=0x55e1b1786830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1094627842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b1786830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57580dca50 tx=0x7f57580aa720 comp rx=0 tx=0).stop 2024-09-10T14:28:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- 172.21.15.151:0/1094627842 shutdown_connections 2024-09-10T14:28:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1094627842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b1786830 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- 172.21.15.151:0/1094627842 >> 172.21.15.151:0/1094627842 conn(0x55e1b1782810 msgr2=0x55e1b1780910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- 172.21.15.151:0/1094627842 shutdown_connections 2024-09-10T14:28:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- 172.21.15.151:0/1094627842 wait complete. 2024-09-10T14:28:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 Processor -- start 2024-09-10T14:28:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- start start 2024-09-10T14:28:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b178d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1b1787280 con 0x55e1b1786430 2024-09-10T14:28:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b178d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f576773a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b178d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40720/0 (socket says 172.21.15.151:40720) 2024-09-10T14:28:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 learned_addr learned my addr 172.21.15.151:0/3708389187 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b178db70 con 0x55e1b1786430 2024-09-10T14:28:47.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f576773a640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b178d630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f57580e2f00 tx=0x7f57580c9eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f56497fa640 1 -- 172.21.15.151:0/3708389187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580fd050 con 0x55e1b1786430 2024-09-10T14:28:47.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1b178db70 con 0x55e1b1786430 2024-09-10T14:28:47.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f56497fa640 1 -- 172.21.15.151:0/3708389187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57580fe040 con 0x55e1b1786430 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f56497fa640 1 -- 172.21.15.151:0/3708389187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57580e1550 con 0x55e1b1786430 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.235+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b178dfe0 con 0x55e1b1786430 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f56497fa640 1 -- 172.21.15.151:0/3708389187 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f575810b020 con 0x55e1b1786430 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f56497fa640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56300346a0 0x7f5630036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f56497fa640 1 -- 172.21.15.151:0/3708389187 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f5758109020 con 0x55e1b1786430 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5766f39640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56300346a0 0x7f5630036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1798520 0x55e1b179a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179b130 con 0x55e1b1798520 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5767f3b640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1798520 0x55e1b179a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5767f3b640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1798520 0x55e1b179a9e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5766f39640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56300346a0 0x7f5630036b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f575c00bb60 tx=0x7f575c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 realm 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179b540 con 0x55e1b1798520 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179bde0 con 0x55e1b1798520 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b179cee0 0x55e1b179f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179f920 con 0x55e1b179cee0 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f576773a640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b179cee0 0x55e1b179f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.239+0000 7f576773a640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b179cee0 0x55e1b179f2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5769c2a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5769c2a980 20 searching for the correct realm 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a1180 con 0x55e1b179cee0 2024-09-10T14:28:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f576773a640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5758104070 0x7f57580c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a1180 con 0x7f5758104070 2024-09-10T14:28:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5766f39640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5758104070 0x7f57580c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5766f39640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5758104070 0x7f57580c21b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5766f39640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f575c037040 0x7f575c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a1180 con 0x7f575c037040 2024-09-10T14:28:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5767f3b640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f575c037040 0x7f575c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5767f3b640 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f575c037040 0x7f575c036410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.243+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f575c037040 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f575c037040 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f5758104070 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b179cee0 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f575c037040 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f5758104070 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b179cee0 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b179cee0 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.247+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f575c037040 2024-09-10T14:28:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b179cee0 2024-09-10T14:28:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b179cee0 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f575c037040 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b179cee0 2024-09-10T14:28:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f5758104070 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.251+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f575c037040 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b179cee0 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f575c037040 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f5758104070 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b179cee0 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f575c037040 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x55e1b1798520 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179c180 con 0x7f5758104070 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:47.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a02a0 con 0x55e1b1798520 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.255+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a0af0 con 0x55e1b1798520 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:47.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b179ff00 con 0x7f575c037040 2024-09-10T14:28:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 zone default found 2024-09-10T14:28:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 4 Realm: () 2024-09-10T14:28:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:47.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 zonegroup default 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a1050 con 0x7f575c037040 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a2f90 con 0x55e1b179cee0 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a3410 con 0x55e1b179cee0 2024-09-10T14:28:47.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 started sync module instance, tier type = 2024-09-10T14:28:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a2430 con 0x7f5758104070 2024-09-10T14:28:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94427833573248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a3870 con 0x7f5758104070 2024-09-10T14:28:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.259+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a40c0 con 0x55e1b1798520 2024-09-10T14:28:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.263+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.263+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94427833580832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a4790 con 0x55e1b1798520 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.263+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a52b0 con 0x55e1b179cee0 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.263+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94427833573248] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94427833580832] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94427833585024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a5270 con 0x55e1b179cee0 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a5b50 con 0x7f5758104070 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94427833587360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a5270 con 0x7f5758104070 2024-09-10T14:28:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a69e0 con 0x55e1b1798520 2024-09-10T14:28:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94427833585024] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94427833587360] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.267+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.271+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94427833589488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a2820 con 0x55e1b1798520 2024-09-10T14:28:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.271+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a7280 con 0x7f575c037040 2024-09-10T14:28:47.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.271+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94427833589488] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.271+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.271+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94427833591056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a71a0 con 0x7f575c037040 2024-09-10T14:28:47.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.271+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a7b60 con 0x7f575c037040 2024-09-10T14:28:47.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.275+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.275+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94427833595568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a7f80 con 0x7f575c037040 2024-09-10T14:28:47.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.275+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a8a30 con 0x7f575c037040 2024-09-10T14:28:47.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.275+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94427833591056] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.275+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94427833595568] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94427833599248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a7ad0 con 0x7f575c037040 2024-09-10T14:28:47.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 20 add_watcher() i=0 2024-09-10T14:28:47.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 20 add_watcher() i=1 2024-09-10T14:28:47.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 20 add_watcher() i=2 2024-09-10T14:28:47.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 20 add_watcher() i=3 2024-09-10T14:28:47.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 20 add_watcher() i=4 2024-09-10T14:28:47.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 20 add_watcher() i=5 2024-09-10T14:28:47.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 20 add_watcher() i=6 2024-09-10T14:28:47.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94427833599248] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 20 add_watcher() i=7 2024-09-10T14:28:47.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:47.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17abb30 con 0x55e1b1798520 2024-09-10T14:28:47.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.279+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94427833592992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a8fb0 con 0x55e1b1798520 2024-09-10T14:28:47.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.283+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94427833592992] v33'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.283+0000 7f561dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:47.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.283+0000 7f5769c2a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:47.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.283+0000 7f5769c2a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:47.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.283+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b41d0 con 0x55e1b1798520 2024-09-10T14:28:47.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.283+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.283+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b48a0 con 0x7f575c037040 2024-09-10T14:28:47.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.287+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.287+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b4cc0 con 0x55e1b179cee0 2024-09-10T14:28:47.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.287+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.287+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b4d00 con 0x55e1b1798520 2024-09-10T14:28:47.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.287+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.287+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b52f0 con 0x7f5758104070 2024-09-10T14:28:47.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.291+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.291+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b57a0 con 0x55e1b179cee0 2024-09-10T14:28:47.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.291+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.291+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b57a0 con 0x55e1b1798520 2024-09-10T14:28:47.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.295+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.295+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b57a0 con 0x7f575c037040 2024-09-10T14:28:47.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.295+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.295+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b5830 con 0x7f5758104070 2024-09-10T14:28:47.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.299+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.299+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b5da0 con 0x55e1b179cee0 2024-09-10T14:28:47.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.299+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.299+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b5da0 con 0x7f5758104070 2024-09-10T14:28:47.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.299+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.299+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x7f575c037040 2024-09-10T14:28:47.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.303+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.303+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x7f5758104070 2024-09-10T14:28:47.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.303+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.303+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x7f575c037040 2024-09-10T14:28:47.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.307+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.307+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x55e1b1798520 2024-09-10T14:28:47.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.307+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.307+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x55e1b179cee0 2024-09-10T14:28:47.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.311+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.311+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x7f5758104070 2024-09-10T14:28:47.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.311+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.311+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x55e1b179cee0 2024-09-10T14:28:47.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.319+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.319+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x55e1b1798520 2024-09-10T14:28:47.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.319+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.319+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x55e1b1798520 2024-09-10T14:28:47.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.323+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.323+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x55e1b179cee0 2024-09-10T14:28:47.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.323+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.323+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b6250 con 0x7f5758104070 2024-09-10T14:28:47.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.327+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.327+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x55e1b179cee0 2024-09-10T14:28:47.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.327+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.327+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x55e1b179cee0 2024-09-10T14:28:47.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.331+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.331+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x55e1b179cee0 2024-09-10T14:28:47.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.331+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.331+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x55e1b179cee0 2024-09-10T14:28:47.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.335+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'16 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.335+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x7f575c037040 2024-09-10T14:28:47.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.339+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.339+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x55e1b179cee0 2024-09-10T14:28:47.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.339+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.339+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x7f575c037040 2024-09-10T14:28:47.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.343+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.343+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x55e1b179cee0 2024-09-10T14:28:47.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.347+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.347+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x7f575c037040 2024-09-10T14:28:47.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.347+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.347+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b62e0 con 0x7f5758104070 2024-09-10T14:28:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f561cfe1640 20 reqs_thread_entry: start 2024-09-10T14:28:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5769c2a980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5769c2a980 20 Filter name: none 2024-09-10T14:28:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f55967fc640 20 reqs_thread_entry: start 2024-09-10T14:28:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5769c2a980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T14:28:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5769c2a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17d1970 con 0x7f575c037040 2024-09-10T14:28:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5769c2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.351+0000 7f5769c2a980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T14:28:47.357 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: 2024-09-10T14:28:47.351+0000 7f5769c2a980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T14:28:47.357 INFO:teuthology.orchestra.run.smithi151.stderr:unable to remove user, user does not exist 2024-09-10T14:28:47.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.355+0000 7f561dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:47.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.355+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94427833592992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17b1020 con 0x55e1b1798520 2024-09-10T14:28:47.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.355+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94427833592992] v33'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.355+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94427833573248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a6ca0 con 0x7f5758104070 2024-09-10T14:28:47.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.359+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94427833573248] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.359+0000 7f5769c2a980 20 remove_watcher() i=0 2024-09-10T14:28:47.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.359+0000 7f5769c2a980 2 removed watcher, disabling cache 2024-09-10T14:28:47.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.359+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94427833580832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a1f80 con 0x55e1b1798520 2024-09-10T14:28:47.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.359+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94427833580832] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.359+0000 7f5769c2a980 20 remove_watcher() i=1 2024-09-10T14:28:47.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.359+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94427833585024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a3d20 con 0x55e1b179cee0 2024-09-10T14:28:47.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f576773a640 1 -- 172.21.15.151:0/3708389187 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94427833585024] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5758100070 con 0x55e1b179cee0 2024-09-10T14:28:47.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f5769c2a980 20 remove_watcher() i=2 2024-09-10T14:28:47.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94427833587360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a3d20 con 0x7f5758104070 2024-09-10T14:28:47.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f5766f39640 1 -- 172.21.15.151:0/3708389187 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94427833587360] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f575c00e6c0 con 0x7f5758104070 2024-09-10T14:28:47.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f5769c2a980 20 remove_watcher() i=3 2024-09-10T14:28:47.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94427833589488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a56a0 con 0x55e1b1798520 2024-09-10T14:28:47.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94427833589488] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x55e1b1798520 2024-09-10T14:28:47.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f5769c2a980 20 remove_watcher() i=4 2024-09-10T14:28:47.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.363+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94427833591056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a3d20 con 0x7f575c037040 2024-09-10T14:28:47.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.367+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94427833591056] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.367+0000 7f5769c2a980 20 remove_watcher() i=5 2024-09-10T14:28:47.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.367+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94427833595568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a5ef0 con 0x7f575c037040 2024-09-10T14:28:47.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94427833595568] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 20 remove_watcher() i=6 2024-09-10T14:28:47.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94427833599248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1b17a56a0 con 0x7f575c037040 2024-09-10T14:28:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94427833599248] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576000a4d0 con 0x7f575c037040 2024-09-10T14:28:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 20 remove_watcher() i=7 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f575c037040 msgr2=0x7f575c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f575c037040 0x7f575c036410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1798520 msgr2=0x55e1b179a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1798520 0x55e1b179a9e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5758104070 msgr2=0x7f57580c21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5758104070 0x7f57580c21b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b179cee0 msgr2=0x55e1b179f2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b179cee0 0x55e1b179f2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56300346a0 msgr2=0x7f5630036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f56300346a0 0x7f5630036b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f575c00bb60 tx=0x7f575c010000 comp rx=0 tx=0).stop 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 msgr2=0x55e1b178d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b178d630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f57580e2f00 tx=0x7f57580c9eb0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5767f3b640 1 -- 172.21.15.151:0/3708389187 reap_dead start 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 shutdown_connections 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/3708389187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1786430 0x55e1b178d630 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 >> 172.21.15.151:0/3708389187 conn(0x55e1b1782810 msgr2=0x55e1b17808e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 shutdown_connections 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/3708389187 wait complete. 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/2698704285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5640034650 msgr2=0x7f5640036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/2698704285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5640034650 0x7f5640036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55e1b176c400 tx=0x7f575c00f000 comp rx=0 tx=0).stop 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/2698704285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1779a90 msgr2=0x55e1b1779eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/2698704285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1779a90 0x55e1b1779eb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f57580ab980 tx=0x7f57580b5dd0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/2698704285 shutdown_connections 2024-09-10T14:28:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/2698704285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5640034650 0x7f5640036b10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/2698704285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1779a90 0x55e1b1779eb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/2698704285 >> 172.21.15.151:0/2698704285 conn(0x55e1b176ebe0 msgr2=0x55e1b1771660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/2698704285 shutdown_connections 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/2698704285 wait complete. 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1b1769480 msgr2=0x55e1b176b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1b1769480 0x55e1b176b870 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1669fa0 msgr2=0x55e1b1762c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1b1669fa0 0x55e1b1762c30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b1765580 msgr2=0x55e1b1767970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1b1765580 0x55e1b1767970 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f564c034650 msgr2=0x7f564c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f564c034650 0x7f564c036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f575c001da0 tx=0x7f575c001300 comp rx=0 tx=0).stop 2024-09-10T14:28:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 msgr2=0x55e1b175bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5769c2a980 1 --2- 172.21.15.151:0/1563039293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1b1669650 0x55e1b175bca0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f57580ab510 tx=0x7f5758018020 comp rx=0 tx=0).stop 2024-09-10T14:28:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.371+0000 7f5767f3b640 1 -- 172.21.15.151:0/1563039293 reap_dead start 2024-09-10T14:28:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.375+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 shutdown_connections 2024-09-10T14:28:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.375+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 >> 172.21.15.151:0/1563039293 conn(0x55e1b1665170 msgr2=0x55e1b174f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.375+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 shutdown_connections 2024-09-10T14:28:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.375+0000 7f5769c2a980 1 -- 172.21.15.151:0/1563039293 wait complete. 2024-09-10T14:28:47.386 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T14:28:47.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T14:28:47.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T14:28:47.387 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T14:28:47.460 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:47.460 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:47.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.455+0000 7fb9236b3980 1 Processor -- start 2024-09-10T14:28:47.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9236b3980 1 -- start start 2024-09-10T14:28:47.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9236b3980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5580ec2818f0 0x5580ec283ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9236b3980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580ec106ae0 con 0x5580ec27d570 2024-09-10T14:28:47.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9236b3980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5580ec12ae30 con 0x5580ec2818f0 2024-09-10T14:28:47.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9209c2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5580ec2818f0 0x5580ec283ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9211c3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5580ec27d570 0x5580ec27d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34080/0 (socket says 172.21.15.151:34080) 2024-09-10T14:28:47.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9211c3640 1 -- 172.21.15.151:0/3238757913 learned_addr learned my addr 172.21.15.151:0/3238757913 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:47.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb913fff640 1 -- 172.21.15.151:0/3238757913 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640713872 0 0) 0x5580ec106ae0 con 0x5580ec27d570 2024-09-10T14:28:47.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb913fff640 1 -- 172.21.15.151:0/3238757913 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb90c001e20 con 0x5580ec27d570 2024-09-10T14:28:47.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9209c2640 1 -- 172.21.15.151:0/3238757913 >> v1:172.21.15.52:6789/0 conn(0x5580ec27d570 legacy=0x5580ec27d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9209c2640 1 -- 172.21.15.151:0/3238757913 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580ec1f28e0 con 0x5580ec2818f0 2024-09-10T14:28:47.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb9209c2640 1 --2- 172.21.15.151:0/3238757913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec2818f0 0x5580ec283ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb91400a480 tx=0x7fb91401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7637c6fab72b5cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.459+0000 7fb913fff640 1 -- 172.21.15.151:0/3238757913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9140b0070 con 0x5580ec2818f0 2024-09-10T14:28:47.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb913fff640 1 -- 172.21.15.151:0/3238757913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140ab540 con 0x5580ec2818f0 2024-09-10T14:28:47.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb913fff640 1 -- 172.21.15.151:0/3238757913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9140ab820 con 0x5580ec2818f0 2024-09-10T14:28:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb9236b3980 1 -- 172.21.15.151:0/3238757913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec2818f0 msgr2=0x5580ec283ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3238757913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec2818f0 0x5580ec283ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb91400a480 tx=0x7fb91401b280 comp rx=0 tx=0).stop 2024-09-10T14:28:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb9236b3980 1 -- 172.21.15.151:0/3238757913 shutdown_connections 2024-09-10T14:28:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3238757913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec2818f0 0x5580ec283ce0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb9236b3980 1 -- 172.21.15.151:0/3238757913 >> 172.21.15.151:0/3238757913 conn(0x5580ec279090 msgr2=0x5580ec27b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb9236b3980 1 -- 172.21.15.151:0/3238757913 shutdown_connections 2024-09-10T14:28:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.463+0000 7fb9236b3980 1 -- 172.21.15.151:0/3238757913 wait complete. 2024-09-10T14:28:47.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.475+0000 7fb9236b3980 1 Processor -- start 2024-09-10T14:28:47.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.475+0000 7fb9236b3980 1 -- start start 2024-09-10T14:28:47.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.475+0000 7fb9236b3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec369850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.475+0000 7fb9236b3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5580ec12c200 con 0x5580ec27d570 2024-09-10T14:28:47.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.475+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec369850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.475+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec369850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40746/0 (socket says 172.21.15.151:40746) 2024-09-10T14:28:47.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.475+0000 7fb9211c3640 1 -- 172.21.15.151:0/64421425 learned_addr learned my addr 172.21.15.151:0/64421425 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9211c3640 1 -- 172.21.15.151:0/64421425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580ec369e20 con 0x5580ec27d570 2024-09-10T14:28:47.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9211c3640 1 --2- 172.21.15.151:0/64421425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec369850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb918006fc0 tx=0x7fb918001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284871afb71e57d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb80f606640 1 -- 172.21.15.151:0/64421425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb918004530 con 0x5580ec27d570 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb80f606640 1 -- 172.21.15.151:0/64421425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9180046d0 con 0x5580ec27d570 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb80f606640 1 -- 172.21.15.151:0/64421425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb918004a70 con 0x5580ec27d570 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- 172.21.15.151:0/64421425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 msgr2=0x5580ec369850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 --2- 172.21.15.151:0/64421425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec369850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb918006fc0 tx=0x7fb918001af0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- 172.21.15.151:0/64421425 shutdown_connections 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 --2- 172.21.15.151:0/64421425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec369850 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- 172.21.15.151:0/64421425 >> 172.21.15.151:0/64421425 conn(0x5580ec279090 msgr2=0x5580ec365480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- 172.21.15.151:0/64421425 shutdown_connections 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- 172.21.15.151:0/64421425 wait complete. 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 Processor -- start 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- start start 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec370b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5580ec1f35c0 con 0x5580ec27d570 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec370b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec370b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40756/0 (socket says 172.21.15.151:40756) 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9211c3640 1 -- 172.21.15.151:0/128325548 learned_addr learned my addr 172.21.15.151:0/128325548 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9211c3640 1 -- 172.21.15.151:0/128325548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580ec3710a0 con 0x5580ec27d570 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9211c3640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec370b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb918002260 tx=0x7fb918000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb80de03640 1 -- 172.21.15.151:0/128325548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb918013760 con 0x5580ec27d570 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580ec371330 con 0x5580ec27d570 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb80de03640 1 -- 172.21.15.151:0/128325548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb918013900 con 0x5580ec27d570 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb80de03640 1 -- 172.21.15.151:0/128325548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb918013c20 con 0x5580ec27d570 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.479+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580ec374010 con 0x5580ec27d570 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb80de03640 1 -- 172.21.15.151:0/128325548 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb918010070 con 0x5580ec27d570 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb80de03640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8080346a0 0x7fb808036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb80de03640 1 -- 172.21.15.151:0/128325548 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb918018070 con 0x5580ec27d570 2024-09-10T14:28:47.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9209c2640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8080346a0 0x7fb808036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9236b3980 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec2818f0 0x5580ec377b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3781a0 con 0x5580ec2818f0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9219c4640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec2818f0 0x5580ec377b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9209c2640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8080346a0 0x7fb808036b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9140ad000 tx=0x7fb9140a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9219c4640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec2818f0 0x5580ec377b30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9219c4640 1 -- 172.21.15.151:0/128325548 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec2818f0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec375230 con 0x5580ec2818f0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9219c4640 1 -- 172.21.15.151:0/128325548 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec2818f0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9236b3980 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec37a4f0 0x5580ec37c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec37cfd0 con 0x5580ec37a4f0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9211c3640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec37a4f0 0x5580ec37c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9211c3640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec37a4f0 0x5580ec37c8e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9211c3640 1 -- 172.21.15.151:0/128325548 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb91801b030 con 0x5580ec37a4f0 2024-09-10T14:28:47.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec379390 con 0x5580ec2818f0 2024-09-10T14:28:47.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9219c4640 1 -- 172.21.15.151:0/128325548 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec2818f0 2024-09-10T14:28:47.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9236b3980 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5580ec37e430 0x5580ec380820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.483+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec380f60 con 0x5580ec37e430 2024-09-10T14:28:47.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9209c2640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5580ec37e430 0x5580ec380820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9209c2640 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5580ec37e430 0x5580ec380820 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9209c2640 1 -- 172.21.15.151:0/128325548 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb9140b3040 con 0x5580ec37e430 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9236b3980 1 Processor -- start 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9236b3980 1 -- start start 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9236b3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec38ea30 0x5580ec38ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9236b3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5580ec185800 con 0x5580ec38ea30 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec38ea30 0x5580ec38ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec38ea30 0x5580ec38ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40758/0 (socket says 172.21.15.151:40758) 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9211c3640 1 -- 172.21.15.151:0/1044409308 learned_addr learned my addr 172.21.15.151:0/1044409308 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9211c3640 1 -- 172.21.15.151:0/1044409308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580ec38f390 con 0x5580ec38ea30 2024-09-10T14:28:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9211c3640 1 --2- 172.21.15.151:0/1044409308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec38ea30 0x5580ec38ee50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9180483f0 tx=0x7fb918021cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb806ffd640 1 -- 172.21.15.151:0/1044409308 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91804b070 con 0x5580ec38ea30 2024-09-10T14:28:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb806ffd640 1 -- 172.21.15.151:0/1044409308 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb918029680 con 0x5580ec38ea30 2024-09-10T14:28:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9236b3980 1 -- 172.21.15.151:0/1044409308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580ec38f620 con 0x5580ec38ea30 2024-09-10T14:28:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb806ffd640 1 -- 172.21.15.151:0/1044409308 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9180123c0 con 0x5580ec38ea30 2024-09-10T14:28:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.487+0000 7fb9236b3980 1 -- 172.21.15.151:0/1044409308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580ec3922a0 con 0x5580ec38ea30 2024-09-10T14:28:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb806ffd640 1 -- 172.21.15.151:0/1044409308 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb91804e070 con 0x5580ec38ea30 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb806ffd640 1 --2- 172.21.15.151:0/1044409308 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7f80346f0 0x7fb7f8036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb806ffd640 1 -- 172.21.15.151:0/1044409308 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb918051cc0 con 0x5580ec38ea30 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9209c2640 1 --2- 172.21.15.151:0/1044409308 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7f80346f0 0x7fb7f8036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 Processor -- start 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 -- start start 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9209c2640 1 --2- 172.21.15.151:0/1044409308 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7f80346f0 0x7fb7f8036bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x5580ec378670 tx=0x7fb914005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec2857f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5580ec36a1a0 con 0x5580ec285410 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec2857f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec2857f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40766/0 (socket says 172.21.15.151:40766) 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9211c3640 1 -- 172.21.15.151:0/828057760 learned_addr learned my addr 172.21.15.151:0/828057760 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9211c3640 1 -- 172.21.15.151:0/828057760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580ec285dc0 con 0x5580ec285410 2024-09-10T14:28:47.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9211c3640 1 --2- 172.21.15.151:0/828057760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec2857f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb918029b00 tx=0x7fb918041b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8310e12d061d6ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb804ff9640 1 -- 172.21.15.151:0/828057760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9180115d0 con 0x5580ec285410 2024-09-10T14:28:47.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb804ff9640 1 -- 172.21.15.151:0/828057760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb918048df0 con 0x5580ec285410 2024-09-10T14:28:47.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb804ff9640 1 -- 172.21.15.151:0/828057760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb918023e90 con 0x5580ec285410 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 -- 172.21.15.151:0/828057760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 msgr2=0x5580ec2857f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 --2- 172.21.15.151:0/828057760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec2857f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb918029b00 tx=0x7fb918041b50 comp rx=0 tx=0).stop 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 -- 172.21.15.151:0/828057760 shutdown_connections 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 --2- 172.21.15.151:0/828057760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec2857f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 -- 172.21.15.151:0/828057760 >> 172.21.15.151:0/828057760 conn(0x5580ec397550 msgr2=0x5580ec395650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 -- 172.21.15.151:0/828057760 shutdown_connections 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.491+0000 7fb9236b3980 1 -- 172.21.15.151:0/828057760 wait complete. 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 1 Processor -- start 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 1 -- start start 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec3a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5580ec286410 con 0x5580ec285410 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec3a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9211c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec3a4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40774/0 (socket says 172.21.15.151:40774) 2024-09-10T14:28:47.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 learned_addr learned my addr 172.21.15.151:0/3737587061 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580ec3a4a60 con 0x5580ec285410 2024-09-10T14:28:47.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9211c3640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec3a4520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb9180287c0 tx=0x7fb918019ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb7f6ffd640 1 -- 172.21.15.151:0/3737587061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91806d070 con 0x5580ec285410 2024-09-10T14:28:47.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580ec3a4a60 con 0x5580ec285410 2024-09-10T14:28:47.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580ec3a4a60 con 0x5580ec285410 2024-09-10T14:28:47.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb7f6ffd640 1 -- 172.21.15.151:0/3737587061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb918011c00 con 0x5580ec285410 2024-09-10T14:28:47.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb7f6ffd640 1 -- 172.21.15.151:0/3737587061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91803d3f0 con 0x5580ec285410 2024-09-10T14:28:47.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb7f6ffd640 1 -- 172.21.15.151:0/3737587061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb918066040 con 0x5580ec285410 2024-09-10T14:28:47.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb7f6ffd640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7ec034650 0x7fb7ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb7f6ffd640 1 -- 172.21.15.151:0/3737587061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb91805b070 con 0x5580ec285410 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9209c2640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7ec034650 0x7fb7ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec3af650 0x5580ec3b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b2240 con 0x5580ec3af650 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9219c4640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec3af650 0x5580ec3b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.495+0000 7fb9209c2640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7ec034650 0x7fb7ec036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb914000c10 tx=0x7fb9140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9219c4640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec3af650 0x5580ec3b1af0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 realm 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b2650 con 0x5580ec3af650 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b2ef0 con 0x5580ec3af650 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:47.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec3b3ff0 0x5580ec3b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b6a30 con 0x5580ec3b3ff0 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9211c3640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec3b3ff0 0x5580ec3b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9211c3640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec3b3ff0 0x5580ec3b63e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 20 searching for the correct realm 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b8290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9211c3640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb918069040 0x7fb918050440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b8290 con 0x7fb918069040 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9209c2640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb918069040 0x7fb918050440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9209c2640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb918069040 0x7fb918050440 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9209c2640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb9140dd040 0x7fb9140cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b8290 con 0x7fb9140dd040 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9219c4640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb9140dd040 0x7fb9140cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.499+0000 7fb9219c4640 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb9140dd040 0x7fb9140cf430 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb9140dd040 2024-09-10T14:28:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb9140dd040 2024-09-10T14:28:47.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb918069040 2024-09-10T14:28:47.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb9140dd040 2024-09-10T14:28:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb918069040 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.503+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb9140dd040 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb9140dd040 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb918069040 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.507+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb9140dd040 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb9140dd040 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb918069040 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3b3ff0 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb9140dd040 2024-09-10T14:28:47.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x5580ec3af650 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b3290 con 0x7fb918069040 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:47.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b7380 con 0x5580ec3af650 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b7bd0 con 0x5580ec3af650 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.511+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b6f90 con 0x7fb9140dd040 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 zone default found 2024-09-10T14:28:47.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 4 Realm: () 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 zonegroup default 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b80f0 con 0x7fb9140dd040 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b80f0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3ba170 con 0x5580ec3b3ff0 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 started sync module instance, tier type = 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b9570 con 0x7fb918069040 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94012207503712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3b91d0 con 0x7fb918069040 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bb0a0 con 0x5580ec3af650 2024-09-10T14:28:47.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.515+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94012207503712] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.519+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.519+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94012207508464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bb4c0 con 0x5580ec3af650 2024-09-10T14:28:47.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.519+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bbd90 con 0x5580ec3b3ff0 2024-09-10T14:28:47.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.519+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94012207508464] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.519+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.519+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94012207509792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bc180 con 0x5580ec3b3ff0 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.519+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bcb40 con 0x7fb918069040 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.523+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.523+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94012207515280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bd3e0 con 0x7fb918069040 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.523+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bdde0 con 0x5580ec3af650 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.523+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94012207509792] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.523+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94012207515280] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.523+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.523+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94012207517488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bd8f0 con 0x5580ec3af650 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.523+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3be680 con 0x7fb9140dd040 2024-09-10T14:28:47.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.527+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94012207517488] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.527+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.527+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94012207510976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3be5a0 con 0x7fb9140dd040 2024-09-10T14:28:47.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.527+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bef60 con 0x7fb9140dd040 2024-09-10T14:28:47.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.527+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.527+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94012207510976] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.527+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94012207524528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bf380 con 0x7fb9140dd040 2024-09-10T14:28:47.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.527+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3be110 con 0x7fb9140dd040 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94012207524528] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94012207522064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bfd70 con 0x7fb9140dd040 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9236b3980 20 add_watcher() i=0 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9236b3980 20 add_watcher() i=1 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9236b3980 20 add_watcher() i=2 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9236b3980 20 add_watcher() i=3 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9236b3980 20 add_watcher() i=4 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9236b3980 20 add_watcher() i=5 2024-09-10T14:28:47.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.531+0000 7fb9236b3980 20 add_watcher() i=6 2024-09-10T14:28:47.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94012207522064] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9236b3980 20 add_watcher() i=7 2024-09-10T14:28:47.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9236b3980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:47.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3c2da0 con 0x5580ec3af650 2024-09-10T14:28:47.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94012207528128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3c0200 con 0x5580ec3af650 2024-09-10T14:28:47.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94012207528128] v33'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb7d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:47.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9236b3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:47.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9236b3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:47.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.535+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cb5d0 con 0x5580ec3af650 2024-09-10T14:28:47.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.539+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.539+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cbca0 con 0x7fb9140dd040 2024-09-10T14:28:47.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.539+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.539+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cc0c0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.539+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.539+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cc000 con 0x5580ec3af650 2024-09-10T14:28:47.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.543+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.543+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cc610 con 0x7fb918069040 2024-09-10T14:28:47.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.543+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.543+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3ccb80 con 0x5580ec3b3ff0 2024-09-10T14:28:47.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.543+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.543+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3ccf60 con 0x5580ec3af650 2024-09-10T14:28:47.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.547+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.547+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3ccf60 con 0x7fb9140dd040 2024-09-10T14:28:47.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.547+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.547+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3ccf60 con 0x7fb918069040 2024-09-10T14:28:47.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.551+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.551+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd410 con 0x5580ec3b3ff0 2024-09-10T14:28:47.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.551+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.551+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd410 con 0x7fb918069040 2024-09-10T14:28:47.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.551+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.551+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x7fb9140dd040 2024-09-10T14:28:47.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.555+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.555+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x7fb918069040 2024-09-10T14:28:47.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.555+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.555+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x7fb9140dd040 2024-09-10T14:28:47.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.559+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.559+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3af650 2024-09-10T14:28:47.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.559+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.559+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.563+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.563+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x7fb918069040 2024-09-10T14:28:47.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.563+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.563+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.563+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.563+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3af650 2024-09-10T14:28:47.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.567+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.567+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3af650 2024-09-10T14:28:47.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.567+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.567+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.571+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.571+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x7fb918069040 2024-09-10T14:28:47.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.571+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.571+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.575+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.575+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.575+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.575+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.579+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.579+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd4a0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.579+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.579+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd550 con 0x7fb9140dd040 2024-09-10T14:28:47.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.583+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.583+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd550 con 0x5580ec3b3ff0 2024-09-10T14:28:47.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.587+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.587+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd550 con 0x7fb9140dd040 2024-09-10T14:28:47.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.587+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.587+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd550 con 0x5580ec3b3ff0 2024-09-10T14:28:47.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.591+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.591+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd550 con 0x7fb9140dd040 2024-09-10T14:28:47.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.595+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.595+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3cd550 con 0x7fb918069040 2024-09-10T14:28:47.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb7d6fe5640 20 reqs_thread_entry: start 2024-09-10T14:28:47.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:47.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 20 Filter name: none 2024-09-10T14:28:47.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb7d4fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:28:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3e8d20 con 0x7fb9140dd040 2024-09-10T14:28:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T14:28:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T14:28:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb7d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.599+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94012207528128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3c94a0 con 0x5580ec3af650 2024-09-10T14:28:47.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.603+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94012207528128] v33'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.603+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94012207503712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bf8c0 con 0x7fb918069040 2024-09-10T14:28:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.603+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94012207503712] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.603+0000 7fb9236b3980 20 remove_watcher() i=0 2024-09-10T14:28:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.603+0000 7fb9236b3980 2 removed watcher, disabling cache 2024-09-10T14:28:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.603+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94012207508464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bf8c0 con 0x5580ec3af650 2024-09-10T14:28:47.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.607+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94012207508464] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.607+0000 7fb9236b3980 20 remove_watcher() i=1 2024-09-10T14:28:47.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.607+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94012207509792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3babf0 con 0x5580ec3b3ff0 2024-09-10T14:28:47.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.607+0000 7fb9211c3640 1 -- 172.21.15.151:0/3737587061 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94012207509792] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91804d030 con 0x5580ec3b3ff0 2024-09-10T14:28:47.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.607+0000 7fb9236b3980 20 remove_watcher() i=2 2024-09-10T14:28:47.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.607+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94012207515280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bf8c0 con 0x7fb918069040 2024-09-10T14:28:47.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.611+0000 7fb9209c2640 1 -- 172.21.15.151:0/3737587061 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94012207515280] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9140ca030 con 0x7fb918069040 2024-09-10T14:28:47.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.611+0000 7fb9236b3980 20 remove_watcher() i=3 2024-09-10T14:28:47.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.611+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94012207517488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bb120 con 0x5580ec3af650 2024-09-10T14:28:47.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.611+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94012207517488] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x5580ec3af650 2024-09-10T14:28:47.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.611+0000 7fb9236b3980 20 remove_watcher() i=4 2024-09-10T14:28:47.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.611+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94012207510976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3babf0 con 0x7fb9140dd040 2024-09-10T14:28:47.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.615+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94012207510976] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.615+0000 7fb9236b3980 20 remove_watcher() i=5 2024-09-10T14:28:47.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.615+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94012207524528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bc690 con 0x7fb9140dd040 2024-09-10T14:28:47.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.615+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94012207524528] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.615+0000 7fb9236b3980 20 remove_watcher() i=6 2024-09-10T14:28:47.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.615+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94012207522064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580ec3bc690 con 0x7fb9140dd040 2024-09-10T14:28:47.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94012207522064] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb91c0083f0 con 0x7fb9140dd040 2024-09-10T14:28:47.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 20 remove_watcher() i=7 2024-09-10T14:28:47.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb9140dd040 msgr2=0x7fb9140cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb9140dd040 0x7fb9140cf430 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec3af650 msgr2=0x5580ec3b1af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec3af650 0x5580ec3b1af0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb918069040 msgr2=0x7fb918050440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb918069040 0x7fb918050440 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec3b3ff0 msgr2=0x5580ec3b63e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec3b3ff0 0x5580ec3b63e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7ec034650 msgr2=0x7fb7ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7ec034650 0x7fb7ec036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb914000c10 tx=0x7fb9140a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 msgr2=0x5580ec3a4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/3737587061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec285410 0x5580ec3a4520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb9180287c0 tx=0x7fb918019ed0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9219c4640 1 -- 172.21.15.151:0/3737587061 reap_dead start 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 shutdown_connections 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 >> 172.21.15.151:0/3737587061 conn(0x5580ec397550 msgr2=0x5580ec395620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 shutdown_connections 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/3737587061 wait complete. 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/1044409308 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7f80346f0 msgr2=0x7fb7f8036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/1044409308 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7f80346f0 0x7fb7f8036bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x5580ec378670 tx=0x7fb914005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/1044409308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec38ea30 msgr2=0x5580ec38ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/1044409308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec38ea30 0x5580ec38ee50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9180483f0 tx=0x7fb918021cd0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/1044409308 shutdown_connections 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/1044409308 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb7f80346f0 0x7fb7f8036bb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 --2- 172.21.15.151:0/1044409308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec38ea30 0x5580ec38ee50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/1044409308 >> 172.21.15.151:0/1044409308 conn(0x5580ec383b80 msgr2=0x5580ec386600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/1044409308 shutdown_connections 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.619+0000 7fb9236b3980 1 -- 172.21.15.151:0/1044409308 wait complete. 2024-09-10T14:28:47.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5580ec37e430 msgr2=0x5580ec380820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5580ec37e430 0x5580ec380820 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec2818f0 msgr2=0x5580ec377b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5580ec2818f0 0x5580ec377b30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec37a4f0 msgr2=0x5580ec37c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5580ec37a4f0 0x5580ec37c8e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8080346a0 msgr2=0x7fb808036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb8080346a0 0x7fb808036b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9140ad000 tx=0x7fb9140a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 msgr2=0x5580ec370b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 --2- 172.21.15.151:0/128325548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5580ec27d570 0x5580ec370b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb918002260 tx=0x7fb918000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9219c4640 1 -- 172.21.15.151:0/128325548 reap_dead start 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 shutdown_connections 2024-09-10T14:28:47.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 >> 172.21.15.151:0/128325548 conn(0x5580ec279090 msgr2=0x5580ec364000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 shutdown_connections 2024-09-10T14:28:47.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.623+0000 7fb9236b3980 1 -- 172.21.15.151:0/128325548 wait complete. 2024-09-10T14:28:47.637 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T14:28:47.637 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T14:28:47.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T14:28:47.638 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T14:28:47.714 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:47.714 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:47.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f269c8f7980 1 Processor -- start 2024-09-10T14:28:47.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f269c8f7980 1 -- start start 2024-09-10T14:28:47.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f269c8f7980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559d835508e0 0x559d83550cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f269c8f7980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d833d6ae0 con 0x559d83551230 2024-09-10T14:28:47.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f269c8f7980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x559d833fae30 con 0x559d835508e0 2024-09-10T14:28:47.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f269a407640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559d835508e0 0x559d83550cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f2699c06640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x559d83551230 0x559d83555c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34082/0 (socket says 172.21.15.151:34082) 2024-09-10T14:28:47.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f2699c06640 1 -- 172.21.15.151:0/4120469807 learned_addr learned my addr 172.21.15.151:0/4120469807 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:47.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f269a407640 1 -- 172.21.15.151:0/4120469807 >> v1:172.21.15.52:6789/0 conn(0x559d83551230 legacy=0x559d83555c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.711+0000 7f269a407640 1 -- 172.21.15.151:0/4120469807 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d835584b0 con 0x559d835508e0 2024-09-10T14:28:47.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f269a407640 1 --2- 172.21.15.151:0/4120469807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d83550cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f268c00a480 tx=0x7f268c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1641533fdfbfe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f2699405640 1 -- 172.21.15.151:0/4120469807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0b0070 con 0x559d835508e0 2024-09-10T14:28:47.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f2699405640 1 -- 172.21.15.151:0/4120469807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c0ab540 con 0x559d835508e0 2024-09-10T14:28:47.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f2699405640 1 -- 172.21.15.151:0/4120469807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0ab840 con 0x559d835508e0 2024-09-10T14:28:47.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f269c8f7980 1 -- 172.21.15.151:0/4120469807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 msgr2=0x559d83550cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4120469807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d83550cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f268c00a480 tx=0x7f268c01b280 comp rx=0 tx=0).stop 2024-09-10T14:28:47.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f269c8f7980 1 -- 172.21.15.151:0/4120469807 shutdown_connections 2024-09-10T14:28:47.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4120469807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d83550cc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f269c8f7980 1 -- 172.21.15.151:0/4120469807 >> 172.21.15.151:0/4120469807 conn(0x559d834c4230 msgr2=0x559d834c4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f269c8f7980 1 -- 172.21.15.151:0/4120469807 shutdown_connections 2024-09-10T14:28:47.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.715+0000 7f269c8f7980 1 -- 172.21.15.151:0/4120469807 wait complete. 2024-09-10T14:28:47.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.727+0000 7f269c8f7980 1 Processor -- start 2024-09-10T14:28:47.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.727+0000 7f269c8f7980 1 -- start start 2024-09-10T14:28:47.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d8363bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559d833fc200 con 0x559d835508e0 2024-09-10T14:28:47.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d8363bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d8363bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40796/0 (socket says 172.21.15.151:40796) 2024-09-10T14:28:47.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269a407640 1 -- 172.21.15.151:0/3820505579 learned_addr learned my addr 172.21.15.151:0/3820505579 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269a407640 1 -- 172.21.15.151:0/3820505579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d8363c1a0 con 0x559d835508e0 2024-09-10T14:28:47.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269a407640 1 --2- 172.21.15.151:0/3820505579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d8363bbd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f268c0ae040 tx=0x7f268c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a713ab3f5ff135 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f2588608640 1 -- 172.21.15.151:0/3820505579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0b0040 con 0x559d835508e0 2024-09-10T14:28:47.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f2588608640 1 -- 172.21.15.151:0/3820505579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c0ab9b0 con 0x559d835508e0 2024-09-10T14:28:47.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f2588608640 1 -- 172.21.15.151:0/3820505579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0abc90 con 0x559d835508e0 2024-09-10T14:28:47.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 -- 172.21.15.151:0/3820505579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 msgr2=0x559d8363bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 --2- 172.21.15.151:0/3820505579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d8363bbd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f268c0ae040 tx=0x7f268c003030 comp rx=0 tx=0).stop 2024-09-10T14:28:47.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 -- 172.21.15.151:0/3820505579 shutdown_connections 2024-09-10T14:28:47.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 --2- 172.21.15.151:0/3820505579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d8363bbd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 -- 172.21.15.151:0/3820505579 >> 172.21.15.151:0/3820505579 conn(0x559d834c4230 msgr2=0x559d83637800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 -- 172.21.15.151:0/3820505579 shutdown_connections 2024-09-10T14:28:47.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 -- 172.21.15.151:0/3820505579 wait complete. 2024-09-10T14:28:47.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 Processor -- start 2024-09-10T14:28:47.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 -- start start 2024-09-10T14:28:47.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d83642e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269c8f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559d83557ef0 con 0x559d835508e0 2024-09-10T14:28:47.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d83642e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d83642e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40802/0 (socket says 172.21.15.151:40802) 2024-09-10T14:28:47.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.731+0000 7f269a407640 1 -- 172.21.15.151:0/4178564418 learned_addr learned my addr 172.21.15.151:0/4178564418 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269a407640 1 -- 172.21.15.151:0/4178564418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d83643340 con 0x559d835508e0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269a407640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d83642e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f268c0030b0 tx=0x7f268c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f2586e05640 1 -- 172.21.15.151:0/4178564418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0c5070 con 0x559d835508e0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d836435d0 con 0x559d835508e0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f2586e05640 1 -- 172.21.15.151:0/4178564418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c0b6970 con 0x559d835508e0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f2586e05640 1 -- 172.21.15.151:0/4178564418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0b0050 con 0x559d835508e0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d836462b0 con 0x559d835508e0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f2586e05640 1 -- 172.21.15.151:0/4178564418 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f268c0c8070 con 0x559d835508e0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f2586e05640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2580034650 0x7f2580036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f2586e05640 1 -- 172.21.15.151:0/4178564418 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f268c0bc070 con 0x559d835508e0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f2699c06640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2580034650 0x7f2580036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d83551230 0x559d83649db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d8364a420 con 0x559d83551230 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269ac08640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d83551230 0x559d83649db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f2699c06640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2580034650 0x7f2580036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2690000f70 tx=0x7f26900012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269ac08640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d83551230 0x559d83649db0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269ac08640 1 -- 172.21.15.151:0/4178564418 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d83551230 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d836474b0 con 0x559d83551230 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269ac08640 1 -- 172.21.15.151:0/4178564418 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f269400a4d0 con 0x559d83551230 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d8364c750 0x559d8364eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d8364f210 con 0x559d8364c750 2024-09-10T14:28:47.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.735+0000 7f269a407640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d8364c750 0x559d8364eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269a407640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d8364c750 0x559d8364eb40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269a407640 1 -- 172.21.15.151:0/4178564418 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f268c0c7030 con 0x559d8364c750 2024-09-10T14:28:47.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d8364b5f0 con 0x559d83551230 2024-09-10T14:28:47.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269ac08640 1 -- 172.21.15.151:0/4178564418 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f269400a4d0 con 0x559d83551230 2024-09-10T14:28:47.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559d83650650 0x559d83652a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d836531d0 con 0x559d83650650 2024-09-10T14:28:47.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f2699c06640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559d83650650 0x559d83652a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f2699c06640 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559d83650650 0x559d83652a40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f2699c06640 1 -- 172.21.15.151:0/4178564418 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f269000e620 con 0x559d83650650 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269c8f7980 1 Processor -- start 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269c8f7980 1 -- start start 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269c8f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d83660c60 0x559d83661080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269c8f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559d83455800 con 0x559d83660c60 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d83660c60 0x559d83661080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d83660c60 0x559d83661080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40808/0 (socket says 172.21.15.151:40808) 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269a407640 1 -- 172.21.15.151:0/137294978 learned_addr learned my addr 172.21.15.151:0/137294978 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.739+0000 7f269a407640 1 -- 172.21.15.151:0/137294978 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d836615c0 con 0x559d83660c60 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269a407640 1 --2- 172.21.15.151:0/137294978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d83660c60 0x559d83661080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f268c0e1f50 tx=0x7f268c0b46f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f257ffff640 1 -- 172.21.15.151:0/137294978 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0aa4e0 con 0x559d83660c60 2024-09-10T14:28:47.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269c8f7980 1 -- 172.21.15.151:0/137294978 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d83661850 con 0x559d83660c60 2024-09-10T14:28:47.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f257ffff640 1 -- 172.21.15.151:0/137294978 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c0aa680 con 0x559d83660c60 2024-09-10T14:28:47.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f257ffff640 1 -- 172.21.15.151:0/137294978 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0aa960 con 0x559d83660c60 2024-09-10T14:28:47.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269c8f7980 1 -- 172.21.15.151:0/137294978 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d836644d0 con 0x559d83660c60 2024-09-10T14:28:47.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f257ffff640 1 -- 172.21.15.151:0/137294978 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f268c0e3d10 con 0x559d83660c60 2024-09-10T14:28:47.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f257ffff640 1 --2- 172.21.15.151:0/137294978 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2574034650 0x7f2574036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f257ffff640 1 -- 172.21.15.151:0/137294978 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f268c0df030 con 0x559d83660c60 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f2699c06640 1 --2- 172.21.15.151:0/137294978 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2574034650 0x7f2574036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269c8f7980 1 Processor -- start 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269c8f7980 1 -- start start 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f2699c06640 1 --2- 172.21.15.151:0/137294978 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2574034650 0x7f2574036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f269000bf60 tx=0x7f269000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269c8f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d8366d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269c8f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559d8363c460 con 0x559d8366d590 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d8366d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d8366d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40810/0 (socket says 172.21.15.151:40810) 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269a407640 1 -- 172.21.15.151:0/3384948253 learned_addr learned my addr 172.21.15.151:0/3384948253 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269a407640 1 -- 172.21.15.151:0/3384948253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d8366df40 con 0x559d8366d590 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.743+0000 7f269a407640 1 --2- 172.21.15.151:0/3384948253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d8366d970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f268c0ddfd0 tx=0x7f268c0cb450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca455d05f6adecd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f257dffb640 1 -- 172.21.15.151:0/3384948253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0cb810 con 0x559d8366d590 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f257dffb640 1 -- 172.21.15.151:0/3384948253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c0c93b0 con 0x559d8366d590 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f257dffb640 1 -- 172.21.15.151:0/3384948253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0b5e50 con 0x559d8366d590 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- 172.21.15.151:0/3384948253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 msgr2=0x559d8366d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 --2- 172.21.15.151:0/3384948253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d8366d970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f268c0ddfd0 tx=0x7f268c0cb450 comp rx=0 tx=0).stop 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- 172.21.15.151:0/3384948253 shutdown_connections 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 --2- 172.21.15.151:0/3384948253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d8366d970 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- 172.21.15.151:0/3384948253 >> 172.21.15.151:0/3384948253 conn(0x559d83669970 msgr2=0x559d83667a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- 172.21.15.151:0/3384948253 shutdown_connections 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- 172.21.15.151:0/3384948253 wait complete. 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 Processor -- start 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- start start 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d83674790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559d8366e3e0 con 0x559d8366d590 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d83674790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269a407640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d83674790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40820/0 (socket says 172.21.15.151:40820) 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 learned_addr learned my addr 172.21.15.151:0/2645473710 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d83674cd0 con 0x559d8366d590 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269a407640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d83674790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f268c0c9560 tx=0x7f268c0c7e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f256bfff640 1 -- 172.21.15.151:0/2645473710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0e3750 con 0x559d8366d590 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f256bfff640 1 -- 172.21.15.151:0/2645473710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268c0e38f0 con 0x559d8366d590 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d83674cd0 con 0x559d8366d590 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f256bfff640 1 -- 172.21.15.151:0/2645473710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f268c0b5790 con 0x559d8366d590 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d83674cd0 con 0x559d8366d590 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.747+0000 7f256bfff640 1 -- 172.21.15.151:0/2645473710 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f268c10f020 con 0x559d8366d590 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f256bfff640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2564034650 0x7f2564036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f256bfff640 1 -- 172.21.15.151:0/2645473710 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f268c10d020 con 0x559d8366d590 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f2699c06640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2564034650 0x7f2564036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d8367f830 0x559d83681cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83682420 con 0x559d8367f830 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269ac08640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d8367f830 0x559d83681cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f2699c06640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2564034650 0x7f2564036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x559d836535d0 tx=0x7f2690010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269ac08640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d8367f830 0x559d83681cd0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 realm 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83682830 con 0x559d8367f830 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d836830d0 con 0x559d8367f830 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d836841d0 0x559d836865c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83686c10 con 0x559d836841d0 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269a407640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d836841d0 0x559d836865c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269a407640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d836841d0 0x559d836865c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 20 searching for the correct realm 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83688470 con 0x559d836841d0 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269a407640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f268c0cbc50 0x7f268c0db170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83688470 con 0x7f268c0cbc50 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f2699c06640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f268c0cbc50 0x7f268c0db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f2699c06640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f268c0cbc50 0x7f268c0db170 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f2699c06640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f2690037040 0x7f2690036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.751+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83688470 con 0x7f2690037040 2024-09-10T14:28:47.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f2690037040 0x7f2690036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f2690037040 0x7f2690036410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f2690037040 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f2690037040 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f268c0cbc50 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d836841d0 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.755+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f2690037040 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f268c0cbc50 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d836841d0 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d836841d0 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f2690037040 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d836841d0 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d836841d0 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.759+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f2690037040 2024-09-10T14:28:47.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d836841d0 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f268c0cbc50 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f2690037040 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d836841d0 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f2690037040 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f268c0cbc50 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d836841d0 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f2690037040 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x559d8367f830 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.763+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559d83683470 con 0x7f268c0cbc50 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:47.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83687590 con 0x559d8367f830 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83687de0 con 0x559d8367f830 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83687930 con 0x7f2690037040 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 zone default found 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 4 Realm: () 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 zonegroup default 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83687d60 con 0x7f2690037040 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d8368a280 con 0x559d836841d0 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d8368a620 con 0x559d836841d0 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 started sync module instance, tier type = 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:47.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d83689720 con 0x7f268c0cbc50 2024-09-10T14:28:47.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94135002894960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368a9c0 con 0x7f268c0cbc50 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.767+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368b380 con 0x559d8367f830 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.771+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.771+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94135002902496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368ba70 con 0x559d8367f830 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.771+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368c590 con 0x559d836841d0 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.771+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94135002894960] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.771+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94135002902496] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.775+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.775+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94135002906720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368b4c0 con 0x559d836841d0 2024-09-10T14:28:47.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.775+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368ce30 con 0x7f268c0cbc50 2024-09-10T14:28:47.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.779+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.779+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94135002909056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368d680 con 0x7f268c0cbc50 2024-09-10T14:28:47.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.779+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94135002906720] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.779+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d83689b60 con 0x559d8367f830 2024-09-10T14:28:47.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.779+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94135002909056] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.779+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.779+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94135002911184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368e040 con 0x559d8367f830 2024-09-10T14:28:47.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.779+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368e890 con 0x7f2690037040 2024-09-10T14:28:47.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.783+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94135002911184] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.783+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.783+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94135002913952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368e650 con 0x7f2690037040 2024-09-10T14:28:47.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.783+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368f190 con 0x7f2690037040 2024-09-10T14:28:47.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.783+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94135002913952] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.783+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.783+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94135002918016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368f150 con 0x7f2690037040 2024-09-10T14:28:47.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.783+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368fb70 con 0x7f2690037040 2024-09-10T14:28:47.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94135002920544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368ffe0 con 0x7f2690037040 2024-09-10T14:28:47.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269c8f7980 20 add_watcher() i=0 2024-09-10T14:28:47.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269c8f7980 20 add_watcher() i=1 2024-09-10T14:28:47.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269c8f7980 20 add_watcher() i=2 2024-09-10T14:28:47.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269c8f7980 20 add_watcher() i=3 2024-09-10T14:28:47.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269c8f7980 20 add_watcher() i=4 2024-09-10T14:28:47.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269c8f7980 20 add_watcher() i=5 2024-09-10T14:28:47.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94135002918016] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.787+0000 7f269c8f7980 20 add_watcher() i=6 2024-09-10T14:28:47.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94135002920544] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269c8f7980 20 add_watcher() i=7 2024-09-10T14:28:47.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269c8f7980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:47.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d8368ffe0 con 0x559d8367f830 2024-09-10T14:28:47.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94135002921776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368ff50 con 0x559d8367f830 2024-09-10T14:28:47.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94135002921776] v33'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f2550fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:47.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269c8f7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:47.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269c8f7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:47.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.791+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369b8b0 con 0x559d8367f830 2024-09-10T14:28:47.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.795+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.795+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369bf80 con 0x7f2690037040 2024-09-10T14:28:47.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.795+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.795+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369c3a0 con 0x559d836841d0 2024-09-10T14:28:47.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.799+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.799+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369c390 con 0x559d8367f830 2024-09-10T14:28:47.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.799+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.799+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369c840 con 0x7f268c0cbc50 2024-09-10T14:28:47.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.803+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.803+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369a970 con 0x559d836841d0 2024-09-10T14:28:47.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.803+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.803+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369a940 con 0x559d8367f830 2024-09-10T14:28:47.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.807+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.807+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369a940 con 0x7f2690037040 2024-09-10T14:28:47.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.807+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.807+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369a940 con 0x7f268c0cbc50 2024-09-10T14:28:47.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.811+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.811+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d3a0 con 0x559d836841d0 2024-09-10T14:28:47.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.811+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.811+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d3a0 con 0x7f268c0cbc50 2024-09-10T14:28:47.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.811+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.811+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d850 con 0x7f2690037040 2024-09-10T14:28:47.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.815+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.815+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d850 con 0x7f268c0cbc50 2024-09-10T14:28:47.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.815+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.819+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d850 con 0x7f2690037040 2024-09-10T14:28:47.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.819+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.819+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d850 con 0x559d8367f830 2024-09-10T14:28:47.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.819+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.819+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d850 con 0x559d836841d0 2024-09-10T14:28:47.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.823+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.823+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d880 con 0x7f268c0cbc50 2024-09-10T14:28:47.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.823+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.823+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d836841d0 2024-09-10T14:28:47.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.827+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.827+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d8367f830 2024-09-10T14:28:47.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.827+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.827+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d8367f830 2024-09-10T14:28:47.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.831+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.831+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d836841d0 2024-09-10T14:28:47.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.831+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.831+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x7f268c0cbc50 2024-09-10T14:28:47.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.835+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.835+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d836841d0 2024-09-10T14:28:47.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.835+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.835+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d836841d0 2024-09-10T14:28:47.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.835+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.835+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d836841d0 2024-09-10T14:28:47.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.839+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.839+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d836841d0 2024-09-10T14:28:47.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.839+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.839+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x7f2690037040 2024-09-10T14:28:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.839+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.843+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d836841d0 2024-09-10T14:28:47.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.843+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.843+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x7f2690037040 2024-09-10T14:28:47.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.843+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.843+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x559d836841d0 2024-09-10T14:28:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.847+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.847+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x7f2690037040 2024-09-10T14:28:47.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.851+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.851+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8369d990 con 0x7f268c0cbc50 2024-09-10T14:28:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.851+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.851+0000 7f24cb7fe640 20 reqs_thread_entry: start 2024-09-10T14:28:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.851+0000 7f269c8f7980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.851+0000 7f269c8f7980 20 Filter name: none 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.851+0000 7f24c97fa640 20 reqs_thread_entry: start 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.851+0000 7f269c8f7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269c8f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559d83699ac0 con 0x559d8367f830 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269c8f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269c8f7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269c8f7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:47.858 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T14:28:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f2550fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94135002921776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d83698540 con 0x559d8367f830 2024-09-10T14:28:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94135002921776] v33'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.855+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94135002894960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368fb30 con 0x7f268c0cbc50 2024-09-10T14:28:47.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.859+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94135002894960] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.859+0000 7f269c8f7980 20 remove_watcher() i=0 2024-09-10T14:28:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.859+0000 7f269c8f7980 2 removed watcher, disabling cache 2024-09-10T14:28:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.859+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94135002902496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368fb30 con 0x559d8367f830 2024-09-10T14:28:47.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.859+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94135002902496] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.859+0000 7f269c8f7980 20 remove_watcher() i=1 2024-09-10T14:28:47.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.859+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94135002906720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368afe0 con 0x559d836841d0 2024-09-10T14:28:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.863+0000 7f269a407640 1 -- 172.21.15.151:0/2645473710 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94135002906720] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f268c0c7030 con 0x559d836841d0 2024-09-10T14:28:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.863+0000 7f269c8f7980 20 remove_watcher() i=2 2024-09-10T14:28:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.863+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94135002909056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368fb30 con 0x7f268c0cbc50 2024-09-10T14:28:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.863+0000 7f2699c06640 1 -- 172.21.15.151:0/2645473710 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94135002909056] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269000e620 con 0x7f268c0cbc50 2024-09-10T14:28:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.863+0000 7f269c8f7980 20 remove_watcher() i=3 2024-09-10T14:28:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.863+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94135002911184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368c060 con 0x559d8367f830 2024-09-10T14:28:47.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.867+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94135002911184] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x559d8367f830 2024-09-10T14:28:47.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.867+0000 7f269c8f7980 20 remove_watcher() i=4 2024-09-10T14:28:47.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.867+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94135002913952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368afe0 con 0x7f2690037040 2024-09-10T14:28:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.867+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94135002913952] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.867+0000 7f269c8f7980 20 remove_watcher() i=5 2024-09-10T14:28:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.867+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94135002918016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368c980 con 0x7f2690037040 2024-09-10T14:28:47.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94135002918016] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 20 remove_watcher() i=6 2024-09-10T14:28:47.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94135002920544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559d8368fb30 con 0x7f2690037040 2024-09-10T14:28:47.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94135002920544] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f269400a4d0 con 0x7f2690037040 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 20 remove_watcher() i=7 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f2690037040 msgr2=0x7f2690036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f2690037040 0x7f2690036410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d8367f830 msgr2=0x559d83681cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d8367f830 0x559d83681cd0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f268c0cbc50 msgr2=0x7f268c0db170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f268c0cbc50 0x7f268c0db170 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d836841d0 msgr2=0x559d836865c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d836841d0 0x559d836865c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2564034650 msgr2=0x7f2564036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2564034650 0x7f2564036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x559d836535d0 tx=0x7f2690010000 comp rx=0 tx=0).stop 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269ac08640 1 -- 172.21.15.151:0/2645473710 reap_dead start 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 msgr2=0x559d83674790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d83674790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f268c0c9560 tx=0x7f268c0c7e90 comp rx=0 tx=0).stop 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 shutdown_connections 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 --2- 172.21.15.151:0/2645473710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d8366d590 0x559d83674790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 >> 172.21.15.151:0/2645473710 conn(0x559d83669970 msgr2=0x559d83667a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 shutdown_connections 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.871+0000 7f269c8f7980 1 -- 172.21.15.151:0/2645473710 wait complete. 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/137294978 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2574034650 msgr2=0x7f2574036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/137294978 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2574034650 0x7f2574036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f269000bf60 tx=0x7f269000f000 comp rx=0 tx=0).stop 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/137294978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d83660c60 msgr2=0x559d83661080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/137294978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d83660c60 0x559d83661080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f268c0e1f50 tx=0x7f268c0b46f0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/137294978 shutdown_connections 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/137294978 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2574034650 0x7f2574036b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/137294978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d83660c60 0x559d83661080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/137294978 >> 172.21.15.151:0/137294978 conn(0x559d83655db0 msgr2=0x559d83658830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/137294978 shutdown_connections 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/137294978 wait complete. 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559d83650650 msgr2=0x559d83652a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559d83650650 0x559d83652a40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d83551230 msgr2=0x559d83649db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559d83551230 0x559d83649db0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d8364c750 msgr2=0x559d8364eb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559d8364c750 0x559d8364eb40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2580034650 msgr2=0x7f2580036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2580034650 0x7f2580036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2690000f70 tx=0x7f26900012c0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 msgr2=0x559d83642e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 --2- 172.21.15.151:0/4178564418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559d835508e0 0x559d83642e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f268c0030b0 tx=0x7f268c018020 comp rx=0 tx=0).stop 2024-09-10T14:28:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269ac08640 1 -- 172.21.15.151:0/4178564418 reap_dead start 2024-09-10T14:28:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 shutdown_connections 2024-09-10T14:28:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 >> 172.21.15.151:0/4178564418 conn(0x559d834c4230 msgr2=0x559d83636380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 shutdown_connections 2024-09-10T14:28:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.875+0000 7f269c8f7980 1 -- 172.21.15.151:0/4178564418 wait complete. 2024-09-10T14:28:47.891 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T14:28:47.892 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T14:28:47.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T14:28:47.892 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T14:28:47.973 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:47.973 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:47.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49abfdd980 1 Processor -- start 2024-09-10T14:28:47.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49abfdd980 1 -- start start 2024-09-10T14:28:47.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49abfdd980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5600cbfe2e80 0x5600cbfe5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49abfdd980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5600cbe64ae0 con 0x5600cbf51380 2024-09-10T14:28:47.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49abfdd980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5600cbe88e30 con 0x5600cbfe2e80 2024-09-10T14:28:47.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49a92ec640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5600cbfe2e80 0x5600cbfe5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49a92ec640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5600cbfe2e80 0x5600cbfe5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40822/0 (socket says 172.21.15.151:40822) 2024-09-10T14:28:47.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49a9aed640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5600cbf51380 0x5600cbfe1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34090/0 (socket says 172.21.15.151:34090) 2024-09-10T14:28:47.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49a92ec640 1 -- 172.21.15.151:0/644554205 learned_addr learned my addr 172.21.15.151:0/644554205 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49a92ec640 1 -- 172.21.15.151:0/644554205 >> v1:172.21.15.52:6789/0 conn(0x5600cbf51380 legacy=0x5600cbfe1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.971+0000 7f49a92ec640 1 -- 172.21.15.151:0/644554205 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cbf51760 con 0x5600cbfe2e80 2024-09-10T14:28:47.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49a92ec640 1 --2- 172.21.15.151:0/644554205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbfe2e80 0x5600cbfe5270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f499400a5c0 tx=0x7f499401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a2ff2a71b12fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49a8aeb640 1 -- 172.21.15.151:0/644554205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49940a6070 con 0x5600cbfe2e80 2024-09-10T14:28:47.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49a8aeb640 1 -- 172.21.15.151:0/644554205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49940af070 con 0x5600cbfe2e80 2024-09-10T14:28:47.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49a8aeb640 1 -- 172.21.15.151:0/644554205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49940aa5c0 con 0x5600cbfe2e80 2024-09-10T14:28:47.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49abfdd980 1 -- 172.21.15.151:0/644554205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbfe2e80 msgr2=0x5600cbfe5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49abfdd980 1 --2- 172.21.15.151:0/644554205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbfe2e80 0x5600cbfe5270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f499400a5c0 tx=0x7f499401b340 comp rx=0 tx=0).stop 2024-09-10T14:28:47.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49abfdd980 1 -- 172.21.15.151:0/644554205 shutdown_connections 2024-09-10T14:28:47.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49abfdd980 1 --2- 172.21.15.151:0/644554205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbfe2e80 0x5600cbfe5270 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49abfdd980 1 -- 172.21.15.151:0/644554205 >> 172.21.15.151:0/644554205 conn(0x5600cbfd7050 msgr2=0x5600cbfd9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49abfdd980 1 -- 172.21.15.151:0/644554205 shutdown_connections 2024-09-10T14:28:47.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.975+0000 7f49abfdd980 1 -- 172.21.15.151:0/644554205 wait complete. 2024-09-10T14:28:47.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49abfdd980 1 Processor -- start 2024-09-10T14:28:47.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49abfdd980 1 -- start start 2024-09-10T14:28:47.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49abfdd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbf51380 0x5600cc0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49abfdd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600cbe8a200 con 0x5600cbf51380 2024-09-10T14:28:47.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49a9aed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbf51380 0x5600cc0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49a9aed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbf51380 0x5600cc0c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40830/0 (socket says 172.21.15.151:40830) 2024-09-10T14:28:47.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49a9aed640 1 -- 172.21.15.151:0/3021742860 learned_addr learned my addr 172.21.15.151:0/3021742860 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:47.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49a9aed640 1 -- 172.21.15.151:0/3021742860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cc0ca4b0 con 0x5600cbf51380 2024-09-10T14:28:47.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f49a9aed640 1 --2- 172.21.15.151:0/3021742860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbf51380 0x5600cc0c9ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f499c0015f0 tx=0x7f499c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb63374bd0136fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:47.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f4897e07640 1 -- 172.21.15.151:0/3021742860 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499c013420 con 0x5600cbf51380 2024-09-10T14:28:47.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f4897e07640 1 -- 172.21.15.151:0/3021742860 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499c0135e0 con 0x5600cbf51380 2024-09-10T14:28:47.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.991+0000 7f4897e07640 1 -- 172.21.15.151:0/3021742860 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499c013940 con 0x5600cbf51380 2024-09-10T14:28:47.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- 172.21.15.151:0/3021742860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbf51380 msgr2=0x5600cc0c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:47.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 --2- 172.21.15.151:0/3021742860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbf51380 0x5600cc0c9ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f499c0015f0 tx=0x7f499c001ab0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- 172.21.15.151:0/3021742860 shutdown_connections 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 --2- 172.21.15.151:0/3021742860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cbf51380 0x5600cc0c9ee0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- 172.21.15.151:0/3021742860 >> 172.21.15.151:0/3021742860 conn(0x5600cbfd7050 msgr2=0x5600cc0c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- 172.21.15.151:0/3021742860 shutdown_connections 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- 172.21.15.151:0/3021742860 wait complete. 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 Processor -- start 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- start start 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0d1480 0x5600cc0d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600cbfe81e0 con 0x5600cc0d1480 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49a9aed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0d1480 0x5600cc0d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49a9aed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0d1480 0x5600cc0d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40846/0 (socket says 172.21.15.151:40846) 2024-09-10T14:28:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49a9aed640 1 -- 172.21.15.151:0/948961091 learned_addr learned my addr 172.21.15.151:0/948961091 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49a9aed640 1 -- 172.21.15.151:0/948961091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cc0d1de0 con 0x5600cc0d1480 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49a9aed640 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0d1480 0x5600cc0d18a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f499c006640 tx=0x7f499c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f4896604640 1 -- 172.21.15.151:0/948961091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499c022020 con 0x5600cc0d1480 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f4896604640 1 -- 172.21.15.151:0/948961091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499c006320 con 0x5600cc0d1480 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f4896604640 1 -- 172.21.15.151:0/948961091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499c004aa0 con 0x5600cc0d1480 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600cc0d2070 con 0x5600cc0d1480 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600cc0d4b50 con 0x5600cc0d1480 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 Processor -- start 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- start start 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0dee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.995+0000 7f49abfdd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600cbee3800 con 0x5600cc0dea40 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0dee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40852/0 (socket says 172.21.15.151:40852) 2024-09-10T14:28:48.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 -- 172.21.15.151:0/1248816326 learned_addr learned my addr 172.21.15.151:0/1248816326 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f4896604640 1 -- 172.21.15.151:0/948961091 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f499c025020 con 0x5600cc0d1480 2024-09-10T14:28:48.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f4896604640 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4890034650 0x7f4890036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f4896604640 1 -- 172.21.15.151:0/948961091 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f499c018030 con 0x5600cc0d1480 2024-09-10T14:28:48.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49a9aed640 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4890034650 0x7f4890036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 -- 172.21.15.151:0/1248816326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cc0df380 con 0x5600cc0dea40 2024-09-10T14:28:48.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49a9aed640 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4890034650 0x7f4890036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f499c006a00 tx=0x7f499c013440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 --2- 172.21.15.151:0/1248816326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0dee40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49a400a440 tx=0x7f49a400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14f8f04573115cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f488ffff640 1 -- 172.21.15.151:0/1248816326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49a4008850 con 0x5600cc0dea40 2024-09-10T14:28:48.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f488ffff640 1 -- 172.21.15.151:0/1248816326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a4008a10 con 0x5600cc0dea40 2024-09-10T14:28:48.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f488ffff640 1 -- 172.21.15.151:0/1248816326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49a4008d30 con 0x5600cc0dea40 2024-09-10T14:28:48.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 -- 172.21.15.151:0/1248816326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 msgr2=0x5600cc0dee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 --2- 172.21.15.151:0/1248816326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0dee40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49a400a440 tx=0x7f49a400a900 comp rx=0 tx=0).stop 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 -- 172.21.15.151:0/1248816326 shutdown_connections 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 --2- 172.21.15.151:0/1248816326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0dee40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 -- 172.21.15.151:0/1248816326 >> 172.21.15.151:0/1248816326 conn(0x5600cc0d9f40 msgr2=0x5600cc0dcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 -- 172.21.15.151:0/1248816326 shutdown_connections 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 -- 172.21.15.151:0/1248816326 wait complete. 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 Processor -- start 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 -- start start 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49abfdd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600cc0dfd60 con 0x5600cc0dea40 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0e5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40868/0 (socket says 172.21.15.151:40868) 2024-09-10T14:28:48.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 -- 172.21.15.151:0/124530662 learned_addr learned my addr 172.21.15.151:0/124530662 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:47.999+0000 7f49aa2ee640 1 -- 172.21.15.151:0/124530662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cc0e5fa0 con 0x5600cc0dea40 2024-09-10T14:28:48.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49aa2ee640 1 --2- 172.21.15.151:0/124530662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0e5a60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49a400ae00 tx=0x7f49a4003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f488e7fc640 1 -- 172.21.15.151:0/124530662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49a4013ba0 con 0x5600cc0dea40 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f488e7fc640 1 -- 172.21.15.151:0/124530662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a4023070 con 0x5600cc0dea40 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f488e7fc640 1 -- 172.21.15.151:0/124530662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49a401e420 con 0x5600cc0dea40 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49abfdd980 1 -- 172.21.15.151:0/124530662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600cc0e6230 con 0x5600cc0dea40 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49abfdd980 1 -- 172.21.15.151:0/124530662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600cc0e65e0 con 0x5600cc0dea40 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f488e7fc640 1 -- 172.21.15.151:0/124530662 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f49a401e5c0 con 0x5600cc0dea40 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49abfdd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49abfdd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f488e7fc640 1 --2- 172.21.15.151:0/124530662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f48840346a0 0x7f4884036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f488e7fc640 1 -- 172.21.15.151:0/124530662 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f49a404a1b0 con 0x5600cc0dea40 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49a92ec640 1 --2- 172.21.15.151:0/124530662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f48840346a0 0x7f4884036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49abfdd980 1 Processor -- start 2024-09-10T14:28:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49abfdd980 1 -- start start 2024-09-10T14:28:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49abfdd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0ff2f0 0x5600cc0ff710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49abfdd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600cc0ca830 con 0x5600cc0ff2f0 2024-09-10T14:28:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49a92ec640 1 --2- 172.21.15.151:0/124530662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f48840346a0 0x7f4884036b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49940ae000 tx=0x7f49940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49a9aed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0ff2f0 0x5600cc0ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49a9aed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0ff2f0 0x5600cc0ff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40872/0 (socket says 172.21.15.151:40872) 2024-09-10T14:28:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49a9aed640 1 -- 172.21.15.151:0/2589101141 learned_addr learned my addr 172.21.15.151:0/2589101141 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.003+0000 7f49a9aed640 1 -- 172.21.15.151:0/2589101141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600cc0ffce0 con 0x5600cc0ff2f0 2024-09-10T14:28:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49a9aed640 1 --2- 172.21.15.151:0/2589101141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0ff2f0 0x5600cc0ff710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c010 tx=0x7f499c028630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f486e7e4640 1 -- 172.21.15.151:0/2589101141 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499c04e070 con 0x5600cc0ff2f0 2024-09-10T14:28:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f486e7e4640 1 -- 172.21.15.151:0/2589101141 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499c01e3f0 con 0x5600cc0ff2f0 2024-09-10T14:28:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49abfdd980 1 -- 172.21.15.151:0/2589101141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600cc102960 con 0x5600cc0ff2f0 2024-09-10T14:28:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f486e7e4640 1 -- 172.21.15.151:0/2589101141 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499c01d950 con 0x5600cc0ff2f0 2024-09-10T14:28:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49abfdd980 1 -- 172.21.15.151:0/2589101141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600cc102d10 con 0x5600cc0ff2f0 2024-09-10T14:28:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f486e7e4640 1 -- 172.21.15.151:0/2589101141 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f499c010070 con 0x5600cc0ff2f0 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f486e7e4640 1 --2- 172.21.15.151:0/2589101141 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47ec0346a0 0x7f47ec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f486e7e4640 1 -- 172.21.15.151:0/2589101141 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f499c039070 con 0x5600cc0ff2f0 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49a92ec640 1 --2- 172.21.15.151:0/2589101141 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47ec0346a0 0x7f47ec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f47dffff640 20 reqs_thread_entry: start 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600cc104ed0 0x5600cc107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600cc107a10 con 0x5600cc104ed0 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49a92ec640 1 --2- 172.21.15.151:0/2589101141 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47ec0346a0 0x7f47ec036b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f499401b380 tx=0x7f4994005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49aa2ee640 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600cc104ed0 0x5600cc107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49aa2ee640 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600cc104ed0 0x5600cc107340 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49aa2ee640 1 -- 172.21.15.151:0/948961091 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49a4028790 con 0x5600cc104ed0 2024-09-10T14:28:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600cc109830 0x5600cc10bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:2 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600cc10c270 con 0x5600cc109830 2024-09-10T14:28:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49a9aed640 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600cc109830 0x5600cc10bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.007+0000 7f49a9aed640 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600cc109830 0x5600cc10bc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.011+0000 7f49a9aed640 1 -- 172.21.15.151:0/948961091 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(2 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f499c01b070 con 0x5600cc109830 2024-09-10T14:28:48.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.011+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600cc110fd0 con 0x5600cc109830 2024-09-10T14:28:48.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.011+0000 7f49a9aed640 1 -- 172.21.15.151:0/948961091 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [stat,call,call,writefull 0~993] v33'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f499c01b070 con 0x5600cc109830 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.011+0000 7f49abfdd980 1 -- 172.21.15.151:0/124530662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f48840346a0 msgr2=0x7f4884036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.011+0000 7f49abfdd980 1 --2- 172.21.15.151:0/124530662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f48840346a0 0x7f4884036b60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49940ae000 tx=0x7f49940a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.011+0000 7f49abfdd980 1 -- 172.21.15.151:0/124530662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 msgr2=0x5600cc0e5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.011+0000 7f49abfdd980 1 --2- 172.21.15.151:0/124530662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0e5a60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49a400ae00 tx=0x7f49a4003000 comp rx=0 tx=0).stop 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/124530662 shutdown_connections 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/124530662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f48840346a0 0x7f4884036b60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/124530662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0dea40 0x5600cc0e5a60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/124530662 >> 172.21.15.151:0/124530662 conn(0x5600cc0d9f40 msgr2=0x5600cc0d8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/124530662 shutdown_connections 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/124530662 wait complete. 2024-09-10T14:28:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/2589101141 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47ec0346a0 msgr2=0x7f47ec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/2589101141 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47ec0346a0 0x7f47ec036b60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f499401b380 tx=0x7f4994005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/2589101141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0ff2f0 msgr2=0x5600cc0ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/2589101141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0ff2f0 0x5600cc0ff710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c010 tx=0x7f499c028630 comp rx=0 tx=0).stop 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/2589101141 shutdown_connections 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/2589101141 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f47ec0346a0 0x7f47ec036b60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/2589101141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0ff2f0 0x5600cc0ff710 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/2589101141 >> 172.21.15.151:0/2589101141 conn(0x5600cc0f4380 msgr2=0x5600cc0f6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/2589101141 shutdown_connections 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/2589101141 wait complete. 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600cc104ed0 msgr2=0x5600cc107340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600cc104ed0 0x5600cc107340 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600cc109830 msgr2=0x5600cc10bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600cc109830 0x5600cc10bc20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4890034650 msgr2=0x7f4890036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4890034650 0x7f4890036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f499c006a00 tx=0x7f499c013440 comp rx=0 tx=0).stop 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0d1480 msgr2=0x5600cc0d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0d1480 0x5600cc0d18a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f499c006640 tx=0x7f499c000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 shutdown_connections 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600cc109830 0x5600cc10bc20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600cc104ed0 0x5600cc107340 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4890034650 0x7f4890036b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 --2- 172.21.15.151:0/948961091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600cc0d1480 0x5600cc0d18a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 >> 172.21.15.151:0/948961091 conn(0x5600cbfd7050 msgr2=0x5600cc0c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 shutdown_connections 2024-09-10T14:28:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.015+0000 7f49abfdd980 1 -- 172.21.15.151:0/948961091 wait complete. 2024-09-10T14:28:48.028 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T14:28:48.029 DEBUG:tasks.util.rgw: json result: {'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T14:28:48.033 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T14:28:48.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T14:28:48.034 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T14:28:48.105 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:48.105 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:48.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6ad012d980 1 Processor -- start 2024-09-10T14:28:48.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6ad012d980 1 -- start start 2024-09-10T14:28:48.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6ad012d980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561f9032eab0 0x561f90330ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6ad012d980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f901b2ae0 con 0x561f9029f280 2024-09-10T14:28:48.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6ad012d980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x561f901d6e30 con 0x561f9032eab0 2024-09-10T14:28:48.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6acd43c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561f9032eab0 0x561f90330ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6acdc3d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x561f9029f280 0x561f9032d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34100/0 (socket says 172.21.15.151:34100) 2024-09-10T14:28:48.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6acd43c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561f9032eab0 0x561f90330ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40888/0 (socket says 172.21.15.151:40888) 2024-09-10T14:28:48.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6acdc3d640 1 -- 172.21.15.151:0/3371742118 learned_addr learned my addr 172.21.15.151:0/3371742118 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:48.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6acd43c640 1 -- 172.21.15.151:0/3371742118 >> v1:172.21.15.52:6789/0 conn(0x561f9029f280 legacy=0x561f9032d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.103+0000 7f6acd43c640 1 -- 172.21.15.151:0/3371742118 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9029f810 con 0x561f9032eab0 2024-09-10T14:28:48.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6acd43c640 1 --2- 172.21.15.151:0/3371742118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9032eab0 0x561f90330ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000a480 tx=0x7f6ac001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7086daf38907a08e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6accc3b640 1 -- 172.21.15.151:0/3371742118 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac00b0070 con 0x561f9032eab0 2024-09-10T14:28:48.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6accc3b640 1 -- 172.21.15.151:0/3371742118 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac00ab540 con 0x561f9032eab0 2024-09-10T14:28:48.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6accc3b640 1 -- 172.21.15.151:0/3371742118 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac00ab840 con 0x561f9032eab0 2024-09-10T14:28:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6ad012d980 1 -- 172.21.15.151:0/3371742118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9032eab0 msgr2=0x561f90330ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6ad012d980 1 --2- 172.21.15.151:0/3371742118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9032eab0 0x561f90330ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000a480 tx=0x7f6ac001b280 comp rx=0 tx=0).stop 2024-09-10T14:28:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6ad012d980 1 -- 172.21.15.151:0/3371742118 shutdown_connections 2024-09-10T14:28:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6ad012d980 1 --2- 172.21.15.151:0/3371742118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9032eab0 0x561f90330ea0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6ad012d980 1 -- 172.21.15.151:0/3371742118 >> 172.21.15.151:0/3371742118 conn(0x561f90325080 msgr2=0x561f903274a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6ad012d980 1 -- 172.21.15.151:0/3371742118 shutdown_connections 2024-09-10T14:28:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.107+0000 7f6ad012d980 1 -- 172.21.15.151:0/3371742118 wait complete. 2024-09-10T14:28:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6ad012d980 1 Processor -- start 2024-09-10T14:28:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6ad012d980 1 -- start start 2024-09-10T14:28:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6ad012d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9032aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6ad012d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561f901d8200 con 0x561f9029f280 2024-09-10T14:28:48.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9032aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9032aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40894/0 (socket says 172.21.15.151:40894) 2024-09-10T14:28:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6acdc3d640 1 -- 172.21.15.151:0/3463196796 learned_addr learned my addr 172.21.15.151:0/3463196796 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6acdc3d640 1 -- 172.21.15.151:0/3463196796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9032b0c0 con 0x561f9029f280 2024-09-10T14:28:48.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/3463196796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9032aaf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4001d90 tx=0x7f6ac4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61f886547ed2c70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f69bbe07640 1 -- 172.21.15.151:0/3463196796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4013030 con 0x561f9029f280 2024-09-10T14:28:48.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f69bbe07640 1 -- 172.21.15.151:0/3463196796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac400e690 con 0x561f9029f280 2024-09-10T14:28:48.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.123+0000 7f69bbe07640 1 -- 172.21.15.151:0/3463196796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac400ea10 con 0x561f9029f280 2024-09-10T14:28:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- 172.21.15.151:0/3463196796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 msgr2=0x561f9032aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 --2- 172.21.15.151:0/3463196796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9032aaf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4001d90 tx=0x7f6ac4001e80 comp rx=0 tx=0).stop 2024-09-10T14:28:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- 172.21.15.151:0/3463196796 shutdown_connections 2024-09-10T14:28:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 --2- 172.21.15.151:0/3463196796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9032aaf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- 172.21.15.151:0/3463196796 >> 172.21.15.151:0/3463196796 conn(0x561f90325080 msgr2=0x561f90411690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- 172.21.15.151:0/3463196796 shutdown_connections 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- 172.21.15.151:0/3463196796 wait complete. 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 Processor -- start 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- start start 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9041efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561f90331ef0 con 0x561f9029f280 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9041efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9041efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40904/0 (socket says 172.21.15.151:40904) 2024-09-10T14:28:48.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6acdc3d640 1 -- 172.21.15.151:0/767634951 learned_addr learned my addr 172.21.15.151:0/767634951 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6acdc3d640 1 -- 172.21.15.151:0/767634951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9041f4f0 con 0x561f9029f280 2024-09-10T14:28:48.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9041efb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x561f9032a670 tx=0x7f6ac4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f69ba604640 1 -- 172.21.15.151:0/767634951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4027070 con 0x561f9029f280 2024-09-10T14:28:48.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f9041f780 con 0x561f9029f280 2024-09-10T14:28:48.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f69ba604640 1 -- 172.21.15.151:0/767634951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4019900 con 0x561f9029f280 2024-09-10T14:28:48.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f69ba604640 1 -- 172.21.15.151:0/767634951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4019c20 con 0x561f9029f280 2024-09-10T14:28:48.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.127+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f90422460 con 0x561f9029f280 2024-09-10T14:28:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f69ba604640 1 -- 172.21.15.151:0/767634951 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6ac402a070 con 0x561f9029f280 2024-09-10T14:28:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f69ba604640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69b4034650 0x7f69b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f69ba604640 1 -- 172.21.15.151:0/767634951 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6ac401f070 con 0x561f9029f280 2024-09-10T14:28:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6acd43c640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69b4034650 0x7f69b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ad012d980 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9032eab0 0x561f904260b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90426630 con 0x561f9032eab0 2024-09-10T14:28:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ace43e640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9032eab0 0x561f904260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6acd43c640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69b4034650 0x7f69b4036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00ad000 tx=0x7f6ac00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ace43e640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9032eab0 0x561f904260b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ace43e640 1 -- 172.21.15.151:0/767634951 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9032eab0 2024-09-10T14:28:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90423680 con 0x561f9032eab0 2024-09-10T14:28:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ace43e640 1 -- 172.21.15.151:0/767634951 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9032eab0 2024-09-10T14:28:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ad012d980 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90428960 0x561f9042ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f9042b440 con 0x561f90428960 2024-09-10T14:28:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90428960 0x561f9042ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90428960 0x561f9042ad50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6acdc3d640 1 -- 172.21.15.151:0/767634951 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ac4029030 con 0x561f90428960 2024-09-10T14:28:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f904277d0 con 0x561f9032eab0 2024-09-10T14:28:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ace43e640 1 -- 172.21.15.151:0/767634951 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9032eab0 2024-09-10T14:28:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ad012d980 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561f9042c8a0 0x561f9042ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f9042f390 con 0x561f9042c8a0 2024-09-10T14:28:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.131+0000 7f6acd43c640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561f9042c8a0 0x561f9042ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6acd43c640 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561f9042c8a0 0x561f9042ec90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6acd43c640 1 -- 172.21.15.151:0/767634951 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ac00abd10 con 0x561f9042c8a0 2024-09-10T14:28:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6ad012d980 1 Processor -- start 2024-09-10T14:28:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6ad012d980 1 -- start start 2024-09-10T14:28:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6ad012d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9043ce60 0x561f9043d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6ad012d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561f90231800 con 0x561f9043ce60 2024-09-10T14:28:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9043ce60 0x561f9043d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9043ce60 0x561f9043d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40918/0 (socket says 172.21.15.151:40918) 2024-09-10T14:28:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6acdc3d640 1 -- 172.21.15.151:0/2029139285 learned_addr learned my addr 172.21.15.151:0/2029139285 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6acdc3d640 1 -- 172.21.15.151:0/2029139285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9043d7c0 con 0x561f9043ce60 2024-09-10T14:28:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/2029139285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9043ce60 0x561f9043d280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4048460 tx=0x7f6ac400d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f69b37fe640 1 -- 172.21.15.151:0/2029139285 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4048a10 con 0x561f9043ce60 2024-09-10T14:28:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6ad012d980 1 -- 172.21.15.151:0/2029139285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f9043da50 con 0x561f9043ce60 2024-09-10T14:28:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f69b37fe640 1 -- 172.21.15.151:0/2029139285 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4048bb0 con 0x561f9043ce60 2024-09-10T14:28:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f69b37fe640 1 -- 172.21.15.151:0/2029139285 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac402a580 con 0x561f9043ce60 2024-09-10T14:28:48.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.135+0000 7f6ad012d980 1 -- 172.21.15.151:0/2029139285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f904406d0 con 0x561f9043ce60 2024-09-10T14:28:48.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f69b37fe640 1 -- 172.21.15.151:0/2029139285 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6ac404c020 con 0x561f9043ce60 2024-09-10T14:28:48.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f69b37fe640 1 --2- 172.21.15.151:0/2029139285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69a8034650 0x7f69a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f69b37fe640 1 -- 172.21.15.151:0/2029139285 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6ac4014070 con 0x561f9043ce60 2024-09-10T14:28:48.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6acd43c640 1 --2- 172.21.15.151:0/2029139285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69a8034650 0x7f69a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 Processor -- start 2024-09-10T14:28:48.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 -- start start 2024-09-10T14:28:48.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f90449c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561f903292e0 con 0x561f90449820 2024-09-10T14:28:48.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6acd43c640 1 --2- 172.21.15.151:0/2029139285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69a8034650 0x7f69a8036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x561f90426ae0 tx=0x7f6ac0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f90449c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f90449c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40932/0 (socket says 172.21.15.151:40932) 2024-09-10T14:28:48.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6acdc3d640 1 -- 172.21.15.151:0/4196630569 learned_addr learned my addr 172.21.15.151:0/4196630569 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6acdc3d640 1 -- 172.21.15.151:0/4196630569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9044a1d0 con 0x561f90449820 2024-09-10T14:28:48.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/4196630569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f90449c00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4022ab0 tx=0x7f6ac40227d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61c84675c025679 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f69b17fa640 1 -- 172.21.15.151:0/4196630569 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac402b730 con 0x561f90449820 2024-09-10T14:28:48.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f69b17fa640 1 -- 172.21.15.151:0/4196630569 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac405d070 con 0x561f90449820 2024-09-10T14:28:48.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f69b17fa640 1 -- 172.21.15.151:0/4196630569 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac402c440 con 0x561f90449820 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 -- 172.21.15.151:0/4196630569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 msgr2=0x561f90449c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 --2- 172.21.15.151:0/4196630569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f90449c00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4022ab0 tx=0x7f6ac40227d0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 -- 172.21.15.151:0/4196630569 shutdown_connections 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 --2- 172.21.15.151:0/4196630569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f90449c00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 -- 172.21.15.151:0/4196630569 >> 172.21.15.151:0/4196630569 conn(0x561f90445c00 msgr2=0x561f90443d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 -- 172.21.15.151:0/4196630569 shutdown_connections 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 -- 172.21.15.151:0/4196630569 wait complete. 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 Processor -- start 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.139+0000 7f6ad012d980 1 -- start start 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ad012d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f904509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ad012d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561f9044a670 con 0x561f90449820 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f904509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6acdc3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f904509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40946/0 (socket says 172.21.15.151:40946) 2024-09-10T14:28:48.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 learned_addr learned my addr 172.21.15.151:0/285798872 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f90450f30 con 0x561f90449820 2024-09-10T14:28:48.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f904509f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4022990 tx=0x7f6ac401cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f699f7fe640 1 -- 172.21.15.151:0/285798872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac401a250 con 0x561f90449820 2024-09-10T14:28:48.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f90450f30 con 0x561f90449820 2024-09-10T14:28:48.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f699f7fe640 1 -- 172.21.15.151:0/285798872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4021530 con 0x561f90449820 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f90450f30 con 0x561f90449820 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f699f7fe640 1 -- 172.21.15.151:0/285798872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ac40216e0 con 0x561f90449820 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f699f7fe640 1 -- 172.21.15.151:0/285798872 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6ac4057070 con 0x561f90449820 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f699f7fe640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6998034650 0x7f6998036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f699f7fe640 1 -- 172.21.15.151:0/285798872 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6ac4054030 con 0x561f90449820 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6acd43c640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6998034650 0x7f6998036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9045bad0 0x561f9045df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f9045e6c0 con 0x561f9045bad0 2024-09-10T14:28:48.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ace43e640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9045bad0 0x561f9045df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6acd43c640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6998034650 0x7f6998036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00c2010 tx=0x7f6ac00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.143+0000 7f6ace43e640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9045bad0 0x561f9045df70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 realm 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f9045ead0 con 0x561f9045bad0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f370 con 0x561f9045bad0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x561f9045bad0 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90460470 0x561f90462860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90462de0 con 0x561f90460470 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90460470 0x561f90462860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90460470 0x561f90462860 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 20 searching for the correct realm 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f90464640 con 0x561f90460470 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acdc3d640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6ac402c060 0x7f6ac4015a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f90464640 con 0x7f6ac402c060 2024-09-10T14:28:48.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acd43c640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6ac402c060 0x7f6ac4015a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acd43c640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6ac402c060 0x7f6ac4015a90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acd43c640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6ac00ce040 0x7f6ac00db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f90464640 con 0x7f6ac00ce040 2024-09-10T14:28:48.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.147+0000 7f6ace43e640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6ac00ce040 0x7f6ac00db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6ac00ce040 0x7f6ac00db920 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x561f9045bad0 2024-09-10T14:28:48.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x561f9045bad0 2024-09-10T14:28:48.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x7f6ac00ce040 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x7f6ac00ce040 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x7f6ac402c060 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x561f90460470 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x561f9045bad0 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.151+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x7f6ac00ce040 2024-09-10T14:28:48.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x561f9045bad0 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561f9045f710 con 0x7f6ac402c060 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f90460470 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f90460470 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x7f6ac00ce040 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f90460470 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f90460470 2024-09-10T14:28:48.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f9045bad0 2024-09-10T14:28:48.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f9045bad0 2024-09-10T14:28:48.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x7f6ac00ce040 2024-09-10T14:28:48.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.155+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f90460470 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x7f6ac402c060 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f9045bad0 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x7f6ac00ce040 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f90460470 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x7f6ac00ce040 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x7f6ac402c060 2024-09-10T14:28:48.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f90460470 2024-09-10T14:28:48.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x7f6ac00ce040 2024-09-10T14:28:48.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.159+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x561f9045bad0 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f6ac00e8060 con 0x7f6ac402c060 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90463730 con 0x561f9045bad0 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90463370 con 0x561f9045bad0 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90463340 con 0x7f6ac00ce040 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 zone default found 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 4 Realm: () 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:48.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 zonegroup default 2024-09-10T14:28:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f904640a0 con 0x7f6ac00ce040 2024-09-10T14:28:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f904644e0 con 0x561f90460470 2024-09-10T14:28:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f904664f0 con 0x561f90460470 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 started sync module instance, tier type = 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.163+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90465990 con 0x7f6ac402c060 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.167+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.167+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94693564505472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90466d40 con 0x7f6ac402c060 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.167+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90467590 con 0x561f9045bad0 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.167+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94693564505472] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.167+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.167+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94693564508304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90467590 con 0x561f9045bad0 2024-09-10T14:28:48.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.167+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90468020 con 0x561f90460470 2024-09-10T14:28:48.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.171+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.171+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94693564512976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f904688c0 con 0x561f90460470 2024-09-10T14:28:48.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.171+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90469300 con 0x7f6ac402c060 2024-09-10T14:28:48.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.171+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94693564508304] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.171+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.171+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94693564517840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f904696f0 con 0x7f6ac402c060 2024-09-10T14:28:48.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.171+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046a0b0 con 0x561f9045bad0 2024-09-10T14:28:48.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.171+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94693564512976] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.175+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.175+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94693564521472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046a020 con 0x561f9045bad0 2024-09-10T14:28:48.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.175+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046ae00 con 0x7f6ac00ce040 2024-09-10T14:28:48.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.175+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94693564517840] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.175+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94693564521472] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.175+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.175+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94693564510432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046a8c0 con 0x7f6ac00ce040 2024-09-10T14:28:48.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.175+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046b150 con 0x7f6ac00ce040 2024-09-10T14:28:48.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94693564524736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046b7e0 con 0x7f6ac00ce040 2024-09-10T14:28:48.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046c090 con 0x7f6ac00ce040 2024-09-10T14:28:48.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94693564510432] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94693564523536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046c270 con 0x7f6ac00ce040 2024-09-10T14:28:48.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 20 add_watcher() i=0 2024-09-10T14:28:48.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 20 add_watcher() i=1 2024-09-10T14:28:48.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 20 add_watcher() i=2 2024-09-10T14:28:48.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 20 add_watcher() i=3 2024-09-10T14:28:48.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 20 add_watcher() i=4 2024-09-10T14:28:48.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 20 add_watcher() i=5 2024-09-10T14:28:48.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94693564524736] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.179+0000 7f6ad012d980 20 add_watcher() i=6 2024-09-10T14:28:48.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94693564523536] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 20 add_watcher() i=7 2024-09-10T14:28:48.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:48.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f9046f190 con 0x561f9045bad0 2024-09-10T14:28:48.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94693564527584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f9046c610 con 0x561f9045bad0 2024-09-10T14:28:48.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94693564527584] v33'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f697f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 5 note: GC not initialized 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f697e7fc640 20 reqs_thread_entry: start 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 20 Filter name: none 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f68effff640 20 reqs_thread_entry: start 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492c20 con 0x561f9045bad0 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac402c060 2024-09-10T14:28:48.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.183+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac402c060 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.187+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.191+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac402c060 2024-09-10T14:28:48.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.195+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.199+0000 7f697f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.199+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94693564527584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.199+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94693564527584] v33'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.199+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94693564505472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac402c060 2024-09-10T14:28:48.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.199+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94693564505472] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.199+0000 7f6ad012d980 20 remove_watcher() i=0 2024-09-10T14:28:48.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.199+0000 7f6ad012d980 2 removed watcher, disabling cache 2024-09-10T14:28:48.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.199+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94693564508304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.203+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94693564508304] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.203+0000 7f6ad012d980 20 remove_watcher() i=1 2024-09-10T14:28:48.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.203+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94693564512976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f90460470 2024-09-10T14:28:48.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.203+0000 7f6acdc3d640 1 -- 172.21.15.151:0/285798872 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94693564512976] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac407f040 con 0x561f90460470 2024-09-10T14:28:48.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.203+0000 7f6ad012d980 20 remove_watcher() i=2 2024-09-10T14:28:48.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.203+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94693564517840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac402c060 2024-09-10T14:28:48.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.207+0000 7f6acd43c640 1 -- 172.21.15.151:0/285798872 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94693564517840] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac00d9070 con 0x7f6ac402c060 2024-09-10T14:28:48.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.207+0000 7f6ad012d980 20 remove_watcher() i=3 2024-09-10T14:28:48.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.207+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94693564521472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x561f9045bad0 2024-09-10T14:28:48.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.207+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94693564521472] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x561f9045bad0 2024-09-10T14:28:48.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.207+0000 7f6ad012d980 20 remove_watcher() i=4 2024-09-10T14:28:48.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.207+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94693564510432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.211+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94693564510432] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.211+0000 7f6ad012d980 20 remove_watcher() i=5 2024-09-10T14:28:48.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.211+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94693564524736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.211+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94693564524736] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.211+0000 7f6ad012d980 20 remove_watcher() i=6 2024-09-10T14:28:48.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.211+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94693564523536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561f90492be0 con 0x7f6ac00ce040 2024-09-10T14:28:48.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94693564523536] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ac800a4d0 con 0x7f6ac00ce040 2024-09-10T14:28:48.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 20 remove_watcher() i=7 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6ac00ce040 msgr2=0x7f6ac00db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6ac00ce040 0x7f6ac00db920 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9045bad0 msgr2=0x561f9045df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9045bad0 0x561f9045df70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6ac402c060 msgr2=0x7f6ac4015a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6ac402c060 0x7f6ac4015a90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90460470 msgr2=0x561f90462860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90460470 0x561f90462860 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6998034650 msgr2=0x7f6998036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6998034650 0x7f6998036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00c2010 tx=0x7f6ac00a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ace43e640 1 -- 172.21.15.151:0/285798872 reap_dead start 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 msgr2=0x561f904509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f904509f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4022990 tx=0x7f6ac401cef0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 shutdown_connections 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/285798872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f90449820 0x561f904509f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 >> 172.21.15.151:0/285798872 conn(0x561f90445c00 msgr2=0x561f90443cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 shutdown_connections 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/285798872 wait complete. 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/2029139285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69a8034650 msgr2=0x7f69a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/2029139285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69a8034650 0x7f69a8036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x561f90426ae0 tx=0x7f6ac0005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/2029139285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9043ce60 msgr2=0x561f9043d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/2029139285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9043ce60 0x561f9043d280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4048460 tx=0x7f6ac400d870 comp rx=0 tx=0).stop 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/2029139285 shutdown_connections 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/2029139285 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69a8034650 0x7f69a8036b10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/2029139285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9043ce60 0x561f9043d280 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/2029139285 >> 172.21.15.151:0/2029139285 conn(0x561f90431fb0 msgr2=0x561f90434a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/2029139285 shutdown_connections 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/2029139285 wait complete. 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561f9042c8a0 msgr2=0x561f9042ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561f9042c8a0 0x561f9042ec90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9032eab0 msgr2=0x561f904260b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561f9032eab0 0x561f904260b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90428960 msgr2=0x561f9042ad50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561f90428960 0x561f9042ad50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69b4034650 msgr2=0x7f69b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f69b4034650 0x7f69b4036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00ad000 tx=0x7f6ac00a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 msgr2=0x561f9041efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 --2- 172.21.15.151:0/767634951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f9029f280 0x561f9041efb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x561f9032a670 tx=0x7f6ac4000bd0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ace43e640 1 -- 172.21.15.151:0/767634951 reap_dead start 2024-09-10T14:28:48.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 shutdown_connections 2024-09-10T14:28:48.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 >> 172.21.15.151:0/767634951 conn(0x561f90325080 msgr2=0x561f904112d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 shutdown_connections 2024-09-10T14:28:48.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.215+0000 7f6ad012d980 1 -- 172.21.15.151:0/767634951 wait complete. 2024-09-10T14:28:48.231 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[],"summary":[]} 2024-09-10T14:28:48.231 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T14:28:48.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:28:48.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:28:48.232 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:28:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:48.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e837a980 1 Processor -- start 2024-09-10T14:28:48.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e837a980 1 -- start start 2024-09-10T14:28:48.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e837a980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560052871540 0x560052871920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e837a980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5600526faae0 con 0x560052871e90 2024-09-10T14:28:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e837a980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56005271ee30 con 0x560052871540 2024-09-10T14:28:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e5e8a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560052871540 0x560052871920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e5689640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x560052871e90 0x560052876910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34116/0 (socket says 172.21.15.151:34116) 2024-09-10T14:28:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e5689640 1 -- 172.21.15.151:0/1014446545 learned_addr learned my addr 172.21.15.151:0/1014446545 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e4e88640 1 -- 172.21.15.151:0/1014446545 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087234203 0 0) 0x5600526faae0 con 0x560052871e90 2024-09-10T14:28:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e4e88640 1 -- 172.21.15.151:0/1014446545 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07d4001e20 con 0x560052871e90 2024-09-10T14:28:48.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e5e8a640 1 -- 172.21.15.151:0/1014446545 >> v1:172.21.15.52:6789/0 conn(0x560052871e90 legacy=0x560052876910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.307+0000 7f07e5e8a640 1 -- 172.21.15.151:0/1014446545 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560052879160 con 0x560052871540 2024-09-10T14:28:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/1014446545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x560052871920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07d800a420 tx=0x7f07d801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1821a1112f24ddf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e4e88640 1 -- 172.21.15.151:0/1014446545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80af070 con 0x560052871540 2024-09-10T14:28:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e4e88640 1 -- 172.21.15.151:0/1014446545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d80aa530 con 0x560052871540 2024-09-10T14:28:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e4e88640 1 -- 172.21.15.151:0/1014446545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80aa850 con 0x560052871540 2024-09-10T14:28:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e837a980 1 -- 172.21.15.151:0/1014446545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 msgr2=0x560052871920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e837a980 1 --2- 172.21.15.151:0/1014446545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x560052871920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07d800a420 tx=0x7f07d801afd0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e837a980 1 -- 172.21.15.151:0/1014446545 shutdown_connections 2024-09-10T14:28:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e837a980 1 --2- 172.21.15.151:0/1014446545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x560052871920 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e837a980 1 -- 172.21.15.151:0/1014446545 >> 172.21.15.151:0/1014446545 conn(0x56005286d060 msgr2=0x56005286f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e837a980 1 -- 172.21.15.151:0/1014446545 shutdown_connections 2024-09-10T14:28:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.311+0000 7f07e837a980 1 -- 172.21.15.151:0/1014446545 wait complete. 2024-09-10T14:28:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 Processor -- start 2024-09-10T14:28:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 -- start start 2024-09-10T14:28:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x56005295c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560052720200 con 0x560052871540 2024-09-10T14:28:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x56005295c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x56005295c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40962/0 (socket says 172.21.15.151:40962) 2024-09-10T14:28:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e5e8a640 1 -- 172.21.15.151:0/1420547731 learned_addr learned my addr 172.21.15.151:0/1420547731 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e5e8a640 1 -- 172.21.15.151:0/1420547731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005295cdc0 con 0x560052871540 2024-09-10T14:28:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/1420547731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x56005295c7f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f07d800a420 tx=0x7f07d80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5183381e35a6ece1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f06d3e07640 1 -- 172.21.15.151:0/1420547731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80af050 con 0x560052871540 2024-09-10T14:28:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f06d3e07640 1 -- 172.21.15.151:0/1420547731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d80b0040 con 0x560052871540 2024-09-10T14:28:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f06d3e07640 1 -- 172.21.15.151:0/1420547731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80aab00 con 0x560052871540 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 -- 172.21.15.151:0/1420547731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 msgr2=0x56005295c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 --2- 172.21.15.151:0/1420547731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x56005295c7f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f07d800a420 tx=0x7f07d80033b0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 -- 172.21.15.151:0/1420547731 shutdown_connections 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 --2- 172.21.15.151:0/1420547731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x56005295c7f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.327+0000 7f07e837a980 1 -- 172.21.15.151:0/1420547731 >> 172.21.15.151:0/1420547731 conn(0x56005286d060 msgr2=0x560052958420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e837a980 1 -- 172.21.15.151:0/1420547731 shutdown_connections 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e837a980 1 -- 172.21.15.151:0/1420547731 wait complete. 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e837a980 1 Processor -- start 2024-09-10T14:28:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e837a980 1 -- start start 2024-09-10T14:28:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e837a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x560052962910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e837a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560052878ba0 con 0x560052871540 2024-09-10T14:28:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x560052962910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x560052962910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40972/0 (socket says 172.21.15.151:40972) 2024-09-10T14:28:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e5e8a640 1 -- 172.21.15.151:0/2620086973 learned_addr learned my addr 172.21.15.151:0/2620086973 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e5e8a640 1 -- 172.21.15.151:0/2620086973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560052962e50 con 0x560052871540 2024-09-10T14:28:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x560052962910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f07d8019680 tx=0x7f07d8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f06d2604640 1 -- 172.21.15.151:0/2620086973 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80c5070 con 0x560052871540 2024-09-10T14:28:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600529630e0 con 0x560052871540 2024-09-10T14:28:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f06d2604640 1 -- 172.21.15.151:0/2620086973 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d80b6b60 con 0x560052871540 2024-09-10T14:28:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f06d2604640 1 -- 172.21.15.151:0/2620086973 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80b6e40 con 0x560052871540 2024-09-10T14:28:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560052965dc0 con 0x560052871540 2024-09-10T14:28:48.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f06d2604640 1 -- 172.21.15.151:0/2620086973 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07d80c1480 con 0x560052871540 2024-09-10T14:28:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.331+0000 7f06d2604640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06cc036860 0x7f06cc038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f06d2604640 1 -- 172.21.15.151:0/2620086973 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f07d80bb070 con 0x560052871540 2024-09-10T14:28:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e5689640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06cc036860 0x7f06cc038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e837a980 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560052871e90 0x560052969a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560052969fe0 con 0x560052871e90 2024-09-10T14:28:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e668b640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560052871e90 0x560052969a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e5689640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06cc036860 0x7f06cc038d20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07d0000f70 tx=0x7f07d00010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e668b640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560052871e90 0x560052969a10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e668b640 1 -- 172.21.15.151:0/2620086973 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x560052871e90 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560052966fc0 con 0x560052871e90 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e668b640 1 -- 172.21.15.151:0/2620086973 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07e00083f0 con 0x560052871e90 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e837a980 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56005296c2f0 0x56005296e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56005296edd0 con 0x56005296c2f0 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56005296c2f0 0x56005296e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56005296c2f0 0x56005296e6e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e5e8a640 1 -- 172.21.15.151:0/2620086973 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07d80d0070 con 0x56005296c2f0 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56005296b190 con 0x560052871e90 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e668b640 1 -- 172.21.15.151:0/2620086973 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07e00083f0 con 0x560052871e90 2024-09-10T14:28:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e837a980 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560052970230 0x560052972620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560052972d60 con 0x560052970230 2024-09-10T14:28:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e5689640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560052970230 0x560052972620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.335+0000 7f07e5689640 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560052970230 0x560052972620 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e5689640 1 -- 172.21.15.151:0/2620086973 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07d000e6c0 con 0x560052970230 2024-09-10T14:28:48.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e837a980 1 Processor -- start 2024-09-10T14:28:48.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e837a980 1 -- start start 2024-09-10T14:28:48.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e837a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052984c40 0x560052985060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e837a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560052779800 con 0x560052984c40 2024-09-10T14:28:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052984c40 0x560052985060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052984c40 0x560052985060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40982/0 (socket says 172.21.15.151:40982) 2024-09-10T14:28:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e5e8a640 1 -- 172.21.15.151:0/3273587990 learned_addr learned my addr 172.21.15.151:0/3273587990 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e5e8a640 1 -- 172.21.15.151:0/3273587990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600529855a0 con 0x560052984c40 2024-09-10T14:28:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/3273587990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052984c40 0x560052985060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f07d80e3420 tx=0x7f07d80d82e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f06cb7fe640 1 -- 172.21.15.151:0/3273587990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80c1c20 con 0x560052984c40 2024-09-10T14:28:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f06cb7fe640 1 -- 172.21.15.151:0/3273587990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d80a93a0 con 0x560052984c40 2024-09-10T14:28:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e837a980 1 -- 172.21.15.151:0/3273587990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560052985830 con 0x560052984c40 2024-09-10T14:28:48.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f06cb7fe640 1 -- 172.21.15.151:0/3273587990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80c0750 con 0x560052984c40 2024-09-10T14:28:48.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.339+0000 7f07e837a980 1 -- 172.21.15.151:0/3273587990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600529884b0 con 0x560052984c40 2024-09-10T14:28:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f06cb7fe640 1 -- 172.21.15.151:0/3273587990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07d80c08f0 con 0x560052984c40 2024-09-10T14:28:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f06cb7fe640 1 --2- 172.21.15.151:0/3273587990 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06c00346a0 0x7f06c0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f06cb7fe640 1 -- 172.21.15.151:0/3273587990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f07d80e0030 con 0x560052984c40 2024-09-10T14:28:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e5689640 1 --2- 172.21.15.151:0/3273587990 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06c00346a0 0x7f06c0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 Processor -- start 2024-09-10T14:28:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- start start 2024-09-10T14:28:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x560052991950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e5689640 1 --2- 172.21.15.151:0/3273587990 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06c00346a0 0x7f06c0036b60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c010 tx=0x7f07d000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56005295d050 con 0x560052991570 2024-09-10T14:28:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x560052991950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x560052991950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40984/0 (socket says 172.21.15.151:40984) 2024-09-10T14:28:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e5e8a640 1 -- 172.21.15.151:0/2423618230 learned_addr learned my addr 172.21.15.151:0/2423618230 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e5e8a640 1 -- 172.21.15.151:0/2423618230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560052991f20 con 0x560052991570 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/2423618230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x560052991950 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07d80d6fd0 tx=0x7f07d80c1dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8fe915bbe21de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f06c97fa640 1 -- 172.21.15.151:0/2423618230 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80ff020 con 0x560052991570 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f06c97fa640 1 -- 172.21.15.151:0/2423618230 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d80ecd50 con 0x560052991570 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f06c97fa640 1 -- 172.21.15.151:0/2423618230 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80e3c20 con 0x560052991570 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- 172.21.15.151:0/2423618230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 msgr2=0x560052991950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 --2- 172.21.15.151:0/2423618230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x560052991950 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07d80d6fd0 tx=0x7f07d80c1dc0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- 172.21.15.151:0/2423618230 shutdown_connections 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 --2- 172.21.15.151:0/2423618230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x560052991950 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- 172.21.15.151:0/2423618230 >> 172.21.15.151:0/2423618230 conn(0x56005298d950 msgr2=0x56005298ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- 172.21.15.151:0/2423618230 shutdown_connections 2024-09-10T14:28:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- 172.21.15.151:0/2423618230 wait complete. 2024-09-10T14:28:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 Processor -- start 2024-09-10T14:28:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- start start 2024-09-10T14:28:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x5600529986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.343+0000 7f07e837a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600529923c0 con 0x560052991570 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x5600529986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e5e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x5600529986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40996/0 (socket says 172.21.15.151:40996) 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 learned_addr learned my addr 172.21.15.151:0/478515867 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560052998bf0 con 0x560052991570 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x5600529986b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f07d80c0fd0 tx=0x7f07d80d8ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f06b77fe640 1 -- 172.21.15.151:0/478515867 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d8114070 con 0x560052991570 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f06b77fe640 1 -- 172.21.15.151:0/478515867 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d80e4c10 con 0x560052991570 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560052998bf0 con 0x560052991570 2024-09-10T14:28:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f06b77fe640 1 -- 172.21.15.151:0/478515867 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07d80d3b60 con 0x560052991570 2024-09-10T14:28:48.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560052998bf0 con 0x560052991570 2024-09-10T14:28:48.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f06b77fe640 1 -- 172.21.15.151:0/478515867 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07d8117070 con 0x560052991570 2024-09-10T14:28:48.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f06b77fe640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06b0034650 0x7f06b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f06b77fe640 1 -- 172.21.15.151:0/478515867 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f07d810b030 con 0x560052991570 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e5689640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06b0034650 0x7f06b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600529a37c0 0x5600529a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529a63b0 con 0x5600529a37c0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e668b640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600529a37c0 0x5600529a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e5689640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06b0034650 0x7f06b0036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x56005296a490 tx=0x7f07d0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.347+0000 7f07e668b640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600529a37c0 0x5600529a5c60 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 realm 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529a67c0 con 0x5600529a37c0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7060 con 0x5600529a37c0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600529a8160 0x5600529aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529aaa90 con 0x5600529a8160 2024-09-10T14:28:48.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600529a8160 0x5600529aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600529a8160 0x5600529aa550 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 20 searching for the correct realm 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529ac330 con 0x5600529a8160 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5e8a640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f07d8119060 0x7f07d80e86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529ac330 con 0x7f07d8119060 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5689640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f07d8119060 0x7f07d80e86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5689640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f07d8119060 0x7f07d80e86a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5689640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07d0037040 0x7f07d0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529ac330 con 0x7f07d0037040 2024-09-10T14:28:48.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.351+0000 7f07e668b640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07d0037040 0x7f07d0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07d0037040 0x7f07d0036410 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d0037040 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d0037040 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d8119060 2024-09-10T14:28:48.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a8160 2024-09-10T14:28:48.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.355+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d0037040 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d8119060 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a8160 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a8160 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d0037040 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a8160 2024-09-10T14:28:48.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a8160 2024-09-10T14:28:48.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d0037040 2024-09-10T14:28:48.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.359+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a8160 2024-09-10T14:28:48.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d8119060 2024-09-10T14:28:48.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d0037040 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a8160 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d0037040 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d8119060 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a8160 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d0037040 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x5600529a37c0 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.363+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5600529a7400 con 0x7f07d8119060 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:48.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529ab2e0 con 0x5600529a37c0 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529ab6d0 con 0x5600529a37c0 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529ab6d0 con 0x7f07d0037040 2024-09-10T14:28:48.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 zone default found 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 4 Realm: () 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 zonegroup default 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529abaf0 con 0x7f07d0037040 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529abaf0 con 0x5600529a8160 2024-09-10T14:28:48.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529ae1e0 con 0x5600529a8160 2024-09-10T14:28:48.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 started sync module instance, tier type = 2024-09-10T14:28:48.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:48.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.367+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529ad680 con 0x7f07d8119060 2024-09-10T14:28:48.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.371+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.371+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94559385868912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529ad2e0 con 0x7f07d8119060 2024-09-10T14:28:48.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.371+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529af050 con 0x5600529a37c0 2024-09-10T14:28:48.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.371+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94559385868912] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.371+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.371+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94559385873312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529aefc0 con 0x5600529a37c0 2024-09-10T14:28:48.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.371+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529afe00 con 0x5600529a8160 2024-09-10T14:28:48.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.375+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94559385873312] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.375+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.375+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94559385875520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b01f0 con 0x5600529a8160 2024-09-10T14:28:48.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.375+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b0bb0 con 0x7f07d8119060 2024-09-10T14:28:48.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.375+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.375+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94559385880320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b1400 con 0x7f07d8119060 2024-09-10T14:28:48.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.375+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b1e20 con 0x5600529a37c0 2024-09-10T14:28:48.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.375+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94559385875520] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.379+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94559385880320] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.379+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.379+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94559385882448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529af860 con 0x5600529a37c0 2024-09-10T14:28:48.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.379+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b26c0 con 0x7f07d0037040 2024-09-10T14:28:48.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.379+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.379+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94559385887088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b2a40 con 0x7f07d0037040 2024-09-10T14:28:48.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.379+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b3490 con 0x7f07d0037040 2024-09-10T14:28:48.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.379+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94559385882448] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94559385887088] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94559385890688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b2590 con 0x7f07d0037040 2024-09-10T14:28:48.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b3b20 con 0x7f07d0037040 2024-09-10T14:28:48.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94559385892464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b3f40 con 0x7f07d0037040 2024-09-10T14:28:48.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 20 add_watcher() i=0 2024-09-10T14:28:48.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 20 add_watcher() i=1 2024-09-10T14:28:48.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 20 add_watcher() i=2 2024-09-10T14:28:48.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 20 add_watcher() i=3 2024-09-10T14:28:48.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 20 add_watcher() i=4 2024-09-10T14:28:48.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.383+0000 7f07e837a980 20 add_watcher() i=5 2024-09-10T14:28:48.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94559385890688] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e837a980 20 add_watcher() i=6 2024-09-10T14:28:48.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94559385892464] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e837a980 20 add_watcher() i=7 2024-09-10T14:28:48.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e837a980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:48.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529b6f70 con 0x5600529a37c0 2024-09-10T14:28:48.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94559385893520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529b4360 con 0x5600529a37c0 2024-09-10T14:28:48.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94559385893520] v33'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f06977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e837a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:48.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e837a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:48.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.387+0000 7f07e837a980 5 note: GC not initialized 2024-09-10T14:28:48.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f06967fc640 20 reqs_thread_entry: start 2024-09-10T14:28:48.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e837a980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:48.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e837a980 20 Filter name: none 2024-09-10T14:28:48.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f0607fff640 20 reqs_thread_entry: start 2024-09-10T14:28:48.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e837a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9ea0 con 0x5600529a37c0 2024-09-10T14:28:48.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e837a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.395 INFO:teuthology.orchestra.run.smithi151.stderr:could not fetch user info: no user info saved 2024-09-10T14:28:48.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f06977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94559385893520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x5600529a37c0 2024-09-10T14:28:48.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94559385893520] v33'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.391+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94559385868912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x7f07d8119060 2024-09-10T14:28:48.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.395+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94559385868912] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.395+0000 7f07e837a980 20 remove_watcher() i=0 2024-09-10T14:28:48.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.395+0000 7f07e837a980 2 removed watcher, disabling cache 2024-09-10T14:28:48.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.395+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94559385873312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x5600529a37c0 2024-09-10T14:28:48.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.395+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94559385873312] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.395+0000 7f07e837a980 20 remove_watcher() i=1 2024-09-10T14:28:48.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.395+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94559385875520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x5600529a8160 2024-09-10T14:28:48.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.399+0000 7f07e5e8a640 1 -- 172.21.15.151:0/478515867 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94559385875520] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d8116030 con 0x5600529a8160 2024-09-10T14:28:48.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.399+0000 7f07e837a980 20 remove_watcher() i=2 2024-09-10T14:28:48.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.399+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94559385880320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x7f07d8119060 2024-09-10T14:28:48.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.399+0000 7f07e5689640 1 -- 172.21.15.151:0/478515867 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94559385880320] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07d000e6c0 con 0x7f07d8119060 2024-09-10T14:28:48.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.399+0000 7f07e837a980 20 remove_watcher() i=3 2024-09-10T14:28:48.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.399+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94559385882448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x5600529a37c0 2024-09-10T14:28:48.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.403+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94559385882448] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x5600529a37c0 2024-09-10T14:28:48.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.403+0000 7f07e837a980 20 remove_watcher() i=4 2024-09-10T14:28:48.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.403+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94559385887088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x7f07d0037040 2024-09-10T14:28:48.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.403+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94559385887088] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.403+0000 7f07e837a980 20 remove_watcher() i=5 2024-09-10T14:28:48.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.403+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94559385890688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x7f07d0037040 2024-09-10T14:28:48.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94559385890688] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 20 remove_watcher() i=6 2024-09-10T14:28:48.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94559385892464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5600529d9e60 con 0x7f07d0037040 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94559385892464] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07e00083f0 con 0x7f07d0037040 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 20 remove_watcher() i=7 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07d0037040 msgr2=0x7f07d0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07d0037040 0x7f07d0036410 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600529a37c0 msgr2=0x5600529a5c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5600529a37c0 0x5600529a5c60 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f07d8119060 msgr2=0x7f07d80e86a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f07d8119060 0x7f07d80e86a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600529a8160 msgr2=0x5600529aa550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5600529a8160 0x5600529aa550 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06b0034650 msgr2=0x7f06b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06b0034650 0x7f06b0036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x56005296a490 tx=0x7f07d0010000 comp rx=0 tx=0).stop 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 msgr2=0x5600529986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x5600529986b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f07d80c0fd0 tx=0x7f07d80d8ef0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e668b640 1 -- 172.21.15.151:0/478515867 reap_dead start 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 shutdown_connections 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 --2- 172.21.15.151:0/478515867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052991570 0x5600529986b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.407+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 >> 172.21.15.151:0/478515867 conn(0x56005298d950 msgr2=0x56005298ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 shutdown_connections 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/478515867 wait complete. 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/3273587990 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06c00346a0 msgr2=0x7f06c0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/3273587990 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06c00346a0 0x7f06c0036b60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c010 tx=0x7f07d000f000 comp rx=0 tx=0).stop 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/3273587990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052984c40 msgr2=0x560052985060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/3273587990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052984c40 0x560052985060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f07d80e3420 tx=0x7f07d80d82e0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/3273587990 shutdown_connections 2024-09-10T14:28:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/3273587990 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06c00346a0 0x7f06c0036b60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/3273587990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052984c40 0x560052985060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/3273587990 >> 172.21.15.151:0/3273587990 conn(0x560052975980 msgr2=0x560052978400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/3273587990 shutdown_connections 2024-09-10T14:28:48.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/3273587990 wait complete. 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560052970230 msgr2=0x560052972620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560052970230 0x560052972620 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560052871e90 msgr2=0x560052969a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560052871e90 0x560052969a10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56005296c2f0 msgr2=0x56005296e6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56005296c2f0 0x56005296e6e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06cc036860 msgr2=0x7f06cc038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f06cc036860 0x7f06cc038d20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07d0000f70 tx=0x7f07d00010b0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 msgr2=0x560052962910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 --2- 172.21.15.151:0/2620086973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560052871540 0x560052962910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f07d8019680 tx=0x7f07d8019810 comp rx=0 tx=0).stop 2024-09-10T14:28:48.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e668b640 1 -- 172.21.15.151:0/2620086973 reap_dead start 2024-09-10T14:28:48.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 shutdown_connections 2024-09-10T14:28:48.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 >> 172.21.15.151:0/2620086973 conn(0x56005286d060 msgr2=0x560052956fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 shutdown_connections 2024-09-10T14:28:48.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.411+0000 7f07e837a980 1 -- 172.21.15.151:0/2620086973 wait complete. 2024-09-10T14:28:48.425 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T14:28:48.426 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T14:28:48.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T14:28:48.426 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-10T14:28:48.517 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:48.517 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:48.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f64251f3980 1 Processor -- start 2024-09-10T14:28:48.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f64251f3980 1 -- start start 2024-09-10T14:28:48.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f64251f3980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5607dd795a30 0x5607dd797e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f64251f3980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5607dd619ae0 con 0x5607dd705a60 2024-09-10T14:28:48.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f64251f3980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5607dd63de30 con 0x5607dd795a30 2024-09-10T14:28:48.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f6422502640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5607dd795a30 0x5607dd797e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f6422d03640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5607dd705a60 0x5607dd794310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34120/0 (socket says 172.21.15.151:34120) 2024-09-10T14:28:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f6422d03640 1 -- 172.21.15.151:0/2182013035 learned_addr learned my addr 172.21.15.151:0/2182013035 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f6421d01640 1 -- 172.21.15.151:0/2182013035 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861183899 0 0) 0x5607dd619ae0 con 0x5607dd705a60 2024-09-10T14:28:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f6421d01640 1 -- 172.21.15.151:0/2182013035 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f640c001e20 con 0x5607dd705a60 2024-09-10T14:28:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f6422502640 1 -- 172.21.15.151:0/2182013035 >> v1:172.21.15.52:6789/0 conn(0x5607dd705a60 legacy=0x5607dd794310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.515+0000 7f6422502640 1 -- 172.21.15.151:0/2182013035 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607dd799370 con 0x5607dd795a30 2024-09-10T14:28:48.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f6422502640 1 --2- 172.21.15.151:0/2182013035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd795a30 0x5607dd797e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f641800a480 tx=0x7f641801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3596d5d5ad070c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f6421d01640 1 -- 172.21.15.151:0/2182013035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64180b0070 con 0x5607dd795a30 2024-09-10T14:28:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f6421d01640 1 -- 172.21.15.151:0/2182013035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64180ab540 con 0x5607dd795a30 2024-09-10T14:28:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f6421d01640 1 -- 172.21.15.151:0/2182013035 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64180ab840 con 0x5607dd795a30 2024-09-10T14:28:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f64251f3980 1 -- 172.21.15.151:0/2182013035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd795a30 msgr2=0x5607dd797e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f64251f3980 1 --2- 172.21.15.151:0/2182013035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd795a30 0x5607dd797e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f641800a480 tx=0x7f641801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:48.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f64251f3980 1 -- 172.21.15.151:0/2182013035 shutdown_connections 2024-09-10T14:28:48.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f64251f3980 1 --2- 172.21.15.151:0/2182013035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd795a30 0x5607dd797e20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f64251f3980 1 -- 172.21.15.151:0/2182013035 >> 172.21.15.151:0/2182013035 conn(0x5607dd78c000 msgr2=0x5607dd78e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f64251f3980 1 -- 172.21.15.151:0/2182013035 shutdown_connections 2024-09-10T14:28:48.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.519+0000 7f64251f3980 1 -- 172.21.15.151:0/2182013035 wait complete. 2024-09-10T14:28:48.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 Processor -- start 2024-09-10T14:28:48.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 -- start start 2024-09-10T14:28:48.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd87c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5607dd63f200 con 0x5607dd705a60 2024-09-10T14:28:48.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd87c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd87c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41016/0 (socket says 172.21.15.151:41016) 2024-09-10T14:28:48.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f6422d03640 1 -- 172.21.15.151:0/1986255403 learned_addr learned my addr 172.21.15.151:0/1986255403 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f6422d03640 1 -- 172.21.15.151:0/1986255403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607dd87cee0 con 0x5607dd705a60 2024-09-10T14:28:48.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f6422d03640 1 --2- 172.21.15.151:0/1986255403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd87c910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6414001dc0 tx=0x7f641400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc294882c40d7130 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f6310e09640 1 -- 172.21.15.151:0/1986255403 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6414012020 con 0x5607dd705a60 2024-09-10T14:28:48.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f6310e09640 1 -- 172.21.15.151:0/1986255403 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641400e7c0 con 0x5607dd705a60 2024-09-10T14:28:48.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f6310e09640 1 -- 172.21.15.151:0/1986255403 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641400eb40 con 0x5607dd705a60 2024-09-10T14:28:48.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 -- 172.21.15.151:0/1986255403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 msgr2=0x5607dd87c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 --2- 172.21.15.151:0/1986255403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd87c910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6414001dc0 tx=0x7f641400b6d0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 -- 172.21.15.151:0/1986255403 shutdown_connections 2024-09-10T14:28:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 --2- 172.21.15.151:0/1986255403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd87c910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 -- 172.21.15.151:0/1986255403 >> 172.21.15.151:0/1986255403 conn(0x5607dd78c000 msgr2=0x5607dd878540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 -- 172.21.15.151:0/1986255403 shutdown_connections 2024-09-10T14:28:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.535+0000 7f64251f3980 1 -- 172.21.15.151:0/1986255403 wait complete. 2024-09-10T14:28:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f64251f3980 1 Processor -- start 2024-09-10T14:28:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f64251f3980 1 -- start start 2024-09-10T14:28:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f64251f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd883ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f64251f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5607dd798db0 con 0x5607dd705a60 2024-09-10T14:28:48.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd883ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd883ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41022/0 (socket says 172.21.15.151:41022) 2024-09-10T14:28:48.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f6422d03640 1 -- 172.21.15.151:0/979689162 learned_addr learned my addr 172.21.15.151:0/979689162 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f6422d03640 1 -- 172.21.15.151:0/979689162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607dd884220 con 0x5607dd705a60 2024-09-10T14:28:48.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f6422d03640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd883ce0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5607dd87daf0 tx=0x7f6414000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f630f606640 1 -- 172.21.15.151:0/979689162 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6414012030 con 0x5607dd705a60 2024-09-10T14:28:48.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607dd8844b0 con 0x5607dd705a60 2024-09-10T14:28:48.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f630f606640 1 -- 172.21.15.151:0/979689162 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6414001440 con 0x5607dd705a60 2024-09-10T14:28:48.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f630f606640 1 -- 172.21.15.151:0/979689162 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641401aaf0 con 0x5607dd705a60 2024-09-10T14:28:48.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607dd887190 con 0x5607dd705a60 2024-09-10T14:28:48.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f630f606640 1 -- 172.21.15.151:0/979689162 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6414015020 con 0x5607dd705a60 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f630f606640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f63080346a0 0x7f6308036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f630f606640 1 -- 172.21.15.151:0/979689162 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6414020030 con 0x5607dd705a60 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.539+0000 7f6422502640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f63080346a0 0x7f6308036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f64251f3980 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd795a30 0x5607dd88ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd88b2c0 con 0x5607dd795a30 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6423504640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd795a30 0x5607dd88ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6422502640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f63080346a0 0x7f6308036b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64180ad000 tx=0x7f64180a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6423504640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd795a30 0x5607dd88ac70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6423504640 1 -- 172.21.15.151:0/979689162 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd795a30 2024-09-10T14:28:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8883b0 con 0x5607dd795a30 2024-09-10T14:28:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6423504640 1 -- 172.21.15.151:0/979689162 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd795a30 2024-09-10T14:28:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f64251f3980 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd88d5f0 0x5607dd88f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8900d0 con 0x5607dd88d5f0 2024-09-10T14:28:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6422d03640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd88d5f0 0x5607dd88f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6422d03640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd88d5f0 0x5607dd88f9e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6422d03640 1 -- 172.21.15.151:0/979689162 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6414008030 con 0x5607dd88d5f0 2024-09-10T14:28:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd88c490 con 0x5607dd795a30 2024-09-10T14:28:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6423504640 1 -- 172.21.15.151:0/979689162 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd795a30 2024-09-10T14:28:48.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f64251f3980 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5607dd891530 0x5607dd893920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd894060 con 0x5607dd891530 2024-09-10T14:28:48.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6422502640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5607dd891530 0x5607dd893920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.543+0000 7f6422502640 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5607dd891530 0x5607dd893920 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f6422502640 1 -- 172.21.15.151:0/979689162 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f64180abd10 con 0x5607dd891530 2024-09-10T14:28:48.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f64251f3980 1 Processor -- start 2024-09-10T14:28:48.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f64251f3980 1 -- start start 2024-09-10T14:28:48.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f64251f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8a1b30 0x5607dd8a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f64251f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5607dd698800 con 0x5607dd8a1b30 2024-09-10T14:28:48.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8a1b30 0x5607dd8a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8a1b30 0x5607dd8a1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41030/0 (socket says 172.21.15.151:41030) 2024-09-10T14:28:48.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f6422d03640 1 -- 172.21.15.151:0/747193066 learned_addr learned my addr 172.21.15.151:0/747193066 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f6422d03640 1 -- 172.21.15.151:0/747193066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607dd8a2490 con 0x5607dd8a1b30 2024-09-10T14:28:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f6422d03640 1 --2- 172.21.15.151:0/747193066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8a1b30 0x5607dd8a1f50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6414048670 tx=0x7f6414016ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f630ce01640 1 -- 172.21.15.151:0/747193066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641403e070 con 0x5607dd8a1b30 2024-09-10T14:28:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f630ce01640 1 -- 172.21.15.151:0/747193066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6414032070 con 0x5607dd8a1b30 2024-09-10T14:28:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f64251f3980 1 -- 172.21.15.151:0/747193066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607dd8a2720 con 0x5607dd8a1b30 2024-09-10T14:28:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f630ce01640 1 -- 172.21.15.151:0/747193066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6414018770 con 0x5607dd8a1b30 2024-09-10T14:28:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f64251f3980 1 -- 172.21.15.151:0/747193066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607dd8a53a0 con 0x5607dd8a1b30 2024-09-10T14:28:48.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f630ce01640 1 -- 172.21.15.151:0/747193066 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6414041070 con 0x5607dd8a1b30 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f630ce01640 1 --2- 172.21.15.151:0/747193066 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62fc034650 0x7f62fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f630ce01640 1 -- 172.21.15.151:0/747193066 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6414005050 con 0x5607dd8a1b30 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.547+0000 7f6422502640 1 --2- 172.21.15.151:0/747193066 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62fc034650 0x7f62fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 Processor -- start 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- start start 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd8ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5607dd87d260 con 0x5607dd8ae4c0 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422502640 1 --2- 172.21.15.151:0/747193066 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62fc034650 0x7f62fc036b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5607dd88b770 tx=0x7f6418005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd8ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd8ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41032/0 (socket says 172.21.15.151:41032) 2024-09-10T14:28:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 -- 172.21.15.151:0/1237759812 learned_addr learned my addr 172.21.15.151:0/1237759812 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 -- 172.21.15.151:0/1237759812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607dd8aee70 con 0x5607dd8ae4c0 2024-09-10T14:28:48.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 --2- 172.21.15.151:0/1237759812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd8ae8a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6414041c30 tx=0x7f6414050ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aefee4fb04f476a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f63067fc640 1 -- 172.21.15.151:0/1237759812 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6414057040 con 0x5607dd8ae4c0 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f63067fc640 1 -- 172.21.15.151:0/1237759812 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6414041dd0 con 0x5607dd8ae4c0 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f63067fc640 1 -- 172.21.15.151:0/1237759812 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641400cde0 con 0x5607dd8ae4c0 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- 172.21.15.151:0/1237759812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 msgr2=0x5607dd8ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 --2- 172.21.15.151:0/1237759812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd8ae8a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6414041c30 tx=0x7f6414050ec0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- 172.21.15.151:0/1237759812 shutdown_connections 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 --2- 172.21.15.151:0/1237759812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd8ae8a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- 172.21.15.151:0/1237759812 >> 172.21.15.151:0/1237759812 conn(0x5607dd8aa8a0 msgr2=0x5607dd8a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- 172.21.15.151:0/1237759812 shutdown_connections 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- 172.21.15.151:0/1237759812 wait complete. 2024-09-10T14:28:48.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 Processor -- start 2024-09-10T14:28:48.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- start start 2024-09-10T14:28:48.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd791c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f64251f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5607dd8af310 con 0x5607dd8ae4c0 2024-09-10T14:28:48.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd791c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd791c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41042/0 (socket says 172.21.15.151:41042) 2024-09-10T14:28:48.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 learned_addr learned my addr 172.21.15.151:0/2736344889 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.551+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607dd790330 con 0x5607dd8ae4c0 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6422d03640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd791c10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6414016a90 tx=0x7f641403cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6304ff9640 1 -- 172.21.15.151:0/2736344889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64140398c0 con 0x5607dd8ae4c0 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6304ff9640 1 -- 172.21.15.151:0/2736344889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641406b030 con 0x5607dd8ae4c0 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607dd790330 con 0x5607dd8ae4c0 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6304ff9640 1 -- 172.21.15.151:0/2736344889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6414039b90 con 0x5607dd8ae4c0 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607dd790330 con 0x5607dd8ae4c0 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6304ff9640 1 -- 172.21.15.151:0/2736344889 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6414009070 con 0x5607dd8ae4c0 2024-09-10T14:28:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6304ff9640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62ec0346a0 0x7f62ec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6304ff9640 1 -- 172.21.15.151:0/2736344889 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6414071c80 con 0x5607dd8ae4c0 2024-09-10T14:28:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6422502640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62ec0346a0 0x7f62ec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd8c28e0 0x5607dd8c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c54f0 con 0x5607dd8c28e0 2024-09-10T14:28:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6423504640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd8c28e0 0x5607dd8c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6422502640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62ec0346a0 0x7f62ec036b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64180b7fd0 tx=0x7f64180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6423504640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd8c28e0 0x5607dd8c4da0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 20 realm 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c5900 con 0x5607dd8c28e0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c61d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.555+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x5607dd8c28e0 2024-09-10T14:28:48.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f64251f3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd8c72d0 0x5607dd8c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c9cd0 con 0x5607dd8c72d0 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422d03640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd8c72d0 0x5607dd8c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422d03640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd8c72d0 0x5607dd8c96c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6414077070 con 0x5607dd8c72d0 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f64251f3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f64251f3980 20 searching for the correct realm 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cb5a0 con 0x5607dd8c72d0 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6414077070 con 0x5607dd8c72d0 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422d03640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6414066050 0x7f6414030120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cb5a0 con 0x7f6414066050 2024-09-10T14:28:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422502640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6414066050 0x7f6414030120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422502640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6414066050 0x7f6414030120 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422502640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f64180ce040 0x7f64180db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cb5a0 con 0x7f64180ce040 2024-09-10T14:28:48.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6423504640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f64180ce040 0x7f64180db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6423504640 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f64180ce040 0x7f64180db920 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.559+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x5607dd8c28e0 2024-09-10T14:28:48.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x5607dd8c28e0 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x7f64180ce040 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x7f64180ce040 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x7f6414066050 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x5607dd8c72d0 2024-09-10T14:28:48.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6414077070 con 0x5607dd8c72d0 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x5607dd8c28e0 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x7f64180ce040 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x5607dd8c28e0 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8c6570 con 0x7f6414066050 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.563+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c72d0 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6414077070 con 0x5607dd8c72d0 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c72d0 2024-09-10T14:28:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6414077070 con 0x5607dd8c72d0 2024-09-10T14:28:48.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x7f64180ce040 2024-09-10T14:28:48.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c72d0 2024-09-10T14:28:48.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6414077070 con 0x5607dd8c72d0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c72d0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6414077070 con 0x5607dd8c72d0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c28e0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c28e0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x7f64180ce040 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c72d0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641408e040 con 0x5607dd8c72d0 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x7f6414066050 2024-09-10T14:28:48.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c28e0 2024-09-10T14:28:48.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.567+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x7f64180ce040 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c72d0 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641408e040 con 0x5607dd8c72d0 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x7f64180ce040 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x7f6414066050 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c72d0 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641408e040 con 0x5607dd8c72d0 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x7f64180ce040 2024-09-10T14:28:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x5607dd8c28e0 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f64180e8060 con 0x7f6414066050 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8ca6c0 con 0x5607dd8c28e0 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8ca300 con 0x5607dd8c28e0 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.571+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cafe0 con 0x7f64180ce040 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 zone default found 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 4 Realm: () 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 zonegroup default 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cb410 con 0x7f64180ce040 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cb410 con 0x5607dd8c72d0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f641408e040 con 0x5607dd8c72d0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cd480 con 0x5607dd8c72d0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f641408e040 con 0x5607dd8c72d0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 started sync module instance, tier type = 2024-09-10T14:28:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cc850 con 0x7f6414066050 2024-09-10T14:28:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94591781751872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cc4b0 con 0x7f6414066050 2024-09-10T14:28:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.575+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8ce3b0 con 0x5607dd8c28e0 2024-09-10T14:28:48.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.579+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.579+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94591781756944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cea80 con 0x5607dd8c28e0 2024-09-10T14:28:48.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.579+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cf580 con 0x5607dd8c72d0 2024-09-10T14:28:48.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.579+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94591781751872] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.579+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641408e040 con 0x5607dd8c72d0 2024-09-10T14:28:48.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.579+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94591781761136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8cf9a0 con 0x5607dd8c72d0 2024-09-10T14:28:48.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.579+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d0360 con 0x7f6414066050 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94591781756944] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94591781758160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d0c00 con 0x7f6414066050 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d1490 con 0x5607dd8c28e0 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94591781761136] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641408e040 con 0x5607dd8c72d0 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94591781758160] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94591781766992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d0fa0 con 0x5607dd8c28e0 2024-09-10T14:28:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.583+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d1d30 con 0x7f64180ce040 2024-09-10T14:28:48.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.587+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.587+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94591781771312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d1c50 con 0x7f64180ce040 2024-09-10T14:28:48.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.587+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d2bf0 con 0x7f64180ce040 2024-09-10T14:28:48.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.587+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94591781766992] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.587+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.587+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94591781755104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d2bf0 con 0x7f64180ce040 2024-09-10T14:28:48.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.587+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d35b0 con 0x7f64180ce040 2024-09-10T14:28:48.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.587+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94591781771312] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94591781755104] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94591781775168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d2b60 con 0x7f64180ce040 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 20 add_watcher() i=0 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 20 add_watcher() i=1 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 20 add_watcher() i=2 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 20 add_watcher() i=3 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 20 add_watcher() i=4 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 20 add_watcher() i=5 2024-09-10T14:28:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 20 add_watcher() i=6 2024-09-10T14:28:48.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94591781775168] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 20 add_watcher() i=7 2024-09-10T14:28:48.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:48.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.591+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d65e0 con 0x5607dd8c28e0 2024-09-10T14:28:48.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94591781777664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8d39d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94591781777664] v33'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f62d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 5 note: GC not initialized 2024-09-10T14:28:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f6253fff640 20 reqs_thread_entry: start 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 Filter name: none 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f6251ffb640 20 reqs_thread_entry: start 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f9b60 con 0x5607dd8c28e0 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f8300 con 0x5607dd8c28e0 2024-09-10T14:28:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-10T14:28:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T14:28:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-10T14:28:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.595+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f8300 con 0x7f64180ce040 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f8d10 con 0x5607dd8c28e0 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v33'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94591781930864 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8fd610 con 0x5607dd8c28e0 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify (1) cookie 94591781766992 notify 141733920768 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5607dd8f90b0 con 0x5607dd8c28e0 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f63067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94591781766992 notifier 4288 bl.length()=567 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f63067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f63067fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 notify.4 [notify cookie 94591781930864 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f63067fc640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f62e8003eb0 con 0x5607dd8c28e0 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== watch-notify(notify_complete (2) cookie 94591781930864 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5607dd8f9770 con 0x5607dd8c28e0 2024-09-10T14:28:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.599+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f86f0 con 0x5607dd8c28e0 2024-09-10T14:28:48.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f64251f3980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f64251f3980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f64251f3980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94591781941472 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8fda40 con 0x7f6414066050 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== watch-notify(notify (1) cookie 94591781758160 notify 141733920768 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f64180e2040 con 0x7f6414066050 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f63067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94591781758160 notifier 4288 bl.length()=169 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f63067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f63067fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(69 notify.3 [notify cookie 94591781941472 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f63067fc640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f62e8003eb0 con 0x7f6414066050 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== watch-notify(notify_complete (2) cookie 94591781941472 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5607dd799370 con 0x7f6414066050 2024-09-10T14:28:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.603+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8fb6f0 con 0x7f64180ce040 2024-09-10T14:28:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f64251f3980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T14:28:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f64251f3980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T14:28:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f64251f3980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T14:28:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94591781930688 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8fcc50 con 0x7f6414066050 2024-09-10T14:28:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== watch-notify(notify (1) cookie 94591781758160 notify 141733920769 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5607dd799370 con 0x7f6414066050 2024-09-10T14:28:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 notify.3 [notify cookie 94591781930688 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f63067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94591781758160 notifier 4288 bl.length()=177 2024-09-10T14:28:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f63067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T14:28:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f63067fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T14:28:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f63067fc640 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f62e8003eb0 con 0x7f6414066050 2024-09-10T14:28:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== watch-notify(notify_complete (2) cookie 94591781930688 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f64180e8400 con 0x7f6414066050 2024-09-10T14:28:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.612 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f62d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.607+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94591781777664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x5607dd8c28e0 2024-09-10T14:28:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.611+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94591781777664] v33'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.611+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94591781751872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x7f6414066050 2024-09-10T14:28:48.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.611+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94591781751872] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.611+0000 7f64251f3980 20 remove_watcher() i=0 2024-09-10T14:28:48.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.611+0000 7f64251f3980 2 removed watcher, disabling cache 2024-09-10T14:28:48.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.611+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94591781756944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x5607dd8c28e0 2024-09-10T14:28:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.615+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94591781756944] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.615+0000 7f64251f3980 20 remove_watcher() i=1 2024-09-10T14:28:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.615+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94591781761136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x5607dd8c72d0 2024-09-10T14:28:48.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.615+0000 7f6422d03640 1 -- 172.21.15.151:0/2736344889 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94591781761136] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641408e040 con 0x5607dd8c72d0 2024-09-10T14:28:48.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.615+0000 7f64251f3980 20 remove_watcher() i=2 2024-09-10T14:28:48.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.615+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94591781758160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x7f6414066050 2024-09-10T14:28:48.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.619+0000 7f6422502640 1 -- 172.21.15.151:0/2736344889 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94591781758160] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64180d9070 con 0x7f6414066050 2024-09-10T14:28:48.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.619+0000 7f64251f3980 20 remove_watcher() i=3 2024-09-10T14:28:48.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.619+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94591781766992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x5607dd8c28e0 2024-09-10T14:28:48.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.619+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94591781766992] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x5607dd8c28e0 2024-09-10T14:28:48.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.619+0000 7f64251f3980 20 remove_watcher() i=4 2024-09-10T14:28:48.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.619+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94591781771312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x7f64180ce040 2024-09-10T14:28:48.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.623+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94591781771312] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.623+0000 7f64251f3980 20 remove_watcher() i=5 2024-09-10T14:28:48.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.623+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94591781755104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x7f64180ce040 2024-09-10T14:28:48.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.623+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94591781755104] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.623+0000 7f64251f3980 20 remove_watcher() i=6 2024-09-10T14:28:48.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.623+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94591781775168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607dd8f7930 con 0x7f64180ce040 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94591781775168] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f641c00a4d0 con 0x7f64180ce040 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 20 remove_watcher() i=7 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f64180ce040 msgr2=0x7f64180db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f64180ce040 0x7f64180db920 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd8c28e0 msgr2=0x5607dd8c4da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd8c28e0 0x5607dd8c4da0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6414066050 msgr2=0x7f6414030120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6414066050 0x7f6414030120 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd8c72d0 msgr2=0x5607dd8c96c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd8c72d0 0x5607dd8c96c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62ec0346a0 msgr2=0x7f62ec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62ec0346a0 0x7f62ec036b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64180b7fd0 tx=0x7f64180a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 msgr2=0x5607dd791c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f6423504640 1 -- 172.21.15.151:0/2736344889 reap_dead start 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd791c10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6414016a90 tx=0x7f641403cf30 comp rx=0 tx=0).stop 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 shutdown_connections 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/2736344889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8ae4c0 0x5607dd791c10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 >> 172.21.15.151:0/2736344889 conn(0x5607dd8aa8a0 msgr2=0x5607dd8a8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 shutdown_connections 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/2736344889 wait complete. 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/747193066 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62fc034650 msgr2=0x7f62fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/747193066 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62fc034650 0x7f62fc036b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5607dd88b770 tx=0x7f6418005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/747193066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8a1b30 msgr2=0x5607dd8a1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/747193066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8a1b30 0x5607dd8a1f50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6414048670 tx=0x7f6414016ed0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/747193066 shutdown_connections 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/747193066 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f62fc034650 0x7f62fc036b10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/747193066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd8a1b30 0x5607dd8a1f50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/747193066 >> 172.21.15.151:0/747193066 conn(0x5607dd896c80 msgr2=0x5607dd899700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/747193066 shutdown_connections 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/747193066 wait complete. 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5607dd891530 msgr2=0x5607dd893920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5607dd891530 0x5607dd893920 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd795a30 msgr2=0x5607dd88ac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5607dd795a30 0x5607dd88ac70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd88d5f0 msgr2=0x5607dd88f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5607dd88d5f0 0x5607dd88f9e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f63080346a0 msgr2=0x7f6308036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f63080346a0 0x7f6308036b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f64180ad000 tx=0x7f64180a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 msgr2=0x5607dd883ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 --2- 172.21.15.151:0/979689162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5607dd705a60 0x5607dd883ce0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x5607dd87daf0 tx=0x7f6414000bd0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f6423504640 1 -- 172.21.15.151:0/979689162 reap_dead start 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 shutdown_connections 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 >> 172.21.15.151:0/979689162 conn(0x5607dd78c000 msgr2=0x5607dd8770c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 shutdown_connections 2024-09-10T14:28:48.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.627+0000 7f64251f3980 1 -- 172.21.15.151:0/979689162 wait complete. 2024-09-10T14:28:48.643 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:48.644 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T14:28:48.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T14:28:48.644 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-10T14:28:48.679 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:48.679 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:48.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc116b3c980 1 Processor -- start 2024-09-10T14:28:48.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc116b3c980 1 -- start start 2024-09-10T14:28:48.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc116b3c980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561fa5b08630 0x561fa5b08a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc116b3c980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561fa5990ae0 con 0x561fa5b08f80 2024-09-10T14:28:48.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc116b3c980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x561fa59b4e30 con 0x561fa5b08630 2024-09-10T14:28:48.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc11464c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561fa5b08630 0x561fa5b08a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc11464c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x561fa5b08630 0x561fa5b08a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41054/0 (socket says 172.21.15.151:41054) 2024-09-10T14:28:48.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc11464c640 1 -- 172.21.15.151:0/1646785408 learned_addr learned my addr 172.21.15.151:0/1646785408 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.675+0000 7fc113e4b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x561fa5b08f80 0x561fa5b0d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34126/0 (socket says 172.21.15.151:34126) 2024-09-10T14:28:48.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc11464c640 1 -- 172.21.15.151:0/1646785408 >> v1:172.21.15.52:6789/0 conn(0x561fa5b08f80 legacy=0x561fa5b0d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc11464c640 1 -- 172.21.15.151:0/1646785408 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa5b10200 con 0x561fa5b08630 2024-09-10T14:28:48.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc11464c640 1 --2- 172.21.15.151:0/1646785408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5b08a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00a5c0 tx=0x7fc10c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755193e12842a29f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc11364a640 1 -- 172.21.15.151:0/1646785408 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0a6070 con 0x561fa5b08630 2024-09-10T14:28:48.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc11364a640 1 -- 172.21.15.151:0/1646785408 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c0af070 con 0x561fa5b08630 2024-09-10T14:28:48.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc11364a640 1 -- 172.21.15.151:0/1646785408 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0aa5c0 con 0x561fa5b08630 2024-09-10T14:28:48.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc116b3c980 1 -- 172.21.15.151:0/1646785408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 msgr2=0x561fa5b08a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc116b3c980 1 --2- 172.21.15.151:0/1646785408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5b08a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00a5c0 tx=0x7fc10c01b340 comp rx=0 tx=0).stop 2024-09-10T14:28:48.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc116b3c980 1 -- 172.21.15.151:0/1646785408 shutdown_connections 2024-09-10T14:28:48.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc116b3c980 1 --2- 172.21.15.151:0/1646785408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5b08a10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc116b3c980 1 -- 172.21.15.151:0/1646785408 >> 172.21.15.151:0/1646785408 conn(0x561fa5b04150 msgr2=0x561fa5b06570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc116b3c980 1 -- 172.21.15.151:0/1646785408 shutdown_connections 2024-09-10T14:28:48.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.679+0000 7fc116b3c980 1 -- 172.21.15.151:0/1646785408 wait complete. 2024-09-10T14:28:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.695+0000 7fc116b3c980 1 Processor -- start 2024-09-10T14:28:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.695+0000 7fc116b3c980 1 -- start start 2024-09-10T14:28:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.695+0000 7fc116b3c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5a7f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.695+0000 7fc116b3c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561fa59b6200 con 0x561fa5b08630 2024-09-10T14:28:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.695+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5a7f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.695+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5a7f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41066/0 (socket says 172.21.15.151:41066) 2024-09-10T14:28:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.695+0000 7fc11464c640 1 -- 172.21.15.151:0/2715036338 learned_addr learned my addr 172.21.15.151:0/2715036338 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc11464c640 1 -- 172.21.15.151:0/2715036338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa5a7f8e0 con 0x561fa5b08630 2024-09-10T14:28:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc11464c640 1 --2- 172.21.15.151:0/2715036338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5a7f310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00a5c0 tx=0x7fc10c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b0656aaae5324b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc00260c640 1 -- 172.21.15.151:0/2715036338 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0aa9b0 con 0x561fa5b08630 2024-09-10T14:28:48.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc00260c640 1 -- 172.21.15.151:0/2715036338 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c0aab50 con 0x561fa5b08630 2024-09-10T14:28:48.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc00260c640 1 -- 172.21.15.151:0/2715036338 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0aae50 con 0x561fa5b08630 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- 172.21.15.151:0/2715036338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 msgr2=0x561fa5a7f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 --2- 172.21.15.151:0/2715036338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5a7f310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00a5c0 tx=0x7fc10c003030 comp rx=0 tx=0).stop 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- 172.21.15.151:0/2715036338 shutdown_connections 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 --2- 172.21.15.151:0/2715036338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08630 0x561fa5a7f310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- 172.21.15.151:0/2715036338 >> 172.21.15.151:0/2715036338 conn(0x561fa5b04150 msgr2=0x561fa5bef610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- 172.21.15.151:0/2715036338 shutdown_connections 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- 172.21.15.151:0/2715036338 wait complete. 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 Processor -- start 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- start start 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08f80 0x561fa5bfd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561fa5b0fc40 con 0x561fa5b08f80 2024-09-10T14:28:48.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08f80 0x561fa5bfd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08f80 0x561fa5bfd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41078/0 (socket says 172.21.15.151:41078) 2024-09-10T14:28:48.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc11464c640 1 -- 172.21.15.151:0/3589756871 learned_addr learned my addr 172.21.15.151:0/3589756871 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc11464c640 1 -- 172.21.15.151:0/3589756871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa5bfd650 con 0x561fa5b08f80 2024-09-10T14:28:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc11464c640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08f80 0x561fa5bfd110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00a5c0 tx=0x7fc10c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc000e09640 1 -- 172.21.15.151:0/3589756871 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0cb020 con 0x561fa5b08f80 2024-09-10T14:28:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fa5bfd8e0 con 0x561fa5b08f80 2024-09-10T14:28:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc000e09640 1 -- 172.21.15.151:0/3589756871 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c0c6650 con 0x561fa5b08f80 2024-09-10T14:28:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc000e09640 1 -- 172.21.15.151:0/3589756871 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0c6930 con 0x561fa5b08f80 2024-09-10T14:28:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.699+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa5c005c0 con 0x561fa5b08f80 2024-09-10T14:28:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc000e09640 1 -- 172.21.15.151:0/3589756871 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc10c0ce020 con 0x561fa5b08f80 2024-09-10T14:28:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc000e09640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbffc034650 0x7fbffc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc000e09640 1 -- 172.21.15.151:0/3589756871 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc10c0e5350 con 0x561fa5b08f80 2024-09-10T14:28:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc113e4b640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbffc034650 0x7fbffc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c02090 0x561fa5c044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c04b50 con 0x561fa5c02090 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc114e4d640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c02090 0x561fa5c044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc113e4b640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbffc034650 0x7fbffc036b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc000f70 tx=0x7fc0fc001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc114e4d640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c02090 0x561fa5c044e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc114e4d640 1 -- 172.21.15.151:0/3589756871 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c02090 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c017e0 con 0x561fa5c02090 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc114e4d640 1 -- 172.21.15.151:0/3589756871 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c02090 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c06ea0 0x561fa5c09290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c09960 con 0x561fa5c06ea0 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc11464c640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c06ea0 0x561fa5c09290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc11464c640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c06ea0 0x561fa5c09290 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc11464c640 1 -- 172.21.15.151:0/3589756871 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc10c0e50b0 con 0x561fa5c06ea0 2024-09-10T14:28:48.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c05d40 con 0x561fa5c02090 2024-09-10T14:28:48.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc114e4d640 1 -- 172.21.15.151:0/3589756871 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c02090 2024-09-10T14:28:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561fa5c0adc0 0x561fa5c0d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.703+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c0d8b0 con 0x561fa5c0adc0 2024-09-10T14:28:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc113e4b640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561fa5c0adc0 0x561fa5c0d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc113e4b640 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561fa5c0adc0 0x561fa5c0d1b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc113e4b640 1 -- 172.21.15.151:0/3589756871 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc0fc00f6a0 con 0x561fa5c0adc0 2024-09-10T14:28:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc116b3c980 1 Processor -- start 2024-09-10T14:28:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc116b3c980 1 -- start start 2024-09-10T14:28:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc116b3c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c1b380 0x561fa5c1b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc116b3c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561fa5a0f800 con 0x561fa5c1b380 2024-09-10T14:28:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c1b380 0x561fa5c1b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c1b380 0x561fa5c1b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41084/0 (socket says 172.21.15.151:41084) 2024-09-10T14:28:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc11464c640 1 -- 172.21.15.151:0/2487592948 learned_addr learned my addr 172.21.15.151:0/2487592948 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc11464c640 1 -- 172.21.15.151:0/2487592948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa5c1bce0 con 0x561fa5c1b380 2024-09-10T14:28:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc11464c640 1 --2- 172.21.15.151:0/2487592948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c1b380 0x561fa5c1b7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0c8fd0 tx=0x7fc10c0b3e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fbff9ffb640 1 -- 172.21.15.151:0/2487592948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0c5850 con 0x561fa5c1b380 2024-09-10T14:28:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc116b3c980 1 -- 172.21.15.151:0/2487592948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fa5c1bf70 con 0x561fa5c1b380 2024-09-10T14:28:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fbff9ffb640 1 -- 172.21.15.151:0/2487592948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c0c59f0 con 0x561fa5c1b380 2024-09-10T14:28:48.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fbff9ffb640 1 -- 172.21.15.151:0/2487592948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0e3c20 con 0x561fa5c1b380 2024-09-10T14:28:48.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.707+0000 7fc116b3c980 1 -- 172.21.15.151:0/2487592948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa5c1ebf0 con 0x561fa5c1b380 2024-09-10T14:28:48.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fbff9ffb640 1 -- 172.21.15.151:0/2487592948 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc10c0c6ad0 con 0x561fa5c1b380 2024-09-10T14:28:48.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fbff9ffb640 1 --2- 172.21.15.151:0/2487592948 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfec034650 0x7fbfec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fbff9ffb640 1 -- 172.21.15.151:0/2487592948 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc10c0eec50 con 0x561fa5c1b380 2024-09-10T14:28:48.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc113e4b640 1 --2- 172.21.15.151:0/2487592948 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfec034650 0x7fbfec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 Processor -- start 2024-09-10T14:28:48.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 -- start start 2024-09-10T14:28:48.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc113e4b640 1 --2- 172.21.15.151:0/2487592948 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfec034650 0x7fbfec036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x561fa5c05450 tx=0x7fc0fc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c28070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561fa5a7da40 con 0x561fa5c27c70 2024-09-10T14:28:48.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c28070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c28070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41098/0 (socket says 172.21.15.151:41098) 2024-09-10T14:28:48.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc11464c640 1 -- 172.21.15.151:0/3595736496 learned_addr learned my addr 172.21.15.151:0/3595736496 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc11464c640 1 -- 172.21.15.151:0/3595736496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa5c28640 con 0x561fa5c27c70 2024-09-10T14:28:48.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc11464c640 1 --2- 172.21.15.151:0/3595736496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c28070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0bb9a0 tx=0x7fc10c0e3330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d0c9d725a4bbc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fbff37fe640 1 -- 172.21.15.151:0/3595736496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0e35a0 con 0x561fa5c27c70 2024-09-10T14:28:48.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fbff37fe640 1 -- 172.21.15.151:0/3595736496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c0bbb20 con 0x561fa5c27c70 2024-09-10T14:28:48.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fbff37fe640 1 -- 172.21.15.151:0/3595736496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0e3dc0 con 0x561fa5c27c70 2024-09-10T14:28:48.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 -- 172.21.15.151:0/3595736496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 msgr2=0x561fa5c28070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3595736496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c28070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0bb9a0 tx=0x7fc10c0e3330 comp rx=0 tx=0).stop 2024-09-10T14:28:48.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 -- 172.21.15.151:0/3595736496 shutdown_connections 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3595736496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c28070 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.711+0000 7fc116b3c980 1 -- 172.21.15.151:0/3595736496 >> 172.21.15.151:0/3595736496 conn(0x561fa5c24050 msgr2=0x561fa5c22150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 -- 172.21.15.151:0/3595736496 shutdown_connections 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 -- 172.21.15.151:0/3595736496 wait complete. 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 Processor -- start 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 -- start start 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c2ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561fa5c28a60 con 0x561fa5c27c70 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c2ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc11464c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c2ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41112/0 (socket says 172.21.15.151:41112) 2024-09-10T14:28:48.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 learned_addr learned my addr 172.21.15.151:0/594555031 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa5c2f380 con 0x561fa5c27c70 2024-09-10T14:28:48.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc11464c640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c2ee40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc10c007000 tx=0x7fc10c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fbff1ffb640 1 -- 172.21.15.151:0/594555031 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0bc9d0 con 0x561fa5c27c70 2024-09-10T14:28:48.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fbff1ffb640 1 -- 172.21.15.151:0/594555031 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c0b54b0 con 0x561fa5c27c70 2024-09-10T14:28:48.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fa5c2f380 con 0x561fa5c27c70 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fbff1ffb640 1 -- 172.21.15.151:0/594555031 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc10c0d1050 con 0x561fa5c27c70 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa5c2f7f0 con 0x561fa5c27c70 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fbff1ffb640 1 -- 172.21.15.151:0/594555031 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc10c113030 con 0x561fa5c27c70 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fbff1ffb640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfe4034650 0x7fbfe4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fbff1ffb640 1 -- 172.21.15.151:0/594555031 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc10c111070 con 0x561fa5c27c70 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc113e4b640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfe4034650 0x7fbfe4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c39f30 0x561fa5c3c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3cb40 con 0x561fa5c39f30 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.715+0000 7fc114e4d640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c39f30 0x561fa5c3c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc114e4d640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c39f30 0x561fa5c3c3f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc113e4b640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfe4034650 0x7fbfe4036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c010 tx=0x7fc0fc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 realm 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3cf50 con 0x561fa5c39f30 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3d820 con 0x561fa5c39f30 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c3e920 0x561fa5c40d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c41320 con 0x561fa5c3e920 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc11464c640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c3e920 0x561fa5c40d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc11464c640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c3e920 0x561fa5c40d10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 20 searching for the correct realm 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c42bf0 con 0x561fa5c3e920 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc11464c640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc10c0db040 0x7fc10c0df210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c42bf0 con 0x7fc10c0db040 2024-09-10T14:28:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc113e4b640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc10c0db040 0x7fc10c0df210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc113e4b640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc10c0db040 0x7fc10c0df210 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc113e4b640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc0fc01fbe0 0x7fc0fc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c42bf0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.719+0000 7fc114e4d640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc0fc01fbe0 0x7fc0fc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc0fc01fbe0 0x7fc0fc03a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc10c0db040 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c3e920 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.723+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc10c0db040 2024-09-10T14:28:48.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c3e920 2024-09-10T14:28:48.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c3e920 2024-09-10T14:28:48.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c3e920 2024-09-10T14:28:48.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c3e920 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.727+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c3e920 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc10c0db040 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c3e920 2024-09-10T14:28:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc10c0db040 2024-09-10T14:28:48.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c3e920 2024-09-10T14:28:48.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.731+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x561fa5c39f30 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c3dbc0 con 0x7fc10c0db040 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c41d10 con 0x561fa5c39f30 2024-09-10T14:28:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c41950 con 0x561fa5c39f30 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c42630 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 zone default found 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 4 Realm: () 2024-09-10T14:28:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 zonegroup default 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c42a60 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c42a60 con 0x561fa5c3e920 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c44b30 con 0x561fa5c3e920 2024-09-10T14:28:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 started sync module instance, tier type = 2024-09-10T14:28:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.735+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c43ea0 con 0x7fc10c0db040 2024-09-10T14:28:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.739+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.739+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94693925077648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c45440 con 0x7fc10c0db040 2024-09-10T14:28:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.739+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c45c90 con 0x561fa5c39f30 2024-09-10T14:28:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.739+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94693925077648] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.739+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.739+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94693925080976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c45c90 con 0x561fa5c39f30 2024-09-10T14:28:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.739+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c46750 con 0x561fa5c3e920 2024-09-10T14:28:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.743+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94693925080976] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.743+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.743+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94693925083104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c45c00 con 0x561fa5c3e920 2024-09-10T14:28:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.743+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c474e0 con 0x7fc10c0db040 2024-09-10T14:28:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.743+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.743+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94693925091536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c481a0 con 0x7fc10c0db040 2024-09-10T14:28:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.743+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c48b60 con 0x561fa5c39f30 2024-09-10T14:28:48.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.743+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94693925083104] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.747+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94693925091536] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.747+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.747+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94693925088064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c48b60 con 0x561fa5c39f30 2024-09-10T14:28:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.747+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c49400 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.747+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94693925088064] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.747+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.747+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94693925095360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c49110 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.747+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c49c30 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94693925099264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c4a0a0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c4ab90 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94693925095360] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94693925099264] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94693925103200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c49bf0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 20 add_watcher() i=0 2024-09-10T14:28:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 20 add_watcher() i=1 2024-09-10T14:28:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 20 add_watcher() i=2 2024-09-10T14:28:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 20 add_watcher() i=3 2024-09-10T14:28:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 20 add_watcher() i=4 2024-09-10T14:28:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 20 add_watcher() i=5 2024-09-10T14:28:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.751+0000 7fc116b3c980 20 add_watcher() i=6 2024-09-10T14:28:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94693925103200] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc116b3c980 20 add_watcher() i=7 2024-09-10T14:28:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc116b3c980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c4dc90 con 0x561fa5c39f30 2024-09-10T14:28:48.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94693925096416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c4b110 con 0x561fa5c39f30 2024-09-10T14:28:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94693925096416] v33'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fbfca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc116b3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc116b3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.755+0000 7fc116b3c980 5 note: GC not initialized 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fbfc97e2640 20 reqs_thread_entry: start 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 Filter name: none 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fbf3affd640 20 reqs_thread_entry: start 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c710a0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c6f840 con 0x561fa5c39f30 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 rados_obj.operate() r=0 bl.length=7 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c6fc30 con 0x561fa5c39f30 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 20 get_user_info_from_index found 0 xattrs 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fbfca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.759+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94693925096416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c50390 con 0x561fa5c39f30 2024-09-10T14:28:48.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.763+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94693925096416] v33'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.763+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94693925077648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c6eed0 con 0x7fc10c0db040 2024-09-10T14:28:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.763+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94693925077648] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.763+0000 7fc116b3c980 20 remove_watcher() i=0 2024-09-10T14:28:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.763+0000 7fc116b3c980 2 removed watcher, disabling cache 2024-09-10T14:28:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.763+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94693925080976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c44290 con 0x561fa5c39f30 2024-09-10T14:28:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94693925080976] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc116b3c980 20 remove_watcher() i=1 2024-09-10T14:28:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94693925083104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c6eed0 con 0x561fa5c3e920 2024-09-10T14:28:48.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc11464c640 1 -- 172.21.15.151:0/594555031 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94693925083104] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10c0f4070 con 0x561fa5c3e920 2024-09-10T14:28:48.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc116b3c980 20 remove_watcher() i=2 2024-09-10T14:28:48.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94693925091536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c44290 con 0x7fc10c0db040 2024-09-10T14:28:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc113e4b640 1 -- 172.21.15.151:0/594555031 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94693925091536] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0fc037040 con 0x7fc10c0db040 2024-09-10T14:28:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc116b3c980 20 remove_watcher() i=3 2024-09-10T14:28:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.767+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94693925088064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c457e0 con 0x561fa5c39f30 2024-09-10T14:28:48.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.771+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94693925088064] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x561fa5c39f30 2024-09-10T14:28:48.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.771+0000 7fc116b3c980 20 remove_watcher() i=4 2024-09-10T14:28:48.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.771+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94693925095360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c478d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.775+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94693925095360] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.775+0000 7fc116b3c980 20 remove_watcher() i=5 2024-09-10T14:28:48.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.775+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94693925099264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c44290 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.775+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94693925099264] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.775+0000 7fc116b3c980 20 remove_watcher() i=6 2024-09-10T14:28:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.775+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94693925103200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561fa5c44290 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94693925103200] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc10400a4d0 con 0x7fc0fc01fbe0 2024-09-10T14:28:48.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 20 remove_watcher() i=7 2024-09-10T14:28:48.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc0fc01fbe0 msgr2=0x7fc0fc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc0fc01fbe0 0x7fc0fc03a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c39f30 msgr2=0x561fa5c3c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c39f30 0x561fa5c3c3f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc10c0db040 msgr2=0x7fc10c0df210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc10c0db040 0x7fc10c0df210 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c3e920 msgr2=0x561fa5c40d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c3e920 0x561fa5c40d10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfe4034650 msgr2=0x7fbfe4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfe4034650 0x7fbfe4036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c010 tx=0x7fc0fc010000 comp rx=0 tx=0).stop 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 msgr2=0x561fa5c2ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc114e4d640 1 -- 172.21.15.151:0/594555031 reap_dead start 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c2ee40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc10c007000 tx=0x7fc10c006f90 comp rx=0 tx=0).stop 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 shutdown_connections 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/594555031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c27c70 0x561fa5c2ee40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 >> 172.21.15.151:0/594555031 conn(0x561fa5c24050 msgr2=0x561fa5c22120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 shutdown_connections 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/594555031 wait complete. 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/2487592948 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfec034650 msgr2=0x7fbfec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/2487592948 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfec034650 0x7fbfec036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x561fa5c05450 tx=0x7fc0fc00f000 comp rx=0 tx=0).stop 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/2487592948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c1b380 msgr2=0x561fa5c1b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/2487592948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c1b380 0x561fa5c1b7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0c8fd0 tx=0x7fc10c0b3e60 comp rx=0 tx=0).stop 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/2487592948 shutdown_connections 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/2487592948 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbfec034650 0x7fbfec036b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/2487592948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5c1b380 0x561fa5c1b7a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/2487592948 >> 172.21.15.151:0/2487592948 conn(0x561fa5c104d0 msgr2=0x561fa5c12f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/2487592948 shutdown_connections 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/2487592948 wait complete. 2024-09-10T14:28:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561fa5c0adc0 msgr2=0x561fa5c0d1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x561fa5c0adc0 0x561fa5c0d1b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c02090 msgr2=0x561fa5c044e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x561fa5c02090 0x561fa5c044e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c06ea0 msgr2=0x561fa5c09290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x561fa5c06ea0 0x561fa5c09290 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbffc034650 msgr2=0x7fbffc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbffc034650 0x7fbffc036b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc000f70 tx=0x7fc0fc001380 comp rx=0 tx=0).stop 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08f80 msgr2=0x561fa5bfd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 --2- 172.21.15.151:0/3589756871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561fa5b08f80 0x561fa5bfd110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00a5c0 tx=0x7fc10c0180e0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc114e4d640 1 -- 172.21.15.151:0/3589756871 reap_dead start 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 shutdown_connections 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 >> 172.21.15.151:0/3589756871 conn(0x561fa5b04150 msgr2=0x561fa5bef250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 shutdown_connections 2024-09-10T14:28:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.779+0000 7fc116b3c980 1 -- 172.21.15.151:0/3589756871 wait complete. 2024-09-10T14:28:48.794 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-10T14:28:48.795 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:28:48.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:28:48.795 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:28:48.872 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:48.872 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:48.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.867+0000 7f8928d29980 1 Processor -- start 2024-09-10T14:28:48.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.867+0000 7f8928d29980 1 -- start start 2024-09-10T14:28:48.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.867+0000 7f8928d29980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55f25548fa90 0x55f255491e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.867+0000 7f8928d29980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f255313ae0 con 0x55f2553ffac0 2024-09-10T14:28:48.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.867+0000 7f8928d29980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55f255337e30 con 0x55f25548fa90 2024-09-10T14:28:48.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.871+0000 7f8926038640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55f25548fa90 0x55f255491e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.871+0000 7f8926839640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55f2553ffac0 0x55f25548e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34136/0 (socket says 172.21.15.151:34136) 2024-09-10T14:28:48.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.871+0000 7f8926839640 1 -- 172.21.15.151:0/1696697585 learned_addr learned my addr 172.21.15.151:0/1696697585 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:48.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.871+0000 7f8926038640 1 -- 172.21.15.151:0/1696697585 >> v1:172.21.15.52:6789/0 conn(0x55f2553ffac0 legacy=0x55f25548e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.871+0000 7f8926038640 1 -- 172.21.15.151:0/1696697585 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2554933d0 con 0x55f25548fa90 2024-09-10T14:28:48.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.871+0000 7f8926038640 1 --2- 172.21.15.151:0/1696697585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548fa90 0x55f255491e80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f891c00a480 tx=0x7f891c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfcc26bc28f40b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.871+0000 7f8925837640 1 -- 172.21.15.151:0/1696697585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891c0b0070 con 0x55f25548fa90 2024-09-10T14:28:48.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8925837640 1 -- 172.21.15.151:0/1696697585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c0ab540 con 0x55f25548fa90 2024-09-10T14:28:48.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8925837640 1 -- 172.21.15.151:0/1696697585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891c0ab840 con 0x55f25548fa90 2024-09-10T14:28:48.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8928d29980 1 -- 172.21.15.151:0/1696697585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548fa90 msgr2=0x55f255491e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8928d29980 1 --2- 172.21.15.151:0/1696697585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548fa90 0x55f255491e80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f891c00a480 tx=0x7f891c01b280 comp rx=0 tx=0).stop 2024-09-10T14:28:48.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8928d29980 1 -- 172.21.15.151:0/1696697585 shutdown_connections 2024-09-10T14:28:48.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8928d29980 1 --2- 172.21.15.151:0/1696697585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548fa90 0x55f255491e80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8928d29980 1 -- 172.21.15.151:0/1696697585 >> 172.21.15.151:0/1696697585 conn(0x55f255486060 msgr2=0x55f255488480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8928d29980 1 -- 172.21.15.151:0/1696697585 shutdown_connections 2024-09-10T14:28:48.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.875+0000 7f8928d29980 1 -- 172.21.15.151:0/1696697585 wait complete. 2024-09-10T14:28:48.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 Processor -- start 2024-09-10T14:28:48.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- start start 2024-09-10T14:28:48.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f255576a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f255339200 con 0x55f2553ffac0 2024-09-10T14:28:48.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f255576a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f255576a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41138/0 (socket says 172.21.15.151:41138) 2024-09-10T14:28:48.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8926839640 1 -- 172.21.15.151:0/2249231302 learned_addr learned my addr 172.21.15.151:0/2249231302 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8926839640 1 -- 172.21.15.151:0/2249231302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f255577030 con 0x55f2553ffac0 2024-09-10T14:28:48.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8926839640 1 --2- 172.21.15.151:0/2249231302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f255576a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89200015f0 tx=0x7f8920001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf19cf031267c4ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8814e09640 1 -- 172.21.15.151:0/2249231302 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920004530 con 0x55f2553ffac0 2024-09-10T14:28:48.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8814e09640 1 -- 172.21.15.151:0/2249231302 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89200046f0 con 0x55f2553ffac0 2024-09-10T14:28:48.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8814e09640 1 -- 172.21.15.151:0/2249231302 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920004a90 con 0x55f2553ffac0 2024-09-10T14:28:48.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- 172.21.15.151:0/2249231302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 msgr2=0x55f255576a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 --2- 172.21.15.151:0/2249231302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f255576a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89200015f0 tx=0x7f8920001ab0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- 172.21.15.151:0/2249231302 shutdown_connections 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 --2- 172.21.15.151:0/2249231302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f255576a60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- 172.21.15.151:0/2249231302 >> 172.21.15.151:0/2249231302 conn(0x55f255486060 msgr2=0x55f255572690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- 172.21.15.151:0/2249231302 shutdown_connections 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- 172.21.15.151:0/2249231302 wait complete. 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 Processor -- start 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- start start 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f25557ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.891+0000 7f8928d29980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f255492e10 con 0x55f2553ffac0 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f25557ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f25557ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41152/0 (socket says 172.21.15.151:41152) 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8926839640 1 -- 172.21.15.151:0/2946450901 learned_addr learned my addr 172.21.15.151:0/2946450901 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8926839640 1 -- 172.21.15.151:0/2946450901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25557e330 con 0x55f2553ffac0 2024-09-10T14:28:48.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8926839640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f25557ddf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55f255577c40 tx=0x7f8920000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8813606640 1 -- 172.21.15.151:0/2946450901 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920013760 con 0x55f2553ffac0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f25557e5c0 con 0x55f2553ffac0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8813606640 1 -- 172.21.15.151:0/2946450901 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8920013900 con 0x55f2553ffac0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8813606640 1 -- 172.21.15.151:0/2946450901 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920013be0 con 0x55f2553ffac0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2555812a0 con 0x55f2553ffac0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8813606640 1 -- 172.21.15.151:0/2946450901 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8920010070 con 0x55f2553ffac0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8813606640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f880c034650 0x7f880c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8813606640 1 -- 172.21.15.151:0/2946450901 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8920018070 con 0x55f2553ffac0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8926038640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f880c034650 0x7f880c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8928d29980 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f25548fa90 0x55f255584dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f255585430 con 0x55f25548fa90 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f892703a640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f25548fa90 0x55f255584dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8926038640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f880c034650 0x7f880c036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f891c0ad000 tx=0x7f891c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f892703a640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f25548fa90 0x55f255584dc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f892703a640 1 -- 172.21.15.151:0/2946450901 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f25548fa90 2024-09-10T14:28:48.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.895+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555824c0 con 0x55f25548fa90 2024-09-10T14:28:48.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f892703a640 1 -- 172.21.15.151:0/2946450901 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f891800a510 con 0x55f25548fa90 2024-09-10T14:28:48.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f255587780 0x55f255589b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f25558a240 con 0x55f255587780 2024-09-10T14:28:48.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8926839640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f255587780 0x55f255589b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8926839640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f255587780 0x55f255589b70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8926839640 1 -- 172.21.15.151:0/2946450901 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f892001b030 con 0x55f255587780 2024-09-10T14:28:48.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f255586620 con 0x55f25548fa90 2024-09-10T14:28:48.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f892703a640 1 -- 172.21.15.151:0/2946450901 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f891800a510 con 0x55f25548fa90 2024-09-10T14:28:48.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f25558b680 0x55f25558da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f25558e200 con 0x55f25558b680 2024-09-10T14:28:48.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8926038640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f25558b680 0x55f25558da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8926038640 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f25558b680 0x55f25558da70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8926038640 1 -- 172.21.15.151:0/2946450901 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f891c0b3040 con 0x55f25558b680 2024-09-10T14:28:48.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 Processor -- start 2024-09-10T14:28:48.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 -- start start 2024-09-10T14:28:48.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25559bcb0 0x55f25559c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.899+0000 7f8928d29980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f255392800 con 0x55f25559bcb0 2024-09-10T14:28:48.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25559bcb0 0x55f25559c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25559bcb0 0x55f25559c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41166/0 (socket says 172.21.15.151:41166) 2024-09-10T14:28:48.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8926839640 1 -- 172.21.15.151:0/4224092289 learned_addr learned my addr 172.21.15.151:0/4224092289 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8926839640 1 -- 172.21.15.151:0/4224092289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25559c610 con 0x55f25559bcb0 2024-09-10T14:28:48.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8926839640 1 --2- 172.21.15.151:0/4224092289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25559bcb0 0x55f25559c0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89200483b0 tx=0x7f8920012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8810e01640 1 -- 172.21.15.151:0/4224092289 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f892004b020 con 0x55f25559bcb0 2024-09-10T14:28:48.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8810e01640 1 -- 172.21.15.151:0/4224092289 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89200413d0 con 0x55f25559bcb0 2024-09-10T14:28:48.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8928d29980 1 -- 172.21.15.151:0/4224092289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f25559c8a0 con 0x55f25559bcb0 2024-09-10T14:28:48.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8810e01640 1 -- 172.21.15.151:0/4224092289 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920039030 con 0x55f25559bcb0 2024-09-10T14:28:48.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8928d29980 1 -- 172.21.15.151:0/4224092289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25559f520 con 0x55f25559bcb0 2024-09-10T14:28:48.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8810e01640 1 -- 172.21.15.151:0/4224092289 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8920041a10 con 0x55f25559bcb0 2024-09-10T14:28:48.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8810e01640 1 --2- 172.21.15.151:0/4224092289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8800034650 0x7f8800036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8810e01640 1 -- 172.21.15.151:0/4224092289 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f892003d070 con 0x55f25559bcb0 2024-09-10T14:28:48.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8926038640 1 --2- 172.21.15.151:0/4224092289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8800034650 0x7f8800036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8928d29980 1 Processor -- start 2024-09-10T14:28:48.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8928d29980 1 -- start start 2024-09-10T14:28:48.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8928d29980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f25548b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8928d29980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f2555773b0 con 0x55f25548b5c0 2024-09-10T14:28:48.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.903+0000 7f8926038640 1 --2- 172.21.15.151:0/4224092289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8800034650 0x7f8800036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f891c01b2c0 tx=0x7f891c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.907+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f25548b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.907+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f25548b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41170/0 (socket says 172.21.15.151:41170) 2024-09-10T14:28:48.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.907+0000 7f8926839640 1 -- 172.21.15.151:0/1979368445 learned_addr learned my addr 172.21.15.151:0/1979368445 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.907+0000 7f8926839640 1 -- 172.21.15.151:0/1979368445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25548bf70 con 0x55f25548b5c0 2024-09-10T14:28:48.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.907+0000 7f8926839640 1 --2- 172.21.15.151:0/1979368445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f25548b9a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f89200528d0 tx=0x7f892003be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abeae5c2e57c744 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f880a7fc640 1 -- 172.21.15.151:0/1979368445 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920052d70 con 0x55f25548b5c0 2024-09-10T14:28:48.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f880a7fc640 1 -- 172.21.15.151:0/1979368445 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89200416f0 con 0x55f25548b5c0 2024-09-10T14:28:48.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f880a7fc640 1 -- 172.21.15.151:0/1979368445 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920052580 con 0x55f25548b5c0 2024-09-10T14:28:48.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- 172.21.15.151:0/1979368445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 msgr2=0x55f25548b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 --2- 172.21.15.151:0/1979368445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f25548b9a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f89200528d0 tx=0x7f892003be10 comp rx=0 tx=0).stop 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- 172.21.15.151:0/1979368445 shutdown_connections 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 --2- 172.21.15.151:0/1979368445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f25548b9a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- 172.21.15.151:0/1979368445 >> 172.21.15.151:0/1979368445 conn(0x55f2555a49d0 msgr2=0x55f2555a2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- 172.21.15.151:0/1979368445 shutdown_connections 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- 172.21.15.151:0/1979368445 wait complete. 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 Processor -- start 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- start start 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f2555b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f25548a150 con 0x55f25548b5c0 2024-09-10T14:28:48.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f2555b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8926839640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f2555b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41180/0 (socket says 172.21.15.151:41180) 2024-09-10T14:28:48.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 learned_addr learned my addr 172.21.15.151:0/2299640788 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:48.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2555b1ee0 con 0x55f25548b5c0 2024-09-10T14:28:48.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8926839640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f2555b19a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8920028fd0 tx=0x7f8920052860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8808ff9640 1 -- 172.21.15.151:0/2299640788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f892002be30 con 0x55f25548b5c0 2024-09-10T14:28:48.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8808ff9640 1 -- 172.21.15.151:0/2299640788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8920028890 con 0x55f25548b5c0 2024-09-10T14:28:48.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2555b1ee0 con 0x55f25548b5c0 2024-09-10T14:28:48.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8808ff9640 1 -- 172.21.15.151:0/2299640788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920041d00 con 0x55f25548b5c0 2024-09-10T14:28:48.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.911+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2555b1ee0 con 0x55f25548b5c0 2024-09-10T14:28:48.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8808ff9640 1 -- 172.21.15.151:0/2299640788 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8920035450 con 0x55f25548b5c0 2024-09-10T14:28:48.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8808ff9640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87f00346a0 0x7f87f0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8808ff9640 1 -- 172.21.15.151:0/2299640788 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f892006f030 con 0x55f25548b5c0 2024-09-10T14:28:48.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926038640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87f00346a0 0x7f87f0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f2555bc9f0 0x55f2555beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555bf600 con 0x55f2555bc9f0 2024-09-10T14:28:48.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f892703a640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f2555bc9f0 0x55f2555beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926038640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87f00346a0 0x7f87f0036b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f891c0abaa0 tx=0x7f891c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f892703a640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f2555bc9f0 0x55f2555beeb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 realm 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555bfa60 con 0x55f2555bc9f0 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c0300 con 0x55f2555bc9f0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f2555c1400 0x55f2555c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c3d70 con 0x55f2555c1400 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926839640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f2555c1400 0x55f2555c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926839640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f2555c1400 0x55f2555c37f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 20 searching for the correct realm 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c5610 con 0x55f2555c1400 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926839640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f892005a070 0x7f8920033480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c5610 con 0x7f892005a070 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.915+0000 7f8926038640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f892005a070 0x7f8920033480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f8926038640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f892005a070 0x7f8920033480 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f8926038640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f891c0dc040 0x7f891c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c5610 con 0x7f891c0dc040 2024-09-10T14:28:48.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f891c0dc040 0x7f891c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f891c0dc040 0x7f891c0ce430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f891c0dc040 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.919+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f891c0dc040 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f892005a070 2024-09-10T14:28:48.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555c1400 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f891c0dc040 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f892005a070 2024-09-10T14:28:48.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555c1400 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555c1400 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f891c0dc040 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555c1400 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555c1400 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.923+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f891c0dc040 2024-09-10T14:28:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555c1400 2024-09-10T14:28:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f892005a070 2024-09-10T14:28:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f891c0dc040 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555c1400 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f891c0dc040 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f892005a070 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.927+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555c1400 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f891c0dc040 2024-09-10T14:28:48.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x55f2555bc9f0 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c06a0 con 0x7f892005a070 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c45c0 con 0x55f2555bc9f0 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c49b0 con 0x55f2555bc9f0 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c49b0 con 0x7f891c0dc040 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 zone default found 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 4 Realm: () 2024-09-10T14:28:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 zonegroup default 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c4dd0 con 0x7f891c0dc040 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.931+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c51f0 con 0x55f2555c1400 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c74c0 con 0x55f2555c1400 2024-09-10T14:28:48.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:48.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 20 started sync module instance, tier type = 2024-09-10T14:28:48.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:48.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c6960 con 0x7f892005a070 2024-09-10T14:28:48.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94499302567248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c65c0 con 0x7f892005a070 2024-09-10T14:28:48.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c8200 con 0x55f2555bc9f0 2024-09-10T14:28:48.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94499302567248] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94499302570080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c8620 con 0x55f2555bc9f0 2024-09-10T14:28:48.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.935+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c8fe0 con 0x55f2555c1400 2024-09-10T14:28:48.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.939+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.939+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94499302574896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c9830 con 0x55f2555c1400 2024-09-10T14:28:48.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.939+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555ca1f0 con 0x7f892005a070 2024-09-10T14:28:48.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.939+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94499302570080] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.939+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.939+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94499302579520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555ca610 con 0x7f892005a070 2024-09-10T14:28:48.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.939+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cb010 con 0x55f2555bc9f0 2024-09-10T14:28:48.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.943+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94499302574896] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.943+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.943+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94499302577024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cb400 con 0x55f2555bc9f0 2024-09-10T14:28:48.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.943+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cbdc0 con 0x7f891c0dc040 2024-09-10T14:28:48.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.943+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94499302579520] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.943+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.943+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94499302571136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cbdc0 con 0x7f891c0dc040 2024-09-10T14:28:48.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.943+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cc650 con 0x7f891c0dc040 2024-09-10T14:28:48.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.947+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94499302577024] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.947+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.947+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94499302583072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cc830 con 0x7f891c0dc040 2024-09-10T14:28:48.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.947+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cd080 con 0x7f891c0dc040 2024-09-10T14:28:48.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.947+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94499302571136] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94499302583072] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94499302587120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555ccce0 con 0x7f891c0dc040 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f8928d29980 20 add_watcher() i=0 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f8928d29980 20 add_watcher() i=1 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f8928d29980 20 add_watcher() i=2 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f8928d29980 20 add_watcher() i=3 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f8928d29980 20 add_watcher() i=4 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f8928d29980 20 add_watcher() i=5 2024-09-10T14:28:48.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.951+0000 7f8928d29980 20 add_watcher() i=6 2024-09-10T14:28:48.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94499302587120] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 20 add_watcher() i=7 2024-09-10T14:28:48.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:48.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cfe30 con 0x55f2555bc9f0 2024-09-10T14:28:48.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94499302590512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cd100 con 0x55f2555bc9f0 2024-09-10T14:28:48.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94499302590512] v33'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f87dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:48.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:48.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 5 note: GC not initialized 2024-09-10T14:28:48.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8757fff640 20 reqs_thread_entry: start 2024-09-10T14:28:48.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:48.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 20 Filter name: none 2024-09-10T14:28:48.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8755ffb640 20 reqs_thread_entry: start 2024-09-10T14:28:48.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 20 rados->read ofs=0 len=0 2024-09-10T14:28:48.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f2555f2fe0 con 0x55f2555bc9f0 2024-09-10T14:28:48.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.955+0000 7f8928d29980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:48.962 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:48.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.959+0000 7f87dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:48.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.959+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94499302590512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555f1f30 con 0x55f2555bc9f0 2024-09-10T14:28:48.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.959+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94499302590512] v33'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.959+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94499302567248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cc830 con 0x7f892005a070 2024-09-10T14:28:48.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.959+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94499302567248] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.959+0000 7f8928d29980 20 remove_watcher() i=0 2024-09-10T14:28:48.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.959+0000 7f8928d29980 2 removed watcher, disabling cache 2024-09-10T14:28:48.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.959+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94499302570080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cc830 con 0x55f2555bc9f0 2024-09-10T14:28:48.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94499302570080] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f8928d29980 20 remove_watcher() i=1 2024-09-10T14:28:48.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94499302574896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cc830 con 0x55f2555c1400 2024-09-10T14:28:48.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f8926839640 1 -- 172.21.15.151:0/2299640788 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94499302574896] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892004d020 con 0x55f2555c1400 2024-09-10T14:28:48.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f8928d29980 20 remove_watcher() i=2 2024-09-10T14:28:48.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94499302579520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c8b30 con 0x7f892005a070 2024-09-10T14:28:48.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f8926038640 1 -- 172.21.15.151:0/2299640788 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94499302579520] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c0c9030 con 0x7f892005a070 2024-09-10T14:28:48.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f8928d29980 20 remove_watcher() i=3 2024-09-10T14:28:48.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.963+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94499302577024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555cc830 con 0x55f2555bc9f0 2024-09-10T14:28:48.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.967+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94499302577024] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x55f2555bc9f0 2024-09-10T14:28:48.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.967+0000 7f8928d29980 20 remove_watcher() i=4 2024-09-10T14:28:48.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.967+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94499302571136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c9d40 con 0x7f891c0dc040 2024-09-10T14:28:48.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.967+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94499302571136] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.967+0000 7f8928d29980 20 remove_watcher() i=5 2024-09-10T14:28:48.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.967+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94499302583072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c8b30 con 0x7f891c0dc040 2024-09-10T14:28:48.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.971+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94499302583072] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.971+0000 7f8928d29980 20 remove_watcher() i=6 2024-09-10T14:28:48.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.971+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94499302587120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f2555c9380 con 0x7f891c0dc040 2024-09-10T14:28:48.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.971+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94499302587120] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891800a510 con 0x7f891c0dc040 2024-09-10T14:28:48.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.971+0000 7f8928d29980 20 remove_watcher() i=7 2024-09-10T14:28:48.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f891c0dc040 msgr2=0x7f891c0ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f891c0dc040 0x7f891c0ce430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f2555bc9f0 msgr2=0x55f2555beeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f2555bc9f0 0x55f2555beeb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f892005a070 msgr2=0x7f8920033480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f892005a070 0x7f8920033480 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f2555c1400 msgr2=0x55f2555c37f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f2555c1400 0x55f2555c37f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87f00346a0 msgr2=0x7f87f0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87f00346a0 0x7f87f0036b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f891c0abaa0 tx=0x7f891c0b9040 comp rx=0 tx=0).stop 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 msgr2=0x55f2555b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f892703a640 1 -- 172.21.15.151:0/2299640788 reap_dead start 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f2555b19a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8920028fd0 tx=0x7f8920052860 comp rx=0 tx=0).stop 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 shutdown_connections 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2299640788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25548b5c0 0x55f2555b19a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 >> 172.21.15.151:0/2299640788 conn(0x55f2555a49d0 msgr2=0x55f2555a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 shutdown_connections 2024-09-10T14:28:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2299640788 wait complete. 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/4224092289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8800034650 msgr2=0x7f8800036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/4224092289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8800034650 0x7f8800036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f891c01b2c0 tx=0x7f891c005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/4224092289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25559bcb0 msgr2=0x55f25559c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/4224092289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25559bcb0 0x55f25559c0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f89200483b0 tx=0x7f8920012ef0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/4224092289 shutdown_connections 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/4224092289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8800034650 0x7f8800036b10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/4224092289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f25559bcb0 0x55f25559c0d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/4224092289 >> 172.21.15.151:0/4224092289 conn(0x55f255590e00 msgr2=0x55f255593880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/4224092289 shutdown_connections 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/4224092289 wait complete. 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f25558b680 msgr2=0x55f25558da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f25558b680 0x55f25558da70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f25548fa90 msgr2=0x55f255584dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f25548fa90 0x55f255584dc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f255587780 msgr2=0x55f255589b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f255587780 0x55f255589b70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f880c034650 msgr2=0x7f880c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f880c034650 0x7f880c036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f891c0ad000 tx=0x7f891c0a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 msgr2=0x55f25557ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 --2- 172.21.15.151:0/2946450901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2553ffac0 0x55f25557ddf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55f255577c40 tx=0x7f8920000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f892703a640 1 -- 172.21.15.151:0/2946450901 reap_dead start 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 shutdown_connections 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 >> 172.21.15.151:0/2946450901 conn(0x55f255486060 msgr2=0x55f255571210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 shutdown_connections 2024-09-10T14:28:48.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:48.975+0000 7f8928d29980 1 -- 172.21.15.151:0/2946450901 wait complete. 2024-09-10T14:28:48.988 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:48.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T14:28:48.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T14:28:48.988 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T14:28:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:49.064 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:49.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.059+0000 7f3714c27980 1 Processor -- start 2024-09-10T14:28:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.059+0000 7f3714c27980 1 -- start start 2024-09-10T14:28:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.059+0000 7f3714c27980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5563238de650 0x5563238dea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.059+0000 7f3714c27980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556323766ae0 con 0x5563238defa0 2024-09-10T14:28:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.059+0000 7f3714c27980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55632378ae30 con 0x5563238de650 2024-09-10T14:28:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3712737640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5563238de650 0x5563238dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3711f36640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5563238defa0 0x5563238e39d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34138/0 (socket says 172.21.15.151:34138) 2024-09-10T14:28:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3712737640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5563238de650 0x5563238dea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41182/0 (socket says 172.21.15.151:41182) 2024-09-10T14:28:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3711f36640 1 -- 172.21.15.151:0/4212634387 learned_addr learned my addr 172.21.15.151:0/4212634387 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3712737640 1 -- 172.21.15.151:0/4212634387 >> v1:172.21.15.52:6789/0 conn(0x5563238defa0 legacy=0x5563238e39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3712737640 1 -- 172.21.15.151:0/4212634387 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563238e6220 con 0x5563238de650 2024-09-10T14:28:49.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3712737640 1 --2- 172.21.15.151:0/4212634387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563238dea30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f370400a480 tx=0x7f370401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf905b6cde8699e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3711735640 1 -- 172.21.15.151:0/4212634387 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040b0070 con 0x5563238de650 2024-09-10T14:28:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3711735640 1 -- 172.21.15.151:0/4212634387 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37040ab540 con 0x5563238de650 2024-09-10T14:28:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3711735640 1 -- 172.21.15.151:0/4212634387 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040ab840 con 0x5563238de650 2024-09-10T14:28:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3714c27980 1 -- 172.21.15.151:0/4212634387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 msgr2=0x5563238dea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3714c27980 1 --2- 172.21.15.151:0/4212634387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563238dea30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f370400a480 tx=0x7f370401b280 comp rx=0 tx=0).stop 2024-09-10T14:28:49.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.063+0000 7f3714c27980 1 -- 172.21.15.151:0/4212634387 shutdown_connections 2024-09-10T14:28:49.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.067+0000 7f3714c27980 1 --2- 172.21.15.151:0/4212634387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563238dea30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.067+0000 7f3714c27980 1 -- 172.21.15.151:0/4212634387 >> 172.21.15.151:0/4212634387 conn(0x5563238da170 msgr2=0x5563238dc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.067+0000 7f3714c27980 1 -- 172.21.15.151:0/4212634387 shutdown_connections 2024-09-10T14:28:49.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.067+0000 7f3714c27980 1 -- 172.21.15.151:0/4212634387 wait complete. 2024-09-10T14:28:49.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3714c27980 1 Processor -- start 2024-09-10T14:28:49.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3714c27980 1 -- start start 2024-09-10T14:28:49.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3714c27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3714c27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55632378c200 con 0x5563238de650 2024-09-10T14:28:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41188/0 (socket says 172.21.15.151:41188) 2024-09-10T14:28:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3712737640 1 -- 172.21.15.151:0/1565638729 learned_addr learned my addr 172.21.15.151:0/1565638729 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3712737640 1 -- 172.21.15.151:0/1565638729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563239ca080 con 0x5563238de650 2024-09-10T14:28:49.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3712737640 1 --2- 172.21.15.151:0/1565638729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239c9ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37040ae040 tx=0x7f3704003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c53698e3f37d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3600608640 1 -- 172.21.15.151:0/1565638729 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040b0040 con 0x5563238de650 2024-09-10T14:28:49.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3600608640 1 -- 172.21.15.151:0/1565638729 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37040ab9d0 con 0x5563238de650 2024-09-10T14:28:49.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.079+0000 7f3600608640 1 -- 172.21.15.151:0/1565638729 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040abcf0 con 0x5563238de650 2024-09-10T14:28:49.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- 172.21.15.151:0/1565638729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 msgr2=0x5563239c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 --2- 172.21.15.151:0/1565638729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239c9ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37040ae040 tx=0x7f3704003030 comp rx=0 tx=0).stop 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- 172.21.15.151:0/1565638729 shutdown_connections 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 --2- 172.21.15.151:0/1565638729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239c9ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- 172.21.15.151:0/1565638729 >> 172.21.15.151:0/1565638729 conn(0x5563238da170 msgr2=0x5563239c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- 172.21.15.151:0/1565638729 shutdown_connections 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- 172.21.15.151:0/1565638729 wait complete. 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 Processor -- start 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- start start 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5563238e5c60 con 0x5563238de650 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239d0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41192/0 (socket says 172.21.15.151:41192) 2024-09-10T14:28:49.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3712737640 1 -- 172.21.15.151:0/2003575364 learned_addr learned my addr 172.21.15.151:0/2003575364 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3712737640 1 -- 172.21.15.151:0/2003575364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563239d11e0 con 0x5563238de650 2024-09-10T14:28:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3712737640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239d0ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3704019930 tx=0x7f3704018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f35fee05640 1 -- 172.21.15.151:0/2003575364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040b0070 con 0x5563238de650 2024-09-10T14:28:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f35fee05640 1 -- 172.21.15.151:0/2003575364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37040b68b0 con 0x5563238de650 2024-09-10T14:28:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563239d1470 con 0x5563238de650 2024-09-10T14:28:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f35fee05640 1 -- 172.21.15.151:0/2003575364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040b6b90 con 0x5563238de650 2024-09-10T14:28:49.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563239d4150 con 0x5563238de650 2024-09-10T14:28:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.083+0000 7f35fee05640 1 -- 172.21.15.151:0/2003575364 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f37040bf3f0 con 0x5563238de650 2024-09-10T14:28:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f35fee05640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35f8034650 0x7f35f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f35fee05640 1 -- 172.21.15.151:0/2003575364 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f37040bc070 con 0x5563238de650 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3711f36640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35f8034650 0x7f35f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3714c27980 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5563238defa0 0x5563239d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5563239d82e0 con 0x5563238defa0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3712f38640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5563238defa0 0x5563239d7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3711f36640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35f8034650 0x7f35f8036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3708001da0 tx=0x7f3708001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3712f38640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5563238defa0 0x5563239d7da0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3712f38640 1 -- 172.21.15.151:0/2003575364 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x5563238defa0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5563239d5370 con 0x5563238defa0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3712f38640 1 -- 172.21.15.151:0/2003575364 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f370c00a4d0 con 0x5563238defa0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3714c27980 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5563239da620 0x5563239dca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5563239dd0e0 con 0x5563239da620 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3712737640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5563239da620 0x5563239dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3712737640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5563239da620 0x5563239dca10 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3712737640 1 -- 172.21.15.151:0/2003575364 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37040b3040 con 0x5563239da620 2024-09-10T14:28:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5563239d94c0 con 0x5563238defa0 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3712f38640 1 -- 172.21.15.151:0/2003575364 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f370c00a4d0 con 0x5563238defa0 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3714c27980 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5563239de540 0x5563239e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5563239e1030 con 0x5563239de540 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3711f36640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5563239de540 0x5563239e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.087+0000 7f3711f36640 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5563239de540 0x5563239e0930 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3711f36640 1 -- 172.21.15.151:0/2003575364 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f370800e6c0 con 0x5563239de540 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3714c27980 1 Processor -- start 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3714c27980 1 -- start start 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3714c27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556323854d70 0x5563238533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3714c27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5563237e5800 con 0x556323854d70 2024-09-10T14:28:49.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556323854d70 0x5563238533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556323854d70 0x5563238533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41206/0 (socket says 172.21.15.151:41206) 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3712737640 1 -- 172.21.15.151:0/1935307453 learned_addr learned my addr 172.21.15.151:0/1935307453 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3712737640 1 -- 172.21.15.151:0/1935307453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556323855190 con 0x556323854d70 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3712737640 1 --2- 172.21.15.151:0/1935307453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556323854d70 0x5563238533f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3704006b40 tx=0x7f37040b4430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f35f7fff640 1 -- 172.21.15.151:0/1935307453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040b5aa0 con 0x556323854d70 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3714c27980 1 -- 172.21.15.151:0/1935307453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556323853990 con 0x556323854d70 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f35f7fff640 1 -- 172.21.15.151:0/1935307453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37040dc430 con 0x556323854d70 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f35f7fff640 1 -- 172.21.15.151:0/1935307453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040dc750 con 0x556323854d70 2024-09-10T14:28:49.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f3714c27980 1 -- 172.21.15.151:0/1935307453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556323853e60 con 0x556323854d70 2024-09-10T14:28:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f35f7fff640 1 -- 172.21.15.151:0/1935307453 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f37040b4a30 con 0x556323854d70 2024-09-10T14:28:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f35f7fff640 1 --2- 172.21.15.151:0/1935307453 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35ec034650 0x7f35ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.091+0000 7f35f7fff640 1 -- 172.21.15.151:0/1935307453 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f37040a8070 con 0x556323854d70 2024-09-10T14:28:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3711f36640 1 --2- 172.21.15.151:0/1935307453 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35ec034650 0x7f35ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 Processor -- start 2024-09-10T14:28:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- start start 2024-09-10T14:28:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3711f36640 1 --2- 172.21.15.151:0/1935307453 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35ec034650 0x7f35ec036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5563239d8bd0 tx=0x7f370800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x5563239fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5563239ca340 con 0x5563239fd610 2024-09-10T14:28:49.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x5563239fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x5563239fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41210/0 (socket says 172.21.15.151:41210) 2024-09-10T14:28:49.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3712737640 1 -- 172.21.15.151:0/2703371783 learned_addr learned my addr 172.21.15.151:0/2703371783 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3712737640 1 -- 172.21.15.151:0/2703371783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563239fdfc0 con 0x5563239fd610 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3712737640 1 --2- 172.21.15.151:0/2703371783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x5563239fd9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f37040e4790 tx=0x7f37040e1260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759f12456656997c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f35f5ffb640 1 -- 172.21.15.151:0/2703371783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040d4dc0 con 0x5563239fd610 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f35f5ffb640 1 -- 172.21.15.151:0/2703371783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37040b4d20 con 0x5563239fd610 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f35f5ffb640 1 -- 172.21.15.151:0/2703371783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040bf730 con 0x5563239fd610 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- 172.21.15.151:0/2703371783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 msgr2=0x5563239fd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 --2- 172.21.15.151:0/2703371783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x5563239fd9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f37040e4790 tx=0x7f37040e1260 comp rx=0 tx=0).stop 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- 172.21.15.151:0/2703371783 shutdown_connections 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 --2- 172.21.15.151:0/2703371783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x5563239fd9f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- 172.21.15.151:0/2703371783 >> 172.21.15.151:0/2703371783 conn(0x5563239f99f0 msgr2=0x5563239f7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- 172.21.15.151:0/2703371783 shutdown_connections 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- 172.21.15.151:0/2703371783 wait complete. 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 Processor -- start 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- start start 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x556323a04770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3714c27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5563239fe460 con 0x5563239fd610 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x556323a04770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3712737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x556323a04770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41220/0 (socket says 172.21.15.151:41220) 2024-09-10T14:28:49.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.095+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 learned_addr learned my addr 172.21.15.151:0/3854771600 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556323a04cb0 con 0x5563239fd610 2024-09-10T14:28:49.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3712737640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x556323a04770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37040e12a0 tx=0x7f37040a8f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f35e3fff640 1 -- 172.21.15.151:0/3854771600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f370410a070 con 0x5563239fd610 2024-09-10T14:28:49.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556323a04cb0 con 0x5563239fd610 2024-09-10T14:28:49.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f35e3fff640 1 -- 172.21.15.151:0/3854771600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37040d6a60 con 0x5563239fd610 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f35e3fff640 1 -- 172.21.15.151:0/3854771600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37040d6d60 con 0x5563239fd610 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556323a05120 con 0x5563239fd610 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f35e3fff640 1 -- 172.21.15.151:0/3854771600 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f370410d070 con 0x5563239fd610 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f35e3fff640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35dc034650 0x7f35dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f35e3fff640 1 -- 172.21.15.151:0/3854771600 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3704102070 con 0x5563239fd610 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3711f36640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35dc034650 0x7f35dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556323a0f740 0x556323a11c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a12350 con 0x556323a0f740 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3712f38640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556323a0f740 0x556323a11c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3711f36640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35dc034650 0x7f35dc036b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5563239e1430 tx=0x7f3708010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3712f38640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556323a0f740 0x556323a11c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 20 realm 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a12760 con 0x556323a0f740 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a13030 con 0x556323a0f740 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.099+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3714c27980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556323a14130 0x556323a16520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a16b30 con 0x556323a14130 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712737640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556323a14130 0x556323a16520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712737640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556323a14130 0x556323a16520 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3714c27980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:49.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3714c27980 20 searching for the correct realm 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a18400 con 0x556323a14130 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712737640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f370410f060 0x7f37040ee870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a18400 con 0x7f370410f060 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3711f36640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f370410f060 0x7f37040ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3711f36640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f370410f060 0x7f37040ee870 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3711f36640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3708037040 0x7f3708036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a18400 con 0x7f3708037040 2024-09-10T14:28:49.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712f38640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3708037040 0x7f3708036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712f38640 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3708037040 0x7f3708036410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.103+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f3708037040 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f3708037040 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f370410f060 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a14130 2024-09-10T14:28:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f3708037040 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f370410f060 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a14130 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.107+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a14130 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f3708037040 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a14130 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a14130 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f3708037040 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a14130 2024-09-10T14:28:49.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f370410f060 2024-09-10T14:28:49.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f3708037040 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.111+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a14130 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f3708037040 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f370410f060 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a14130 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f3708037040 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x556323a0f740 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556323a133d0 con 0x7f370410f060 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a17520 con 0x556323a0f740 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a17160 con 0x556323a0f740 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.115+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a17e40 con 0x7f3708037040 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 zone default found 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 4 Realm: () 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:49.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 zonegroup default 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a18270 con 0x7f3708037040 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a18270 con 0x556323a14130 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a1a260 con 0x556323a14130 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 started sync module instance, tier type = 2024-09-10T14:28:49.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:49.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a196b0 con 0x7f370410f060 2024-09-10T14:28:49.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93884287916704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a19310 con 0x7f370410f060 2024-09-10T14:28:49.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1b190 con 0x556323a0f740 2024-09-10T14:28:49.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.119+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93884287916704] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93884287921376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1b100 con 0x556323a0f740 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1bf20 con 0x556323a14130 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93884287924784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1c7c0 con 0x556323a14130 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1d1c0 con 0x7f370410f060 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93884287921376] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.123+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93884287923584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1d5b0 con 0x7f370410f060 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1df70 con 0x556323a0f740 2024-09-10T14:28:49.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93884287924784] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93884287923584] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93884287927056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1df70 con 0x556323a0f740 2024-09-10T14:28:49.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1e810 con 0x7f3708037040 2024-09-10T14:28:49.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93884287934592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1eab0 con 0x7f3708037040 2024-09-10T14:28:49.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.127+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1f5b0 con 0x7f3708037040 2024-09-10T14:28:49.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93884287927056] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93884287938720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1f570 con 0x7f3708037040 2024-09-10T14:28:49.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1ffb0 con 0x7f3708037040 2024-09-10T14:28:49.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93884287934592] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93884287938720] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93884287933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1e500 con 0x7f3708037040 2024-09-10T14:28:49.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 20 add_watcher() i=0 2024-09-10T14:28:49.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 20 add_watcher() i=1 2024-09-10T14:28:49.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 20 add_watcher() i=2 2024-09-10T14:28:49.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 20 add_watcher() i=3 2024-09-10T14:28:49.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 20 add_watcher() i=4 2024-09-10T14:28:49.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 20 add_watcher() i=5 2024-09-10T14:28:49.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.131+0000 7f3714c27980 20 add_watcher() i=6 2024-09-10T14:28:49.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93884287933120] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 20 add_watcher() i=7 2024-09-10T14:28:49.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:49.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a22fa0 con 0x556323a0f740 2024-09-10T14:28:49.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93884287941248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a20420 con 0x556323a0f740 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93884287941248] v33'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f35c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 5 note: GC not initialized 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f35437fe640 20 reqs_thread_entry: start 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.135+0000 7f3714c27980 20 Filter name: none 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f35417fa640 20 reqs_thread_entry: start 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a464f0 con 0x556323a0f740 2024-09-10T14:28:49.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:49.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:49.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:49.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a48f80 con 0x7f370410f060 2024-09-10T14:28:49.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a4c750 con 0x556323a0f740 2024-09-10T14:28:49.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v33'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:49.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:49.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93884288123296 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556323a47f70 con 0x556323a0f740 2024-09-10T14:28:49.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 93884287927056 notify 141733920769 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f370c02d040 con 0x556323a0f740 2024-09-10T14:28:49.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f35f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 93884287927056 notifier 4309 bl.length()=567 2024-09-10T14:28:49.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f35f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:49.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f35f5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(65 notify.4 [notify cookie 93884288123296 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f35f5ffb640 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f35d8003eb0 con 0x556323a0f740 2024-09-10T14:28:49.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 93884288123296 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f370c01e040 con 0x556323a0f740 2024-09-10T14:28:49.146 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:49.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f35c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.139+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93884287941248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a44320 con 0x556323a0f740 2024-09-10T14:28:49.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93884287941248] v33'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93884287916704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a44320 con 0x7f370410f060 2024-09-10T14:28:49.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93884287916704] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3714c27980 20 remove_watcher() i=0 2024-09-10T14:28:49.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3714c27980 2 removed watcher, disabling cache 2024-09-10T14:28:49.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93884287921376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a19aa0 con 0x556323a0f740 2024-09-10T14:28:49.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93884287921376] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3714c27980 20 remove_watcher() i=1 2024-09-10T14:28:49.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.143+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93884287924784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a44320 con 0x556323a14130 2024-09-10T14:28:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.147+0000 7f3712737640 1 -- 172.21.15.151:0/3854771600 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93884287924784] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370410c030 con 0x556323a14130 2024-09-10T14:28:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.147+0000 7f3714c27980 20 remove_watcher() i=2 2024-09-10T14:28:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.147+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93884287923584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1ace0 con 0x7f370410f060 2024-09-10T14:28:49.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.147+0000 7f3711f36640 1 -- 172.21.15.151:0/3854771600 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93884287923584] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370800e6c0 con 0x7f370410f060 2024-09-10T14:28:49.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.147+0000 7f3714c27980 20 remove_watcher() i=3 2024-09-10T14:28:49.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.147+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93884287927056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a19aa0 con 0x556323a0f740 2024-09-10T14:28:49.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.151+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93884287927056] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x556323a0f740 2024-09-10T14:28:49.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.151+0000 7f3714c27980 20 remove_watcher() i=4 2024-09-10T14:28:49.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.151+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93884287934592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a44320 con 0x7f3708037040 2024-09-10T14:28:49.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.151+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93884287934592] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.151+0000 7f3714c27980 20 remove_watcher() i=5 2024-09-10T14:28:49.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.151+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93884287938720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1b580 con 0x7f3708037040 2024-09-10T14:28:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93884287938720] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 20 remove_watcher() i=6 2024-09-10T14:28:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93884287933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556323a1ace0 con 0x7f3708037040 2024-09-10T14:28:49.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93884287933120] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f370c00a4d0 con 0x7f3708037040 2024-09-10T14:28:49.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 20 remove_watcher() i=7 2024-09-10T14:28:49.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3708037040 msgr2=0x7f3708036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3708037040 0x7f3708036410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556323a0f740 msgr2=0x556323a11c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556323a0f740 0x556323a11c00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f370410f060 msgr2=0x7f37040ee870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f370410f060 0x7f37040ee870 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556323a14130 msgr2=0x556323a16520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556323a14130 0x556323a16520 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35dc034650 msgr2=0x7f35dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35dc034650 0x7f35dc036b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5563239e1430 tx=0x7f3708010000 comp rx=0 tx=0).stop 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 msgr2=0x556323a04770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x556323a04770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37040e12a0 tx=0x7f37040a8f90 comp rx=0 tx=0).stop 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3712f38640 1 -- 172.21.15.151:0/3854771600 reap_dead start 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 shutdown_connections 2024-09-10T14:28:49.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/3854771600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563239fd610 0x556323a04770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 >> 172.21.15.151:0/3854771600 conn(0x5563239f99f0 msgr2=0x5563239f7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 shutdown_connections 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/3854771600 wait complete. 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/1935307453 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35ec034650 msgr2=0x7f35ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/1935307453 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35ec034650 0x7f35ec036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5563239d8bd0 tx=0x7f370800f000 comp rx=0 tx=0).stop 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/1935307453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556323854d70 msgr2=0x5563238533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/1935307453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556323854d70 0x5563238533f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3704006b40 tx=0x7f37040b4430 comp rx=0 tx=0).stop 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/1935307453 shutdown_connections 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/1935307453 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35ec034650 0x7f35ec036b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 --2- 172.21.15.151:0/1935307453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556323854d70 0x5563238533f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/1935307453 >> 172.21.15.151:0/1935307453 conn(0x5563239e3c50 msgr2=0x5563239e66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/1935307453 shutdown_connections 2024-09-10T14:28:49.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.155+0000 7f3714c27980 1 -- 172.21.15.151:0/1935307453 wait complete. 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5563239de540 msgr2=0x5563239e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5563239de540 0x5563239e0930 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5563238defa0 msgr2=0x5563239d7da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5563238defa0 0x5563239d7da0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5563239da620 msgr2=0x5563239dca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5563239da620 0x5563239dca10 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35f8034650 msgr2=0x7f35f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f35f8034650 0x7f35f8036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3708001da0 tx=0x7f3708001300 comp rx=0 tx=0).stop 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 msgr2=0x5563239d0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 --2- 172.21.15.151:0/2003575364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563238de650 0x5563239d0ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3704019930 tx=0x7f3704018020 comp rx=0 tx=0).stop 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3712f38640 1 -- 172.21.15.151:0/2003575364 reap_dead start 2024-09-10T14:28:49.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 shutdown_connections 2024-09-10T14:28:49.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 >> 172.21.15.151:0/2003575364 conn(0x5563238da170 msgr2=0x5563239c4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 shutdown_connections 2024-09-10T14:28:49.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.159+0000 7f3714c27980 1 -- 172.21.15.151:0/2003575364 wait complete. 2024-09-10T14:28:49.170 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:49.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:28:49.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:28:49.171 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:28:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.243+0000 7f3f18a6e980 1 Processor -- start 2024-09-10T14:28:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f18a6e980 1 -- start start 2024-09-10T14:28:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f18a6e980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55dac7dae8f0 0x55dac7db0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f18a6e980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dac7c33ae0 con 0x55dac7daa570 2024-09-10T14:28:49.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f18a6e980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55dac7c57e30 con 0x55dac7dae8f0 2024-09-10T14:28:49.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f15d7d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55dac7dae8f0 0x55dac7db0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f1657e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55dac7daa570 0x55dac7daa950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34148/0 (socket says 172.21.15.151:34148) 2024-09-10T14:28:49.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f1657e640 1 -- 172.21.15.151:0/3882060456 learned_addr learned my addr 172.21.15.151:0/3882060456 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/3882060456 >> v2:172.21.15.52:3300/0 conn(0x55dac7dae8f0 0x55dac7db0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41234/0 (socket says 172.21.15.151:41234) 2024-09-10T14:28:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f15d7d640 1 -- 172.21.15.151:0/3882060456 >> v1:172.21.15.52:6789/0 conn(0x55dac7daa570 legacy=0x55dac7daa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f15d7d640 1 -- 172.21.15.151:0/3882060456 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac7db2230 con 0x55dac7dae8f0 2024-09-10T14:28:49.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/3882060456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7dae8f0 0x55dac7db0ce0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00a480 tx=0x7f3f0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7e817ae2d41085 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f1557c640 1 -- 172.21.15.151:0/3882060456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0c0b0070 con 0x55dac7dae8f0 2024-09-10T14:28:49.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f1557c640 1 -- 172.21.15.151:0/3882060456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0c0ab540 con 0x55dac7dae8f0 2024-09-10T14:28:49.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.247+0000 7f3f1557c640 1 -- 172.21.15.151:0/3882060456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0c0ab840 con 0x55dac7dae8f0 2024-09-10T14:28:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.251+0000 7f3f18a6e980 1 -- 172.21.15.151:0/3882060456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7dae8f0 msgr2=0x55dac7db0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.251+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/3882060456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7dae8f0 0x55dac7db0ce0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00a480 tx=0x7f3f0c01b280 comp rx=0 tx=0).stop 2024-09-10T14:28:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.251+0000 7f3f18a6e980 1 -- 172.21.15.151:0/3882060456 shutdown_connections 2024-09-10T14:28:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.251+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/3882060456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7dae8f0 0x55dac7db0ce0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.251+0000 7f3f18a6e980 1 -- 172.21.15.151:0/3882060456 >> 172.21.15.151:0/3882060456 conn(0x55dac7da6090 msgr2=0x55dac7da84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.251+0000 7f3f18a6e980 1 -- 172.21.15.151:0/3882060456 shutdown_connections 2024-09-10T14:28:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.251+0000 7f3f18a6e980 1 -- 172.21.15.151:0/3882060456 wait complete. 2024-09-10T14:28:49.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f18a6e980 1 Processor -- start 2024-09-10T14:28:49.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f18a6e980 1 -- start start 2024-09-10T14:28:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f18a6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7d1fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f18a6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dac7c59200 con 0x55dac7daa570 2024-09-10T14:28:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7d1fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7d1fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41240/0 (socket says 172.21.15.151:41240) 2024-09-10T14:28:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f1657e640 1 -- 172.21.15.151:0/793842345 learned_addr learned my addr 172.21.15.151:0/793842345 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f1657e640 1 -- 172.21.15.151:0/793842345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac7d201d0 con 0x55dac7daa570 2024-09-10T14:28:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3f1657e640 1 --2- 172.21.15.151:0/793842345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7d1fc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3f100017b0 tx=0x7f3f10001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf5feebf691e655 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3e04608640 1 -- 172.21.15.151:0/793842345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10016070 con 0x55dac7daa570 2024-09-10T14:28:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3e04608640 1 -- 172.21.15.151:0/793842345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f10004530 con 0x55dac7daa570 2024-09-10T14:28:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.263+0000 7f3e04608640 1 -- 172.21.15.151:0/793842345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10004870 con 0x55dac7daa570 2024-09-10T14:28:49.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- 172.21.15.151:0/793842345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 msgr2=0x55dac7d1fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/793842345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7d1fc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3f100017b0 tx=0x7f3f10001c70 comp rx=0 tx=0).stop 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- 172.21.15.151:0/793842345 shutdown_connections 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/793842345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7d1fc00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- 172.21.15.151:0/793842345 >> 172.21.15.151:0/793842345 conn(0x55dac7da6090 msgr2=0x55dac7e915a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- 172.21.15.151:0/793842345 shutdown_connections 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- 172.21.15.151:0/793842345 wait complete. 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 Processor -- start 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- start start 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7e9dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dac7db1d30 con 0x55dac7daa570 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7e9dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7e9dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41254/0 (socket says 172.21.15.151:41254) 2024-09-10T14:28:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f1657e640 1 -- 172.21.15.151:0/2287795567 learned_addr learned my addr 172.21.15.151:0/2287795567 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f1657e640 1 -- 172.21.15.151:0/2287795567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac7e9e2e0 con 0x55dac7daa570 2024-09-10T14:28:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f1657e640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7e9dda0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3f10000f90 tx=0x7f3f10001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3e02e05640 1 -- 172.21.15.151:0/2287795567 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10020070 con 0x55dac7daa570 2024-09-10T14:28:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3e02e05640 1 -- 172.21.15.151:0/2287795567 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f10011400 con 0x55dac7daa570 2024-09-10T14:28:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dac7e9e570 con 0x55dac7daa570 2024-09-10T14:28:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3e02e05640 1 -- 172.21.15.151:0/2287795567 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10016040 con 0x55dac7daa570 2024-09-10T14:28:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac7ea1250 con 0x55dac7daa570 2024-09-10T14:28:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.267+0000 7f3e02e05640 1 -- 172.21.15.151:0/2287795567 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f10023070 con 0x55dac7daa570 2024-09-10T14:28:49.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3e02e05640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dfc034650 0x7f3dfc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3e02e05640 1 -- 172.21.15.151:0/2287795567 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3f10049170 con 0x55dac7daa570 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dfc034650 0x7f3dfc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7dae8f0 0x55dac7ea4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ea53e0 con 0x55dac7dae8f0 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f16d7f640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7dae8f0 0x55dac7ea4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dfc034650 0x7f3dfc036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0ad000 tx=0x7f3f0c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f16d7f640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7dae8f0 0x55dac7ea4ea0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2287795567 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7dae8f0 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ea2450 con 0x55dac7dae8f0 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2287795567 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7dae8f0 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7ea7680 0x55dac7ea9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eaa160 con 0x55dac7ea7680 2024-09-10T14:28:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f1657e640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7ea7680 0x55dac7ea9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f1657e640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7ea7680 0x55dac7ea9a70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f1657e640 1 -- 172.21.15.151:0/2287795567 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7ea7680 2024-09-10T14:28:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ea64f0 con 0x55dac7dae8f0 2024-09-10T14:28:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2287795567 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7dae8f0 2024-09-10T14:28:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dac7eab5c0 0x55dac7ead9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eae0b0 con 0x55dac7eab5c0 2024-09-10T14:28:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dac7eab5c0 0x55dac7ead9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.271+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dac7eab5c0 0x55dac7ead9b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2287795567 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f0c0b3040 con 0x55dac7eab5c0 2024-09-10T14:28:49.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 Processor -- start 2024-09-10T14:28:49.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 -- start start 2024-09-10T14:28:49.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ebbb80 0x55dac7ebbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dac7cb2800 con 0x55dac7ebbb80 2024-09-10T14:28:49.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ebbb80 0x55dac7ebbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ebbb80 0x55dac7ebbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41262/0 (socket says 172.21.15.151:41262) 2024-09-10T14:28:49.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f1657e640 1 -- 172.21.15.151:0/2068779470 learned_addr learned my addr 172.21.15.151:0/2068779470 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f1657e640 1 -- 172.21.15.151:0/2068779470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac7ebc4e0 con 0x55dac7ebbb80 2024-09-10T14:28:49.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f1657e640 1 --2- 172.21.15.151:0/2068779470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ebbb80 0x55dac7ebbfa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3f100475c0 tx=0x7f3f10023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3dfbfff640 1 -- 172.21.15.151:0/2068779470 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1002a040 con 0x55dac7ebbb80 2024-09-10T14:28:49.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2068779470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dac7ebc770 con 0x55dac7ebbb80 2024-09-10T14:28:49.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3dfbfff640 1 -- 172.21.15.151:0/2068779470 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f100116e0 con 0x55dac7ebbb80 2024-09-10T14:28:49.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3dfbfff640 1 -- 172.21.15.151:0/2068779470 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1002a420 con 0x55dac7ebbb80 2024-09-10T14:28:49.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2068779470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac7ebf3f0 con 0x55dac7ebbb80 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3dfbfff640 1 -- 172.21.15.151:0/2068779470 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f100119c0 con 0x55dac7ebbb80 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3dfbfff640 1 --2- 172.21.15.151:0/2068779470 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df0034650 0x7f3df0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3dfbfff640 1 -- 172.21.15.151:0/2068779470 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3f10036070 con 0x55dac7ebbb80 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2068779470 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df0034650 0x7f3df0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 Processor -- start 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 -- start start 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2068779470 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df0034650 0x7f3df0036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55dac7ea5820 tx=0x7f3f0c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ec8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.275+0000 7f3f18a6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dac7d20550 con 0x55dac7ec8560 2024-09-10T14:28:49.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ec8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ec8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41268/0 (socket says 172.21.15.151:41268) 2024-09-10T14:28:49.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 -- 172.21.15.151:0/118977154 learned_addr learned my addr 172.21.15.151:0/118977154 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 -- 172.21.15.151:0/118977154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac7ec8f30 con 0x55dac7ec8560 2024-09-10T14:28:49.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 --2- 172.21.15.151:0/118977154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ec8960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f10006830 tx=0x7f3f1004aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497fe63fb1cc5ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3df9ffb640 1 -- 172.21.15.151:0/118977154 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1005d070 con 0x55dac7ec8560 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3df9ffb640 1 -- 172.21.15.151:0/118977154 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1004bdb0 con 0x55dac7ec8560 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3df9ffb640 1 -- 172.21.15.151:0/118977154 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10054040 con 0x55dac7ec8560 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- 172.21.15.151:0/118977154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 msgr2=0x55dac7ec8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/118977154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ec8960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f10006830 tx=0x7f3f1004aec0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- 172.21.15.151:0/118977154 shutdown_connections 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/118977154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ec8960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- 172.21.15.151:0/118977154 >> 172.21.15.151:0/118977154 conn(0x55dac7ec4890 msgr2=0x55dac7ec2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- 172.21.15.151:0/118977154 shutdown_connections 2024-09-10T14:28:49.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- 172.21.15.151:0/118977154 wait complete. 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 Processor -- start 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- start start 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ecf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dac7ec9420 con 0x55dac7ec8560 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ecf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ecf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41284/0 (socket says 172.21.15.151:41284) 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 learned_addr learned my addr 172.21.15.151:0/2107905930 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac7ecfbe0 con 0x55dac7ec8560 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f1657e640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ecf6a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3f1004c040 tx=0x7f3f10039ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3de7fff640 1 -- 172.21.15.151:0/2107905930 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f10065020 con 0x55dac7ec8560 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dac7ecfbe0 con 0x55dac7ec8560 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3de7fff640 1 -- 172.21.15.151:0/2107905930 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f10026c00 con 0x55dac7ec8560 2024-09-10T14:28:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac7ecfbe0 con 0x55dac7ec8560 2024-09-10T14:28:49.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.279+0000 7f3de7fff640 1 -- 172.21.15.151:0/2107905930 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1005d040 con 0x55dac7ec8560 2024-09-10T14:28:49.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3de7fff640 1 -- 172.21.15.151:0/2107905930 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f10068020 con 0x55dac7ec8560 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3de7fff640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de0034600 0x7f3de0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3de7fff640 1 -- 172.21.15.151:0/2107905930 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3f1006bc60 con 0x55dac7ec8560 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de0034600 0x7f3de0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7eda770 0x55dac7edcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7edd360 con 0x55dac7eda770 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f16d7f640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7eda770 0x55dac7edcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de0034600 0x7f3de0036ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c000c10 tx=0x7f3f0c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f16d7f640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7eda770 0x55dac7edcc10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 realm 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7edd770 con 0x55dac7eda770 2024-09-10T14:28:49.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:49.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede010 con 0x55dac7eda770 2024-09-10T14:28:49.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7edf110 0x55dac7ee1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee1a80 con 0x55dac7edf110 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f1657e640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7edf110 0x55dac7ee1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f1657e640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7edf110 0x55dac7ee1500 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 20 searching for the correct realm 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee32e0 con 0x55dac7edf110 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f1657e640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3f1006a020 0x7f3f100405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee32e0 con 0x7f3f1006a020 2024-09-10T14:28:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.283+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3f1006a020 0x7f3f100405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3f1006a020 0x7f3f100405e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f15d7d640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3f0c0dc040 0x7f3f0c0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee32e0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3f0c0dc040 0x7f3f0c0dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3f0c0dc040 0x7f3f0c0dd430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.287+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f1006a020 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7edf110 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f1006a020 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7edf110 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7edf110 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7edf110 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7edf110 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.291+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7edf110 2024-09-10T14:28:49.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f1006a020 2024-09-10T14:28:49.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7edf110 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f1006a020 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.295+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7edf110 2024-09-10T14:28:49.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x55dac7eda770 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ede3b0 con 0x7f3f1006a020 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:49.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee23d0 con 0x55dac7eda770 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee2010 con 0x55dac7eda770 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee1fe0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 zone default found 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 4 Realm: () 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 zonegroup default 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee2d40 con 0x7f3f0c0dc040 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee3160 con 0x55dac7edf110 2024-09-10T14:28:49.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee5190 con 0x55dac7edf110 2024-09-10T14:28:49.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 started sync module instance, tier type = 2024-09-10T14:28:49.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:49.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.299+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee4630 con 0x7f3f1006a020 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.303+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.303+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94398145514064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee59e0 con 0x7f3f1006a020 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.303+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee6230 con 0x55dac7eda770 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.303+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94398145514064] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.303+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.303+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94398145516848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee6230 con 0x55dac7eda770 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.303+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee6cd0 con 0x55dac7edf110 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.307+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94398145516848] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.307+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.307+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94398145518976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee61a0 con 0x55dac7edf110 2024-09-10T14:28:49.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.307+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee7a20 con 0x7f3f1006a020 2024-09-10T14:28:49.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.307+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.307+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94398145527312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee86e0 con 0x7f3f1006a020 2024-09-10T14:28:49.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.307+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee90a0 con 0x55dac7eda770 2024-09-10T14:28:49.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.307+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94398145518976] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.311+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.311+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94398145530864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee9010 con 0x55dac7eda770 2024-09-10T14:28:49.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.311+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee9df0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.311+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94398145527312] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.315+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.315+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94398145528368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee9df0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.315+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eea710 con 0x7f3f0c0dc040 2024-09-10T14:28:49.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.315+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94398145530864] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.315+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.315+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94398145536480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eea6d0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.315+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eeb0d0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(58 notify.7 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 94398145528368] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94398145539040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eeb510 con 0x7f3f0c0dc040 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 20 add_watcher() i=0 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 20 add_watcher() i=1 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 20 add_watcher() i=2 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 20 add_watcher() i=3 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 20 add_watcher() i=4 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 20 add_watcher() i=5 2024-09-10T14:28:49.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94398145536480] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 20 add_watcher() i=6 2024-09-10T14:28:49.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94398145539040] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 20 add_watcher() i=7 2024-09-10T14:28:49.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:49.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee9a00 con 0x55dac7eda770 2024-09-10T14:28:49.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.319+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94398145540096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee9a00 con 0x55dac7eda770 2024-09-10T14:28:49.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94398145540096] v33'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3dccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 5 note: GC not initialized 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3d477fe640 20 reqs_thread_entry: start 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 20 Filter name: none 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3d457fa640 20 reqs_thread_entry: start 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dac7f111b0 con 0x55dac7eda770 2024-09-10T14:28:49.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:49.329 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:49.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3dccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94398145540096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7f10100 con 0x55dac7eda770 2024-09-10T14:28:49.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94398145540096] v33'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.323+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94398145514064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eeb000 con 0x7f3f1006a020 2024-09-10T14:28:49.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.327+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94398145514064] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.327+0000 7f3f18a6e980 20 remove_watcher() i=0 2024-09-10T14:28:49.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.327+0000 7f3f18a6e980 2 removed watcher, disabling cache 2024-09-10T14:28:49.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.327+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94398145516848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eeb000 con 0x55dac7eda770 2024-09-10T14:28:49.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.327+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94398145516848] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.327+0000 7f3f18a6e980 20 remove_watcher() i=1 2024-09-10T14:28:49.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.327+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94398145518976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eeb000 con 0x55dac7edf110 2024-09-10T14:28:49.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f1657e640 1 -- 172.21.15.151:0/2107905930 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94398145518976] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f1002c070 con 0x55dac7edf110 2024-09-10T14:28:49.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f18a6e980 20 remove_watcher() i=2 2024-09-10T14:28:49.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94398145527312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee5d80 con 0x7f3f1006a020 2024-09-10T14:28:49.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f15d7d640 1 -- 172.21.15.151:0/2107905930 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94398145527312] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0c0c9030 con 0x7f3f1006a020 2024-09-10T14:28:49.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f18a6e980 20 remove_watcher() i=3 2024-09-10T14:28:49.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94398145530864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee5d80 con 0x55dac7eda770 2024-09-10T14:28:49.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94398145530864] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x55dac7eda770 2024-09-10T14:28:49.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f18a6e980 20 remove_watcher() i=4 2024-09-10T14:28:49.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.331+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94398145528368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee8bf0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.335+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94398145528368] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.335+0000 7f3f18a6e980 20 remove_watcher() i=5 2024-09-10T14:28:49.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.335+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94398145536480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7ee8bf0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.335+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94398145536480] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.335+0000 7f3f18a6e980 20 remove_watcher() i=6 2024-09-10T14:28:49.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.335+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94398145539040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dac7eea1e0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94398145539040] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f080083f0 con 0x7f3f0c0dc040 2024-09-10T14:28:49.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 20 remove_watcher() i=7 2024-09-10T14:28:49.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3f0c0dc040 msgr2=0x7f3f0c0dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3f0c0dc040 0x7f3f0c0dd430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7eda770 msgr2=0x55dac7edcc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7eda770 0x55dac7edcc10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3f1006a020 msgr2=0x7f3f100405e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3f1006a020 0x7f3f100405e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7edf110 msgr2=0x55dac7ee1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7edf110 0x55dac7ee1500 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de0034600 msgr2=0x7f3de0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de0034600 0x7f3de0036ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c000c10 tx=0x7f3f0c0b9040 comp rx=0 tx=0).stop 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 msgr2=0x55dac7ecf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2107905930 reap_dead start 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ecf6a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3f1004c040 tx=0x7f3f10039ef0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 shutdown_connections 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2107905930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ec8560 0x55dac7ecf6a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 >> 172.21.15.151:0/2107905930 conn(0x55dac7ec4890 msgr2=0x55dac7ec2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 shutdown_connections 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2107905930 wait complete. 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2068779470 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df0034650 msgr2=0x7f3df0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2068779470 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df0034650 0x7f3df0036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55dac7ea5820 tx=0x7f3f0c005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2068779470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ebbb80 msgr2=0x55dac7ebbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2068779470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ebbb80 0x55dac7ebbfa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3f100475c0 tx=0x7f3f10023ac0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2068779470 shutdown_connections 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2068779470 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df0034650 0x7f3df0036b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2068779470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7ebbb80 0x55dac7ebbfa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2068779470 >> 172.21.15.151:0/2068779470 conn(0x55dac7eb0cd0 msgr2=0x55dac7eb3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2068779470 shutdown_connections 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2068779470 wait complete. 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dac7eab5c0 msgr2=0x55dac7ead9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dac7eab5c0 0x55dac7ead9b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7dae8f0 msgr2=0x55dac7ea4ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dac7dae8f0 0x55dac7ea4ea0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7ea7680 msgr2=0x55dac7ea9a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dac7ea7680 0x55dac7ea9a70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dfc034650 msgr2=0x7f3dfc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dfc034650 0x7f3dfc036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0ad000 tx=0x7f3f0c0a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 msgr2=0x55dac7e9dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 --2- 172.21.15.151:0/2287795567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dac7daa570 0x55dac7e9dda0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3f10000f90 tx=0x7f3f10001260 comp rx=0 tx=0).stop 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f16d7f640 1 -- 172.21.15.151:0/2287795567 reap_dead start 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 shutdown_connections 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 >> 172.21.15.151:0/2287795567 conn(0x55dac7da6090 msgr2=0x55dac7e90120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 shutdown_connections 2024-09-10T14:28:49.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.339+0000 7f3f18a6e980 1 -- 172.21.15.151:0/2287795567 wait complete. 2024-09-10T14:28:49.354 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:49.354 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T14:28:49.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T14:28:49.354 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T14:28:49.434 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:49.434 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:49.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73f1343980 1 Processor -- start 2024-09-10T14:28:49.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73f1343980 1 -- start start 2024-09-10T14:28:49.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73f1343980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55cec07ca290 0x55cec085a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73f1343980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cec06ddae0 con 0x55cec085ace0 2024-09-10T14:28:49.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73f1343980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55cec0701e30 con 0x55cec07ca290 2024-09-10T14:28:49.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73eee53640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55cec07ca290 0x55cec085a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73ee652640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55cec085ace0 0x55cec085d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34152/0 (socket says 172.21.15.151:34152) 2024-09-10T14:28:49.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73eee53640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55cec07ca290 0x55cec085a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41294/0 (socket says 172.21.15.151:41294) 2024-09-10T14:28:49.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73ee652640 1 -- 172.21.15.151:0/3911390974 learned_addr learned my addr 172.21.15.151:0/3911390974 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73eee53640 1 -- 172.21.15.151:0/3911390974 >> v1:172.21.15.52:6789/0 conn(0x55cec085ace0 legacy=0x55cec085d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.431+0000 7f73eee53640 1 -- 172.21.15.151:0/3911390974 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec07ca670 con 0x55cec07ca290 2024-09-10T14:28:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73eee53640 1 --2- 172.21.15.151:0/3911390974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec085a7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f73e800a480 tx=0x7f73e801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3591579cdd7efb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73ede51640 1 -- 172.21.15.151:0/3911390974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80b0070 con 0x55cec07ca290 2024-09-10T14:28:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73ede51640 1 -- 172.21.15.151:0/3911390974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e80ab540 con 0x55cec07ca290 2024-09-10T14:28:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73ede51640 1 -- 172.21.15.151:0/3911390974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80ab840 con 0x55cec07ca290 2024-09-10T14:28:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73f1343980 1 -- 172.21.15.151:0/3911390974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 msgr2=0x55cec085a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73f1343980 1 --2- 172.21.15.151:0/3911390974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec085a7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f73e800a480 tx=0x7f73e801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73f1343980 1 -- 172.21.15.151:0/3911390974 shutdown_connections 2024-09-10T14:28:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73f1343980 1 --2- 172.21.15.151:0/3911390974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec085a7a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73f1343980 1 -- 172.21.15.151:0/3911390974 >> 172.21.15.151:0/3911390974 conn(0x55cec0850090 msgr2=0x55cec08524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73f1343980 1 -- 172.21.15.151:0/3911390974 shutdown_connections 2024-09-10T14:28:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.435+0000 7f73f1343980 1 -- 172.21.15.151:0/3911390974 wait complete. 2024-09-10T14:28:49.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.447+0000 7f73f1343980 1 Processor -- start 2024-09-10T14:28:49.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.447+0000 7f73f1343980 1 -- start start 2024-09-10T14:28:49.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.447+0000 7f73f1343980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0942cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.447+0000 7f73f1343980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cec0703200 con 0x55cec07ca290 2024-09-10T14:28:49.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0942cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0942cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41300/0 (socket says 172.21.15.151:41300) 2024-09-10T14:28:49.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 -- 172.21.15.151:0/1730732247 learned_addr learned my addr 172.21.15.151:0/1730732247 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 -- 172.21.15.151:0/1730732247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec0943280 con 0x55cec07ca290 2024-09-10T14:28:49.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 --2- 172.21.15.151:0/1730732247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0942cb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f73e8017e90 tx=0x7f73e8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefd9a205b30f62d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f72dbe17640 1 -- 172.21.15.151:0/1730732247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80b0070 con 0x55cec07ca290 2024-09-10T14:28:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f72dbe17640 1 -- 172.21.15.151:0/1730732247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e80b1040 con 0x55cec07ca290 2024-09-10T14:28:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f72dbe17640 1 -- 172.21.15.151:0/1730732247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80ab6f0 con 0x55cec07ca290 2024-09-10T14:28:49.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 -- 172.21.15.151:0/1730732247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 msgr2=0x55cec0942cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 --2- 172.21.15.151:0/1730732247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0942cb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f73e8017e90 tx=0x7f73e8003030 comp rx=0 tx=0).stop 2024-09-10T14:28:49.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 -- 172.21.15.151:0/1730732247 shutdown_connections 2024-09-10T14:28:49.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 --2- 172.21.15.151:0/1730732247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0942cb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 -- 172.21.15.151:0/1730732247 >> 172.21.15.151:0/1730732247 conn(0x55cec0850090 msgr2=0x55cec093e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 -- 172.21.15.151:0/1730732247 shutdown_connections 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 -- 172.21.15.151:0/1730732247 wait complete. 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 Processor -- start 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 -- start start 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0949f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73f1343980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cec0861220 con 0x55cec07ca290 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0949f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0949f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41316/0 (socket says 172.21.15.151:41316) 2024-09-10T14:28:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 -- 172.21.15.151:0/2024728212 learned_addr learned my addr 172.21.15.151:0/2024728212 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 -- 172.21.15.151:0/2024728212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec094a4a0 con 0x55cec07ca290 2024-09-10T14:28:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.451+0000 7f73eee53640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0949f60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f73e801b760 tx=0x7f73e8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f72da614640 1 -- 172.21.15.151:0/2024728212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80b7480 con 0x55cec07ca290 2024-09-10T14:28:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f72da614640 1 -- 172.21.15.151:0/2024728212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e80b7620 con 0x55cec07ca290 2024-09-10T14:28:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cec094a730 con 0x55cec07ca290 2024-09-10T14:28:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f72da614640 1 -- 172.21.15.151:0/2024728212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80b7900 con 0x55cec07ca290 2024-09-10T14:28:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec094d410 con 0x55cec07ca290 2024-09-10T14:28:49.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f72da614640 1 -- 172.21.15.151:0/2024728212 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73e80b7aa0 con 0x55cec07ca290 2024-09-10T14:28:49.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f72da614640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72d4034650 0x7f72d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f72da614640 1 -- 172.21.15.151:0/2024728212 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f73e80bc070 con 0x55cec07ca290 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73ee652640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72d4034650 0x7f72d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73f1343980 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec085ace0 0x55cec0950ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec09514c0 con 0x55cec085ace0 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73ef654640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec085ace0 0x55cec0950ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73ee652640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72d4034650 0x7f72d4036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73d80012f0 tx=0x7f73d8006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73ef654640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec085ace0 0x55cec0950ef0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73ef654640 1 -- 172.21.15.151:0/2024728212 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec085ace0 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec094e630 con 0x55cec085ace0 2024-09-10T14:28:49.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73ef654640 1 -- 172.21.15.151:0/2024728212 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec085ace0 2024-09-10T14:28:49.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73f1343980 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec0953840 0x55cec0955c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec0956300 con 0x55cec0953840 2024-09-10T14:28:49.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73eee53640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec0953840 0x55cec0955c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73eee53640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec0953840 0x55cec0955c30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73eee53640 1 -- 172.21.15.151:0/2024728212 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73e80d1070 con 0x55cec0953840 2024-09-10T14:28:49.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.455+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec09526e0 con 0x55cec085ace0 2024-09-10T14:28:49.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73ef654640 1 -- 172.21.15.151:0/2024728212 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec085ace0 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73f1343980 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55cec0957760 0x55cec0959b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec095a250 con 0x55cec0957760 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73ee652640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55cec0957760 0x55cec0959b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73ee652640 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55cec0957760 0x55cec0959b50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73ee652640 1 -- 172.21.15.151:0/2024728212 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f73d800f070 con 0x55cec0957760 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73f1343980 1 Processor -- start 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73f1343980 1 -- start start 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73f1343980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0967d20 0x55cec0968140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73f1343980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cec075c800 con 0x55cec0967d20 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0967d20 0x55cec0968140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0967d20 0x55cec0968140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41330/0 (socket says 172.21.15.151:41330) 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73eee53640 1 -- 172.21.15.151:0/1399200947 learned_addr learned my addr 172.21.15.151:0/1399200947 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73eee53640 1 -- 172.21.15.151:0/1399200947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec0968680 con 0x55cec0967d20 2024-09-10T14:28:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73eee53640 1 --2- 172.21.15.151:0/1399200947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0967d20 0x55cec0968140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f73e80e32f0 tx=0x7f73e80aad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f72d37fe640 1 -- 172.21.15.151:0/1399200947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80bed60 con 0x55cec0967d20 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f73f1343980 1 -- 172.21.15.151:0/1399200947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cec0968910 con 0x55cec0967d20 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f72d37fe640 1 -- 172.21.15.151:0/1399200947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e80cbae0 con 0x55cec0967d20 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.459+0000 7f72d37fe640 1 -- 172.21.15.151:0/1399200947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80cbde0 con 0x55cec0967d20 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 -- 172.21.15.151:0/1399200947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec0968910 con 0x55cec0967d20 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f72d37fe640 1 -- 172.21.15.151:0/1399200947 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73e80aa3b0 con 0x55cec0967d20 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f72d37fe640 1 --2- 172.21.15.151:0/1399200947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72c8034650 0x7f72c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f72d37fe640 1 -- 172.21.15.151:0/1399200947 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f73e80a8070 con 0x55cec0967d20 2024-09-10T14:28:49.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73ee652640 1 --2- 172.21.15.151:0/1399200947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72c8034650 0x7f72c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 Processor -- start 2024-09-10T14:28:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 -- start start 2024-09-10T14:28:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73ee652640 1 --2- 172.21.15.151:0/1399200947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72c8034650 0x7f72c8036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55cec0951df0 tx=0x7f73d800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec0974870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cec0943540 con 0x55cec0974470 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec0974870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec0974870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41334/0 (socket says 172.21.15.151:41334) 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73eee53640 1 -- 172.21.15.151:0/1182536404 learned_addr learned my addr 172.21.15.151:0/1182536404 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73eee53640 1 -- 172.21.15.151:0/1182536404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec0974e40 con 0x55cec0974470 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73eee53640 1 --2- 172.21.15.151:0/1182536404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec0974870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f73e80cae80 tx=0x7f73e80b9e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170bc4e22f272a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f72d17fa640 1 -- 172.21.15.151:0/1182536404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80cb030 con 0x55cec0974470 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f72d17fa640 1 -- 172.21.15.151:0/1182536404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e80fe030 con 0x55cec0974470 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f72d17fa640 1 -- 172.21.15.151:0/1182536404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80be730 con 0x55cec0974470 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 -- 172.21.15.151:0/1182536404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 msgr2=0x55cec0974870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 --2- 172.21.15.151:0/1182536404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec0974870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f73e80cae80 tx=0x7f73e80b9e50 comp rx=0 tx=0).stop 2024-09-10T14:28:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 -- 172.21.15.151:0/1182536404 shutdown_connections 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 --2- 172.21.15.151:0/1182536404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec0974870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.463+0000 7f73f1343980 1 -- 172.21.15.151:0/1182536404 >> 172.21.15.151:0/1182536404 conn(0x55cec0970800 msgr2=0x55cec096e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 -- 172.21.15.151:0/1182536404 shutdown_connections 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 -- 172.21.15.151:0/1182536404 wait complete. 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 Processor -- start 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 -- start start 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec097b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cec0975390 con 0x55cec0974470 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec097b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73eee53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec097b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41340/0 (socket says 172.21.15.151:41340) 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 learned_addr learned my addr 172.21.15.151:0/38964048 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec097bb30 con 0x55cec0974470 2024-09-10T14:28:49.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73eee53640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec097b5f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f73e80aa920 tx=0x7f73e80ddee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f72bf7fe640 1 -- 172.21.15.151:0/38964048 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80cb170 con 0x55cec0974470 2024-09-10T14:28:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cec097bb30 con 0x55cec0974470 2024-09-10T14:28:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f72bf7fe640 1 -- 172.21.15.151:0/38964048 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e80ee430 con 0x55cec0974470 2024-09-10T14:28:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec097bb30 con 0x55cec0974470 2024-09-10T14:28:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f72bf7fe640 1 -- 172.21.15.151:0/38964048 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73e80ee750 con 0x55cec0974470 2024-09-10T14:28:49.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f72bf7fe640 1 -- 172.21.15.151:0/38964048 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73e80ad970 con 0x55cec0974470 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f72bf7fe640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72b8034650 0x7f72b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f72bf7fe640 1 -- 172.21.15.151:0/38964048 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f73e810b070 con 0x55cec0974470 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73ee652640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72b8034650 0x7f72b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec0986750 0x55cec0988bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec0989340 con 0x55cec0986750 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.467+0000 7f73ef654640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec0986750 0x55cec0988bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ee652640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72b8034650 0x7f72b8036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73d80062e0 tx=0x7f73d8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ef654640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec0986750 0x55cec0988bf0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 realm 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec0989750 con 0x55cec0986750 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec0989ff0 con 0x55cec0986750 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec098b0f0 0x55cec098d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec098db30 con 0x55cec098b0f0 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73eee53640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec098b0f0 0x55cec098d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73eee53640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec098b0f0 0x55cec098d4e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f73e8115020 con 0x55cec098b0f0 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 20 searching for the correct realm 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098f390 con 0x55cec098b0f0 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e8115020 con 0x55cec098b0f0 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73eee53640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f73e80ab030 0x7f73e80db910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098f390 con 0x7f73e80ab030 2024-09-10T14:28:49.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ee652640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f73e80ab030 0x7f73e80db910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ee652640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f73e80ab030 0x7f73e80db910 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73d800f070 con 0x7f73e80ab030 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ee652640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73d8024070 0x7f73d8031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098f390 con 0x7f73d8024070 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.471+0000 7f73ef654640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73d8024070 0x7f73d8031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73d8024070 0x7f73d8031460 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73d8024070 2024-09-10T14:28:49.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73d8024070 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73e80ab030 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73d800f070 con 0x7f73e80ab030 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec098b0f0 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e8115020 con 0x55cec098b0f0 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.475+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73d8024070 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73e80ab030 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec098b0f0 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f73e8115020 con 0x55cec098b0f0 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec098b0f0 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e8115020 con 0x55cec098b0f0 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73d8024070 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec098b0f0 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e8115020 con 0x55cec098b0f0 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec098b0f0 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e8115020 con 0x55cec098b0f0 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73d8024070 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.479+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec098b0f0 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e8131040 con 0x55cec098b0f0 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73e80ab030 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73d8024070 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec098b0f0 2024-09-10T14:28:49.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e8131040 con 0x55cec098b0f0 2024-09-10T14:28:49.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73d8024070 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73e80ab030 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec098b0f0 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e8131040 con 0x55cec098b0f0 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73d8024070 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x55cec0986750 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.483+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cec098a390 con 0x7f73e80ab030 2024-09-10T14:28:49.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec098e4b0 con 0x55cec0986750 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec098ed00 con 0x55cec0986750 2024-09-10T14:28:49.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec098e110 con 0x7f73d8024070 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 zone default found 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 4 Realm: () 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 zonegroup default 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec098f260 con 0x7f73d8024070 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec09911a0 con 0x55cec098b0f0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73e8131040 con 0x55cec098b0f0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec0991680 con 0x55cec098b0f0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73e8131040 con 0x55cec098b0f0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 started sync module instance, tier type = 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0990640 con 0x7f73e80ab030 2024-09-10T14:28:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94346482879024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec09902a0 con 0x7f73e80ab030 2024-09-10T14:28:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.487+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec09925b0 con 0x55cec0986750 2024-09-10T14:28:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.491+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94346482879024] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.491+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.491+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94346482884864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec09929d0 con 0x55cec0986750 2024-09-10T14:28:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.491+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0993260 con 0x55cec098b0f0 2024-09-10T14:28:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.495+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e8131040 con 0x55cec098b0f0 2024-09-10T14:28:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.495+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94346482887424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0993b00 con 0x55cec098b0f0 2024-09-10T14:28:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.495+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0994500 con 0x7f73e80ab030 2024-09-10T14:28:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.495+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94346482884864] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.495+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.495+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94346482885920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0994dd0 con 0x7f73e80ab030 2024-09-10T14:28:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.495+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0995660 con 0x55cec0986750 2024-09-10T14:28:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.495+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94346482887424] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e8131040 con 0x55cec098b0f0 2024-09-10T14:28:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.499+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.499+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94346482890320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0995a50 con 0x55cec0986750 2024-09-10T14:28:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.499+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0996410 con 0x7f73d8024070 2024-09-10T14:28:49.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.499+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94346482885920] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.499+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.499+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94346482895136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0996410 con 0x7f73d8024070 2024-09-10T14:28:49.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.499+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0996dd0 con 0x7f73d8024070 2024-09-10T14:28:49.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.503+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94346482895136] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94346482890320] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94346482900832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0996380 con 0x7f73d8024070 2024-09-10T14:28:49.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0997280 con 0x7f73d8024070 2024-09-10T14:28:49.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94346482904528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec09976a0 con 0x7f73d8024070 2024-09-10T14:28:49.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 20 add_watcher() i=0 2024-09-10T14:28:49.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 20 add_watcher() i=1 2024-09-10T14:28:49.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 20 add_watcher() i=2 2024-09-10T14:28:49.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 20 add_watcher() i=3 2024-09-10T14:28:49.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 20 add_watcher() i=4 2024-09-10T14:28:49.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 20 add_watcher() i=5 2024-09-10T14:28:49.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94346482900832] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.507+0000 7f73f1343980 20 add_watcher() i=6 2024-09-10T14:28:49.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94346482904528] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 20 add_watcher() i=7 2024-09-10T14:28:49.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:49.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec0996920 con 0x55cec0986750 2024-09-10T14:28:49.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94346482903328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0997ae0 con 0x55cec0986750 2024-09-10T14:28:49.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94346482903328] v33'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f729f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 5 note: GC not initialized 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f729e7fc640 20 reqs_thread_entry: start 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 20 Filter name: none 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f720ffff640 20 reqs_thread_entry: start 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec09bdc00 con 0x55cec0986750 2024-09-10T14:28:49.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:49.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:49.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:49.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec09bd720 con 0x7f73e80ab030 2024-09-10T14:28:49.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.511+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec09c4200 con 0x55cec0986750 2024-09-10T14:28:49.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v33'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73f1343980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:49.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73f1343980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73f1343980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:49.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94346483088528 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cec09bf820 con 0x55cec0986750 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 94346482890320 notify 141733920770 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f73e0010040 con 0x55cec0986750 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f72d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94346482890320 notifier 4323 bl.length()=567 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f72d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f72d17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(65 notify.4 [notify cookie 94346483088528 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f72d17fa640 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f72b0003eb0 con 0x55cec0986750 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 94346483088528 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f73e000be30 con 0x55cec0986750 2024-09-10T14:28:49.520 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:49.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f729f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94346482903328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec09bf820 con 0x55cec0986750 2024-09-10T14:28:49.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94346482903328] v33'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.515+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94346482879024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec09bf7f0 con 0x7f73e80ab030 2024-09-10T14:28:49.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.519+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94346482879024] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.519+0000 7f73f1343980 20 remove_watcher() i=0 2024-09-10T14:28:49.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.519+0000 7f73f1343980 2 removed watcher, disabling cache 2024-09-10T14:28:49.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.519+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94346482884864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec09bf7f0 con 0x55cec0986750 2024-09-10T14:28:49.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.519+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94346482884864] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.519+0000 7f73f1343980 20 remove_watcher() i=1 2024-09-10T14:28:49.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.519+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94346482887424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0990a30 con 0x55cec098b0f0 2024-09-10T14:28:49.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73eee53640 1 -- 172.21.15.151:0/38964048 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94346482887424] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e8131040 con 0x55cec098b0f0 2024-09-10T14:28:49.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73f1343980 20 remove_watcher() i=2 2024-09-10T14:28:49.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94346482885920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0992100 con 0x7f73e80ab030 2024-09-10T14:28:49.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73ee652640 1 -- 172.21.15.151:0/38964048 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94346482885920] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73d8040040 con 0x7f73e80ab030 2024-09-10T14:28:49.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73f1343980 20 remove_watcher() i=3 2024-09-10T14:28:49.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94346482890320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0990a30 con 0x55cec0986750 2024-09-10T14:28:49.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94346482890320] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x55cec0986750 2024-09-10T14:28:49.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73f1343980 20 remove_watcher() i=4 2024-09-10T14:28:49.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.523+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94346482895136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0990a30 con 0x7f73d8024070 2024-09-10T14:28:49.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.527+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94346482895136] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.527+0000 7f73f1343980 20 remove_watcher() i=5 2024-09-10T14:28:49.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.527+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94346482900832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0994920 con 0x7f73d8024070 2024-09-10T14:28:49.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.527+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94346482900832] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.527+0000 7f73f1343980 20 remove_watcher() i=6 2024-09-10T14:28:49.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.527+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94346482904528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cec0990a30 con 0x7f73d8024070 2024-09-10T14:28:49.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94346482904528] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73e00083f0 con 0x7f73d8024070 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 20 remove_watcher() i=7 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73d8024070 msgr2=0x7f73d8031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73d8024070 0x7f73d8031460 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec0986750 msgr2=0x55cec0988bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec0986750 0x55cec0988bf0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f73e80ab030 msgr2=0x7f73e80db910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f73e80ab030 0x7f73e80db910 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec098b0f0 msgr2=0x55cec098d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec098b0f0 0x55cec098d4e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72b8034650 msgr2=0x7f72b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72b8034650 0x7f72b8036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73d80062e0 tx=0x7f73d8010000 comp rx=0 tx=0).stop 2024-09-10T14:28:49.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 msgr2=0x55cec097b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/38964048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0974470 0x55cec097b5f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f73e80aa920 tx=0x7f73e80ddee0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 reap_dead start 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73ef654640 1 -- 172.21.15.151:0/38964048 reap_dead start 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 shutdown_connections 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 >> 172.21.15.151:0/38964048 conn(0x55cec0970800 msgr2=0x55cec096e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 shutdown_connections 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/38964048 wait complete. 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/1399200947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72c8034650 msgr2=0x7f72c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/1399200947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72c8034650 0x7f72c8036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55cec0951df0 tx=0x7f73d800f000 comp rx=0 tx=0).stop 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/1399200947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0967d20 msgr2=0x55cec0968140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/1399200947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0967d20 0x55cec0968140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f73e80e32f0 tx=0x7f73e80aad60 comp rx=0 tx=0).stop 2024-09-10T14:28:49.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/1399200947 shutdown_connections 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/1399200947 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72c8034650 0x7f72c8036b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/1399200947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec0967d20 0x55cec0968140 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/1399200947 >> 172.21.15.151:0/1399200947 conn(0x55cec095ce70 msgr2=0x55cec095f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/1399200947 shutdown_connections 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/1399200947 wait complete. 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55cec0957760 msgr2=0x55cec0959b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55cec0957760 0x55cec0959b50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec085ace0 msgr2=0x55cec0950ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55cec085ace0 0x55cec0950ef0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec0953840 msgr2=0x55cec0955c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55cec0953840 0x55cec0955c30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72d4034650 msgr2=0x7f72d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f72d4034650 0x7f72d4036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73d80012f0 tx=0x7f73d8006700 comp rx=0 tx=0).stop 2024-09-10T14:28:49.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 msgr2=0x55cec0949f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 --2- 172.21.15.151:0/2024728212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cec07ca290 0x55cec0949f60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f73e801b760 tx=0x7f73e8018020 comp rx=0 tx=0).stop 2024-09-10T14:28:49.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73ef654640 1 -- 172.21.15.151:0/2024728212 reap_dead start 2024-09-10T14:28:49.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 shutdown_connections 2024-09-10T14:28:49.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 >> 172.21.15.151:0/2024728212 conn(0x55cec0850090 msgr2=0x55cec093d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 shutdown_connections 2024-09-10T14:28:49.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.531+0000 7f73f1343980 1 -- 172.21.15.151:0/2024728212 wait complete. 2024-09-10T14:28:49.546 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:49.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:28:49.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:28:49.546 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:28:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d3cec980 1 Processor -- start 2024-09-10T14:28:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d3cec980 1 -- start start 2024-09-10T14:28:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d3cec980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e8f24a6570 0x55e8f24a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d3cec980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e8f232fae0 con 0x55e8f24a6ec0 2024-09-10T14:28:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d3cec980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55e8f2353e30 con 0x55e8f24a6570 2024-09-10T14:28:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d17fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e8f24a6570 0x55e8f24a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d0ffb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55e8f24a6ec0 0x55e8f24ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34162/0 (socket says 172.21.15.151:34162) 2024-09-10T14:28:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d0ffb640 1 -- 172.21.15.151:0/1470639203 learned_addr learned my addr 172.21.15.151:0/1470639203 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d17fc640 1 -- 172.21.15.151:0/1470639203 >> v1:172.21.15.52:6789/0 conn(0x55e8f24a6ec0 legacy=0x55e8f24ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.619+0000 7f79d17fc640 1 -- 172.21.15.151:0/1470639203 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f24ae140 con 0x55e8f24a6570 2024-09-10T14:28:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79d17fc640 1 --2- 172.21.15.151:0/1470639203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f24a6950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f79c400a480 tx=0x7f79c401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80711612ff3692d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79c3fff640 1 -- 172.21.15.151:0/1470639203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40b0070 con 0x55e8f24a6570 2024-09-10T14:28:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79c3fff640 1 -- 172.21.15.151:0/1470639203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c40ab540 con 0x55e8f24a6570 2024-09-10T14:28:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79c3fff640 1 -- 172.21.15.151:0/1470639203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40ab840 con 0x55e8f24a6570 2024-09-10T14:28:49.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79d3cec980 1 -- 172.21.15.151:0/1470639203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 msgr2=0x55e8f24a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79d3cec980 1 --2- 172.21.15.151:0/1470639203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f24a6950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f79c400a480 tx=0x7f79c401b280 comp rx=0 tx=0).stop 2024-09-10T14:28:49.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79d3cec980 1 -- 172.21.15.151:0/1470639203 shutdown_connections 2024-09-10T14:28:49.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79d3cec980 1 --2- 172.21.15.151:0/1470639203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f24a6950 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79d3cec980 1 -- 172.21.15.151:0/1470639203 >> 172.21.15.151:0/1470639203 conn(0x55e8f24a2090 msgr2=0x55e8f24a44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79d3cec980 1 -- 172.21.15.151:0/1470639203 shutdown_connections 2024-09-10T14:28:49.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.623+0000 7f79d3cec980 1 -- 172.21.15.151:0/1470639203 wait complete. 2024-09-10T14:28:49.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d3cec980 1 Processor -- start 2024-09-10T14:28:49.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d3cec980 1 -- start start 2024-09-10T14:28:49.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d3cec980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f2591930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d3cec980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e8f2355200 con 0x55e8f24a6570 2024-09-10T14:28:49.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f2591930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f2591930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41350/0 (socket says 172.21.15.151:41350) 2024-09-10T14:28:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d17fc640 1 -- 172.21.15.151:0/2179725926 learned_addr learned my addr 172.21.15.151:0/2179725926 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d17fc640 1 -- 172.21.15.151:0/2179725926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f2591f00 con 0x55e8f24a6570 2024-09-10T14:28:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f79d17fc640 1 --2- 172.21.15.151:0/2179725926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f2591930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f79c40ae040 tx=0x7f79c4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8bd9c786e17bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f78bf606640 1 -- 172.21.15.151:0/2179725926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40b0040 con 0x55e8f24a6570 2024-09-10T14:28:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f78bf606640 1 -- 172.21.15.151:0/2179725926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c40ab9b0 con 0x55e8f24a6570 2024-09-10T14:28:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.635+0000 7f78bf606640 1 -- 172.21.15.151:0/2179725926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40abc90 con 0x55e8f24a6570 2024-09-10T14:28:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- 172.21.15.151:0/2179725926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 msgr2=0x55e8f2591930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2179725926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f2591930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f79c40ae040 tx=0x7f79c4003030 comp rx=0 tx=0).stop 2024-09-10T14:28:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- 172.21.15.151:0/2179725926 shutdown_connections 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2179725926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f2591930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- 172.21.15.151:0/2179725926 >> 172.21.15.151:0/2179725926 conn(0x55e8f24a2090 msgr2=0x55e8f258d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- 172.21.15.151:0/2179725926 shutdown_connections 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- 172.21.15.151:0/2179725926 wait complete. 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 Processor -- start 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- start start 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f241c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e8f24adb80 con 0x55e8f24a6570 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f241c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f241c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41364/0 (socket says 172.21.15.151:41364) 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d17fc640 1 -- 172.21.15.151:0/2792670662 learned_addr learned my addr 172.21.15.151:0/2792670662 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d17fc640 1 -- 172.21.15.151:0/2792670662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f259a700 con 0x55e8f24a6570 2024-09-10T14:28:49.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d17fc640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f241c370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f79c40030b0 tx=0x7f79c4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f78bde03640 1 -- 172.21.15.151:0/2792670662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40c5070 con 0x55e8f24a6570 2024-09-10T14:28:49.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8f259ed10 con 0x55e8f24a6570 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f78bde03640 1 -- 172.21.15.151:0/2792670662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c40b6970 con 0x55e8f24a6570 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f78bde03640 1 -- 172.21.15.151:0/2792670662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40b0050 con 0x55e8f24a6570 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f259f0c0 con 0x55e8f24a6570 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f78bde03640 1 -- 172.21.15.151:0/2792670662 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79c40c8070 con 0x55e8f24a6570 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f78bde03640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78b8034650 0x7f78b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f78bde03640 1 -- 172.21.15.151:0/2792670662 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f79c40bc070 con 0x55e8f24a6570 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78b8034650 0x7f78b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f24a6ec0 0x55e8f25a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25a3400 con 0x55e8f24a6ec0 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.639+0000 7f79d1ffd640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f24a6ec0 0x55e8f25a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78b8034650 0x7f78b8036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f79c8000f70 tx=0x7f79c80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d1ffd640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f24a6ec0 0x55e8f25a2de0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d1ffd640 1 -- 172.21.15.151:0/2792670662 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f24a6ec0 2024-09-10T14:28:49.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25a0390 con 0x55e8f24a6ec0 2024-09-10T14:28:49.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d1ffd640 1 -- 172.21.15.151:0/2792670662 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f24a6ec0 2024-09-10T14:28:49.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25a5750 0x55e8f25a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25a8210 con 0x55e8f25a5750 2024-09-10T14:28:49.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d17fc640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25a5750 0x55e8f25a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d17fc640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25a5750 0x55e8f25a7b40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d17fc640 1 -- 172.21.15.151:0/2792670662 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f79c40c7030 con 0x55e8f25a5750 2024-09-10T14:28:49.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25a45f0 con 0x55e8f24a6ec0 2024-09-10T14:28:49.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d1ffd640 1 -- 172.21.15.151:0/2792670662 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f24a6ec0 2024-09-10T14:28:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e8f25a9670 0x55e8f25aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25ac150 con 0x55e8f25a9670 2024-09-10T14:28:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e8f25a9670 0x55e8f25aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e8f25a9670 0x55e8f25aba60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d0ffb640 1 -- 172.21.15.151:0/2792670662 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f79c800e620 con 0x55e8f25a9670 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.643+0000 7f79d3cec980 1 Processor -- start 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 -- start start 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25b9c20 0x55e8f25ba040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e8f23ae800 con 0x55e8f25b9c20 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25b9c20 0x55e8f25ba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25b9c20 0x55e8f25ba040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41370/0 (socket says 172.21.15.151:41370) 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d17fc640 1 -- 172.21.15.151:0/3793856771 learned_addr learned my addr 172.21.15.151:0/3793856771 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d17fc640 1 -- 172.21.15.151:0/3793856771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f25ba580 con 0x55e8f25b9c20 2024-09-10T14:28:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d17fc640 1 --2- 172.21.15.151:0/3793856771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25b9c20 0x55e8f25ba040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79c40e1fa0 tx=0x7f79c40d1370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f78b6ffd640 1 -- 172.21.15.151:0/3793856771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40e8070 con 0x55e8f25b9c20 2024-09-10T14:28:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f78b6ffd640 1 -- 172.21.15.151:0/3793856771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c40cce30 con 0x55e8f25b9c20 2024-09-10T14:28:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 -- 172.21.15.151:0/3793856771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8f25ba810 con 0x55e8f25b9c20 2024-09-10T14:28:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f78b6ffd640 1 -- 172.21.15.151:0/3793856771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40d5040 con 0x55e8f25b9c20 2024-09-10T14:28:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 -- 172.21.15.151:0/3793856771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f25bd490 con 0x55e8f25b9c20 2024-09-10T14:28:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f78b6ffd640 1 -- 172.21.15.151:0/3793856771 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79c40eb070 con 0x55e8f25b9c20 2024-09-10T14:28:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f78b6ffd640 1 --2- 172.21.15.151:0/3793856771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78a8034650 0x7f78a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f78b6ffd640 1 -- 172.21.15.151:0/3793856771 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f79c40a8070 con 0x55e8f25b9c20 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/3793856771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78a8034650 0x7f78a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 Processor -- start 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 -- start start 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d3cec980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e8f25921c0 con 0x55e8f25c6550 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/3793856771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78a8034650 0x7f78a8036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55e8f25a3d00 tx=0x7f79c800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.647+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41384/0 (socket says 172.21.15.151:41384) 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 -- 172.21.15.151:0/3797654787 learned_addr learned my addr 172.21.15.151:0/3797654787 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 -- 172.21.15.151:0/3797654787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f25c6f20 con 0x55e8f25c6550 2024-09-10T14:28:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 --2- 172.21.15.151:0/3797654787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25c6950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79c40b4b90 tx=0x7f79c40d1fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5692722876c1189b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f78b4ff9640 1 -- 172.21.15.151:0/3797654787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c4101070 con 0x55e8f25c6550 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f78b4ff9640 1 -- 172.21.15.151:0/3797654787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c40d4e20 con 0x55e8f25c6550 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f78b4ff9640 1 -- 172.21.15.151:0/3797654787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c40f8040 con 0x55e8f25c6550 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- 172.21.15.151:0/3797654787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 msgr2=0x55e8f25c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 --2- 172.21.15.151:0/3797654787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25c6950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79c40b4b90 tx=0x7f79c40d1fa0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- 172.21.15.151:0/3797654787 shutdown_connections 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 --2- 172.21.15.151:0/3797654787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25c6950 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- 172.21.15.151:0/3797654787 >> 172.21.15.151:0/3797654787 conn(0x55e8f25c2930 msgr2=0x55e8f25c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- 172.21.15.151:0/3797654787 shutdown_connections 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- 172.21.15.151:0/3797654787 wait complete. 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 Processor -- start 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- start start 2024-09-10T14:28:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e8f25c73a0 con 0x55e8f25c6550 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41386/0 (socket says 172.21.15.151:41386) 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 learned_addr learned my addr 172.21.15.151:0/4019665704 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f25cdca0 con 0x55e8f25c6550 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d17fc640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25cd760 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79c40ff040 tx=0x7f79c40b1f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f78a6ffd640 1 -- 172.21.15.151:0/4019665704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c4109020 con 0x55e8f25c6550 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8f25cdca0 con 0x55e8f25c6550 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f25cdca0 con 0x55e8f25c6550 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f78a6ffd640 1 -- 172.21.15.151:0/4019665704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c40cc490 con 0x55e8f25c6550 2024-09-10T14:28:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.651+0000 7f78a6ffd640 1 -- 172.21.15.151:0/4019665704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c4101040 con 0x55e8f25c6550 2024-09-10T14:28:49.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f78a6ffd640 1 -- 172.21.15.151:0/4019665704 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79c410c020 con 0x55e8f25c6550 2024-09-10T14:28:49.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f78a6ffd640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f789c0345b0 0x7f789c036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f78a6ffd640 1 -- 172.21.15.151:0/4019665704 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f79c410fc60 con 0x55e8f25c6550 2024-09-10T14:28:49.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f789c0345b0 0x7f789c036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f25d87c0 0x55e8f25dac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25db3b0 con 0x55e8f25d87c0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d1ffd640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f25d87c0 0x55e8f25dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f789c0345b0 0x7f789c036a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79c800bf60 tx=0x7f79c8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d1ffd640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f25d87c0 0x55e8f25dac60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 realm 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25db7c0 con 0x55e8f25d87c0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:49.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc060 con 0x55e8f25d87c0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25dcf30 0x55e8f25df320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dfa60 con 0x55e8f25dcf30 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d17fc640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25dcf30 0x55e8f25df320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d17fc640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25dcf30 0x55e8f25df320 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 20 searching for the correct realm 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e1330 con 0x55e8f25dcf30 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d17fc640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f79c410e020 0x7f79c40c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e1330 con 0x7f79c410e020 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.655+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f79c410e020 0x7f79c40c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f79c410e020 0x7f79c40c04a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d0ffb640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f79c8037040 0x7f79c8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e1330 con 0x7f79c8037040 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f79c8037040 0x7f79c8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f79c8037040 0x7f79c8036410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c8037040 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c8037040 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c410e020 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25dcf30 2024-09-10T14:28:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.659+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c8037040 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c410e020 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25dcf30 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25dcf30 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c8037040 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25dcf30 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25dcf30 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c8037040 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.663+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25dcf30 2024-09-10T14:28:49.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c410e020 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c8037040 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25dcf30 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c8037040 2024-09-10T14:28:49.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c410e020 2024-09-10T14:28:49.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25dcf30 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c8037040 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x55e8f25d87c0 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.667+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25dc400 con 0x7f79c410e020 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e0450 con 0x55e8f25d87c0 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e0cf0 con 0x55e8f25d87c0 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e0090 con 0x7f79c8037040 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 zone default found 2024-09-10T14:28:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 4 Realm: () 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 zonegroup default 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e0840 con 0x7f79c8037040 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e0c60 con 0x55e8f25dcf30 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e31c0 con 0x55e8f25dcf30 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 started sync module instance, tier type = 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e2660 con 0x7f79c410e020 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94458987031088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e22c0 con 0x7f79c410e020 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.671+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e4030 con 0x55e8f25d87c0 2024-09-10T14:28:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.675+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94458987031088] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.675+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.675+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94458987035520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e3fa0 con 0x55e8f25d87c0 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.675+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e4e00 con 0x55e8f25dcf30 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94458987035520] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94458987038928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e51f0 con 0x55e8f25dcf30 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e5bb0 con 0x7f79c410e020 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94458987044768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e6870 con 0x7f79c410e020 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e7230 con 0x55e8f25d87c0 2024-09-10T14:28:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94458987038928] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94458987044768] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94458987037728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e7230 con 0x55e8f25d87c0 2024-09-10T14:28:49.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.679+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e7ad0 con 0x7f79c8037040 2024-09-10T14:28:49.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.683+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94458987037728] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.683+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.683+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94458987048592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e7800 con 0x7f79c8037040 2024-09-10T14:28:49.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.683+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e8320 con 0x7f79c8037040 2024-09-10T14:28:49.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94458987048592] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94458987052528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e82e0 con 0x7f79c8037040 2024-09-10T14:28:49.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e8d20 con 0x7f79c8037040 2024-09-10T14:28:49.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94458987052528] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94458987055088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e8ce0 con 0x7f79c8037040 2024-09-10T14:28:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 20 add_watcher() i=0 2024-09-10T14:28:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 20 add_watcher() i=1 2024-09-10T14:28:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 20 add_watcher() i=2 2024-09-10T14:28:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 20 add_watcher() i=3 2024-09-10T14:28:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 20 add_watcher() i=4 2024-09-10T14:28:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 20 add_watcher() i=5 2024-09-10T14:28:49.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.687+0000 7f79d3cec980 20 add_watcher() i=6 2024-09-10T14:28:49.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94458987055088] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 20 add_watcher() i=7 2024-09-10T14:28:49.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:49.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25ec1a0 con 0x55e8f25d87c0 2024-09-10T14:28:49.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94458987049648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e9690 con 0x55e8f25d87c0 2024-09-10T14:28:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94458987049648] v33'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f78877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 5 note: GC not initialized 2024-09-10T14:28:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f78867e4640 20 reqs_thread_entry: start 2024-09-10T14:28:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 20 Filter name: none 2024-09-10T14:28:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f77f7fff640 20 reqs_thread_entry: start 2024-09-10T14:28:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e8f260f2d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.691+0000 7f79d3cec980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:49.698 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.695+0000 7f78877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.695+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94458987049648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f260e220 con 0x55e8f25d87c0 2024-09-10T14:28:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.695+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94458987049648] v33'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.695+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94458987031088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e72b0 con 0x7f79c410e020 2024-09-10T14:28:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.695+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94458987031088] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.695+0000 7f79d3cec980 20 remove_watcher() i=0 2024-09-10T14:28:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.695+0000 7f79d3cec980 2 removed watcher, disabling cache 2024-09-10T14:28:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.695+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94458987035520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e72b0 con 0x55e8f25d87c0 2024-09-10T14:28:49.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94458987035520] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d3cec980 20 remove_watcher() i=1 2024-09-10T14:28:49.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94458987038928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e3b80 con 0x55e8f25dcf30 2024-09-10T14:28:49.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d17fc640 1 -- 172.21.15.151:0/4019665704 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94458987038928] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c40ea030 con 0x55e8f25dcf30 2024-09-10T14:28:49.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d3cec980 20 remove_watcher() i=2 2024-09-10T14:28:49.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94458987044768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e72b0 con 0x7f79c410e020 2024-09-10T14:28:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d0ffb640 1 -- 172.21.15.151:0/4019665704 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94458987044768] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79c800e620 con 0x7f79c410e020 2024-09-10T14:28:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d3cec980 20 remove_watcher() i=3 2024-09-10T14:28:49.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.699+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94458987037728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e48d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.703+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94458987037728] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x55e8f25d87c0 2024-09-10T14:28:49.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.703+0000 7f79d3cec980 20 remove_watcher() i=4 2024-09-10T14:28:49.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.703+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94458987048592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e3b80 con 0x7f79c8037040 2024-09-10T14:28:49.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.703+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94458987048592] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.703+0000 7f79d3cec980 20 remove_watcher() i=5 2024-09-10T14:28:49.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.703+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94458987052528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e5fa0 con 0x7f79c8037040 2024-09-10T14:28:49.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94458987052528] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 20 remove_watcher() i=6 2024-09-10T14:28:49.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94458987055088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e8f25e48d0 con 0x7f79c8037040 2024-09-10T14:28:49.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94458987055088] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f79cc00a4d0 con 0x7f79c8037040 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 20 remove_watcher() i=7 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f79c8037040 msgr2=0x7f79c8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f79c8037040 0x7f79c8036410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f25d87c0 msgr2=0x55e8f25dac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f25d87c0 0x55e8f25dac60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f79c410e020 msgr2=0x7f79c40c04a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f79c410e020 0x7f79c40c04a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25dcf30 msgr2=0x55e8f25df320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25dcf30 0x55e8f25df320 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f789c0345b0 msgr2=0x7f789c036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f789c0345b0 0x7f789c036a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79c800bf60 tx=0x7f79c8010000 comp rx=0 tx=0).stop 2024-09-10T14:28:49.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d1ffd640 1 -- 172.21.15.151:0/4019665704 reap_dead start 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 msgr2=0x55e8f25cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25cd760 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79c40ff040 tx=0x7f79c40b1f30 comp rx=0 tx=0).stop 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 shutdown_connections 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/4019665704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25c6550 0x55e8f25cd760 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 >> 172.21.15.151:0/4019665704 conn(0x55e8f25c2930 msgr2=0x55e8f25c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 shutdown_connections 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/4019665704 wait complete. 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/3793856771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78a8034650 msgr2=0x7f78a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/3793856771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78a8034650 0x7f78a8036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55e8f25a3d00 tx=0x7f79c800f000 comp rx=0 tx=0).stop 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/3793856771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25b9c20 msgr2=0x55e8f25ba040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/3793856771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25b9c20 0x55e8f25ba040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79c40e1fa0 tx=0x7f79c40d1370 comp rx=0 tx=0).stop 2024-09-10T14:28:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/3793856771 shutdown_connections 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/3793856771 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78a8034650 0x7f78a8036b10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 --2- 172.21.15.151:0/3793856771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f25b9c20 0x55e8f25ba040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/3793856771 >> 172.21.15.151:0/3793856771 conn(0x55e8f25aed70 msgr2=0x55e8f25b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/3793856771 shutdown_connections 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.707+0000 7f79d3cec980 1 -- 172.21.15.151:0/3793856771 wait complete. 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e8f25a9670 msgr2=0x55e8f25aba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e8f25a9670 0x55e8f25aba60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f24a6ec0 msgr2=0x55e8f25a2de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e8f24a6ec0 0x55e8f25a2de0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25a5750 msgr2=0x55e8f25a7b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e8f25a5750 0x55e8f25a7b40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78b8034650 msgr2=0x7f78b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f78b8034650 0x7f78b8036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f79c8000f70 tx=0x7f79c80012c0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 msgr2=0x55e8f241c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 --2- 172.21.15.151:0/2792670662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8f24a6570 0x55e8f241c370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f79c40030b0 tx=0x7f79c4018020 comp rx=0 tx=0).stop 2024-09-10T14:28:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d1ffd640 1 -- 172.21.15.151:0/2792670662 reap_dead start 2024-09-10T14:28:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 shutdown_connections 2024-09-10T14:28:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 >> 172.21.15.151:0/2792670662 conn(0x55e8f24a2090 msgr2=0x55e8f258c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 shutdown_connections 2024-09-10T14:28:49.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.711+0000 7f79d3cec980 1 -- 172.21.15.151:0/2792670662 wait complete. 2024-09-10T14:28:49.722 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:49.722 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T14:28:49.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T14:28:49.723 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-10T14:28:49.796 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:49.796 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:49.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.791+0000 7f5d9da6e980 1 Processor -- start 2024-09-10T14:28:49.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.791+0000 7f5d9da6e980 1 -- start start 2024-09-10T14:28:49.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.791+0000 7f5d9da6e980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557949fb6a60 0x557949fb8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.791+0000 7f5d9da6e980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557949e3aae0 con 0x557949f27230 2024-09-10T14:28:49.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.791+0000 7f5d9da6e980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x557949e5ee30 con 0x557949fb6a60 2024-09-10T14:28:49.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9ad7d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557949fb6a60 0x557949fb8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9b57e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x557949f27230 0x557949fb5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34170/0 (socket says 172.21.15.151:34170) 2024-09-10T14:28:49.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9ad7d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557949fb6a60 0x557949fb8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41396/0 (socket says 172.21.15.151:41396) 2024-09-10T14:28:49.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9b57e640 1 -- 172.21.15.151:0/1558300792 learned_addr learned my addr 172.21.15.151:0/1558300792 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:49.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/1558300792 >> v1:172.21.15.52:6789/0 conn(0x557949f27230 legacy=0x557949fb5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/1558300792 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557949f277c0 con 0x557949fb6a60 2024-09-10T14:28:49.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/1558300792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949fb6a60 0x557949fb8e50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000a480 tx=0x7f5d9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4695a67cfb756622 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9a57c640 1 -- 172.21.15.151:0/1558300792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d900b0070 con 0x557949fb6a60 2024-09-10T14:28:49.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9a57c640 1 -- 172.21.15.151:0/1558300792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d900ab540 con 0x557949fb6a60 2024-09-10T14:28:49.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9a57c640 1 -- 172.21.15.151:0/1558300792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d900ab840 con 0x557949fb6a60 2024-09-10T14:28:49.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1558300792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949fb6a60 msgr2=0x557949fb8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.795+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/1558300792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949fb6a60 0x557949fb8e50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000a480 tx=0x7f5d9001b280 comp rx=0 tx=0).stop 2024-09-10T14:28:49.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.799+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1558300792 shutdown_connections 2024-09-10T14:28:49.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.799+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/1558300792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949fb6a60 0x557949fb8e50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.799+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1558300792 >> 172.21.15.151:0/1558300792 conn(0x557949fad030 msgr2=0x557949faf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.799+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1558300792 shutdown_connections 2024-09-10T14:28:49.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.799+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1558300792 wait complete. 2024-09-10T14:28:49.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 Processor -- start 2024-09-10T14:28:49.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- start start 2024-09-10T14:28:49.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a09da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557949e60200 con 0x557949f27230 2024-09-10T14:28:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a09da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a09da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41410/0 (socket says 172.21.15.151:41410) 2024-09-10T14:28:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2706538364 learned_addr learned my addr 172.21.15.151:0/2706538364 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2706538364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55794a09e030 con 0x557949f27230 2024-09-10T14:28:49.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/2706538364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a09da60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c001d90 tx=0x7f5d8c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dd79acf14a12b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5c8960a640 1 -- 172.21.15.151:0/2706538364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c013030 con 0x557949f27230 2024-09-10T14:28:49.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5c8960a640 1 -- 172.21.15.151:0/2706538364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c00e690 con 0x557949f27230 2024-09-10T14:28:49.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5c8960a640 1 -- 172.21.15.151:0/2706538364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c00ea10 con 0x557949f27230 2024-09-10T14:28:49.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2706538364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 msgr2=0x55794a09da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2706538364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a09da60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c001d90 tx=0x7f5d8c001e80 comp rx=0 tx=0).stop 2024-09-10T14:28:49.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2706538364 shutdown_connections 2024-09-10T14:28:49.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2706538364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a09da60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2706538364 >> 172.21.15.151:0/2706538364 conn(0x557949fad030 msgr2=0x55794a099690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2706538364 shutdown_connections 2024-09-10T14:28:49.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2706538364 wait complete. 2024-09-10T14:28:49.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 Processor -- start 2024-09-10T14:28:49.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- start start 2024-09-10T14:28:49.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a0a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.811+0000 7f5d9da6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557949fb9ea0 con 0x557949f27230 2024-09-10T14:28:49.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a0a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a0a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41412/0 (socket says 172.21.15.151:41412) 2024-09-10T14:28:49.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9b57e640 1 -- 172.21.15.151:0/540692535 learned_addr learned my addr 172.21.15.151:0/540692535 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9b57e640 1 -- 172.21.15.151:0/540692535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55794a0a5370 con 0x557949f27230 2024-09-10T14:28:49.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a0a4e30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55794a09ec40 tx=0x7f5d8c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5c87e07640 1 -- 172.21.15.151:0/540692535 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c027070 con 0x557949f27230 2024-09-10T14:28:49.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55794a0a5600 con 0x557949f27230 2024-09-10T14:28:49.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55794a0a82e0 con 0x557949f27230 2024-09-10T14:28:49.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5c87e07640 1 -- 172.21.15.151:0/540692535 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c019900 con 0x557949f27230 2024-09-10T14:28:49.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5c87e07640 1 -- 172.21.15.151:0/540692535 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c019be0 con 0x557949f27230 2024-09-10T14:28:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5c87e07640 1 -- 172.21.15.151:0/540692535 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d8c02a070 con 0x557949f27230 2024-09-10T14:28:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5c87e07640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c800346a0 0x7f5c80036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5c87e07640 1 -- 172.21.15.151:0/540692535 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f5d8c01f070 con 0x557949f27230 2024-09-10T14:28:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c800346a0 0x7f5c80036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557949fb6a60 0x55794a0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ac430 con 0x557949fb6a60 2024-09-10T14:28:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9bd7f640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557949fb6a60 0x55794a0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c800346a0 0x7f5c80036b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d900ad000 tx=0x7f5d900a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9bd7f640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557949fb6a60 0x55794a0abe40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/540692535 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x557949fb6a60 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.815+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0a9500 con 0x557949fb6a60 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/540692535 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d9400a4d0 con 0x557949fb6a60 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0ae780 0x55794a0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0b1240 con 0x55794a0ae780 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0ae780 0x55794a0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0ae780 0x55794a0b0b70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9b57e640 1 -- 172.21.15.151:0/540692535 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d8c029030 con 0x55794a0ae780 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ad5f0 con 0x557949fb6a60 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/540692535 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d9400a4d0 con 0x557949fb6a60 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55794a0b2680 0x55794a0b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0b51e0 con 0x55794a0b2680 2024-09-10T14:28:49.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55794a0b2680 0x55794a0b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55794a0b2680 0x55794a0b4a70 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/540692535 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d900b3040 con 0x55794a0b2680 2024-09-10T14:28:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 Processor -- start 2024-09-10T14:28:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 -- start start 2024-09-10T14:28:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0c2c70 0x55794a0c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9da6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557949eb9800 con 0x55794a0c2c70 2024-09-10T14:28:49.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0c2c70 0x55794a0c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0c2c70 0x55794a0c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41422/0 (socket says 172.21.15.151:41422) 2024-09-10T14:28:49.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.819+0000 7f5d9b57e640 1 -- 172.21.15.151:0/1508803312 learned_addr learned my addr 172.21.15.151:0/1508803312 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9b57e640 1 -- 172.21.15.151:0/1508803312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55794a0c35d0 con 0x55794a0c2c70 2024-09-10T14:28:49.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/1508803312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0c2c70 0x55794a0c3090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c048370 tx=0x7f5d8c02aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5c85602640 1 -- 172.21.15.151:0/1508803312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c04d070 con 0x55794a0c2c70 2024-09-10T14:28:49.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5c85602640 1 -- 172.21.15.151:0/1508803312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c045420 con 0x55794a0c2c70 2024-09-10T14:28:49.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5c85602640 1 -- 172.21.15.151:0/1508803312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c02bde0 con 0x55794a0c2c70 2024-09-10T14:28:49.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1508803312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55794a0c3860 con 0x55794a0c2c70 2024-09-10T14:28:49.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1508803312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55794a0c64e0 con 0x55794a0c2c70 2024-09-10T14:28:49.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5c85602640 1 -- 172.21.15.151:0/1508803312 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d8c050070 con 0x55794a0c2c70 2024-09-10T14:28:49.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5c85602640 1 --2- 172.21.15.151:0/1508803312 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c74034650 0x7f5c74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5c85602640 1 -- 172.21.15.151:0/1508803312 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f5d8c014070 con 0x55794a0c2c70 2024-09-10T14:28:49.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/1508803312 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c74034650 0x7f5c74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9da6e980 1 Processor -- start 2024-09-10T14:28:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9da6e980 1 -- start start 2024-09-10T14:28:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/1508803312 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c74034650 0x7f5c74036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5d9001b2c0 tx=0x7f5d90005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9da6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9da6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55794a09e3b0 con 0x55794a0cf610 2024-09-10T14:28:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41432/0 (socket says 172.21.15.151:41432) 2024-09-10T14:28:49.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2537214575 learned_addr learned my addr 172.21.15.151:0/2537214575 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.823+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2537214575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55794a0cffe0 con 0x55794a0cf610 2024-09-10T14:28:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/2537214575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0cfa10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c01bfd0 tx=0x7f5d8c048ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf0ed511d1922a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5c7effd640 1 -- 172.21.15.151:0/2537214575 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c066070 con 0x55794a0cf610 2024-09-10T14:28:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5c7effd640 1 -- 172.21.15.151:0/2537214575 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c016bd0 con 0x55794a0cf610 2024-09-10T14:28:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5c7effd640 1 -- 172.21.15.151:0/2537214575 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c05d040 con 0x55794a0cf610 2024-09-10T14:28:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2537214575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 msgr2=0x55794a0cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2537214575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0cfa10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c01bfd0 tx=0x7f5d8c048ba0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2537214575 shutdown_connections 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2537214575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0cfa10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2537214575 >> 172.21.15.151:0/2537214575 conn(0x55794a0cb9f0 msgr2=0x55794a0c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2537214575 shutdown_connections 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2537214575 wait complete. 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 Processor -- start 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- start start 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0d67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55794a0d0460 con 0x55794a0cf610 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0d67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9b57e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0d67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41444/0 (socket says 172.21.15.151:41444) 2024-09-10T14:28:49.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 learned_addr learned my addr 172.21.15.151:0/2333733759 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55794a0d6d10 con 0x55794a0cf610 2024-09-10T14:28:49.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0d67d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00dfd0 tx=0x7f5d8c036e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5c7d7fa640 1 -- 172.21.15.151:0/2333733759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c06e020 con 0x55794a0cf610 2024-09-10T14:28:49.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55794a0d6d10 con 0x55794a0cf610 2024-09-10T14:28:49.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5c7d7fa640 1 -- 172.21.15.151:0/2333733759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c022540 con 0x55794a0cf610 2024-09-10T14:28:49.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55794a0d6d10 con 0x55794a0cf610 2024-09-10T14:28:49.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.827+0000 7f5c7d7fa640 1 -- 172.21.15.151:0/2333733759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d8c066040 con 0x55794a0cf610 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5c7d7fa640 1 -- 172.21.15.151:0/2333733759 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5d8c071020 con 0x55794a0cf610 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5c7d7fa640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c64034650 0x7f5c64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5c7d7fa640 1 -- 172.21.15.151:0/2333733759 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f5d8c005050 con 0x55794a0cf610 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c64034650 0x7f5c64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55794a0e18b0 0x55794a0e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e44a0 con 0x55794a0e18b0 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9bd7f640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55794a0e18b0 0x55794a0e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c64034650 0x7f5c64036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d900abaa0 tx=0x7f5d900b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9bd7f640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55794a0e18b0 0x55794a0e3d50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 realm 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e48b0 con 0x55794a0e18b0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e5150 con 0x55794a0e18b0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0e6250 0x55794a0e8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e8c90 con 0x55794a0e6250 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0e6250 0x55794a0e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0e6250 0x55794a0e8640 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 20 searching for the correct realm 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ea4f0 con 0x55794a0e6250 2024-09-10T14:28:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9b57e640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5d8c073020 0x7f5d8c052440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ea4f0 con 0x7f5d8c073020 2024-09-10T14:28:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.831+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5d8c073020 0x7f5d8c052440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5d8c073020 0x7f5d8c052440 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9ad7d640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5d900dc040 0x7f5d900ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ea4f0 con 0x7f5d900dc040 2024-09-10T14:28:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5d900dc040 0x7f5d900ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5d900dc040 0x7f5d900ce430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d900dc040 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d900dc040 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.835+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d8c073020 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e6250 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d900dc040 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d8c073020 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e6250 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e6250 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d900dc040 2024-09-10T14:28:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e6250 2024-09-10T14:28:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e6250 2024-09-10T14:28:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.839+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d900dc040 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e6250 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d8c073020 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d900dc040 2024-09-10T14:28:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e6250 2024-09-10T14:28:49.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d900dc040 2024-09-10T14:28:49.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d8c073020 2024-09-10T14:28:49.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e6250 2024-09-10T14:28:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.843+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d900dc040 2024-09-10T14:28:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x55794a0e18b0 2024-09-10T14:28:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e54f0 con 0x7f5d8c073020 2024-09-10T14:28:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e95e0 con 0x55794a0e18b0 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e9e30 con 0x55794a0e18b0 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0e9220 con 0x7f5d900dc040 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 zone default found 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 4 Realm: () 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 zonegroup default 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ea2e0 con 0x7f5d900dc040 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ea2e0 con 0x55794a0e6250 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ec3e0 con 0x55794a0e6250 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 started sync module instance, tier type = 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.847+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0eb7a0 con 0x7f5d8c073020 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.851+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.851+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93979421883280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0eccf0 con 0x7f5d8c073020 2024-09-10T14:28:49.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.851+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ed540 con 0x55794a0e18b0 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.851+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93979421883280] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.851+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.851+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93979421886528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ed540 con 0x55794a0e18b0 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.851+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0edfd0 con 0x55794a0e6250 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93979421891200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ee870 con 0x55794a0e6250 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ef2b0 con 0x7f5d8c073020 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93979421886528] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93979421896064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ef6a0 con 0x7f5d8c073020 2024-09-10T14:28:49.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f0060 con 0x55794a0e18b0 2024-09-10T14:28:49.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93979421891200] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.855+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93979421896064] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.859+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.859+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93979421893568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f0060 con 0x55794a0e18b0 2024-09-10T14:28:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.859+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f0900 con 0x7f5d900dc040 2024-09-10T14:28:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.859+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93979421893568] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.859+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.859+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93979421899968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f0630 con 0x7f5d900dc040 2024-09-10T14:28:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.859+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f1150 con 0x7f5d900dc040 2024-09-10T14:28:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93979421903904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f15c0 con 0x7f5d900dc040 2024-09-10T14:28:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f20b0 con 0x7f5d900dc040 2024-09-10T14:28:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93979421899968] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93979421903904] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93979421907840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f1110 con 0x7f5d900dc040 2024-09-10T14:28:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 20 add_watcher() i=0 2024-09-10T14:28:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 20 add_watcher() i=1 2024-09-10T14:28:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 20 add_watcher() i=2 2024-09-10T14:28:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 20 add_watcher() i=3 2024-09-10T14:28:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 20 add_watcher() i=4 2024-09-10T14:28:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 20 add_watcher() i=5 2024-09-10T14:28:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.863+0000 7f5d9da6e980 20 add_watcher() i=6 2024-09-10T14:28:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93979421907840] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 20 add_watcher() i=7 2024-09-10T14:28:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f51b0 con 0x55794a0e18b0 2024-09-10T14:28:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93979421901024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f2630 con 0x55794a0e18b0 2024-09-10T14:28:49.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93979421901024] v33'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5c51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 5 note: GC not initialized 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5c50fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 20 Filter name: none 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5bca7fc640 20 reqs_thread_entry: start 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a118650 con 0x55794a0e18b0 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:49.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:49.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T14:28:49.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:49.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a1190c0 con 0x7f5d900dc040 2024-09-10T14:28:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.867+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a11ea70 con 0x55794a0e18b0 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v33'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93979422090464 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a11a160 con 0x55794a0e18b0 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 93979421893568 notify 141733920771 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f5d9402d040 con 0x55794a0e18b0 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5c7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 93979421893568 notifier 4337 bl.length()=678 2024-09-10T14:28:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5c7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:49.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5c7effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:49.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(65 notify.4 [notify cookie 93979422090464 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5c7effd640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5c60003eb0 con 0x55794a0e18b0 2024-09-10T14:28:49.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 93979422090464 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5d9401e040 con 0x55794a0e18b0 2024-09-10T14:28:49.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.871+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a11e4e0 con 0x7f5d900dc040 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9da6e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9da6e980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9da6e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93979422090464 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55794a119cb0 con 0x55794a0e6250 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== watch-notify(notify (1) cookie 93979421891200 notify 141733920768 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55794a0c3860 con 0x55794a0e6250 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5c7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 93979421891200 notifier 4337 bl.length()=177 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5c7e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5c7e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5c7e7fc640 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5bd0003410 con 0x55794a0e6250 2024-09-10T14:28:49.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(68 notify.2 [notify cookie 93979422090464 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== watch-notify(notify_complete (2) cookie 93979422090464 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55794a0c35d0 con 0x55794a0e6250 2024-09-10T14:28:49.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.880 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T14:28:49.875277Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:49.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5c51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:49.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93979421901024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a119ef0 con 0x55794a0e18b0 2024-09-10T14:28:49.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93979421901024] v33'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.875+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93979421883280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f00e0 con 0x7f5d8c073020 2024-09-10T14:28:49.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.879+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93979421883280] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.879+0000 7f5d9da6e980 20 remove_watcher() i=0 2024-09-10T14:28:49.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.879+0000 7f5d9da6e980 2 removed watcher, disabling cache 2024-09-10T14:28:49.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.879+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93979421886528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ebb90 con 0x55794a0e18b0 2024-09-10T14:28:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.879+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93979421886528] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.879+0000 7f5d9da6e980 20 remove_watcher() i=1 2024-09-10T14:28:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.879+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93979421891200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f00e0 con 0x55794a0e6250 2024-09-10T14:28:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9b57e640 1 -- 172.21.15.151:0/2333733759 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93979421891200] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c04f030 con 0x55794a0e6250 2024-09-10T14:28:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9da6e980 20 remove_watcher() i=2 2024-09-10T14:28:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93979421896064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ec840 con 0x7f5d8c073020 2024-09-10T14:28:49.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9ad7d640 1 -- 172.21.15.151:0/2333733759 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93979421896064] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d900c9030 con 0x7f5d8c073020 2024-09-10T14:28:49.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9da6e980 20 remove_watcher() i=3 2024-09-10T14:28:49.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93979421893568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ebb90 con 0x55794a0e18b0 2024-09-10T14:28:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93979421893568] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x55794a0e18b0 2024-09-10T14:28:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9da6e980 20 remove_watcher() i=4 2024-09-10T14:28:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.883+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93979421899968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0f00e0 con 0x7f5d900dc040 2024-09-10T14:28:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.887+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93979421899968] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.887+0000 7f5d9da6e980 20 remove_watcher() i=5 2024-09-10T14:28:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.887+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93979421903904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0eed80 con 0x7f5d900dc040 2024-09-10T14:28:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93979421903904] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 20 remove_watcher() i=6 2024-09-10T14:28:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93979421907840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55794a0ec840 con 0x7f5d900dc040 2024-09-10T14:28:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93979421907840] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400a4d0 con 0x7f5d900dc040 2024-09-10T14:28:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 20 remove_watcher() i=7 2024-09-10T14:28:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5d900dc040 msgr2=0x7f5d900ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5d900dc040 0x7f5d900ce430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55794a0e18b0 msgr2=0x55794a0e3d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55794a0e18b0 0x55794a0e3d50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5d8c073020 msgr2=0x7f5d8c052440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5d8c073020 0x7f5d8c052440 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0e6250 msgr2=0x55794a0e8640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0e6250 0x55794a0e8640 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c64034650 msgr2=0x7f5c64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c64034650 0x7f5c64036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d900abaa0 tx=0x7f5d900b9040 comp rx=0 tx=0).stop 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/2333733759 reap_dead start 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 msgr2=0x55794a0d67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0d67d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00dfd0 tx=0x7f5d8c036e70 comp rx=0 tx=0).stop 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 shutdown_connections 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/2333733759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0cf610 0x55794a0d67d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 >> 172.21.15.151:0/2333733759 conn(0x55794a0cb9f0 msgr2=0x55794a0c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 shutdown_connections 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/2333733759 wait complete. 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1508803312 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c74034650 msgr2=0x7f5c74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/1508803312 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c74034650 0x7f5c74036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5d9001b2c0 tx=0x7f5d90005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1508803312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0c2c70 msgr2=0x55794a0c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/1508803312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0c2c70 0x55794a0c3090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c048370 tx=0x7f5d8c02aab0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1508803312 shutdown_connections 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/1508803312 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c74034650 0x7f5c74036b10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/1508803312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55794a0c2c70 0x55794a0c3090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1508803312 >> 172.21.15.151:0/1508803312 conn(0x55794a0b7dc0 msgr2=0x55794a0ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1508803312 shutdown_connections 2024-09-10T14:28:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/1508803312 wait complete. 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55794a0b2680 msgr2=0x55794a0b4a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55794a0b2680 0x55794a0b4a70 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557949fb6a60 msgr2=0x55794a0abe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557949fb6a60 0x55794a0abe40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0ae780 msgr2=0x55794a0b0b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55794a0ae780 0x55794a0b0b70 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c800346a0 msgr2=0x7f5c80036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5c800346a0 0x7f5c80036b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d900ad000 tx=0x7f5d900a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 msgr2=0x55794a0a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 --2- 172.21.15.151:0/540692535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557949f27230 0x55794a0a4e30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55794a09ec40 tx=0x7f5d8c000bd0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9bd7f640 1 -- 172.21.15.151:0/540692535 reap_dead start 2024-09-10T14:28:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 shutdown_connections 2024-09-10T14:28:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 >> 172.21.15.151:0/540692535 conn(0x557949fad030 msgr2=0x55794a098210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 shutdown_connections 2024-09-10T14:28:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.891+0000 7f5d9da6e980 1 -- 172.21.15.151:0/540692535 wait complete. 2024-09-10T14:28:49.905 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T14:28:49.875277Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:49.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:28:49.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:28:49.906 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:28:49.975 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:49.975 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:49.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa48fd3980 1 Processor -- start 2024-09-10T14:28:49.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa48fd3980 1 -- start start 2024-09-10T14:28:49.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa48fd3980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55946bdd68f0 0x55946bdd8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa48fd3980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55946bc5bae0 con 0x55946bdd2570 2024-09-10T14:28:49.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa48fd3980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55946bc7fe30 con 0x55946bdd68f0 2024-09-10T14:28:49.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa462e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55946bdd68f0 0x55946bdd8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa462e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55946bdd68f0 0x55946bdd8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41454/0 (socket says 172.21.15.151:41454) 2024-09-10T14:28:49.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa462e2640 1 -- 172.21.15.151:0/3514319764 learned_addr learned my addr 172.21.15.151:0/3514319764 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.971+0000 7faa46ae3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55946bdd2570 0x55946bdd2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34174/0 (socket says 172.21.15.151:34174) 2024-09-10T14:28:49.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa462e2640 1 -- 172.21.15.151:0/3514319764 >> v1:172.21.15.52:6789/0 conn(0x55946bdd2570 legacy=0x55946bdd2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa462e2640 1 -- 172.21.15.151:0/3514319764 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946bdda230 con 0x55946bdd68f0 2024-09-10T14:28:49.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa462e2640 1 --2- 172.21.15.151:0/3514319764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 0x55946bdd8ce0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00a5c0 tx=0x7faa3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df13cae19ca3ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa45ae1640 1 -- 172.21.15.151:0/3514319764 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa3c0a6070 con 0x55946bdd68f0 2024-09-10T14:28:49.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa45ae1640 1 -- 172.21.15.151:0/3514319764 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa3c0af070 con 0x55946bdd68f0 2024-09-10T14:28:49.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa45ae1640 1 -- 172.21.15.151:0/3514319764 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa3c0aa5c0 con 0x55946bdd68f0 2024-09-10T14:28:49.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa48fd3980 1 -- 172.21.15.151:0/3514319764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 msgr2=0x55946bdd8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3514319764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 0x55946bdd8ce0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00a5c0 tx=0x7faa3c01b340 comp rx=0 tx=0).stop 2024-09-10T14:28:49.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa48fd3980 1 -- 172.21.15.151:0/3514319764 shutdown_connections 2024-09-10T14:28:49.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3514319764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 0x55946bdd8ce0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa48fd3980 1 -- 172.21.15.151:0/3514319764 >> 172.21.15.151:0/3514319764 conn(0x55946bdce090 msgr2=0x55946bdd04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa48fd3980 1 -- 172.21.15.151:0/3514319764 shutdown_connections 2024-09-10T14:28:49.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.975+0000 7faa48fd3980 1 -- 172.21.15.151:0/3514319764 wait complete. 2024-09-10T14:28:49.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.987+0000 7faa48fd3980 1 Processor -- start 2024-09-10T14:28:49.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.987+0000 7faa48fd3980 1 -- start start 2024-09-10T14:28:49.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd2570 0x55946bebc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:49.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55946bc81200 con 0x55946bdd2570 2024-09-10T14:28:49.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd2570 0x55946bebc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:49.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd2570 0x55946bebc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41462/0 (socket says 172.21.15.151:41462) 2024-09-10T14:28:49.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa46ae3640 1 -- 172.21.15.151:0/1039184474 learned_addr learned my addr 172.21.15.151:0/1039184474 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:49.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa46ae3640 1 -- 172.21.15.151:0/1039184474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946bebcdc0 con 0x55946bdd2570 2024-09-10T14:28:49.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa46ae3640 1 --2- 172.21.15.151:0/1039184474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd2570 0x55946bebc7f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa40001690 tx=0x7faa40001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cfda6fc2e03e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:49.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7fa934e09640 1 -- 172.21.15.151:0/1039184474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40003460 con 0x55946bdd2570 2024-09-10T14:28:49.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7fa934e09640 1 -- 172.21.15.151:0/1039184474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa40003600 con 0x55946bdd2570 2024-09-10T14:28:49.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7fa934e09640 1 -- 172.21.15.151:0/1039184474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40003920 con 0x55946bdd2570 2024-09-10T14:28:49.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 -- 172.21.15.151:0/1039184474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd2570 msgr2=0x55946bebc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:49.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1039184474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd2570 0x55946bebc7f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa40001690 tx=0x7faa40001b50 comp rx=0 tx=0).stop 2024-09-10T14:28:49.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 -- 172.21.15.151:0/1039184474 shutdown_connections 2024-09-10T14:28:49.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1039184474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd2570 0x55946bebc7f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:49.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 -- 172.21.15.151:0/1039184474 >> 172.21.15.151:0/1039184474 conn(0x55946bdce090 msgr2=0x55946beb8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:49.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 -- 172.21.15.151:0/1039184474 shutdown_connections 2024-09-10T14:28:50.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 -- 172.21.15.151:0/1039184474 wait complete. 2024-09-10T14:28:50.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 Processor -- start 2024-09-10T14:28:50.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 -- start start 2024-09-10T14:28:50.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 0x55946bec3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa48fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55946bdd9d30 con 0x55946bdd68f0 2024-09-10T14:28:50.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 0x55946bec3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 0x55946bec3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41468/0 (socket says 172.21.15.151:41468) 2024-09-10T14:28:50.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.991+0000 7faa46ae3640 1 -- 172.21.15.151:0/1526349790 learned_addr learned my addr 172.21.15.151:0/1526349790 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa46ae3640 1 -- 172.21.15.151:0/1526349790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946bec4260 con 0x55946bdd68f0 2024-09-10T14:28:50.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa46ae3640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 0x55946bec3d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa40001360 tx=0x7faa40001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7fa933606640 1 -- 172.21.15.151:0/1526349790 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40021020 con 0x55946bdd68f0 2024-09-10T14:28:50.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55946bec44f0 con 0x55946bdd68f0 2024-09-10T14:28:50.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7fa933606640 1 -- 172.21.15.151:0/1526349790 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4001d680 con 0x55946bdd68f0 2024-09-10T14:28:50.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7fa933606640 1 -- 172.21.15.151:0/1526349790 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4001d8b0 con 0x55946bdd68f0 2024-09-10T14:28:50.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55946bec71d0 con 0x55946bdd68f0 2024-09-10T14:28:50.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7fa933606640 1 -- 172.21.15.151:0/1526349790 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faa40024020 con 0x55946bdd68f0 2024-09-10T14:28:50.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7fa933606640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa92c034650 0x7fa92c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7fa933606640 1 -- 172.21.15.151:0/1526349790 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7faa40018040 con 0x55946bdd68f0 2024-09-10T14:28:50.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa462e2640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa92c034650 0x7fa92c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bec8e10 0x55946becb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946becb740 con 0x55946bec8e10 2024-09-10T14:28:50.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa472e4640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bec8e10 0x55946becb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa462e2640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa92c034650 0x7fa92c036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0ae000 tx=0x7faa3c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa472e4640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bec8e10 0x55946becb200 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa472e4640 1 -- 172.21.15.151:0/1526349790 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bec8e10 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bec83f0 con 0x55946bec8e10 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa472e4640 1 -- 172.21.15.151:0/1526349790 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa380083f0 con 0x55946bec8e10 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946becda70 0x55946becfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bed0550 con 0x55946becda70 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa46ae3640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946becda70 0x55946becfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.995+0000 7faa46ae3640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946becda70 0x55946becfe60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa46ae3640 1 -- 172.21.15.151:0/1526349790 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faa4000f070 con 0x55946becda70 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946becc8e0 con 0x55946bec8e10 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa472e4640 1 -- 172.21.15.151:0/1526349790 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa380083f0 con 0x55946bec8e10 2024-09-10T14:28:50.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55946bed19b0 0x55946bed3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bed44a0 con 0x55946bed19b0 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa462e2640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55946bed19b0 0x55946bed3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa462e2640 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55946bed19b0 0x55946bed3da0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa462e2640 1 -- 172.21.15.151:0/1526349790 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faa3c0aab50 con 0x55946bed19b0 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa48fd3980 1 Processor -- start 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa48fd3980 1 -- start start 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa48fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bee1f70 0x55946bee2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa48fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55946bcda800 con 0x55946bee1f70 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bee1f70 0x55946bee2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bee1f70 0x55946bee2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41474/0 (socket says 172.21.15.151:41474) 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa46ae3640 1 -- 172.21.15.151:0/1712282774 learned_addr learned my addr 172.21.15.151:0/1712282774 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:49.999+0000 7faa46ae3640 1 -- 172.21.15.151:0/1712282774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946bee28d0 con 0x55946bee1f70 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa46ae3640 1 --2- 172.21.15.151:0/1712282774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bee1f70 0x55946bee2390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa40047d90 tx=0x7faa40042e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7fa930e01640 1 -- 172.21.15.151:0/1712282774 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa400417f0 con 0x55946bee1f70 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7fa930e01640 1 -- 172.21.15.151:0/1712282774 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa40049070 con 0x55946bee1f70 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7fa930e01640 1 -- 172.21.15.151:0/1712282774 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40049370 con 0x55946bee1f70 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa48fd3980 1 -- 172.21.15.151:0/1712282774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55946bee2b60 con 0x55946bee1f70 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa48fd3980 1 -- 172.21.15.151:0/1712282774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55946bee57e0 con 0x55946bee1f70 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7fa930e01640 1 -- 172.21.15.151:0/1712282774 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faa40038030 con 0x55946bee1f70 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7fa930e01640 1 --2- 172.21.15.151:0/1712282774 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa920034650 0x7fa920036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7fa930e01640 1 -- 172.21.15.151:0/1712282774 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7faa40036070 con 0x55946bee1f70 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa462e2640 1 --2- 172.21.15.151:0/1712282774 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa920034650 0x7fa920036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa48fd3980 1 Processor -- start 2024-09-10T14:28:50.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa48fd3980 1 -- start start 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa48fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946beeed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa48fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55946bebd0e0 con 0x55946beee950 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa462e2640 1 --2- 172.21.15.151:0/1712282774 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa920034650 0x7fa920036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55946becbbf0 tx=0x7faa3c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946beeed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946beeed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41486/0 (socket says 172.21.15.151:41486) 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa46ae3640 1 -- 172.21.15.151:0/3083818528 learned_addr learned my addr 172.21.15.151:0/3083818528 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.003+0000 7faa46ae3640 1 -- 172.21.15.151:0/3083818528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946beef300 con 0x55946beee950 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa46ae3640 1 --2- 172.21.15.151:0/3083818528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946beeed30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa40041a60 tx=0x7faa40041a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abaf2f9e4629486 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7fa92a7fc640 1 -- 172.21.15.151:0/3083818528 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40059070 con 0x55946beee950 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7fa92a7fc640 1 -- 172.21.15.151:0/3083818528 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4001b970 con 0x55946beee950 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7fa92a7fc640 1 -- 172.21.15.151:0/3083818528 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40050040 con 0x55946beee950 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- 172.21.15.151:0/3083818528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 msgr2=0x55946beeed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3083818528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946beeed30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa40041a60 tx=0x7faa40041a90 comp rx=0 tx=0).stop 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- 172.21.15.151:0/3083818528 shutdown_connections 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3083818528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946beeed30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- 172.21.15.151:0/3083818528 >> 172.21.15.151:0/3083818528 conn(0x55946beeac90 msgr2=0x55946bee8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- 172.21.15.151:0/3083818528 shutdown_connections 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- 172.21.15.151:0/3083818528 wait complete. 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 Processor -- start 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- start start 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946bef5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55946beef6f0 con 0x55946beee950 2024-09-10T14:28:50.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946bef5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa46ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946bef5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41502/0 (socket says 172.21.15.151:41502) 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 learned_addr learned my addr 172.21.15.151:0/3045200122 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946bef5f70 con 0x55946beee950 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa46ae3640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946bef5a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faa40046b90 tx=0x7faa4002df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7fa928ff9640 1 -- 172.21.15.151:0/3045200122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40059040 con 0x55946beee950 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55946bef5f70 con 0x55946beee950 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7fa928ff9640 1 -- 172.21.15.151:0/3045200122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa40049c80 con 0x55946beee950 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55946bef5f70 con 0x55946beee950 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.007+0000 7fa928ff9640 1 -- 172.21.15.151:0/3045200122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4003f040 con 0x55946beee950 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7fa928ff9640 1 -- 172.21.15.151:0/3045200122 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faa40065020 con 0x55946beee950 2024-09-10T14:28:50.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7fa928ff9640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa910034650 0x7fa910036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7fa928ff9640 1 -- 172.21.15.151:0/3045200122 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7faa40063020 con 0x55946beee950 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa462e2640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa910034650 0x7fa910036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bf00b20 0x55946bf02fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf03710 con 0x55946bf00b20 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa472e4640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bf00b20 0x55946bf02fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa462e2640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa910034650 0x7fa910036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa3c01b380 tx=0x7faa3c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa472e4640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bf00b20 0x55946bf02fc0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 realm 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf03b20 con 0x55946bf00b20 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf043c0 con 0x55946bf00b20 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946bf054c0 0x55946bf078b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf07e30 con 0x55946bf054c0 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa46ae3640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946bf054c0 0x55946bf078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa46ae3640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946bf054c0 0x55946bf078b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 20 searching for the correct realm 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf09690 con 0x55946bf054c0 2024-09-10T14:28:50.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa46ae3640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7faa40026020 0x7faa400080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf09690 con 0x7faa40026020 2024-09-10T14:28:50.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa462e2640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7faa40026020 0x7faa400080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.011+0000 7faa462e2640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7faa40026020 0x7faa400080c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa462e2640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7faa3c0e0040 0x7faa3c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf09690 con 0x7faa3c0e0040 2024-09-10T14:28:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7faa3c0e0040 0x7faa3c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7faa3c0e0040 0x7faa3c0e0420 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa3c0e0040 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa3c0e0040 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.015+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa40026020 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf054c0 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa3c0e0040 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa40026020 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf054c0 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf054c0 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa3c0e0040 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf054c0 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf054c0 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.019+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa3c0e0040 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf054c0 2024-09-10T14:28:50.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa40026020 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa3c0e0040 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf054c0 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa3c0e0040 2024-09-10T14:28:50.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa40026020 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf054c0 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.023+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa3c0e0040 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x55946bf00b20 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55946bf04760 con 0x7faa40026020 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:50.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:50.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:50.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:50.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:50.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:50.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf08780 con 0x55946bf00b20 2024-09-10T14:28:50.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf083c0 con 0x55946bf00b20 2024-09-10T14:28:50.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf08390 con 0x7faa3c0e0040 2024-09-10T14:28:50.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 zone default found 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 4 Realm: () 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 zonegroup default 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf090f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf09510 con 0x55946bf054c0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0b510 con 0x55946bf054c0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 started sync module instance, tier type = 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.027+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0a9b0 con 0x7faa40026020 2024-09-10T14:28:50.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.031+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.031+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94095954455968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0bd60 con 0x7faa40026020 2024-09-10T14:28:50.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.031+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0c5b0 con 0x55946bf00b20 2024-09-10T14:28:50.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.031+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94095954455968] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.031+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.031+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94095954458800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0c5b0 con 0x55946bf00b20 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.031+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0d0d0 con 0x55946bf054c0 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94095954463648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0d090 con 0x55946bf054c0 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0dfd0 con 0x7faa40026020 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94095954458800] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94095954467552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0e3c0 con 0x7faa40026020 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0ed80 con 0x55946bf00b20 2024-09-10T14:28:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94095954463648] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.035+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94095954467552] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.039+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.039+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94095954465984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0c210 con 0x55946bf00b20 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.039+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0f4a0 con 0x7faa3c0e0040 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.039+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94095954465984] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.039+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.039+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94095954472816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0f460 con 0x7faa3c0e0040 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.039+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0feb0 con 0x7faa3c0e0040 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94095954475520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf102d0 con 0x7faa3c0e0040 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf10d20 con 0x7faa3c0e0040 2024-09-10T14:28:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94095954472816] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94095954479120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf10ce0 con 0x7faa3c0e0040 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 20 add_watcher() i=0 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 20 add_watcher() i=1 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 20 add_watcher() i=2 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 20 add_watcher() i=3 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 20 add_watcher() i=4 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 20 add_watcher() i=5 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94095954475520] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.043+0000 7faa48fd3980 20 add_watcher() i=6 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94095954479120] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 20 add_watcher() i=7 2024-09-10T14:28:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0fe20 con 0x55946bf00b20 2024-09-10T14:28:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94095954476576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf11110 con 0x55946bf00b20 2024-09-10T14:28:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94095954476576] v33'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7fa8fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 5 note: GC not initialized 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7fa877fff640 20 reqs_thread_entry: start 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 20 Filter name: none 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7fa875ffb640 20 reqs_thread_entry: start 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bf36d80 con 0x55946bf00b20 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.047+0000 7faa48fd3980 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T14:28:50.057 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T14:28:49.875277Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.051+0000 7fa8fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.051+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94095954476576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf35930 con 0x55946bf00b20 2024-09-10T14:28:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.051+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94095954476576] v33'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.051+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94095954455968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf34c60 con 0x7faa40026020 2024-09-10T14:28:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.051+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94095954455968] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.051+0000 7faa48fd3980 20 remove_watcher() i=0 2024-09-10T14:28:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.051+0000 7faa48fd3980 2 removed watcher, disabling cache 2024-09-10T14:28:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.051+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94095954458800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf34c60 con 0x55946bf00b20 2024-09-10T14:28:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94095954458800] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa48fd3980 20 remove_watcher() i=1 2024-09-10T14:28:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94095954463648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf34c60 con 0x55946bf054c0 2024-09-10T14:28:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa46ae3640 1 -- 172.21.15.151:0/3045200122 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94095954463648] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4005c040 con 0x55946bf054c0 2024-09-10T14:28:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa48fd3980 20 remove_watcher() i=2 2024-09-10T14:28:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94095954467552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf34c60 con 0x7faa40026020 2024-09-10T14:28:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa462e2640 1 -- 172.21.15.151:0/3045200122 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94095954467552] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3c0aab50 con 0x7faa40026020 2024-09-10T14:28:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa48fd3980 20 remove_watcher() i=3 2024-09-10T14:28:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.055+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94095954465984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf34c60 con 0x55946bf00b20 2024-09-10T14:28:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.059+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94095954465984] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x55946bf00b20 2024-09-10T14:28:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.059+0000 7faa48fd3980 20 remove_watcher() i=4 2024-09-10T14:28:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.059+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94095954472816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf34c60 con 0x7faa3c0e0040 2024-09-10T14:28:50.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.059+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94095954472816] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.059+0000 7faa48fd3980 20 remove_watcher() i=5 2024-09-10T14:28:50.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.059+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94095954475520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf34c60 con 0x7faa3c0e0040 2024-09-10T14:28:50.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94095954475520] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 20 remove_watcher() i=6 2024-09-10T14:28:50.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94095954479120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bf0feb0 con 0x7faa3c0e0040 2024-09-10T14:28:50.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94095954479120] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa380083f0 con 0x7faa3c0e0040 2024-09-10T14:28:50.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 20 remove_watcher() i=7 2024-09-10T14:28:50.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7faa3c0e0040 msgr2=0x7faa3c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7faa3c0e0040 0x7faa3c0e0420 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bf00b20 msgr2=0x55946bf02fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bf00b20 0x55946bf02fc0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7faa40026020 msgr2=0x7faa400080c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7faa40026020 0x7faa400080c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946bf054c0 msgr2=0x55946bf078b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946bf054c0 0x55946bf078b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa910034650 msgr2=0x7fa910036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa910034650 0x7fa910036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa3c01b380 tx=0x7faa3c0c1040 comp rx=0 tx=0).stop 2024-09-10T14:28:50.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 msgr2=0x55946bef5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa472e4640 1 -- 172.21.15.151:0/3045200122 reap_dead start 2024-09-10T14:28:50.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946bef5a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faa40046b90 tx=0x7faa4002df90 comp rx=0 tx=0).stop 2024-09-10T14:28:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 shutdown_connections 2024-09-10T14:28:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 --2- 172.21.15.151:0/3045200122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946beee950 0x55946bef5a30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 >> 172.21.15.151:0/3045200122 conn(0x55946beeac90 msgr2=0x55946bee8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 shutdown_connections 2024-09-10T14:28:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.063+0000 7faa48fd3980 1 -- 172.21.15.151:0/3045200122 wait complete. 2024-09-10T14:28:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1712282774 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa920034650 msgr2=0x7fa920036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1712282774 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa920034650 0x7fa920036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55946becbbf0 tx=0x7faa3c005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1712282774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bee1f70 msgr2=0x55946bee2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1712282774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bee1f70 0x55946bee2390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa40047d90 tx=0x7faa40042e50 comp rx=0 tx=0).stop 2024-09-10T14:28:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1712282774 shutdown_connections 2024-09-10T14:28:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1712282774 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa920034650 0x7fa920036b10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1712282774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bee1f70 0x55946bee2390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1712282774 >> 172.21.15.151:0/1712282774 conn(0x55946bed70c0 msgr2=0x55946bed9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1712282774 shutdown_connections 2024-09-10T14:28:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1712282774 wait complete. 2024-09-10T14:28:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55946bed19b0 msgr2=0x55946bed3da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55946bed19b0 0x55946bed3da0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bec8e10 msgr2=0x55946becb200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55946bec8e10 0x55946becb200 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946becda70 msgr2=0x55946becfe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55946becda70 0x55946becfe60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa92c034650 msgr2=0x7fa92c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa92c034650 0x7fa92c036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0ae000 tx=0x7faa3c0a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 msgr2=0x55946bec3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 --2- 172.21.15.151:0/1526349790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55946bdd68f0 0x55946bec3d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa40001360 tx=0x7faa40001260 comp rx=0 tx=0).stop 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa472e4640 1 -- 172.21.15.151:0/1526349790 reap_dead start 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 shutdown_connections 2024-09-10T14:28:50.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 >> 172.21.15.151:0/1526349790 conn(0x55946bdce090 msgr2=0x55946beb6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 shutdown_connections 2024-09-10T14:28:50.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.067+0000 7faa48fd3980 1 -- 172.21.15.151:0/1526349790 wait complete. 2024-09-10T14:28:50.082 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T14:28:49.875277Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:50.082 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T14:28:50.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T14:28:50.082 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-10T14:28:50.159 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:50.159 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:50.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f90462eb980 1 Processor -- start 2024-09-10T14:28:50.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f90462eb980 1 -- start start 2024-09-10T14:28:50.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f90462eb980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d7ce8bf2a0 0x55d7ce94d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f90462eb980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7ce7d2ae0 con 0x55d7ce94d8f0 2024-09-10T14:28:50.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f90462eb980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55d7ce7f6e30 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f9043dfb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d7ce8bf2a0 0x55d7ce94d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f9043dfb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d7ce8bf2a0 0x55d7ce94d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41510/0 (socket says 172.21.15.151:41510) 2024-09-10T14:28:50.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f90435fa640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d7ce94d8f0 0x55d7ce94fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34180/0 (socket says 172.21.15.151:34180) 2024-09-10T14:28:50.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.155+0000 7f9043dfb640 1 -- 172.21.15.151:0/4127736066 learned_addr learned my addr 172.21.15.151:0/4127736066 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f9043dfb640 1 -- 172.21.15.151:0/4127736066 >> v1:172.21.15.52:6789/0 conn(0x55d7ce94d8f0 legacy=0x55d7ce94fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f9043dfb640 1 -- 172.21.15.151:0/4127736066 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ce8bf830 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f9043dfb640 1 --2- 172.21.15.151:0/4127736066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94d3b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f903400a4e0 tx=0x7f903401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e19a38bb237f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f9042df9640 1 -- 172.21.15.151:0/4127736066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340aa540 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f9042df9640 1 -- 172.21.15.151:0/4127736066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90340aa6e0 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f9042df9640 1 -- 172.21.15.151:0/4127736066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340aaa40 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f90462eb980 1 -- 172.21.15.151:0/4127736066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 msgr2=0x55d7ce94d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f90462eb980 1 --2- 172.21.15.151:0/4127736066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94d3b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f903400a4e0 tx=0x7f903401b090 comp rx=0 tx=0).stop 2024-09-10T14:28:50.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f90462eb980 1 -- 172.21.15.151:0/4127736066 shutdown_connections 2024-09-10T14:28:50.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f90462eb980 1 --2- 172.21.15.151:0/4127736066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94d3b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f90462eb980 1 -- 172.21.15.151:0/4127736066 >> 172.21.15.151:0/4127736066 conn(0x55d7ce9450a0 msgr2=0x55d7ce9474c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f90462eb980 1 -- 172.21.15.151:0/4127736066 shutdown_connections 2024-09-10T14:28:50.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.159+0000 7f90462eb980 1 -- 172.21.15.151:0/4127736066 wait complete. 2024-09-10T14:28:50.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.171+0000 7f90462eb980 1 Processor -- start 2024-09-10T14:28:50.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.171+0000 7f90462eb980 1 -- start start 2024-09-10T14:28:50.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.171+0000 7f90462eb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.171+0000 7f90462eb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7ce7f8200 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41514/0 (socket says 172.21.15.151:41514) 2024-09-10T14:28:50.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 -- 172.21.15.151:0/1694269661 learned_addr learned my addr 172.21.15.151:0/1694269661 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 -- 172.21.15.151:0/1694269661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ce94b0e0 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 --2- 172.21.15.151:0/1694269661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94ab10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9034017ca0 tx=0x7f90340033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e693c58c44d17d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f8f30e19640 1 -- 172.21.15.151:0/1694269661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340b9030 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f8f30e19640 1 -- 172.21.15.151:0/1694269661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90340aaac0 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f8f30e19640 1 -- 172.21.15.151:0/1694269661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340aada0 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 -- 172.21.15.151:0/1694269661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 msgr2=0x55d7ce94ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 --2- 172.21.15.151:0/1694269661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94ab10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9034017ca0 tx=0x7f90340033b0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 -- 172.21.15.151:0/1694269661 shutdown_connections 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 --2- 172.21.15.151:0/1694269661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7ce94ab10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 -- 172.21.15.151:0/1694269661 >> 172.21.15.151:0/1694269661 conn(0x55d7ce9450a0 msgr2=0x55d7cea316a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 -- 172.21.15.151:0/1694269661 shutdown_connections 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 -- 172.21.15.151:0/1694269661 wait complete. 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 Processor -- start 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 -- start start 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7cea3ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f90462eb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7ce951f10 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7cea3ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7cea3ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41530/0 (socket says 172.21.15.151:41530) 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 -- 172.21.15.151:0/2758929855 learned_addr learned my addr 172.21.15.151:0/2758929855 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 -- 172.21.15.151:0/2758929855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7cea3f3c0 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.175+0000 7f9043dfb640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7cea3ee80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9034005cc0 tx=0x7f9034017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f8f2f616640 1 -- 172.21.15.151:0/2758929855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340b9030 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7cea3f650 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f8f2f616640 1 -- 172.21.15.151:0/2758929855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90340c3070 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f8f2f616640 1 -- 172.21.15.151:0/2758929855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340bf750 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7cea42330 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f8f2f616640 1 -- 172.21.15.151:0/2758929855 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f90340c5030 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f8f2f616640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f28034650 0x7f8f28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f8f2f616640 1 -- 172.21.15.151:0/2758929855 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f90340ba070 con 0x55d7ce8bf2a0 2024-09-10T14:28:50.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90435fa640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f28034650 0x7f8f28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90462eb980 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7ce94d8f0 0x55d7cea45e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea46430 con 0x55d7ce94d8f0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90445fc640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7ce94d8f0 0x55d7cea45e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90435fa640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f28034650 0x7f8f28036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f903c000f70 tx=0x7f903c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90445fc640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7ce94d8f0 0x55d7cea45e10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90445fc640 1 -- 172.21.15.151:0/2758929855 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7ce94d8f0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea43550 con 0x55d7ce94d8f0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90445fc640 1 -- 172.21.15.151:0/2758929855 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7ce94d8f0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90462eb980 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea48780 0x55d7cea4ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea4b240 con 0x55d7cea48780 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f9043dfb640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea48780 0x55d7cea4ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f9043dfb640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea48780 0x55d7cea4ab70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f9043dfb640 1 -- 172.21.15.151:0/2758929855 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea48780 2024-09-10T14:28:50.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.179+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea47620 con 0x55d7ce94d8f0 2024-09-10T14:28:50.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90445fc640 1 -- 172.21.15.151:0/2758929855 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7ce94d8f0 2024-09-10T14:28:50.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90462eb980 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7cea4c680 0x55d7cea4ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea4f200 con 0x55d7cea4c680 2024-09-10T14:28:50.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90435fa640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7cea4c680 0x55d7cea4ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90435fa640 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7cea4c680 0x55d7cea4ea70 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90435fa640 1 -- 172.21.15.151:0/2758929855 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f903c00f6a0 con 0x55d7cea4c680 2024-09-10T14:28:50.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90462eb980 1 Processor -- start 2024-09-10T14:28:50.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90462eb980 1 -- start start 2024-09-10T14:28:50.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90462eb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea5cc90 0x55d7cea5d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90462eb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7ce851800 con 0x55d7cea5cc90 2024-09-10T14:28:50.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea5cc90 0x55d7cea5d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea5cc90 0x55d7cea5d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41538/0 (socket says 172.21.15.151:41538) 2024-09-10T14:28:50.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f9043dfb640 1 -- 172.21.15.151:0/3054359105 learned_addr learned my addr 172.21.15.151:0/3054359105 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f9043dfb640 1 -- 172.21.15.151:0/3054359105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7cea5d5f0 con 0x55d7cea5cc90 2024-09-10T14:28:50.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f9043dfb640 1 --2- 172.21.15.151:0/3054359105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea5cc90 0x55d7cea5d0b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90340bdad0 tx=0x7f90340a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f8f2ce11640 1 -- 172.21.15.151:0/3054359105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340c63c0 con 0x55d7cea5cc90 2024-09-10T14:28:50.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90462eb980 1 -- 172.21.15.151:0/3054359105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7cea5d820 con 0x55d7cea5cc90 2024-09-10T14:28:50.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f8f2ce11640 1 -- 172.21.15.151:0/3054359105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90340c6560 con 0x55d7cea5cc90 2024-09-10T14:28:50.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f8f2ce11640 1 -- 172.21.15.151:0/3054359105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340b4a20 con 0x55d7cea5cc90 2024-09-10T14:28:50.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.183+0000 7f90462eb980 1 -- 172.21.15.151:0/3054359105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7cea604a0 con 0x55d7cea5cc90 2024-09-10T14:28:50.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f8f2ce11640 1 -- 172.21.15.151:0/3054359105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f90340b3040 con 0x55d7cea5cc90 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f8f2ce11640 1 --2- 172.21.15.151:0/3054359105 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f1c034650 0x7f8f1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f8f2ce11640 1 -- 172.21.15.151:0/3054359105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f90340d7070 con 0x55d7cea5cc90 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90435fa640 1 --2- 172.21.15.151:0/3054359105 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f1c034650 0x7f8f1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 Processor -- start 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 -- start start 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90435fa640 1 --2- 172.21.15.151:0/3054359105 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f1c034650 0x7f8f1c036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55d7cea4f600 tx=0x7f903c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea69940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7ce949240 con 0x55d7cea69560 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea69940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea69940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41548/0 (socket says 172.21.15.151:41548) 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f9043dfb640 1 -- 172.21.15.151:0/2408720054 learned_addr learned my addr 172.21.15.151:0/2408720054 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f9043dfb640 1 -- 172.21.15.151:0/2408720054 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7cea69f10 con 0x55d7cea69560 2024-09-10T14:28:50.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f9043dfb640 1 --2- 172.21.15.151:0/2408720054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea69940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90340b7010 tx=0x7f90340da4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9cb10207e0d9df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f8f267fc640 1 -- 172.21.15.151:0/2408720054 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340c91b0 con 0x55d7cea69560 2024-09-10T14:28:50.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f8f267fc640 1 -- 172.21.15.151:0/2408720054 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90340dcb50 con 0x55d7cea69560 2024-09-10T14:28:50.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f8f267fc640 1 -- 172.21.15.151:0/2408720054 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340bf9c0 con 0x55d7cea69560 2024-09-10T14:28:50.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 -- 172.21.15.151:0/2408720054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 msgr2=0x55d7cea69940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 --2- 172.21.15.151:0/2408720054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea69940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90340b7010 tx=0x7f90340da4c0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 -- 172.21.15.151:0/2408720054 shutdown_connections 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 --2- 172.21.15.151:0/2408720054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea69940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 -- 172.21.15.151:0/2408720054 >> 172.21.15.151:0/2408720054 conn(0x55d7cea65940 msgr2=0x55d7cea63a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 -- 172.21.15.151:0/2408720054 shutdown_connections 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.187+0000 7f90462eb980 1 -- 172.21.15.151:0/2408720054 wait complete. 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 1 Processor -- start 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 1 -- start start 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7cea69f10 con 0x55d7cea69560 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f9043dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41552/0 (socket says 172.21.15.151:41552) 2024-09-10T14:28:50.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 learned_addr learned my addr 172.21.15.151:0/2032971021 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7cea70af0 con 0x55d7cea69560 2024-09-10T14:28:50.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f9043dfb640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea705b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90340dca60 tx=0x7f90340c90e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f8f24ff9640 1 -- 172.21.15.151:0/2032971021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9034100040 con 0x55d7cea69560 2024-09-10T14:28:50.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f8f24ff9640 1 -- 172.21.15.151:0/2032971021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903410b070 con 0x55d7cea69560 2024-09-10T14:28:50.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7cea70af0 con 0x55d7cea69560 2024-09-10T14:28:50.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f8f24ff9640 1 -- 172.21.15.151:0/2032971021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90340bf9c0 con 0x55d7cea69560 2024-09-10T14:28:50.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7cea70af0 con 0x55d7cea69560 2024-09-10T14:28:50.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f8f24ff9640 1 -- 172.21.15.151:0/2032971021 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f90340b4bc0 con 0x55d7cea69560 2024-09-10T14:28:50.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f8f24ff9640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f0c034650 0x7f8f0c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f8f24ff9640 1 -- 172.21.15.151:0/2032971021 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f90340c3220 con 0x55d7cea69560 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90435fa640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f0c034650 0x7f8f0c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7cea7b500 0x55d7cea7d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7e110 con 0x55d7cea7b500 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.191+0000 7f90445fc640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7cea7b500 0x55d7cea7d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90435fa640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f0c034650 0x7f8f0c036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c010 tx=0x7f903c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90445fc640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7cea7b500 0x55d7cea7d9c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 realm 2024-09-10T14:28:50.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7e520 con 0x55d7cea7b500 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7edc0 con 0x55d7cea7b500 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea7fec0 0x55d7cea822b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea82950 con 0x55d7cea7fec0 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f9043dfb640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea7fec0 0x55d7cea822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f9043dfb640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea7fec0 0x55d7cea822b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 20 searching for the correct realm 2024-09-10T14:28:50.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea841b0 con 0x55d7cea7fec0 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f9043dfb640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f90340da020 0x7f90340d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea841b0 con 0x7f90340da020 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90435fa640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f90340da020 0x7f90340d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90435fa640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f90340da020 0x7f90340d79e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90435fa640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f903c01fbe0 0x7f903c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea841b0 con 0x7f903c01fbe0 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.195+0000 7f90445fc640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f903c01fbe0 0x7f903c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f903c01fbe0 0x7f903c03a3c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f903c01fbe0 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f903c01fbe0 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f90340da020 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7fec0 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.199+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f903c01fbe0 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f90340da020 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7fec0 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7fec0 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f903c01fbe0 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7fec0 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7fec0 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f903c01fbe0 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7fec0 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f90340da020 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.203+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f903c01fbe0 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7fec0 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f903c01fbe0 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f90340da020 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7fec0 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f903c01fbe0 2024-09-10T14:28:50.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x55d7cea7b500 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea7f160 con 0x7f90340da020 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90462eb980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90462eb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90462eb980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90462eb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90462eb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90462eb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.207+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea832d0 con 0x55d7cea7b500 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea82f10 con 0x55d7cea7b500 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea83ba0 con 0x7f903c01fbe0 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 zone default found 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 4 Realm: () 2024-09-10T14:28:50.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 zonegroup default 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea83fd0 con 0x7f903c01fbe0 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea83fd0 con 0x55d7cea7fec0 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea860c0 con 0x55d7cea7fec0 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 started sync module instance, tier type = 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea85460 con 0x7f90340da020 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94385373468752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea850c0 con 0x7f90340da020 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.211+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea86ff0 con 0x55d7cea7b500 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.215+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94385373468752] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.215+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.215+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94385373473600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea86f60 con 0x55d7cea7b500 2024-09-10T14:28:50.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.215+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea87d80 con 0x55d7cea7fec0 2024-09-10T14:28:50.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.215+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94385373473600] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94385373475808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea88170 con 0x55d7cea7fec0 2024-09-10T14:28:50.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea88b30 con 0x7f90340da020 2024-09-10T14:28:50.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94385373482784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea897f0 con 0x7f90340da020 2024-09-10T14:28:50.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8a1b0 con 0x55d7cea7b500 2024-09-10T14:28:50.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94385373475808] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94385373482784] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94385373476864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8a1b0 con 0x55d7cea7b500 2024-09-10T14:28:50.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.219+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8aa50 con 0x7f903c01fbe0 2024-09-10T14:28:50.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.223+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94385373476864] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.223+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.223+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94385373486608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8a780 con 0x7f903c01fbe0 2024-09-10T14:28:50.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.223+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8b2a0 con 0x7f903c01fbe0 2024-09-10T14:28:50.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.223+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94385373486608] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94385373490544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8b260 con 0x7f903c01fbe0 2024-09-10T14:28:50.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8bc60 con 0x7f903c01fbe0 2024-09-10T14:28:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94385373493104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8c080 con 0x7f903c01fbe0 2024-09-10T14:28:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 20 add_watcher() i=0 2024-09-10T14:28:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 20 add_watcher() i=1 2024-09-10T14:28:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 20 add_watcher() i=2 2024-09-10T14:28:50.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 20 add_watcher() i=3 2024-09-10T14:28:50.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 20 add_watcher() i=4 2024-09-10T14:28:50.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 20 add_watcher() i=5 2024-09-10T14:28:50.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94385373490544] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.227+0000 7f90462eb980 20 add_watcher() i=6 2024-09-10T14:28:50.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94385373493104] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 20 add_watcher() i=7 2024-09-10T14:28:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8a230 con 0x55d7cea7b500 2024-09-10T14:28:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94385373487664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea8c5c0 con 0x55d7cea7b500 2024-09-10T14:28:50.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94385373487664] v33'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f8ef97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:50.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:50.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 5 note: GC not initialized 2024-09-10T14:28:50.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f8e73fff640 20 reqs_thread_entry: start 2024-09-10T14:28:50.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:50.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 20 Filter name: none 2024-09-10T14:28:50.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f8e71ffb640 20 reqs_thread_entry: start 2024-09-10T14:28:50.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:50.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab2780 con 0x55d7cea7b500 2024-09-10T14:28:50.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T14:28:50.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:50.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:50.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.231+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab8e10 con 0x55d7cea7b500 2024-09-10T14:28:50.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90462eb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:50.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90462eb980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90462eb980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:50.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94385373677696 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab4520 con 0x55d7cea7b500 2024-09-10T14:28:50.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 94385373476864 notify 141733920772 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f902c010040 con 0x55d7cea7b500 2024-09-10T14:28:50.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f8f267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94385373476864 notifier 4351 bl.length()=567 2024-09-10T14:28:50.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f8f267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:50.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f8f267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(64 notify.4 [notify cookie 94385373677696 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f8f267fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8f08003eb0 con 0x55d7cea7b500 2024-09-10T14:28:50.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== watch-notify(notify_complete (2) cookie 94385373677696 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f902c029430 con 0x55d7cea7b500 2024-09-10T14:28:50.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab8880 con 0x7f903c01fbe0 2024-09-10T14:28:50.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v33'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90462eb980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T14:28:50.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94385373677696 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab4070 con 0x55d7cea7fec0 2024-09-10T14:28:50.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== watch-notify(notify (1) cookie 94385373475808 notify 141733920769 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d7cea5d820 con 0x55d7cea7fec0 2024-09-10T14:28:50.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f8f267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94385373475808 notifier 4351 bl.length()=170 2024-09-10T14:28:50.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 notify.2 [notify cookie 94385373677696 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f8f267fc640 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8f08003eb0 con 0x55d7cea7fec0 2024-09-10T14:28:50.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== watch-notify(notify_complete (2) cookie 94385373677696 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d7cea5d5f0 con 0x55d7cea7fec0 2024-09-10T14:28:50.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.235+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.242 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:50.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.239+0000 7f8ef97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.239+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94385373487664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab0560 con 0x55d7cea7b500 2024-09-10T14:28:50.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.239+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94385373487664] v33'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.239+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94385373468752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab0560 con 0x7f90340da020 2024-09-10T14:28:50.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.239+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94385373468752] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.239+0000 7f90462eb980 20 remove_watcher() i=0 2024-09-10T14:28:50.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.239+0000 7f90462eb980 2 removed watcher, disabling cache 2024-09-10T14:28:50.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.239+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94385373473600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab0560 con 0x55d7cea7b500 2024-09-10T14:28:50.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.243+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94385373473600] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.243+0000 7f90462eb980 20 remove_watcher() i=1 2024-09-10T14:28:50.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.243+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94385373475808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea86b40 con 0x55d7cea7fec0 2024-09-10T14:28:50.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.243+0000 7f9043dfb640 1 -- 172.21.15.151:0/2032971021 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94385373475808] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90340ce070 con 0x55d7cea7fec0 2024-09-10T14:28:50.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.243+0000 7f90462eb980 20 remove_watcher() i=2 2024-09-10T14:28:50.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.243+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94385373482784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab0560 con 0x7f90340da020 2024-09-10T14:28:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90435fa640 1 -- 172.21.15.151:0/2032971021 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94385373482784] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f903c037040 con 0x7f90340da020 2024-09-10T14:28:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90462eb980 20 remove_watcher() i=3 2024-09-10T14:28:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94385373476864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea873e0 con 0x55d7cea7b500 2024-09-10T14:28:50.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94385373476864] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x55d7cea7b500 2024-09-10T14:28:50.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90462eb980 20 remove_watcher() i=4 2024-09-10T14:28:50.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94385373486608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea86b40 con 0x7f903c01fbe0 2024-09-10T14:28:50.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94385373486608] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90462eb980 20 remove_watcher() i=5 2024-09-10T14:28:50.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.247+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94385373490544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7cea88f20 con 0x7f903c01fbe0 2024-09-10T14:28:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94385373490544] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 20 remove_watcher() i=6 2024-09-10T14:28:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94385373493104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d7ceab0560 con 0x7f903c01fbe0 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94385373493104] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f902c0083f0 con 0x7f903c01fbe0 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 20 remove_watcher() i=7 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f903c01fbe0 msgr2=0x7f903c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f903c01fbe0 0x7f903c03a3c0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7cea7b500 msgr2=0x55d7cea7d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7cea7b500 0x55d7cea7d9c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f90340da020 msgr2=0x7f90340d79e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.251+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f90340da020 0x7f90340d79e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea7fec0 msgr2=0x55d7cea822b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea7fec0 0x55d7cea822b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f0c034650 msgr2=0x7f8f0c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f0c034650 0x7f8f0c036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c010 tx=0x7f903c010000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 msgr2=0x55d7cea705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90445fc640 1 -- 172.21.15.151:0/2032971021 reap_dead start 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea705b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90340dca60 tx=0x7f90340c90e0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 shutdown_connections 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2032971021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea69560 0x55d7cea705b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 >> 172.21.15.151:0/2032971021 conn(0x55d7cea65940 msgr2=0x55d7cea63a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 shutdown_connections 2024-09-10T14:28:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2032971021 wait complete. 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/3054359105 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f1c034650 msgr2=0x7f8f1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/3054359105 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f1c034650 0x7f8f1c036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55d7cea4f600 tx=0x7f903c00f000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/3054359105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea5cc90 msgr2=0x55d7cea5d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/3054359105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea5cc90 0x55d7cea5d0b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90340bdad0 tx=0x7f90340a9f70 comp rx=0 tx=0).stop 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/3054359105 shutdown_connections 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/3054359105 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f1c034650 0x7f8f1c036b10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/3054359105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7cea5cc90 0x55d7cea5d0b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/3054359105 >> 172.21.15.151:0/3054359105 conn(0x55d7cea51de0 msgr2=0x55d7cea54860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/3054359105 shutdown_connections 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/3054359105 wait complete. 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7cea4c680 msgr2=0x55d7cea4ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7cea4c680 0x55d7cea4ea70 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7ce94d8f0 msgr2=0x55d7cea45e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7ce94d8f0 0x55d7cea45e10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea48780 msgr2=0x55d7cea4ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7cea48780 0x55d7cea4ab70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f28034650 msgr2=0x7f8f28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8f28034650 0x7f8f28036b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f903c000f70 tx=0x7f903c001380 comp rx=0 tx=0).stop 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 msgr2=0x55d7cea3ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 --2- 172.21.15.151:0/2758929855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7ce8bf2a0 0x55d7cea3ee80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9034005cc0 tx=0x7f9034017e30 comp rx=0 tx=0).stop 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90445fc640 1 -- 172.21.15.151:0/2758929855 reap_dead start 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 shutdown_connections 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 >> 172.21.15.151:0/2758929855 conn(0x55d7ce9450a0 msgr2=0x55d7ce949760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 shutdown_connections 2024-09-10T14:28:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.255+0000 7f90462eb980 1 -- 172.21.15.151:0/2758929855 wait complete. 2024-09-10T14:28:50.268 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:50.268 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T14:28:50.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T14:28:50.268 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-10T14:28:50.337 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:50.338 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:50.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8bcd4a980 1 Processor -- start 2024-09-10T14:28:50.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8bcd4a980 1 -- start start 2024-09-10T14:28:50.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8bcd4a980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b5366f62e0 0x55b536784370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8bcd4a980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b536609ae0 con 0x55b5367848b0 2024-09-10T14:28:50.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8bcd4a980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55b53662de30 con 0x55b5366f62e0 2024-09-10T14:28:50.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8ba85a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b5366f62e0 0x55b536784370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8ba85a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b5366f62e0 0x55b536784370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41568/0 (socket says 172.21.15.151:41568) 2024-09-10T14:28:50.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8ba059640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55b5367848b0 0x55b536786ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34190/0 (socket says 172.21.15.151:34190) 2024-09-10T14:28:50.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8ba85a640 1 -- 172.21.15.151:0/2766898655 learned_addr learned my addr 172.21.15.151:0/2766898655 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8ba85a640 1 -- 172.21.15.151:0/2766898655 >> v1:172.21.15.52:6789/0 conn(0x55b5367848b0 legacy=0x55b536786ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.335+0000 7fc8ba85a640 1 -- 172.21.15.151:0/2766898655 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5367893d0 con 0x55b5366f62e0 2024-09-10T14:28:50.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/2766898655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b536784370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00a5c0 tx=0x7fc8ac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c396445d6e6eb2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8b9858640 1 -- 172.21.15.151:0/2766898655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0a6070 con 0x55b5366f62e0 2024-09-10T14:28:50.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8b9858640 1 -- 172.21.15.151:0/2766898655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0af070 con 0x55b5366f62e0 2024-09-10T14:28:50.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8b9858640 1 -- 172.21.15.151:0/2766898655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0aa5c0 con 0x55b5366f62e0 2024-09-10T14:28:50.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2766898655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 msgr2=0x55b536784370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2766898655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b536784370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00a5c0 tx=0x7fc8ac01b340 comp rx=0 tx=0).stop 2024-09-10T14:28:50.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2766898655 shutdown_connections 2024-09-10T14:28:50.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2766898655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b536784370 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2766898655 >> 172.21.15.151:0/2766898655 conn(0x55b53677c0a0 msgr2=0x55b53677e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2766898655 shutdown_connections 2024-09-10T14:28:50.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.339+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2766898655 wait complete. 2024-09-10T14:28:50.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8bcd4a980 1 Processor -- start 2024-09-10T14:28:50.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8bcd4a980 1 -- start start 2024-09-10T14:28:50.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8bcd4a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b53686ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8bcd4a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b53662f200 con 0x55b5366f62e0 2024-09-10T14:28:50.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b53686ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b53686ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41580/0 (socket says 172.21.15.151:41580) 2024-09-10T14:28:50.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8ba85a640 1 -- 172.21.15.151:0/292542812 learned_addr learned my addr 172.21.15.151:0/292542812 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8ba85a640 1 -- 172.21.15.151:0/292542812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53686cfd0 con 0x55b5366f62e0 2024-09-10T14:28:50.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.359+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/292542812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b53686ca00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0199f0 tx=0x7fc8ac003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c038de14aa4c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc7a8e09640 1 -- 172.21.15.151:0/292542812 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0aaa00 con 0x55b5366f62e0 2024-09-10T14:28:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc7a8e09640 1 -- 172.21.15.151:0/292542812 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0aaba0 con 0x55b5366f62e0 2024-09-10T14:28:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc7a8e09640 1 -- 172.21.15.151:0/292542812 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0bd3f0 con 0x55b5366f62e0 2024-09-10T14:28:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/292542812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 msgr2=0x55b53686ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/292542812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b53686ca00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0199f0 tx=0x7fc8ac003030 comp rx=0 tx=0).stop 2024-09-10T14:28:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/292542812 shutdown_connections 2024-09-10T14:28:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/292542812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b53686ca00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/292542812 >> 172.21.15.151:0/292542812 conn(0x55b53677c0a0 msgr2=0x55b536868630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/292542812 shutdown_connections 2024-09-10T14:28:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/292542812 wait complete. 2024-09-10T14:28:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 Processor -- start 2024-09-10T14:28:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- start start 2024-09-10T14:28:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b536873c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b536788e40 con 0x55b5366f62e0 2024-09-10T14:28:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b536873c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b536873c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41584/0 (socket says 172.21.15.151:41584) 2024-09-10T14:28:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8ba85a640 1 -- 172.21.15.151:0/2064796318 learned_addr learned my addr 172.21.15.151:0/2064796318 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8ba85a640 1 -- 172.21.15.151:0/2064796318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b536874150 con 0x55b5366f62e0 2024-09-10T14:28:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b536873c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0199f0 tx=0x7fc8ac0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc7a7606640 1 -- 172.21.15.151:0/2064796318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0bd7c0 con 0x55b5366f62e0 2024-09-10T14:28:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5368743e0 con 0x55b5366f62e0 2024-09-10T14:28:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc7a7606640 1 -- 172.21.15.151:0/2064796318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0bd960 con 0x55b5366f62e0 2024-09-10T14:28:50.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc7a7606640 1 -- 172.21.15.151:0/2064796318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0bdc40 con 0x55b5366f62e0 2024-09-10T14:28:50.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.363+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5368770c0 con 0x55b5366f62e0 2024-09-10T14:28:50.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc7a7606640 1 -- 172.21.15.151:0/2064796318 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8ac0ce020 con 0x55b5366f62e0 2024-09-10T14:28:50.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc7a7606640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc7a00346a0 0x7fc7a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc7a7606640 1 -- 172.21.15.151:0/2064796318 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc8ac0cc020 con 0x55b5366f62e0 2024-09-10T14:28:50.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8ba059640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc7a00346a0 0x7fc7a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5367848b0 0x55b53687ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b53687b220 con 0x55b5367848b0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bb05b640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5367848b0 0x55b53687ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8ba059640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc7a00346a0 0x7fc7a0036b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000f70 tx=0x7fc8b0001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bb05b640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5367848b0 0x55b53687ac00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bb05b640 1 -- 172.21.15.151:0/2064796318 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5367848b0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368782e0 con 0x55b5367848b0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bb05b640 1 -- 172.21.15.151:0/2064796318 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5367848b0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b53687d570 0x55b53687f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b536880030 con 0x55b53687d570 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b53687d570 0x55b53687f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b53687d570 0x55b53687f960 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8ba85a640 1 -- 172.21.15.151:0/2064796318 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8ac0c6d20 con 0x55b53687d570 2024-09-10T14:28:50.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b53687c3e0 con 0x55b5367848b0 2024-09-10T14:28:50.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bb05b640 1 -- 172.21.15.151:0/2064796318 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5367848b0 2024-09-10T14:28:50.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b536881470 0x55b536883860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b536883fd0 con 0x55b536881470 2024-09-10T14:28:50.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.367+0000 7fc8ba059640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b536881470 0x55b536883860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8ba059640 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b536881470 0x55b536883860 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8ba059640 1 -- 172.21.15.151:0/2064796318 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8b000f6a0 con 0x55b536881470 2024-09-10T14:28:50.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8bcd4a980 1 Processor -- start 2024-09-10T14:28:50.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8bcd4a980 1 -- start start 2024-09-10T14:28:50.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8bcd4a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b536891a40 0x55b536891e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8bcd4a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b536688800 con 0x55b536891a40 2024-09-10T14:28:50.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b536891a40 0x55b536891e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b536891a40 0x55b536891e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41594/0 (socket says 172.21.15.151:41594) 2024-09-10T14:28:50.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8ba85a640 1 -- 172.21.15.151:0/4000101297 learned_addr learned my addr 172.21.15.151:0/4000101297 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8ba85a640 1 -- 172.21.15.151:0/4000101297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5368923a0 con 0x55b536891a40 2024-09-10T14:28:50.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/4000101297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b536891a40 0x55b536891e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0e37a0 tx=0x7fc8ac0c5e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc7a4e01640 1 -- 172.21.15.151:0/4000101297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0bcbd0 con 0x55b536891a40 2024-09-10T14:28:50.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc7a4e01640 1 -- 172.21.15.151:0/4000101297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0e9070 con 0x55b536891a40 2024-09-10T14:28:50.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/4000101297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b536892630 con 0x55b536891a40 2024-09-10T14:28:50.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc7a4e01640 1 -- 172.21.15.151:0/4000101297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0e30c0 con 0x55b536891a40 2024-09-10T14:28:50.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.371+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/4000101297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5368952b0 con 0x55b536891a40 2024-09-10T14:28:50.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc7a4e01640 1 -- 172.21.15.151:0/4000101297 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8ac0e3260 con 0x55b536891a40 2024-09-10T14:28:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc7a4e01640 1 --2- 172.21.15.151:0/4000101297 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc794034650 0x7fc794036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc7a4e01640 1 -- 172.21.15.151:0/4000101297 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc8ac0efcc0 con 0x55b536891a40 2024-09-10T14:28:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba059640 1 --2- 172.21.15.151:0/4000101297 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc794034650 0x7fc794036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 Processor -- start 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- start start 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b53689e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b53686d290 con 0x55b53689e3a0 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba059640 1 --2- 172.21.15.151:0/4000101297 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc794034650 0x7fc794036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55b5368843b0 tx=0x7fc8b000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b53689e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b53689e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41596/0 (socket says 172.21.15.151:41596) 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba85a640 1 -- 172.21.15.151:0/140959395 learned_addr learned my addr 172.21.15.151:0/140959395 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba85a640 1 -- 172.21.15.151:0/140959395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53689ed50 con 0x55b53689e3a0 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/140959395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b53689e780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0f0000 tx=0x7fc8ac0dea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c799e52172bfbd6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc79e7fc640 1 -- 172.21.15.151:0/140959395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0fc030 con 0x55b53689e3a0 2024-09-10T14:28:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc79e7fc640 1 -- 172.21.15.151:0/140959395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0e3550 con 0x55b53689e3a0 2024-09-10T14:28:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc79e7fc640 1 -- 172.21.15.151:0/140959395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0f3070 con 0x55b53689e3a0 2024-09-10T14:28:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/140959395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 msgr2=0x55b53689e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/140959395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b53689e780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0f0000 tx=0x7fc8ac0dea80 comp rx=0 tx=0).stop 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/140959395 shutdown_connections 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/140959395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b53689e780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/140959395 >> 172.21.15.151:0/140959395 conn(0x55b53689a780 msgr2=0x55b536898880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/140959395 shutdown_connections 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/140959395 wait complete. 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 Processor -- start 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- start start 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b5368a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8bcd4a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b53689f1f0 con 0x55b53689e3a0 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b5368a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba85a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b5368a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41600/0 (socket says 172.21.15.151:41600) 2024-09-10T14:28:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.375+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 learned_addr learned my addr 172.21.15.151:0/1211570146 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5368a7ca0 con 0x55b53689e3a0 2024-09-10T14:28:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b5368a7760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0f0000 tx=0x7fc8ac002da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc79cff9640 1 -- 172.21.15.151:0/1211570146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac113070 con 0x55b53689e3a0 2024-09-10T14:28:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5368a7ca0 con 0x55b53689e3a0 2024-09-10T14:28:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc79cff9640 1 -- 172.21.15.151:0/1211570146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0e5510 con 0x55b53689e3a0 2024-09-10T14:28:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc79cff9640 1 -- 172.21.15.151:0/1211570146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ac0fc040 con 0x55b53689e3a0 2024-09-10T14:28:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5368a8110 con 0x55b53689e3a0 2024-09-10T14:28:50.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc79cff9640 1 -- 172.21.15.151:0/1211570146 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8ac116070 con 0x55b53689e3a0 2024-09-10T14:28:50.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc79cff9640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc784034600 0x7fc784036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc79cff9640 1 -- 172.21.15.151:0/1211570146 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fc8ac10b070 con 0x55b53689e3a0 2024-09-10T14:28:50.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8ba059640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc784034600 0x7fc784036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5368b2810 0x55b5368b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b5400 con 0x55b5368b2810 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bb05b640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5368b2810 0x55b5368b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8ba059640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc784034600 0x7fc784036ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000c010 tx=0x7fc8b0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bb05b640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5368b2810 0x55b5368b4cb0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 realm 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b5810 con 0x55b5368b2810 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b60b0 con 0x55b5368b2810 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.379+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b5368b71b0 0x55b5368b95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b9bf0 con 0x55b5368b71b0 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b5368b71b0 0x55b5368b95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b5368b71b0 0x55b5368b95a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bcd4a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bcd4a980 20 searching for the correct realm 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bb450 con 0x55b5368b71b0 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba85a640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc8ac118060 0x7fc8ac004290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bb450 con 0x7fc8ac118060 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba059640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc8ac118060 0x7fc8ac004290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba059640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc8ac118060 0x7fc8ac004290 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba059640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc8b001fbe0 0x7fc8b003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bb450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bb05b640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc8b001fbe0 0x7fc8b003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bb05b640 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc8b001fbe0 0x7fc8b003a3c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.383+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8ac118060 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b71b0 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8ac118060 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b71b0 2024-09-10T14:28:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b71b0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.387+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b71b0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b71b0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b71b0 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8ac118060 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b71b0 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.391+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8ac118060 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b71b0 2024-09-10T14:28:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8b001fbe0 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x55b5368b2810 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5368b6450 con 0x7fc8ac118060 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:50.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368ba570 con 0x55b5368b2810 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368badc0 con 0x55b5368b2810 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368ba910 con 0x7fc8b001fbe0 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 zone default found 2024-09-10T14:28:50.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 4 Realm: () 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 zonegroup default 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bad40 con 0x7fc8b001fbe0 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.395+0000 7fc8bcd4a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bd260 con 0x55b5368b71b0 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bd600 con 0x55b5368b71b0 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 20 started sync module instance, tier type = 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bc700 con 0x7fc8ac118060 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94236792570448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bd600 con 0x7fc8ac118060 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bdef0 con 0x55b5368b2810 2024-09-10T14:28:50.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94236792570448] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94236792576416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368be2e0 con 0x55b5368b2810 2024-09-10T14:28:50.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.399+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368beca0 con 0x55b5368b71b0 2024-09-10T14:28:50.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.403+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.403+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94236792576416] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.403+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94236792580080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bec10 con 0x55b5368b71b0 2024-09-10T14:28:50.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.403+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bcb60 con 0x7fc8ac118060 2024-09-10T14:28:50.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.403+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.403+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94236792583904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bffb0 con 0x7fc8ac118060 2024-09-10T14:28:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.403+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c0970 con 0x55b5368b2810 2024-09-10T14:28:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94236792580080] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94236792583904] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94236792582288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c0970 con 0x55b5368b2810 2024-09-10T14:28:50.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c1210 con 0x7fc8b001fbe0 2024-09-10T14:28:50.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94236792582288] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94236792587728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c0f60 con 0x7fc8b001fbe0 2024-09-10T14:28:50.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.407+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c1a60 con 0x7fc8b001fbe0 2024-09-10T14:28:50.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.411+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.411+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94236792591696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c1ed0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.411+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c29c0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.411+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94236792587728] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94236792591696] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94236792595600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c1a20 con 0x7fc8b001fbe0 2024-09-10T14:28:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 20 add_watcher() i=0 2024-09-10T14:28:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 20 add_watcher() i=1 2024-09-10T14:28:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 20 add_watcher() i=2 2024-09-10T14:28:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 20 add_watcher() i=3 2024-09-10T14:28:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 20 add_watcher() i=4 2024-09-10T14:28:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 20 add_watcher() i=5 2024-09-10T14:28:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 20 add_watcher() i=6 2024-09-10T14:28:50.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94236792595600] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 20 add_watcher() i=7 2024-09-10T14:28:50.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:50.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c5ac0 con 0x55b5368b2810 2024-09-10T14:28:50.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.415+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94236792588784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368c2f40 con 0x55b5368b2810 2024-09-10T14:28:50.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94236792588784] v33'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc7717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:50.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 5 note: GC not initialized 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc6ebfff640 20 reqs_thread_entry: start 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 20 Filter name: none 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc6e9ffb640 20 reqs_thread_entry: start 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368e8e90 con 0x55b5368b2810 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368e9900 con 0x55b5368b2810 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-10T14:28:50.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368ef2f0 con 0x55b5368b2810 2024-09-10T14:28:50.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v33'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:50.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94236792778080 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368ea910 con 0x55b5368b2810 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify (1) cookie 94236792582288 notify 141733920773 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fc8b402d040 con 0x55b5368b2810 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc79e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94236792582288 notifier 4358 bl.length()=732 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc79e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc79e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(65 notify.4 [notify cookie 94236792778080 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc79e7fc640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fc780003eb0 con 0x55b5368b2810 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== watch-notify(notify_complete (2) cookie 94236792778080 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc8b401e040 con 0x55b5368b2810 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.419+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368eed60 con 0x55b5368b2810 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8bcd4a980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8bcd4a980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8bcd4a980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94236792778080 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5368ea460 con 0x7fc8ac118060 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== watch-notify(notify (1) cookie 94236792570448 notify 141733920770 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fc8b0018040 con 0x7fc8ac118060 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc79e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94236792570448 notifier 4358 bl.length()=166 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc79e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc79e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(68 notify.0 [notify cookie 94236792778080 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc79e7fc640 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fc780003eb0 con 0x7fc8ac118060 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== watch-notify(notify_complete (2) cookie 94236792778080 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b536609ae0 con 0x7fc8ac118060 2024-09-10T14:28:50.430 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"sBDV06RSDcmFEoGfCTJ3kNCDERNZhBaYBFunaEDg","active":true,"create_date":"2024-09-10T14:28:50.425166Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:50.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc7717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94236792588784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368e6cc0 con 0x55b5368b2810 2024-09-10T14:28:50.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94236792588784] v33'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.423+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94236792570448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368e6cc0 con 0x7fc8ac118060 2024-09-10T14:28:50.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.427+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94236792570448] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.427+0000 7fc8bcd4a980 20 remove_watcher() i=0 2024-09-10T14:28:50.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.427+0000 7fc8bcd4a980 2 removed watcher, disabling cache 2024-09-10T14:28:50.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.427+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94236792576416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bc250 con 0x55b5368b2810 2024-09-10T14:28:50.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.427+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94236792576416] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.427+0000 7fc8bcd4a980 20 remove_watcher() i=1 2024-09-10T14:28:50.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.427+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94236792580080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368e6cc0 con 0x55b5368b71b0 2024-09-10T14:28:50.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8ba85a640 1 -- 172.21.15.151:0/1211570146 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94236792580080] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac115030 con 0x55b5368b71b0 2024-09-10T14:28:50.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8bcd4a980 20 remove_watcher() i=2 2024-09-10T14:28:50.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94236792583904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bd9a0 con 0x7fc8ac118060 2024-09-10T14:28:50.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8ba059640 1 -- 172.21.15.151:0/1211570146 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94236792583904] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b0037040 con 0x7fc8ac118060 2024-09-10T14:28:50.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8bcd4a980 20 remove_watcher() i=3 2024-09-10T14:28:50.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94236792582288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bc250 con 0x55b5368b2810 2024-09-10T14:28:50.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94236792582288] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x55b5368b2810 2024-09-10T14:28:50.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8bcd4a980 20 remove_watcher() i=4 2024-09-10T14:28:50.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.431+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94236792587728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368be7f0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.435+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94236792587728] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.435+0000 7fc8bcd4a980 20 remove_watcher() i=5 2024-09-10T14:28:50.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.435+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94236792591696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368e6cc0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.435+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94236792591696] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.435+0000 7fc8bcd4a980 20 remove_watcher() i=6 2024-09-10T14:28:50.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.435+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94236792595600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5368bf6e0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94236792595600] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8b400a4d0 con 0x7fc8b001fbe0 2024-09-10T14:28:50.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 20 remove_watcher() i=7 2024-09-10T14:28:50.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc8b001fbe0 msgr2=0x7fc8b003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc8b001fbe0 0x7fc8b003a3c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5368b2810 msgr2=0x55b5368b4cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5368b2810 0x55b5368b4cb0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc8ac118060 msgr2=0x7fc8ac004290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc8ac118060 0x7fc8ac004290 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b5368b71b0 msgr2=0x55b5368b95a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b5368b71b0 0x55b5368b95a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc784034600 msgr2=0x7fc784036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc784034600 0x7fc784036ac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000c010 tx=0x7fc8b0010000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 msgr2=0x55b5368a7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bb05b640 1 -- 172.21.15.151:0/1211570146 reap_dead start 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b5368a7760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0f0000 tx=0x7fc8ac002da0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 shutdown_connections 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/1211570146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b53689e3a0 0x55b5368a7760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 >> 172.21.15.151:0/1211570146 conn(0x55b53689a780 msgr2=0x55b536898850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 shutdown_connections 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/1211570146 wait complete. 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/4000101297 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc794034650 msgr2=0x7fc794036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/4000101297 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc794034650 0x7fc794036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55b5368843b0 tx=0x7fc8b000f000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/4000101297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b536891a40 msgr2=0x55b536891e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/4000101297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b536891a40 0x55b536891e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0e37a0 tx=0x7fc8ac0c5e20 comp rx=0 tx=0).stop 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/4000101297 shutdown_connections 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/4000101297 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc794034650 0x7fc794036b10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/4000101297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b536891a40 0x55b536891e60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/4000101297 >> 172.21.15.151:0/4000101297 conn(0x55b536886b90 msgr2=0x55b536889610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/4000101297 shutdown_connections 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/4000101297 wait complete. 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b536881470 msgr2=0x55b536883860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b536881470 0x55b536883860 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5367848b0 msgr2=0x55b53687ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b5367848b0 0x55b53687ac00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b53687d570 msgr2=0x55b53687f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b53687d570 0x55b53687f960 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc7a00346a0 msgr2=0x7fc7a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc7a00346a0 0x7fc7a0036b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000f70 tx=0x7fc8b0001380 comp rx=0 tx=0).stop 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 msgr2=0x55b536873c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 --2- 172.21.15.151:0/2064796318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5366f62e0 0x55b536873c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0199f0 tx=0x7fc8ac0180e0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bb05b640 1 -- 172.21.15.151:0/2064796318 reap_dead start 2024-09-10T14:28:50.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 shutdown_connections 2024-09-10T14:28:50.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 >> 172.21.15.151:0/2064796318 conn(0x55b53677c0a0 msgr2=0x55b5368671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 shutdown_connections 2024-09-10T14:28:50.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.439+0000 7fc8bcd4a980 1 -- 172.21.15.151:0/2064796318 wait complete. 2024-09-10T14:28:50.453 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'sBDV06RSDcmFEoGfCTJ3kNCDERNZhBaYBFunaEDg', 'active': True, 'create_date': '2024-09-10T14:28:50.425166Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:50.453 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T14:28:50.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T14:28:50.454 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-10T14:28:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc356e980 1 Processor -- start 2024-09-10T14:28:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc356e980 1 -- start start 2024-09-10T14:28:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc356e980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d53433de60 0x55d534340250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc356e980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5341bfae0 con 0x55d5342ac230 2024-09-10T14:28:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc356e980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55d5341e3e30 con 0x55d53433de60 2024-09-10T14:28:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc087d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d53433de60 0x55d534340250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc107e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d5342ac230 0x55d53433c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34194/0 (socket says 172.21.15.151:34194) 2024-09-10T14:28:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc087d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d53433de60 0x55d534340250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41602/0 (socket says 172.21.15.151:41602) 2024-09-10T14:28:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.531+0000 7fccc107e640 1 -- 172.21.15.151:0/358792965 learned_addr learned my addr 172.21.15.151:0/358792965 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc087d640 1 -- 172.21.15.151:0/358792965 >> v1:172.21.15.52:6789/0 conn(0x55d5342ac230 legacy=0x55d53433c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc087d640 1 -- 172.21.15.151:0/358792965 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5342ac610 con 0x55d53433de60 2024-09-10T14:28:50.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc087d640 1 --2- 172.21.15.151:0/358792965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d53433de60 0x55d534340250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fccb800a480 tx=0x7fccb801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48479a2588ccb5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccb3fff640 1 -- 172.21.15.151:0/358792965 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb80b0070 con 0x55d53433de60 2024-09-10T14:28:50.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccb3fff640 1 -- 172.21.15.151:0/358792965 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb80ab540 con 0x55d53433de60 2024-09-10T14:28:50.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccb3fff640 1 -- 172.21.15.151:0/358792965 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb80ab840 con 0x55d53433de60 2024-09-10T14:28:50.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc356e980 1 -- 172.21.15.151:0/358792965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d53433de60 msgr2=0x55d534340250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc356e980 1 --2- 172.21.15.151:0/358792965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d53433de60 0x55d534340250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fccb800a480 tx=0x7fccb801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:50.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc356e980 1 -- 172.21.15.151:0/358792965 shutdown_connections 2024-09-10T14:28:50.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc356e980 1 --2- 172.21.15.151:0/358792965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d53433de60 0x55d534340250 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc356e980 1 -- 172.21.15.151:0/358792965 >> 172.21.15.151:0/358792965 conn(0x55d534332030 msgr2=0x55d534334450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc356e980 1 -- 172.21.15.151:0/358792965 shutdown_connections 2024-09-10T14:28:50.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.535+0000 7fccc356e980 1 -- 172.21.15.151:0/358792965 wait complete. 2024-09-10T14:28:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 Processor -- start 2024-09-10T14:28:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- start start 2024-09-10T14:28:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d534424c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5341e5200 con 0x55d5342ac230 2024-09-10T14:28:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d534424c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d534424c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41604/0 (socket says 172.21.15.151:41604) 2024-09-10T14:28:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 -- 172.21.15.151:0/208879502 learned_addr learned my addr 172.21.15.151:0/208879502 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 -- 172.21.15.151:0/208879502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d534425260 con 0x55d5342ac230 2024-09-10T14:28:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 --2- 172.21.15.151:0/208879502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d534424c90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fccb4001d90 tx=0x7fccb4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab9068d27d81388 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fcbaf606640 1 -- 172.21.15.151:0/208879502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4013030 con 0x55d5342ac230 2024-09-10T14:28:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fcbaf606640 1 -- 172.21.15.151:0/208879502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb400e690 con 0x55d5342ac230 2024-09-10T14:28:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fcbaf606640 1 -- 172.21.15.151:0/208879502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb400ea10 con 0x55d5342ac230 2024-09-10T14:28:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- 172.21.15.151:0/208879502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 msgr2=0x55d534424c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 --2- 172.21.15.151:0/208879502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d534424c90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fccb4001d90 tx=0x7fccb4001e80 comp rx=0 tx=0).stop 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- 172.21.15.151:0/208879502 shutdown_connections 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 --2- 172.21.15.151:0/208879502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d534424c90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- 172.21.15.151:0/208879502 >> 172.21.15.151:0/208879502 conn(0x55d534332030 msgr2=0x55d5344208c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- 172.21.15.151:0/208879502 shutdown_connections 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- 172.21.15.151:0/208879502 wait complete. 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 Processor -- start 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- start start 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d53442c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc356e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5343431c0 con 0x55d5342ac230 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d53442c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d53442c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41612/0 (socket says 172.21.15.151:41612) 2024-09-10T14:28:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 -- 172.21.15.151:0/3930267835 learned_addr learned my addr 172.21.15.151:0/3930267835 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.551+0000 7fccc107e640 1 -- 172.21.15.151:0/3930267835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53442c580 con 0x55d5342ac230 2024-09-10T14:28:50.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc107e640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d53442c040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55d534425e70 tx=0x7fccb4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fcbade03640 1 -- 172.21.15.151:0/3930267835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4027070 con 0x55d5342ac230 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d53442c810 con 0x55d5342ac230 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fcbade03640 1 -- 172.21.15.151:0/3930267835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb4019900 con 0x55d5342ac230 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d53442f4f0 con 0x55d5342ac230 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fcbade03640 1 -- 172.21.15.151:0/3930267835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4019be0 con 0x55d5342ac230 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fcbade03640 1 -- 172.21.15.151:0/3930267835 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fccb402a070 con 0x55d5342ac230 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fcbade03640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcba8034650 0x7fcba8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fcbade03640 1 -- 172.21.15.151:0/3930267835 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fccb401f070 con 0x55d5342ac230 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc087d640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcba8034650 0x7fcba8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc356e980 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d53433de60 0x55d534433050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534433640 con 0x55d53433de60 2024-09-10T14:28:50.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc187f640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d53433de60 0x55d534433050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc087d640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcba8034650 0x7fcba8036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fccb80ad000 tx=0x7fccb80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc187f640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d53433de60 0x55d534433050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc187f640 1 -- 172.21.15.151:0/3930267835 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d53433de60 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534430710 con 0x55d53433de60 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc187f640 1 -- 172.21.15.151:0/3930267835 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d53433de60 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc356e980 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d534435990 0x55d534437d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534438450 con 0x55d534435990 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc107e640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d534435990 0x55d534437d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.555+0000 7fccc107e640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d534435990 0x55d534437d80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc107e640 1 -- 172.21.15.151:0/3930267835 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fccb4029030 con 0x55d534435990 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534434830 con 0x55d53433de60 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc187f640 1 -- 172.21.15.151:0/3930267835 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d53433de60 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc356e980 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d534439890 0x55d53443bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d53443c410 con 0x55d534439890 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc087d640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d534439890 0x55d53443bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc087d640 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d534439890 0x55d53443bc80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc087d640 1 -- 172.21.15.151:0/3930267835 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fccb80ab8f0 con 0x55d534439890 2024-09-10T14:28:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc356e980 1 Processor -- start 2024-09-10T14:28:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc356e980 1 -- start start 2024-09-10T14:28:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc356e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d534449ea0 0x55d53444a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc356e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d53423e800 con 0x55d534449ea0 2024-09-10T14:28:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d534449ea0 0x55d53444a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d534449ea0 0x55d53444a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41620/0 (socket says 172.21.15.151:41620) 2024-09-10T14:28:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc107e640 1 -- 172.21.15.151:0/3310039724 learned_addr learned my addr 172.21.15.151:0/3310039724 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.559+0000 7fccc107e640 1 -- 172.21.15.151:0/3310039724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53444a800 con 0x55d534449ea0 2024-09-10T14:28:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc107e640 1 --2- 172.21.15.151:0/3310039724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d534449ea0 0x55d53444a2c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fccb400bc00 tx=0x7fccb4016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba6ffd640 1 -- 172.21.15.151:0/3310039724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4040070 con 0x55d534449ea0 2024-09-10T14:28:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc356e980 1 -- 172.21.15.151:0/3310039724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d53444aa90 con 0x55d534449ea0 2024-09-10T14:28:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba6ffd640 1 -- 172.21.15.151:0/3310039724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb402a580 con 0x55d534449ea0 2024-09-10T14:28:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba6ffd640 1 -- 172.21.15.151:0/3310039724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4037040 con 0x55d534449ea0 2024-09-10T14:28:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc356e980 1 -- 172.21.15.151:0/3310039724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d53444d710 con 0x55d534449ea0 2024-09-10T14:28:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba6ffd640 1 -- 172.21.15.151:0/3310039724 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fccb4016070 con 0x55d534449ea0 2024-09-10T14:28:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba6ffd640 1 --2- 172.21.15.151:0/3310039724 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb98034650 0x7fcb98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba6ffd640 1 -- 172.21.15.151:0/3310039724 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fccb4014070 con 0x55d534449ea0 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc087d640 1 --2- 172.21.15.151:0/3310039724 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb98034650 0x7fcb98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc356e980 1 Processor -- start 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc356e980 1 -- start start 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc087d640 1 --2- 172.21.15.151:0/3310039724 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb98034650 0x7fcb98036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fccb8000c10 tx=0x7fccb8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc356e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d534456bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc356e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5344255e0 con 0x55d5344567d0 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d534456bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d534456bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41630/0 (socket says 172.21.15.151:41630) 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc107e640 1 -- 172.21.15.151:0/2052443081 learned_addr learned my addr 172.21.15.151:0/2052443081 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc107e640 1 -- 172.21.15.151:0/2052443081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5344571a0 con 0x55d5344567d0 2024-09-10T14:28:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc107e640 1 --2- 172.21.15.151:0/2052443081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d534456bd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fccb40471d0 tx=0x7fccb402d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a777247e6028fac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba4ff9640 1 -- 172.21.15.151:0/2052443081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb405f020 con 0x55d5344567d0 2024-09-10T14:28:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba4ff9640 1 -- 172.21.15.151:0/2052443081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb400c970 con 0x55d5344567d0 2024-09-10T14:28:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fcba4ff9640 1 -- 172.21.15.151:0/2052443081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4050dd0 con 0x55d5344567d0 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc356e980 1 -- 172.21.15.151:0/2052443081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 msgr2=0x55d534456bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.563+0000 7fccc356e980 1 --2- 172.21.15.151:0/2052443081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d534456bd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fccb40471d0 tx=0x7fccb402d450 comp rx=0 tx=0).stop 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- 172.21.15.151:0/2052443081 shutdown_connections 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 --2- 172.21.15.151:0/2052443081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d534456bd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- 172.21.15.151:0/2052443081 >> 172.21.15.151:0/2052443081 conn(0x55d534452bb0 msgr2=0x55d534450cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- 172.21.15.151:0/2052443081 shutdown_connections 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- 172.21.15.151:0/2052443081 wait complete. 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 Processor -- start 2024-09-10T14:28:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- start start 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d53445d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d534457620 con 0x55d5344567d0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d53445d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc107e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d53445d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41638/0 (socket says 172.21.15.151:41638) 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 learned_addr learned my addr 172.21.15.151:0/2564767940 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53445df10 con 0x55d5344567d0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc107e640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d53445d9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fccb4021530 tx=0x7fccb4031670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fcb96ffd640 1 -- 172.21.15.151:0/2564767940 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb4041260 con 0x55d5344567d0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d53445df10 con 0x55d5344567d0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fcb96ffd640 1 -- 172.21.15.151:0/2564767940 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb402d630 con 0x55d5344567d0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d53445df10 con 0x55d5344567d0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fcb96ffd640 1 -- 172.21.15.151:0/2564767940 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb402d820 con 0x55d5344567d0 2024-09-10T14:28:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fcb96ffd640 1 -- 172.21.15.151:0/2564767940 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fccb4062020 con 0x55d5344567d0 2024-09-10T14:28:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fcb96ffd640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb8c034650 0x7fcb8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fcb96ffd640 1 -- 172.21.15.151:0/2564767940 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fccb406d070 con 0x55d5344567d0 2024-09-10T14:28:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc087d640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb8c034650 0x7fcb8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d534468a10 0x55d53446aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d53446b620 con 0x55d534468a10 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.567+0000 7fccc187f640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d534468a10 0x55d53446aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc087d640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb8c034650 0x7fcb8c036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fccb8018eb0 tx=0x7fccb80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc187f640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d534468a10 0x55d53446aed0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 realm 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d53446ba80 con 0x55d534468a10 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c320 con 0x55d534468a10 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x55d534468a10 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d53446d420 0x55d53446f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d53446feb0 con 0x55d53446d420 2024-09-10T14:28:50.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc107e640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d53446d420 0x55d53446f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc107e640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d53446d420 0x55d53446f810 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 20 searching for the correct realm 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d534471710 con 0x55d53446d420 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc107e640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fccb4064050 0x7fccb40215a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d534471710 con 0x7fccb4064050 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc087d640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fccb4064050 0x7fccb40215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc087d640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fccb4064050 0x7fccb40215a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc087d640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fccb80cf040 0x7fccb80dc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d534471710 con 0x7fccb80cf040 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc187f640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fccb80cf040 0x7fccb80dc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.571+0000 7fccc187f640 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fccb80cf040 0x7fccb80dc920 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x55d534468a10 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x55d534468a10 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x7fccb80cf040 2024-09-10T14:28:50.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x7fccb80cf040 2024-09-10T14:28:50.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x7fccb4064050 2024-09-10T14:28:50.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x55d53446d420 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x55d534468a10 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x7fccb80cf040 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x55d534468a10 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.575+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d53446c6c0 con 0x7fccb4064050 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d53446d420 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d53446d420 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x7fccb80cf040 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d53446d420 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d53446d420 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d534468a10 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d534468a10 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x7fccb80cf040 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d53446d420 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x7fccb4064050 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d534468a10 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.579+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x7fccb80cf040 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d53446d420 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x7fccb80cf040 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x7fccb4064050 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d53446d420 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x7fccb80cf040 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x55d534468a10 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fccb80e9060 con 0x7fccb4064050 2024-09-10T14:28:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d5344707c0 con 0x55d534468a10 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534471010 con 0x55d534468a10 2024-09-10T14:28:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.583+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534470b60 con 0x7fccb80cf040 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 zone default found 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 4 Realm: () 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 zonegroup default 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534470f90 con 0x7fccb80cf040 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534470ff0 con 0x55d53446d420 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d534473600 con 0x55d53446d420 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 started sync module instance, tier type = 2024-09-10T14:28:50.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344729c0 con 0x7fccb4064050 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94374193474992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534473f10 con 0x7fccb4064050 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534474760 con 0x55d534468a10 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.587+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94374193474992] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.591+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.591+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94374193478240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534474760 con 0x55d534468a10 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.591+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534475220 con 0x55d53446d420 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.591+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94374193478240] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.591+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.591+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94374193482992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534474760 con 0x55d53446d420 2024-09-10T14:28:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.591+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534475c30 con 0x7fccb4064050 2024-09-10T14:28:50.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.595+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.595+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94374193485696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534476480 con 0x7fccb4064050 2024-09-10T14:28:50.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.595+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534476ea0 con 0x55d534468a10 2024-09-10T14:28:50.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.595+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94374193485696] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.595+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94374193482992] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.595+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.595+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94374193480368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534475fd0 con 0x55d534468a10 2024-09-10T14:28:50.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.595+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534477740 con 0x7fccb80cf040 2024-09-10T14:28:50.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.599+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94374193480368] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.599+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.599+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94374193490320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344776c0 con 0x7fccb80cf040 2024-09-10T14:28:50.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.599+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534477fb0 con 0x7fccb80cf040 2024-09-10T14:28:50.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.599+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.599+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94374193493696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534478660 con 0x7fccb80cf040 2024-09-10T14:28:50.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.599+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534478f10 con 0x7fccb80cf040 2024-09-10T14:28:50.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.599+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94374193490320] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94374193493696] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94374193492416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534478660 con 0x7fccb80cf040 2024-09-10T14:28:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 20 add_watcher() i=0 2024-09-10T14:28:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 20 add_watcher() i=1 2024-09-10T14:28:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 20 add_watcher() i=2 2024-09-10T14:28:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 20 add_watcher() i=3 2024-09-10T14:28:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 20 add_watcher() i=4 2024-09-10T14:28:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 20 add_watcher() i=5 2024-09-10T14:28:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 20 add_watcher() i=6 2024-09-10T14:28:50.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94374193492416] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 20 add_watcher() i=7 2024-09-10T14:28:50.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:50.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d53447c010 con 0x55d534468a10 2024-09-10T14:28:50.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.603+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94374193496464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d534479490 con 0x55d534468a10 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94374193496464] v33'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fcb777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 5 note: GC not initialized 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fcb767e4640 20 reqs_thread_entry: start 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 20 Filter name: none 2024-09-10T14:28:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fcae7fff640 20 reqs_thread_entry: start 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d53449f490 con 0x55d534468a10 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a5c30 con 0x55d534468a10 2024-09-10T14:28:50.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v33'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94374193682080 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x55d534468a10 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 94374193480368 notify 141733920774 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fccbc02d040 con 0x55d534468a10 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fcba4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94374193480368 notifier 4365 bl.length()=732 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fcba4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fcba4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(64 notify.4 [notify cookie 94374193682080 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fcba4ff9640 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fcb84003eb0 con 0x55d534468a10 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.607+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 94374193682080 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fccbc01e040 con 0x55d534468a10 2024-09-10T14:28:50.616 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:50.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.611+0000 7fcb777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.611+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94374193496464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a0eb0 con 0x55d534468a10 2024-09-10T14:28:50.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.611+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94374193496464] v33'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.611+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94374193474992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x7fccb4064050 2024-09-10T14:28:50.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.611+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94374193474992] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.611+0000 7fccc356e980 20 remove_watcher() i=0 2024-09-10T14:28:50.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.611+0000 7fccc356e980 2 removed watcher, disabling cache 2024-09-10T14:28:50.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.611+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94374193478240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x55d534468a10 2024-09-10T14:28:50.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94374193478240] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc356e980 20 remove_watcher() i=1 2024-09-10T14:28:50.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94374193482992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x55d53446d420 2024-09-10T14:28:50.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc107e640 1 -- 172.21.15.151:0/2564767940 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94374193482992] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb4029030 con 0x55d53446d420 2024-09-10T14:28:50.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc356e980 20 remove_watcher() i=2 2024-09-10T14:28:50.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94374193485696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x7fccb4064050 2024-09-10T14:28:50.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc087d640 1 -- 172.21.15.151:0/2564767940 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94374193485696] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb80da070 con 0x7fccb4064050 2024-09-10T14:28:50.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc356e980 20 remove_watcher() i=3 2024-09-10T14:28:50.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.615+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94374193480368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x55d534468a10 2024-09-10T14:28:50.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.619+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94374193480368] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x55d534468a10 2024-09-10T14:28:50.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.619+0000 7fccc356e980 20 remove_watcher() i=4 2024-09-10T14:28:50.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.619+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94374193490320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x7fccb80cf040 2024-09-10T14:28:50.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.619+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94374193490320] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.619+0000 7fccc356e980 20 remove_watcher() i=5 2024-09-10T14:28:50.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.619+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94374193493696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x7fccb80cf040 2024-09-10T14:28:50.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.623+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94374193493696] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.623+0000 7fccc356e980 20 remove_watcher() i=6 2024-09-10T14:28:50.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.623+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94374193492416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d5344a1360 con 0x7fccb80cf040 2024-09-10T14:28:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.623+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94374193492416] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccbc00a4d0 con 0x7fccb80cf040 2024-09-10T14:28:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.623+0000 7fccc356e980 20 remove_watcher() i=7 2024-09-10T14:28:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fccb80cf040 msgr2=0x7fccb80dc920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fccb80cf040 0x7fccb80dc920 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d534468a10 msgr2=0x55d53446aed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d534468a10 0x55d53446aed0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fccb4064050 msgr2=0x7fccb40215a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fccb4064050 0x7fccb40215a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d53446d420 msgr2=0x55d53446f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d53446d420 0x55d53446f810 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb8c034650 msgr2=0x7fcb8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb8c034650 0x7fcb8c036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fccb8018eb0 tx=0x7fccb80a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc187f640 1 -- 172.21.15.151:0/2564767940 reap_dead start 2024-09-10T14:28:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 msgr2=0x55d53445d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d53445d9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fccb4021530 tx=0x7fccb4031670 comp rx=0 tx=0).stop 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 shutdown_connections 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/2564767940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5344567d0 0x55d53445d9d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 >> 172.21.15.151:0/2564767940 conn(0x55d534452bb0 msgr2=0x55d534450c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 shutdown_connections 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/2564767940 wait complete. 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3310039724 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb98034650 msgr2=0x7fcb98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3310039724 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb98034650 0x7fcb98036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fccb8000c10 tx=0x7fccb8005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3310039724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d534449ea0 msgr2=0x55d53444a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3310039724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d534449ea0 0x55d53444a2c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fccb400bc00 tx=0x7fccb4016630 comp rx=0 tx=0).stop 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3310039724 shutdown_connections 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3310039724 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcb98034650 0x7fcb98036b10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3310039724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d534449ea0 0x55d53444a2c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3310039724 >> 172.21.15.151:0/3310039724 conn(0x55d53443eff0 msgr2=0x55d534441a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3310039724 shutdown_connections 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3310039724 wait complete. 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d534439890 msgr2=0x55d53443bc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d534439890 0x55d53443bc80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d53433de60 msgr2=0x55d534433050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d53433de60 0x55d534433050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d534435990 msgr2=0x55d534437d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d534435990 0x55d534437d80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcba8034650 msgr2=0x7fcba8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcba8034650 0x7fcba8036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fccb80ad000 tx=0x7fccb80a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 msgr2=0x55d53442c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 --2- 172.21.15.151:0/3930267835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5342ac230 0x55d53442c040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55d534425e70 tx=0x7fccb4000bd0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc187f640 1 -- 172.21.15.151:0/3930267835 reap_dead start 2024-09-10T14:28:50.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 shutdown_connections 2024-09-10T14:28:50.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 >> 172.21.15.151:0/3930267835 conn(0x55d534332030 msgr2=0x55d53441f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 shutdown_connections 2024-09-10T14:28:50.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.627+0000 7fccc356e980 1 -- 172.21.15.151:0/3930267835 wait complete. 2024-09-10T14:28:50.640 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:50.640 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:28:50.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:28:50.640 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:28:50.710 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:50.710 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:50.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73f5bb980 1 Processor -- start 2024-09-10T14:28:50.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73f5bb980 1 -- start start 2024-09-10T14:28:50.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73f5bb980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559abb315910 0x559abb317d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73f5bb980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559abb19aae0 con 0x559abb311540 2024-09-10T14:28:50.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73f5bb980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x559abb1bee30 con 0x559abb315910 2024-09-10T14:28:50.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73c8ca640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559abb315910 0x559abb317d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73c8ca640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559abb315910 0x559abb317d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41640/0 (socket says 172.21.15.151:41640) 2024-09-10T14:28:50.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1094323959 learned_addr learned my addr 172.21.15.151:0/1094323959 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73d0cb640 1 --1- 172.21.15.151:0/1094323959 >> v1:172.21.15.52:6789/0 conn(0x559abb311540 0x559abb311920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34210/0 (socket says 172.21.15.151:34210) 2024-09-10T14:28:50.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1094323959 >> v1:172.21.15.52:6789/0 conn(0x559abb311540 legacy=0x559abb311920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.707+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1094323959 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abb319250 con 0x559abb315910 2024-09-10T14:28:50.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/1094323959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb315910 0x559abb317d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd73400a750 tx=0x7fd73401d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3361a6b4d2898753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd72ffff640 1 -- 172.21.15.151:0/1094323959 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7340b1070 con 0x559abb315910 2024-09-10T14:28:50.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd72ffff640 1 -- 172.21.15.151:0/1094323959 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73400a200 con 0x559abb315910 2024-09-10T14:28:50.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd72ffff640 1 -- 172.21.15.151:0/1094323959 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7340085a0 con 0x559abb315910 2024-09-10T14:28:50.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1094323959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb315910 msgr2=0x559abb317d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1094323959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb315910 0x559abb317d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd73400a750 tx=0x7fd73401d200 comp rx=0 tx=0).stop 2024-09-10T14:28:50.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1094323959 shutdown_connections 2024-09-10T14:28:50.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1094323959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb315910 0x559abb317d00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1094323959 >> 172.21.15.151:0/1094323959 conn(0x559abb30d060 msgr2=0x559abb30f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1094323959 shutdown_connections 2024-09-10T14:28:50.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.711+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1094323959 wait complete. 2024-09-10T14:28:50.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.723+0000 7fd73f5bb980 1 Processor -- start 2024-09-10T14:28:50.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.723+0000 7fd73f5bb980 1 -- start start 2024-09-10T14:28:50.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.723+0000 7fd73f5bb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb3fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.723+0000 7fd73f5bb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559abb1c0200 con 0x559abb311540 2024-09-10T14:28:50.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.723+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb3fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.723+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb3fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41650/0 (socket says 172.21.15.151:41650) 2024-09-10T14:28:50.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.723+0000 7fd73d0cb640 1 -- 172.21.15.151:0/150079282 learned_addr learned my addr 172.21.15.151:0/150079282 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73d0cb640 1 -- 172.21.15.151:0/150079282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abb3fbe70 con 0x559abb311540 2024-09-10T14:28:50.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/150079282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb3fb8a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd730001690 tx=0x7fd730001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7b85d0c53171fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd62b606640 1 -- 172.21.15.151:0/150079282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730003460 con 0x559abb311540 2024-09-10T14:28:50.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd62b606640 1 -- 172.21.15.151:0/150079282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730003600 con 0x559abb311540 2024-09-10T14:28:50.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd62b606640 1 -- 172.21.15.151:0/150079282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730003920 con 0x559abb311540 2024-09-10T14:28:50.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 -- 172.21.15.151:0/150079282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 msgr2=0x559abb3fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/150079282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb3fb8a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd730001690 tx=0x7fd730001b50 comp rx=0 tx=0).stop 2024-09-10T14:28:50.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 -- 172.21.15.151:0/150079282 shutdown_connections 2024-09-10T14:28:50.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/150079282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb3fb8a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 -- 172.21.15.151:0/150079282 >> 172.21.15.151:0/150079282 conn(0x559abb30d060 msgr2=0x559abb3f74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 -- 172.21.15.151:0/150079282 shutdown_connections 2024-09-10T14:28:50.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 -- 172.21.15.151:0/150079282 wait complete. 2024-09-10T14:28:50.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 Processor -- start 2024-09-10T14:28:50.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 -- start start 2024-09-10T14:28:50.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb402bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559abb318d50 con 0x559abb311540 2024-09-10T14:28:50.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb402bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb402bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41652/0 (socket says 172.21.15.151:41652) 2024-09-10T14:28:50.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73d0cb640 1 -- 172.21.15.151:0/3118967971 learned_addr learned my addr 172.21.15.151:0/3118967971 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73d0cb640 1 -- 172.21.15.151:0/3118967971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abb403110 con 0x559abb311540 2024-09-10T14:28:50.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb402bd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd730000f90 tx=0x7fd730001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd629e03640 1 -- 172.21.15.151:0/3118967971 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730022020 con 0x559abb311540 2024-09-10T14:28:50.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd629e03640 1 -- 172.21.15.151:0/3118967971 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730006840 con 0x559abb311540 2024-09-10T14:28:50.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.727+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559abb4033a0 con 0x559abb311540 2024-09-10T14:28:50.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd629e03640 1 -- 172.21.15.151:0/3118967971 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73001e800 con 0x559abb311540 2024-09-10T14:28:50.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559abb406080 con 0x559abb311540 2024-09-10T14:28:50.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd629e03640 1 -- 172.21.15.151:0/3118967971 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd730025020 con 0x559abb311540 2024-09-10T14:28:50.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd629e03640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd624034650 0x7fd624036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd629e03640 1 -- 172.21.15.151:0/3118967971 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd730049b90 con 0x559abb311540 2024-09-10T14:28:50.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd624034650 0x7fd624036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb315910 0x559abb409cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb40a210 con 0x559abb315910 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73d8cc640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb315910 0x559abb409cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd624034650 0x7fd624036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ae000 tx=0x7fd7340a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73d8cc640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb315910 0x559abb409cd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73d8cc640 1 -- 172.21.15.151:0/3118967971 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb315910 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb4072a0 con 0x559abb315910 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73d8cc640 1 -- 172.21.15.151:0/3118967971 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb315910 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb40c540 0x559abb40e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb40f000 con 0x559abb40c540 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb40c540 0x559abb40e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb40c540 0x559abb40e930 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73d0cb640 1 -- 172.21.15.151:0/3118967971 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd73001b040 con 0x559abb40c540 2024-09-10T14:28:50.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb40b3e0 con 0x559abb315910 2024-09-10T14:28:50.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73d8cc640 1 -- 172.21.15.151:0/3118967971 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb315910 2024-09-10T14:28:50.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559abb410460 0x559abb412850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.731+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb412f50 con 0x559abb410460 2024-09-10T14:28:50.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559abb410460 0x559abb412850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559abb410460 0x559abb412850 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73c8ca640 1 -- 172.21.15.151:0/3118967971 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd7340b4070 con 0x559abb410460 2024-09-10T14:28:50.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73f5bb980 1 Processor -- start 2024-09-10T14:28:50.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73f5bb980 1 -- start start 2024-09-10T14:28:50.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73f5bb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb420a20 0x559abb420e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73f5bb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559abb219800 con 0x559abb420a20 2024-09-10T14:28:50.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb420a20 0x559abb420e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb420a20 0x559abb420e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41656/0 (socket says 172.21.15.151:41656) 2024-09-10T14:28:50.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73d0cb640 1 -- 172.21.15.151:0/808802655 learned_addr learned my addr 172.21.15.151:0/808802655 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73d0cb640 1 -- 172.21.15.151:0/808802655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abb421380 con 0x559abb420a20 2024-09-10T14:28:50.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/808802655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb420a20 0x559abb420e40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd730047fb0 tx=0x7fd730010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd622ffd640 1 -- 172.21.15.151:0/808802655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73001de10 con 0x559abb420a20 2024-09-10T14:28:50.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd622ffd640 1 -- 172.21.15.151:0/808802655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730026730 con 0x559abb420a20 2024-09-10T14:28:50.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd73f5bb980 1 -- 172.21.15.151:0/808802655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559abb4215b0 con 0x559abb420a20 2024-09-10T14:28:50.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.735+0000 7fd622ffd640 1 -- 172.21.15.151:0/808802655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730026a10 con 0x559abb420a20 2024-09-10T14:28:50.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 -- 172.21.15.151:0/808802655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559abb424230 con 0x559abb420a20 2024-09-10T14:28:50.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd622ffd640 1 -- 172.21.15.151:0/808802655 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd730041210 con 0x559abb420a20 2024-09-10T14:28:50.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd622ffd640 1 --2- 172.21.15.151:0/808802655 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd614034600 0x7fd614036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd622ffd640 1 -- 172.21.15.151:0/808802655 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd730039070 con 0x559abb420a20 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/808802655 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd614034600 0x7fd614036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 Processor -- start 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 -- start start 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/808802655 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd614034600 0x7fd614036ac0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x559abb40aaf0 tx=0x7fd734005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb42d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559abb3fc190 con 0x559abb42d3a0 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb42d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb42d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41666/0 (socket says 172.21.15.151:41666) 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73d0cb640 1 -- 172.21.15.151:0/980664166 learned_addr learned my addr 172.21.15.151:0/980664166 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73d0cb640 1 -- 172.21.15.151:0/980664166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abb42dd70 con 0x559abb42d3a0 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/980664166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb42d7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd730049010 tx=0x7fd7300304c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fb38a83e9d01cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd620ff9640 1 -- 172.21.15.151:0/980664166 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730041b30 con 0x559abb42d3a0 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd620ff9640 1 -- 172.21.15.151:0/980664166 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730033d80 con 0x559abb42d3a0 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd620ff9640 1 -- 172.21.15.151:0/980664166 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730041610 con 0x559abb42d3a0 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 -- 172.21.15.151:0/980664166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 msgr2=0x559abb42d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/980664166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb42d7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd730049010 tx=0x7fd7300304c0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 -- 172.21.15.151:0/980664166 shutdown_connections 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/980664166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb42d7a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 -- 172.21.15.151:0/980664166 >> 172.21.15.151:0/980664166 conn(0x559abb429720 msgr2=0x559abb427820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 -- 172.21.15.151:0/980664166 shutdown_connections 2024-09-10T14:28:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.739+0000 7fd73f5bb980 1 -- 172.21.15.151:0/980664166 wait complete. 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 1 Processor -- start 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 1 -- start start 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb434580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559abb42e130 con 0x559abb42d3a0 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb434580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73d0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb434580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41668/0 (socket says 172.21.15.151:41668) 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 learned_addr learned my addr 172.21.15.151:0/1249667169 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559abb434ac0 con 0x559abb42d3a0 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb434580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd730049e80 tx=0x7fd7300338d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd612ffd640 1 -- 172.21.15.151:0/1249667169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd730010a50 con 0x559abb42d3a0 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd612ffd640 1 -- 172.21.15.151:0/1249667169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730041b30 con 0x559abb42d3a0 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559abb434ac0 con 0x559abb42d3a0 2024-09-10T14:28:50.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd612ffd640 1 -- 172.21.15.151:0/1249667169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd73001d550 con 0x559abb42d3a0 2024-09-10T14:28:50.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559abb434ac0 con 0x559abb42d3a0 2024-09-10T14:28:50.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd612ffd640 1 -- 172.21.15.151:0/1249667169 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd73006e030 con 0x559abb42d3a0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd612ffd640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd608034650 0x7fd608036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd612ffd640 1 -- 172.21.15.151:0/1249667169 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd73006c070 con 0x559abb42d3a0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd608034650 0x7fd608036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb43f5e0 0x559abb441a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb4421d0 con 0x559abb43f5e0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73d8cc640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb43f5e0 0x559abb441a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd608034650 0x7fd608036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd73400a590 tx=0x7fd7340a9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.743+0000 7fd73d8cc640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb43f5e0 0x559abb441a80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 realm 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb4425e0 con 0x559abb43f5e0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb442e80 con 0x559abb43f5e0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb443f80 0x559abb446370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb4468b0 con 0x559abb443f80 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb443f80 0x559abb446370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb443f80 0x559abb446370 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 20 searching for the correct realm 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb448150 con 0x559abb443f80 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d0cb640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd730030c20 0x7fd7300396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb448150 con 0x7fd730030c20 2024-09-10T14:28:50.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd730030c20 0x7fd7300396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd730030c20 0x7fd7300396d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73c8ca640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd7340b8070 0x7fd7340ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb448150 con 0x7fd7340b8070 2024-09-10T14:28:50.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d8cc640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd7340b8070 0x7fd7340ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.747+0000 7fd73d8cc640 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd7340b8070 0x7fd7340ac400 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd7340b8070 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd7340b8070 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd730030c20 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb443f80 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd7340b8070 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.751+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd730030c20 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb443f80 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb443f80 2024-09-10T14:28:50.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd7340b8070 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb443f80 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb443f80 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd7340b8070 2024-09-10T14:28:50.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb443f80 2024-09-10T14:28:50.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd730030c20 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.755+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd7340b8070 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb443f80 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd7340b8070 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd730030c20 2024-09-10T14:28:50.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb443f80 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd7340b8070 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x559abb43f5e0 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559abb443220 con 0x7fd730030c20 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:50.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb447100 con 0x559abb43f5e0 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.759+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb4474f0 con 0x559abb43f5e0 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb4474f0 con 0x7fd7340b8070 2024-09-10T14:28:50.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 zone default found 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 4 Realm: () 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 zonegroup default 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb447910 con 0x7fd7340b8070 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb447d30 con 0x559abb443f80 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb44a000 con 0x559abb443f80 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 started sync module instance, tier type = 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:50.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb4494a0 con 0x7fd730030c20 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94123055159488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb449100 con 0x7fd730030c20 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.763+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44ad40 con 0x559abb43f5e0 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.767+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94123055159488] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.767+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.767+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94123055162272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44b130 con 0x559abb43f5e0 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.767+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44baf0 con 0x559abb443f80 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.767+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.767+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94123055167040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44c390 con 0x559abb443f80 2024-09-10T14:28:50.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.767+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44cdb0 con 0x7fd730030c20 2024-09-10T14:28:50.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94123055162272] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94123055163328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44d650 con 0x7fd730030c20 2024-09-10T14:28:50.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44dea0 con 0x559abb43f5e0 2024-09-10T14:28:50.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94123055167040] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94123055163328] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94123055169248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44dea0 con 0x559abb43f5e0 2024-09-10T14:28:50.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.771+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44e770 con 0x7fd7340b8070 2024-09-10T14:28:50.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.775+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94123055169248] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.775+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.775+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94123055176480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44e490 con 0x7fd7340b8070 2024-09-10T14:28:50.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.775+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44efb0 con 0x7fd7340b8070 2024-09-10T14:28:50.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.775+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94123055176480] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.775+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.775+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94123055180416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44ef70 con 0x7fd7340b8070 2024-09-10T14:28:50.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.775+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44f9b0 con 0x7fd7340b8070 2024-09-10T14:28:50.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94123055180416] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94123055182976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44f970 con 0x7fd7340b8070 2024-09-10T14:28:50.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 20 add_watcher() i=0 2024-09-10T14:28:50.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 20 add_watcher() i=1 2024-09-10T14:28:50.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 20 add_watcher() i=2 2024-09-10T14:28:50.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 20 add_watcher() i=3 2024-09-10T14:28:50.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 20 add_watcher() i=4 2024-09-10T14:28:50.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 20 add_watcher() i=5 2024-09-10T14:28:50.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 20 add_watcher() i=6 2024-09-10T14:28:50.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94123055182976] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 20 add_watcher() i=7 2024-09-10T14:28:50.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:50.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.779+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb452e00 con 0x559abb43f5e0 2024-09-10T14:28:50.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94123055177536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb450320 con 0x559abb43f5e0 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94123055177536] v33'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd5f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 5 note: GC not initialized 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd5f27e4640 20 reqs_thread_entry: start 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 20 Filter name: none 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd563fff640 20 reqs_thread_entry: start 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559abb476010 con 0x559abb43f5e0 2024-09-10T14:28:50.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T14:28:50.788 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:50.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd5f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.783+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94123055177536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb474bc0 con 0x559abb43f5e0 2024-09-10T14:28:50.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94123055177536] v33'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94123055159488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb474bc0 con 0x7fd730030c20 2024-09-10T14:28:50.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94123055159488] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73f5bb980 20 remove_watcher() i=0 2024-09-10T14:28:50.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73f5bb980 2 removed watcher, disabling cache 2024-09-10T14:28:50.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94123055162272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb4498c0 con 0x559abb43f5e0 2024-09-10T14:28:50.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94123055162272] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73f5bb980 20 remove_watcher() i=1 2024-09-10T14:28:50.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.787+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94123055167040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb4498c0 con 0x559abb443f80 2024-09-10T14:28:50.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.791+0000 7fd73d0cb640 1 -- 172.21.15.151:0/1249667169 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94123055167040] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd730050070 con 0x559abb443f80 2024-09-10T14:28:50.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.791+0000 7fd73f5bb980 20 remove_watcher() i=2 2024-09-10T14:28:50.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.791+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94123055163328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44a3a0 con 0x7fd730030c20 2024-09-10T14:28:50.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.791+0000 7fd73c8ca640 1 -- 172.21.15.151:0/1249667169 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94123055163328] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7340d9040 con 0x7fd730030c20 2024-09-10T14:28:50.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.791+0000 7fd73f5bb980 20 remove_watcher() i=3 2024-09-10T14:28:50.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.791+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94123055169248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44b640 con 0x559abb43f5e0 2024-09-10T14:28:50.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.795+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94123055169248] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x559abb43f5e0 2024-09-10T14:28:50.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.795+0000 7fd73f5bb980 20 remove_watcher() i=4 2024-09-10T14:28:50.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.795+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94123055176480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb44bee0 con 0x7fd7340b8070 2024-09-10T14:28:50.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.795+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94123055176480] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.795+0000 7fd73f5bb980 20 remove_watcher() i=5 2024-09-10T14:28:50.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.795+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94123055180416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb475410 con 0x7fd7340b8070 2024-09-10T14:28:50.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94123055180416] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 20 remove_watcher() i=6 2024-09-10T14:28:50.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94123055182976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559abb475410 con 0x7fd7340b8070 2024-09-10T14:28:50.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94123055182976] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7380083f0 con 0x7fd7340b8070 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 20 remove_watcher() i=7 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd7340b8070 msgr2=0x7fd7340ac400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd7340b8070 0x7fd7340ac400 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb43f5e0 msgr2=0x559abb441a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb43f5e0 0x559abb441a80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd730030c20 msgr2=0x7fd7300396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd730030c20 0x7fd7300396d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb443f80 msgr2=0x559abb446370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb443f80 0x559abb446370 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd608034650 msgr2=0x7fd608036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd608034650 0x7fd608036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd73400a590 tx=0x7fd7340a9000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 msgr2=0x559abb434580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/1249667169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb42d3a0 0x559abb434580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd730049e80 tx=0x7fd7300338d0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73d8cc640 1 -- 172.21.15.151:0/1249667169 reap_dead start 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 shutdown_connections 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 >> 172.21.15.151:0/1249667169 conn(0x559abb429720 msgr2=0x559abb4277f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 shutdown_connections 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.799+0000 7fd73f5bb980 1 -- 172.21.15.151:0/1249667169 wait complete. 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/808802655 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd614034600 msgr2=0x7fd614036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/808802655 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd614034600 0x7fd614036ac0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x559abb40aaf0 tx=0x7fd734005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/808802655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb420a20 msgr2=0x559abb420e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/808802655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb420a20 0x559abb420e40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd730047fb0 tx=0x7fd730010f90 comp rx=0 tx=0).stop 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/808802655 shutdown_connections 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/808802655 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd614034600 0x7fd614036ac0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/808802655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb420a20 0x559abb420e40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/808802655 >> 172.21.15.151:0/808802655 conn(0x559abb415b70 msgr2=0x559abb4185f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/808802655 shutdown_connections 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/808802655 wait complete. 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559abb410460 msgr2=0x559abb412850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559abb410460 0x559abb412850 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb315910 msgr2=0x559abb409cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559abb315910 0x559abb409cd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb40c540 msgr2=0x559abb40e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559abb40c540 0x559abb40e930 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd624034650 msgr2=0x7fd624036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd624034650 0x7fd624036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7340ae000 tx=0x7fd7340a7000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 msgr2=0x559abb402bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 --2- 172.21.15.151:0/3118967971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559abb311540 0x559abb402bd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd730000f90 tx=0x7fd730001260 comp rx=0 tx=0).stop 2024-09-10T14:28:50.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73d8cc640 1 -- 172.21.15.151:0/3118967971 reap_dead start 2024-09-10T14:28:50.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 shutdown_connections 2024-09-10T14:28:50.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 >> 172.21.15.151:0/3118967971 conn(0x559abb30d060 msgr2=0x559abb3f6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 shutdown_connections 2024-09-10T14:28:50.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.803+0000 7fd73f5bb980 1 -- 172.21.15.151:0/3118967971 wait complete. 2024-09-10T14:28:50.815 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:50.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:28:50.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:28:50.815 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:28:50.884 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:50.884 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:50.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbef0a19980 1 Processor -- start 2024-09-10T14:28:50.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbef0a19980 1 -- start start 2024-09-10T14:28:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbef0a19980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55bf63f88c60 0x55bf63f8b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbef0a19980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bf63e0aae0 con 0x55bf63f848e0 2024-09-10T14:28:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbef0a19980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55bf63e2ee30 con 0x55bf63f88c60 2024-09-10T14:28:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbeee529640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55bf63f848e0 0x55bf63f84cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34212/0 (socket says 172.21.15.151:34212) 2024-09-10T14:28:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbeee529640 1 -- 172.21.15.151:0/1565271104 learned_addr learned my addr 172.21.15.151:0/1565271104 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbeedd28640 1 --2- 172.21.15.151:0/1565271104 >> v2:172.21.15.52:3300/0 conn(0x55bf63f88c60 0x55bf63f8b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbeed527640 1 -- 172.21.15.151:0/1565271104 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994121688 0 0) 0x55bf63e0aae0 con 0x55bf63f848e0 2024-09-10T14:28:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbeed527640 1 -- 172.21.15.151:0/1565271104 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbedc001e20 con 0x55bf63f848e0 2024-09-10T14:28:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbeedd28640 1 -- 172.21.15.151:0/1565271104 >> v1:172.21.15.52:6789/0 conn(0x55bf63f848e0 legacy=0x55bf63f84cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbeedd28640 1 -- 172.21.15.151:0/1565271104 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf63f8c5a0 con 0x55bf63f88c60 2024-09-10T14:28:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.883+0000 7fbeedd28640 1 --2- 172.21.15.151:0/1565271104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f88c60 0x55bf63f8b050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbed800a480 tx=0x7fbed801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5265ff9e03827ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbeed527640 1 -- 172.21.15.151:0/1565271104 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed80b0070 con 0x55bf63f88c60 2024-09-10T14:28:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbeed527640 1 -- 172.21.15.151:0/1565271104 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed80ab540 con 0x55bf63f88c60 2024-09-10T14:28:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbeed527640 1 -- 172.21.15.151:0/1565271104 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed80ab820 con 0x55bf63f88c60 2024-09-10T14:28:50.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbef0a19980 1 -- 172.21.15.151:0/1565271104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f88c60 msgr2=0x55bf63f8b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1565271104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f88c60 0x55bf63f8b050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbed800a480 tx=0x7fbed801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:50.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbef0a19980 1 -- 172.21.15.151:0/1565271104 shutdown_connections 2024-09-10T14:28:50.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1565271104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f88c60 0x55bf63f8b050 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbef0a19980 1 -- 172.21.15.151:0/1565271104 >> 172.21.15.151:0/1565271104 conn(0x55bf63ef8230 msgr2=0x55bf63ef8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbef0a19980 1 -- 172.21.15.151:0/1565271104 shutdown_connections 2024-09-10T14:28:50.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.887+0000 7fbef0a19980 1 -- 172.21.15.151:0/1565271104 wait complete. 2024-09-10T14:28:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbef0a19980 1 Processor -- start 2024-09-10T14:28:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbef0a19980 1 -- start start 2024-09-10T14:28:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbef0a19980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf6406fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbef0a19980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf63e30200 con 0x55bf63f848e0 2024-09-10T14:28:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf6406fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf6406fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41686/0 (socket says 172.21.15.151:41686) 2024-09-10T14:28:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbeee529640 1 -- 172.21.15.151:0/750083226 learned_addr learned my addr 172.21.15.151:0/750083226 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbeee529640 1 -- 172.21.15.151:0/750083226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6406fff0 con 0x55bf63f848e0 2024-09-10T14:28:50.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbeee529640 1 --2- 172.21.15.151:0/750083226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf6406fa20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006fc0 tx=0x7fbee8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631fddaf75a89127 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbddc608640 1 -- 172.21.15.151:0/750083226 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8004530 con 0x55bf63f848e0 2024-09-10T14:28:50.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbddc608640 1 -- 172.21.15.151:0/750083226 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee80046d0 con 0x55bf63f848e0 2024-09-10T14:28:50.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.899+0000 7fbddc608640 1 -- 172.21.15.151:0/750083226 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8004a70 con 0x55bf63f848e0 2024-09-10T14:28:50.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- 172.21.15.151:0/750083226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 msgr2=0x55bf6406fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 --2- 172.21.15.151:0/750083226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf6406fa20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006fc0 tx=0x7fbee8001af0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- 172.21.15.151:0/750083226 shutdown_connections 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 --2- 172.21.15.151:0/750083226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf6406fa20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- 172.21.15.151:0/750083226 >> 172.21.15.151:0/750083226 conn(0x55bf63ef8230 msgr2=0x55bf6406b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- 172.21.15.151:0/750083226 shutdown_connections 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- 172.21.15.151:0/750083226 wait complete. 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 Processor -- start 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- start start 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf64076dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf63f8c0a0 con 0x55bf63f848e0 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf64076dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf64076dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41692/0 (socket says 172.21.15.151:41692) 2024-09-10T14:28:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbeee529640 1 -- 172.21.15.151:0/1882899313 learned_addr learned my addr 172.21.15.151:0/1882899313 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbeee529640 1 -- 172.21.15.151:0/1882899313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf64077310 con 0x55bf63f848e0 2024-09-10T14:28:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbeee529640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf64076dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbee8002260 tx=0x7fbee8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbddae05640 1 -- 172.21.15.151:0/1882899313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8013760 con 0x55bf63f848e0 2024-09-10T14:28:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf640775a0 con 0x55bf63f848e0 2024-09-10T14:28:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6407a280 con 0x55bf63f848e0 2024-09-10T14:28:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbddae05640 1 -- 172.21.15.151:0/1882899313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8013900 con 0x55bf63f848e0 2024-09-10T14:28:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbddae05640 1 -- 172.21.15.151:0/1882899313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8013be0 con 0x55bf63f848e0 2024-09-10T14:28:50.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbddae05640 1 -- 172.21.15.151:0/1882899313 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbee8010070 con 0x55bf63f848e0 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.903+0000 7fbddae05640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdd40346a0 0x7fbdd4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbddae05640 1 -- 172.21.15.151:0/1882899313 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbee8018070 con 0x55bf63f848e0 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeedd28640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdd40346a0 0x7fbdd4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf63f88c60 0x55bf6407dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6407e330 con 0x55bf63f88c60 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeeed2a640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf63f88c60 0x55bf6407dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeedd28640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdd40346a0 0x7fbdd4036b60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbed80ad000 tx=0x7fbed80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeeed2a640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf63f88c60 0x55bf6407dd60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeeed2a640 1 -- 172.21.15.151:0/1882899313 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf63f88c60 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6407b4a0 con 0x55bf63f88c60 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeeed2a640 1 -- 172.21.15.151:0/1882899313 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf63f88c60 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf64080680 0x55bf64082a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf64083140 con 0x55bf64080680 2024-09-10T14:28:50.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeee529640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf64080680 0x55bf64082a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeee529640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf64080680 0x55bf64082a70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeee529640 1 -- 172.21.15.151:0/1882899313 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbee801b030 con 0x55bf64080680 2024-09-10T14:28:50.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6407f4f0 con 0x55bf63f88c60 2024-09-10T14:28:50.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeeed2a640 1 -- 172.21.15.151:0/1882899313 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf63f88c60 2024-09-10T14:28:50.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bf64084580 0x55bf64086970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640870e0 con 0x55bf64084580 2024-09-10T14:28:50.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeedd28640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bf64084580 0x55bf64086970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.907+0000 7fbeedd28640 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bf64084580 0x55bf64086970 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbeedd28640 1 -- 172.21.15.151:0/1882899313 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbed80b3040 con 0x55bf64084580 2024-09-10T14:28:50.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbef0a19980 1 Processor -- start 2024-09-10T14:28:50.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbef0a19980 1 -- start start 2024-09-10T14:28:50.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbef0a19980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf64094b50 0x55bf64094f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbef0a19980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf63e89800 con 0x55bf64094b50 2024-09-10T14:28:50.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf64094b50 0x55bf64094f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf64094b50 0x55bf64094f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41696/0 (socket says 172.21.15.151:41696) 2024-09-10T14:28:50.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbeee529640 1 -- 172.21.15.151:0/1607419802 learned_addr learned my addr 172.21.15.151:0/1607419802 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbeee529640 1 -- 172.21.15.151:0/1607419802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf640954b0 con 0x55bf64094b50 2024-09-10T14:28:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbeee529640 1 --2- 172.21.15.151:0/1607419802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf64094b50 0x55bf64094f70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbee8048490 tx=0x7fbee8029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbdd3fff640 1 -- 172.21.15.151:0/1607419802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8039030 con 0x55bf64094b50 2024-09-10T14:28:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbef0a19980 1 -- 172.21.15.151:0/1607419802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf64095740 con 0x55bf64094b50 2024-09-10T14:28:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbef0a19980 1 -- 172.21.15.151:0/1607419802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf64095740 con 0x55bf64094b50 2024-09-10T14:28:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbdd3fff640 1 -- 172.21.15.151:0/1607419802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8028900 con 0x55bf64094b50 2024-09-10T14:28:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbdd3fff640 1 -- 172.21.15.151:0/1607419802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8055060 con 0x55bf64094b50 2024-09-10T14:28:50.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbdd3fff640 1 -- 172.21.15.151:0/1607419802 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbee803f030 con 0x55bf64094b50 2024-09-10T14:28:50.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbdd3fff640 1 --2- 172.21.15.151:0/1607419802 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdc8034650 0x7fbdc8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbdd3fff640 1 -- 172.21.15.151:0/1607419802 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbee803d070 con 0x55bf64094b50 2024-09-10T14:28:50.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.911+0000 7fbeedd28640 1 --2- 172.21.15.151:0/1607419802 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdc8034650 0x7fbdc8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 Processor -- start 2024-09-10T14:28:50.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- start start 2024-09-10T14:28:50.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeedd28640 1 --2- 172.21.15.151:0/1607419802 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdc8034650 0x7fbdc8036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbed800a480 tx=0x7fbed8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf64070370 con 0x55bf640a1310 2024-09-10T14:28:50.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41710/0 (socket says 172.21.15.151:41710) 2024-09-10T14:28:50.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 -- 172.21.15.151:0/222585105 learned_addr learned my addr 172.21.15.151:0/222585105 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 -- 172.21.15.151:0/222585105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf640a1ce0 con 0x55bf640a1310 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 --2- 172.21.15.151:0/222585105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a1710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbee8010040 tx=0x7fbee804f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3ef800991c90e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbdd1ffb640 1 -- 172.21.15.151:0/222585105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8016e60 con 0x55bf640a1310 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbdd1ffb640 1 -- 172.21.15.151:0/222585105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8008dc0 con 0x55bf640a1310 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbdd1ffb640 1 -- 172.21.15.151:0/222585105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee802c100 con 0x55bf640a1310 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- 172.21.15.151:0/222585105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 msgr2=0x55bf640a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 --2- 172.21.15.151:0/222585105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a1710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbee8010040 tx=0x7fbee804f610 comp rx=0 tx=0).stop 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- 172.21.15.151:0/222585105 shutdown_connections 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 --2- 172.21.15.151:0/222585105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a1710 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- 172.21.15.151:0/222585105 >> 172.21.15.151:0/222585105 conn(0x55bf6409d690 msgr2=0x55bf6409b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- 172.21.15.151:0/222585105 shutdown_connections 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- 172.21.15.151:0/222585105 wait complete. 2024-09-10T14:28:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 Processor -- start 2024-09-10T14:28:50.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- start start 2024-09-10T14:28:50.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbef0a19980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf640a20a0 con 0x55bf640a1310 2024-09-10T14:28:50.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41722/0 (socket says 172.21.15.151:41722) 2024-09-10T14:28:50.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 learned_addr learned my addr 172.21.15.151:0/860852733 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:50.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.915+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf640a8960 con 0x55bf640a1310 2024-09-10T14:28:50.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeee529640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a8420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbee8028fc0 tx=0x7fbee80419e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbdbffff640 1 -- 172.21.15.151:0/860852733 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee8048d10 con 0x55bf640a1310 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf640a8960 con 0x55bf640a1310 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbdbffff640 1 -- 172.21.15.151:0/860852733 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8035450 con 0x55bf640a1310 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbdbffff640 1 -- 172.21.15.151:0/860852733 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee802bc90 con 0x55bf640a1310 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf640a8dd0 con 0x55bf640a1310 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbdbffff640 1 -- 172.21.15.151:0/860852733 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbee8076060 con 0x55bf640a1310 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbdbffff640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdb8034650 0x7fbdb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbdbffff640 1 -- 172.21.15.151:0/860852733 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fbee8070c60 con 0x55bf640a1310 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeedd28640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdb8034650 0x7fbdb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf640b3520 0x55bf640b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b6110 con 0x55bf640b3520 2024-09-10T14:28:50.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeeed2a640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf640b3520 0x55bf640b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeedd28640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdb8034650 0x7fbdb8036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbed80ab510 tx=0x7fbed80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeeed2a640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf640b3520 0x55bf640b59c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 realm 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b6520 con 0x55bf640b3520 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b6dc0 con 0x55bf640b3520 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf640b7ec0 0x55bf640ba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640ba830 con 0x55bf640b7ec0 2024-09-10T14:28:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeee529640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf640b7ec0 0x55bf640ba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.919+0000 7fbeee529640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf640b7ec0 0x55bf640ba2b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbee806d070 con 0x55bf640b7ec0 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbef0a19980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbef0a19980 20 searching for the correct realm 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bc090 con 0x55bf640b7ec0 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee806d070 con 0x55bf640b7ec0 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeee529640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbee8078070 0x7fbee803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bc090 con 0x7fbee8078070 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeedd28640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbee8078070 0x7fbee803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeedd28640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbee8078070 0x7fbee803f320 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeedd28640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbed80dd040 0x7fbed80cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bc090 con 0x7fbed80dd040 2024-09-10T14:28:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbed80dd040 0x7fbed80cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbed80dd040 0x7fbed80cf430 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbed80dd040 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.923+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbed80dd040 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbee8078070 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b7ec0 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee806d070 con 0x55bf640b7ec0 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbed80dd040 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbee8078070 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b7ec0 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbee806d070 con 0x55bf640b7ec0 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b7ec0 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee806d070 con 0x55bf640b7ec0 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbed80dd040 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b7ec0 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee806d070 con 0x55bf640b7ec0 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b7ec0 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.927+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee806d070 con 0x55bf640b7ec0 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbed80dd040 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b7ec0 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8090040 con 0x55bf640b7ec0 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbee8078070 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbed80dd040 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b7ec0 2024-09-10T14:28:50.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8090040 con 0x55bf640b7ec0 2024-09-10T14:28:50.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbed80dd040 2024-09-10T14:28:50.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbee8078070 2024-09-10T14:28:50.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b7ec0 2024-09-10T14:28:50.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee8090040 con 0x55bf640b7ec0 2024-09-10T14:28:50.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.931+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbed80dd040 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x55bf640b3520 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf640b7160 con 0x7fbee8078070 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bb180 con 0x55bf640b3520 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bad90 con 0x55bf640b3520 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bad60 con 0x7fbed80dd040 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 zone default found 2024-09-10T14:28:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 4 Realm: () 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 zonegroup default 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bbac0 con 0x7fbed80dd040 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bbf00 con 0x55bf640b7ec0 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbee8090040 con 0x55bf640b7ec0 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bdf20 con 0x55bf640b7ec0 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbee8090040 con 0x55bf640b7ec0 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 started sync module instance, tier type = 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.935+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bd3c0 con 0x7fbee8078070 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.939+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.939+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94280505612208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bd020 con 0x7fbee8078070 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.939+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bec60 con 0x55bf640b3520 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.939+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94280505612208] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.939+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.939+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94280505615040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bf050 con 0x55bf640b3520 2024-09-10T14:28:50.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.939+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bfa10 con 0x55bf640b7ec0 2024-09-10T14:28:50.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94280505615040] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee8090040 con 0x55bf640b7ec0 2024-09-10T14:28:50.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94280505619808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bfe00 con 0x55bf640b7ec0 2024-09-10T14:28:50.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c07c0 con 0x7fbee8078070 2024-09-10T14:28:50.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94280505623312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c1010 con 0x7fbee8078070 2024-09-10T14:28:50.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c19d0 con 0x55bf640b3520 2024-09-10T14:28:50.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94280505623312] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.943+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94280505619808] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee8090040 con 0x55bf640b7ec0 2024-09-10T14:28:50.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.947+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.947+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94280505625440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c19d0 con 0x55bf640b3520 2024-09-10T14:28:50.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.947+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c22a0 con 0x7fbed80dd040 2024-09-10T14:28:50.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.947+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94280505625440] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.947+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.947+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94280505628208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c1fe0 con 0x7fbed80dd040 2024-09-10T14:28:50.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.947+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c2ae0 con 0x7fbed80dd040 2024-09-10T14:28:50.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94280505628208] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94280505632208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c2f50 con 0x7fbed80dd040 2024-09-10T14:28:50.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c3510 con 0x7fbed80dd040 2024-09-10T14:28:50.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94280505632208] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94280505629264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c36f0 con 0x7fbed80dd040 2024-09-10T14:28:50.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 20 add_watcher() i=0 2024-09-10T14:28:50.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 20 add_watcher() i=1 2024-09-10T14:28:50.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 20 add_watcher() i=2 2024-09-10T14:28:50.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 20 add_watcher() i=3 2024-09-10T14:28:50.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 20 add_watcher() i=4 2024-09-10T14:28:50.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 20 add_watcher() i=5 2024-09-10T14:28:50.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.951+0000 7fbef0a19980 20 add_watcher() i=6 2024-09-10T14:28:50.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94280505629264] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 20 add_watcher() i=7 2024-09-10T14:28:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c6ac0 con 0x55bf640b3520 2024-09-10T14:28:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94280505636320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c3eb0 con 0x55bf640b3520 2024-09-10T14:28:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94280505636320] v33'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbda4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 5 note: GC not initialized 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbd1f7fe640 20 reqs_thread_entry: start 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 20 Filter name: none 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbd1d7fa640 20 reqs_thread_entry: start 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 20 rados->read ofs=0 len=0 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf640e9b40 con 0x55bf640b3520 2024-09-10T14:28:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.955+0000 7fbef0a19980 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T14:28:50.962 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.959+0000 7fbda4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:50.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.959+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94280505636320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640e86f0 con 0x55bf640b3520 2024-09-10T14:28:50.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.959+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94280505636320] v33'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.959+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94280505612208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c35e0 con 0x7fbee8078070 2024-09-10T14:28:50.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.959+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94280505612208] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.959+0000 7fbef0a19980 20 remove_watcher() i=0 2024-09-10T14:28:50.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.959+0000 7fbef0a19980 2 removed watcher, disabling cache 2024-09-10T14:28:50.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.959+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94280505615040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c35e0 con 0x55bf640b3520 2024-09-10T14:28:50.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94280505615040] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbef0a19980 20 remove_watcher() i=1 2024-09-10T14:28:50.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94280505619808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c35e0 con 0x55bf640b7ec0 2024-09-10T14:28:50.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbeee529640 1 -- 172.21.15.151:0/860852733 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94280505619808] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee8090040 con 0x55bf640b7ec0 2024-09-10T14:28:50.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbef0a19980 20 remove_watcher() i=2 2024-09-10T14:28:50.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94280505623312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640bf560 con 0x7fbee8078070 2024-09-10T14:28:50.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbeedd28640 1 -- 172.21.15.151:0/860852733 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94280505623312] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbed80ca030 con 0x7fbee8078070 2024-09-10T14:28:50.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbef0a19980 20 remove_watcher() i=3 2024-09-10T14:28:50.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.963+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94280505625440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c35e0 con 0x55bf640b3520 2024-09-10T14:28:50.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.967+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94280505625440] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x55bf640b3520 2024-09-10T14:28:50.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.967+0000 7fbef0a19980 20 remove_watcher() i=4 2024-09-10T14:28:50.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.967+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94280505628208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c0b60 con 0x7fbed80dd040 2024-09-10T14:28:50.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.967+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94280505628208] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.967+0000 7fbef0a19980 20 remove_watcher() i=5 2024-09-10T14:28:50.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.967+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94280505632208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c35e0 con 0x7fbed80dd040 2024-09-10T14:28:50.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94280505632208] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 20 remove_watcher() i=6 2024-09-10T14:28:50.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94280505629264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf640c1630 con 0x7fbed80dd040 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94280505629264] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbee00083f0 con 0x7fbed80dd040 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 20 remove_watcher() i=7 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbed80dd040 msgr2=0x7fbed80cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbed80dd040 0x7fbed80cf430 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf640b3520 msgr2=0x55bf640b59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf640b3520 0x55bf640b59c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbee8078070 msgr2=0x7fbee803f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbee8078070 0x7fbee803f320 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf640b7ec0 msgr2=0x55bf640ba2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf640b7ec0 0x55bf640ba2b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdb8034650 msgr2=0x7fbdb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdb8034650 0x7fbdb8036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbed80ab510 tx=0x7fbed80a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 msgr2=0x55bf640a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/860852733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf640a1310 0x55bf640a8420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbee8028fc0 tx=0x7fbee80419e0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 reap_dead start 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbeeed2a640 1 -- 172.21.15.151:0/860852733 reap_dead start 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 shutdown_connections 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 >> 172.21.15.151:0/860852733 conn(0x55bf6409d690 msgr2=0x55bf6409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 shutdown_connections 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/860852733 wait complete. 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/1607419802 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdc8034650 msgr2=0x7fbdc8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1607419802 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdc8034650 0x7fbdc8036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbed800a480 tx=0x7fbed8005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/1607419802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf64094b50 msgr2=0x55bf64094f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1607419802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf64094b50 0x55bf64094f70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbee8048490 tx=0x7fbee8029840 comp rx=0 tx=0).stop 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/1607419802 shutdown_connections 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1607419802 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdc8034650 0x7fbdc8036b10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1607419802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf64094b50 0x55bf64094f70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/1607419802 >> 172.21.15.151:0/1607419802 conn(0x55bf64089ca0 msgr2=0x55bf6408c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/1607419802 shutdown_connections 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.971+0000 7fbef0a19980 1 -- 172.21.15.151:0/1607419802 wait complete. 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bf64084580 msgr2=0x55bf64086970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55bf64084580 0x55bf64086970 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf63f88c60 msgr2=0x55bf6407dd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55bf63f88c60 0x55bf6407dd60 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf64080680 msgr2=0x55bf64082a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55bf64080680 0x55bf64082a70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdd40346a0 msgr2=0x7fbdd4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbdd40346a0 0x7fbdd4036b60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbed80ad000 tx=0x7fbed80a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 msgr2=0x55bf64076dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 --2- 172.21.15.151:0/1882899313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf63f848e0 0x55bf64076dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbee8002260 tx=0x7fbee8000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbeeed2a640 1 -- 172.21.15.151:0/1882899313 reap_dead start 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 shutdown_connections 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 >> 172.21.15.151:0/1882899313 conn(0x55bf63ef8230 msgr2=0x55bf6406a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 shutdown_connections 2024-09-10T14:28:50.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:50.975+0000 7fbef0a19980 1 -- 172.21.15.151:0/1882899313 wait complete. 2024-09-10T14:28:50.986 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:50.987 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T14:28:50.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T14:28:50.987 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-10T14:28:51.070 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:51.070 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa9633f2980 1 Processor -- start 2024-09-10T14:28:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa9633f2980 1 -- start start 2024-09-10T14:28:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa9633f2980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560f7c032c00 0x560f7c034ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa9633f2980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f7beb4ae0 con 0x560f7c02e880 2024-09-10T14:28:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa9633f2980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x560f7bed8e30 con 0x560f7c032c00 2024-09-10T14:28:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa960701640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560f7c032c00 0x560f7c034ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa960f02640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x560f7c02e880 0x560f7c02ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34216/0 (socket says 172.21.15.151:34216) 2024-09-10T14:28:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa960701640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560f7c032c00 0x560f7c034ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41736/0 (socket says 172.21.15.151:41736) 2024-09-10T14:28:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa960f02640 1 -- 172.21.15.151:0/3789036080 learned_addr learned my addr 172.21.15.151:0/3789036080 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa960701640 1 -- 172.21.15.151:0/3789036080 >> v1:172.21.15.52:6789/0 conn(0x560f7c02e880 legacy=0x560f7c02ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.067+0000 7fa960701640 1 -- 172.21.15.151:0/3789036080 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7c036540 con 0x560f7c032c00 2024-09-10T14:28:51.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa960701640 1 --2- 172.21.15.151:0/3789036080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c032c00 0x560f7c034ff0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa95400a480 tx=0x7fa95401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e8d34103680f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa95ff00640 1 -- 172.21.15.151:0/3789036080 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9540b0070 con 0x560f7c032c00 2024-09-10T14:28:51.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa95ff00640 1 -- 172.21.15.151:0/3789036080 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9540ab540 con 0x560f7c032c00 2024-09-10T14:28:51.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa95ff00640 1 -- 172.21.15.151:0/3789036080 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9540ab840 con 0x560f7c032c00 2024-09-10T14:28:51.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa9633f2980 1 -- 172.21.15.151:0/3789036080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c032c00 msgr2=0x560f7c034ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3789036080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c032c00 0x560f7c034ff0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa95400a480 tx=0x7fa95401b280 comp rx=0 tx=0).stop 2024-09-10T14:28:51.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa9633f2980 1 -- 172.21.15.151:0/3789036080 shutdown_connections 2024-09-10T14:28:51.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3789036080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c032c00 0x560f7c034ff0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa9633f2980 1 -- 172.21.15.151:0/3789036080 >> 172.21.15.151:0/3789036080 conn(0x560f7bfa21d0 msgr2=0x560f7bfa25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa9633f2980 1 -- 172.21.15.151:0/3789036080 shutdown_connections 2024-09-10T14:28:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.071+0000 7fa9633f2980 1 -- 172.21.15.151:0/3789036080 wait complete. 2024-09-10T14:28:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.083+0000 7fa9633f2980 1 Processor -- start 2024-09-10T14:28:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.083+0000 7fa9633f2980 1 -- start start 2024-09-10T14:28:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.083+0000 7fa9633f2980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c119c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.083+0000 7fa9633f2980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f7beda200 con 0x560f7c02e880 2024-09-10T14:28:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c119c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c119c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41744/0 (socket says 172.21.15.151:41744) 2024-09-10T14:28:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 -- 172.21.15.151:0/1605820505 learned_addr learned my addr 172.21.15.151:0/1605820505 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 -- 172.21.15.151:0/1605820505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7c11a230 con 0x560f7c02e880 2024-09-10T14:28:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 --2- 172.21.15.151:0/1605820505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c119c60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9580015f0 tx=0x7fa958001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734cb51414d7524b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa84ee0d640 1 -- 172.21.15.151:0/1605820505 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958004530 con 0x560f7c02e880 2024-09-10T14:28:51.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa84ee0d640 1 -- 172.21.15.151:0/1605820505 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9580046f0 con 0x560f7c02e880 2024-09-10T14:28:51.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa84ee0d640 1 -- 172.21.15.151:0/1605820505 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958004a90 con 0x560f7c02e880 2024-09-10T14:28:51.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 -- 172.21.15.151:0/1605820505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 msgr2=0x560f7c119c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 --2- 172.21.15.151:0/1605820505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c119c60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9580015f0 tx=0x7fa958001ab0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 -- 172.21.15.151:0/1605820505 shutdown_connections 2024-09-10T14:28:51.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 --2- 172.21.15.151:0/1605820505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c119c60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 -- 172.21.15.151:0/1605820505 >> 172.21.15.151:0/1605820505 conn(0x560f7bfa21d0 msgr2=0x560f7c115890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 -- 172.21.15.151:0/1605820505 shutdown_connections 2024-09-10T14:28:51.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 -- 172.21.15.151:0/1605820505 wait complete. 2024-09-10T14:28:51.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 Processor -- start 2024-09-10T14:28:51.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 -- start start 2024-09-10T14:28:51.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c121050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa9633f2980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f7c036040 con 0x560f7c02e880 2024-09-10T14:28:51.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c121050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c121050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41756/0 (socket says 172.21.15.151:41756) 2024-09-10T14:28:51.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 -- 172.21.15.151:0/3246700525 learned_addr learned my addr 172.21.15.151:0/3246700525 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 -- 172.21.15.151:0/3246700525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7c121590 con 0x560f7c02e880 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.087+0000 7fa960f02640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c121050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x560f7c11ae40 tx=0x7fa958000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa84d60a640 1 -- 172.21.15.151:0/3246700525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958013760 con 0x560f7c02e880 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f7c121820 con 0x560f7c02e880 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa84d60a640 1 -- 172.21.15.151:0/3246700525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958013900 con 0x560f7c02e880 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa84d60a640 1 -- 172.21.15.151:0/3246700525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958013be0 con 0x560f7c02e880 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f7c124500 con 0x560f7c02e880 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa84d60a640 1 -- 172.21.15.151:0/3246700525 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa958010070 con 0x560f7c02e880 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa84d60a640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa848034650 0x7fa848036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa84d60a640 1 -- 172.21.15.151:0/3246700525 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa958018070 con 0x560f7c02e880 2024-09-10T14:28:51.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa960701640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa848034650 0x7fa848036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c032c00 0x560f7c128060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c128680 con 0x560f7c032c00 2024-09-10T14:28:51.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa961703640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c032c00 0x560f7c128060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa960701640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa848034650 0x7fa848036b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa9540ad000 tx=0x7fa9540a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa961703640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c032c00 0x560f7c128060 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa961703640 1 -- 172.21.15.151:0/3246700525 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c032c00 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c125720 con 0x560f7c032c00 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa961703640 1 -- 172.21.15.151:0/3246700525 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c032c00 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c12a9d0 0x560f7c12cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c12d490 con 0x560f7c12a9d0 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa960f02640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c12a9d0 0x560f7c12cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa960f02640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c12a9d0 0x560f7c12cdc0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa960f02640 1 -- 172.21.15.151:0/3246700525 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c12a9d0 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c129840 con 0x560f7c032c00 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa961703640 1 -- 172.21.15.151:0/3246700525 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c032c00 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560f7c12e8d0 0x560f7c130cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.091+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c131430 con 0x560f7c12e8d0 2024-09-10T14:28:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa960701640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560f7c12e8d0 0x560f7c130cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa960701640 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560f7c12e8d0 0x560f7c130cc0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa960701640 1 -- 172.21.15.151:0/3246700525 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9540b3040 con 0x560f7c12e8d0 2024-09-10T14:28:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa9633f2980 1 Processor -- start 2024-09-10T14:28:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa9633f2980 1 -- start start 2024-09-10T14:28:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa9633f2980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c13eec0 0x560f7c13f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa9633f2980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f7bf33800 con 0x560f7c13eec0 2024-09-10T14:28:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c13eec0 0x560f7c13f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c13eec0 0x560f7c13f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41768/0 (socket says 172.21.15.151:41768) 2024-09-10T14:28:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa960f02640 1 -- 172.21.15.151:0/3606739146 learned_addr learned my addr 172.21.15.151:0/3606739146 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa960f02640 1 -- 172.21.15.151:0/3606739146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7c13f820 con 0x560f7c13eec0 2024-09-10T14:28:51.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa960f02640 1 --2- 172.21.15.151:0/3606739146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c13eec0 0x560f7c13f2e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa958010410 tx=0x7fa958029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa8467fc640 1 -- 172.21.15.151:0/3606739146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958038030 con 0x560f7c13eec0 2024-09-10T14:28:51.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa8467fc640 1 -- 172.21.15.151:0/3606739146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958041420 con 0x560f7c13eec0 2024-09-10T14:28:51.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa9633f2980 1 -- 172.21.15.151:0/3606739146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f7c13fab0 con 0x560f7c13eec0 2024-09-10T14:28:51.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa8467fc640 1 -- 172.21.15.151:0/3606739146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958041700 con 0x560f7c13eec0 2024-09-10T14:28:51.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.095+0000 7fa9633f2980 1 -- 172.21.15.151:0/3606739146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f7c142730 con 0x560f7c13eec0 2024-09-10T14:28:51.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa8467fc640 1 -- 172.21.15.151:0/3606739146 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa958041a50 con 0x560f7c13eec0 2024-09-10T14:28:51.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa8467fc640 1 --2- 172.21.15.151:0/3606739146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa838034650 0x7fa838036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa8467fc640 1 -- 172.21.15.151:0/3606739146 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa95803c070 con 0x560f7c13eec0 2024-09-10T14:28:51.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa960701640 1 --2- 172.21.15.151:0/3606739146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa838034650 0x7fa838036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 Processor -- start 2024-09-10T14:28:51.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- start start 2024-09-10T14:28:51.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa960701640 1 --2- 172.21.15.151:0/3606739146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa838034650 0x7fa838036b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa95401b2c0 tx=0x7fa954005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f7c11a5b0 con 0x560f7c14b780 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c14bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41780/0 (socket says 172.21.15.151:41780) 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa960f02640 1 -- 172.21.15.151:0/4098031197 learned_addr learned my addr 172.21.15.151:0/4098031197 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa960f02640 1 -- 172.21.15.151:0/4098031197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7c14c150 con 0x560f7c14b780 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa960f02640 1 --2- 172.21.15.151:0/4098031197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c14bb80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa958026040 tx=0x7fa958041e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2dc804e89816b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa837fff640 1 -- 172.21.15.151:0/4098031197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9580403d0 con 0x560f7c14b780 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa837fff640 1 -- 172.21.15.151:0/4098031197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958034800 con 0x560f7c14b780 2024-09-10T14:28:51.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa837fff640 1 -- 172.21.15.151:0/4098031197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958012820 con 0x560f7c14b780 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- 172.21.15.151:0/4098031197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 msgr2=0x560f7c14bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 --2- 172.21.15.151:0/4098031197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c14bb80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa958026040 tx=0x7fa958041e50 comp rx=0 tx=0).stop 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- 172.21.15.151:0/4098031197 shutdown_connections 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 --2- 172.21.15.151:0/4098031197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c14bb80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- 172.21.15.151:0/4098031197 >> 172.21.15.151:0/4098031197 conn(0x560f7c147bb0 msgr2=0x560f7c145cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- 172.21.15.151:0/4098031197 shutdown_connections 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- 172.21.15.151:0/4098031197 wait complete. 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 Processor -- start 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- start start 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.099+0000 7fa9633f2980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f7c14c620 con 0x560f7c14b780 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa960f02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41788/0 (socket says 172.21.15.151:41788) 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 learned_addr learned my addr 172.21.15.151:0/3571408018 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7c152ec0 con 0x560f7c14b780 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa960f02640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c152980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa958047240 tx=0x7fa95803bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa8367fc640 1 -- 172.21.15.151:0/3571408018 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9580405b0 con 0x560f7c14b780 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f7c152ec0 con 0x560f7c14b780 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa8367fc640 1 -- 172.21.15.151:0/3571408018 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958034440 con 0x560f7c14b780 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa8367fc640 1 -- 172.21.15.151:0/3571408018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9580403d0 con 0x560f7c14b780 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f7c152ec0 con 0x560f7c14b780 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa8367fc640 1 -- 172.21.15.151:0/3571408018 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa958040bc0 con 0x560f7c14b780 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa8367fc640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa82c034650 0x7fa82c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa8367fc640 1 -- 172.21.15.151:0/3571408018 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa95806d030 con 0x560f7c14b780 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa960701640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa82c034650 0x7fa82c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c15da90 0x560f7c15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1606a0 con 0x560f7c15da90 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa961703640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c15da90 0x560f7c15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa960701640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa82c034650 0x7fa82c036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9540abaa0 tx=0x7fa9540b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa961703640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c15da90 0x560f7c15ff50 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 20 realm 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c160ab0 con 0x560f7c15da90 2024-09-10T14:28:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c161350 con 0x560f7c15da90 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.103+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa9633f2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c162450 0x560f7c164840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c164e90 con 0x560f7c162450 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960f02640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c162450 0x560f7c164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960f02640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c162450 0x560f7c164840 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa9633f2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa9633f2980 20 searching for the correct realm 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1666f0 con 0x560f7c162450 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960f02640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa958018810 0x7fa958072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1666f0 con 0x7fa958018810 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960701640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa958018810 0x7fa958072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960701640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa958018810 0x7fa958072640 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960701640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa9540dc040 0x7fa9540ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1666f0 con 0x7fa9540dc040 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa9540dc040 0x7fa9540ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa9540dc040 0x7fa9540ce430 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.107+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa9540dc040 2024-09-10T14:28:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa9540dc040 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa958018810 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c162450 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa9540dc040 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa958018810 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c162450 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c162450 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.111+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa9540dc040 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c162450 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c162450 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa9540dc040 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c162450 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa958018810 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa9540dc040 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c162450 2024-09-10T14:28:51.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.115+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa9540dc040 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa958018810 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c162450 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa9540dc040 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x560f7c15da90 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1616f0 con 0x7fa958018810 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1657e0 con 0x560f7c15da90 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c166030 con 0x560f7c15da90 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c165420 con 0x7fa9540dc040 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 zone default found 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 4 Realm: () 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 zonegroup default 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c166030 con 0x7fa9540dc040 2024-09-10T14:28:51.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.119+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c166030 con 0x560f7c162450 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c168590 con 0x560f7c162450 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 20 started sync module instance, tier type = 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1679a0 con 0x7fa958018810 2024-09-10T14:28:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94624506346896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c168ea0 con 0x7fa958018810 2024-09-10T14:28:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1696f0 con 0x560f7c15da90 2024-09-10T14:28:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94624506346896] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94624506350064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1696f0 con 0x560f7c15da90 2024-09-10T14:28:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.123+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16a210 con 0x560f7c162450 2024-09-10T14:28:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.127+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.127+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94624506354912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16aab0 con 0x560f7c162450 2024-09-10T14:28:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.127+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16b4b0 con 0x7fa958018810 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.127+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94624506350064] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.127+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.127+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94624506352192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16b8a0 con 0x7fa958018810 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.127+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16c260 con 0x560f7c15da90 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.127+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94624506354912] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.131+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94624506352192] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.131+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.131+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94624506357248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16c260 con 0x560f7c15da90 2024-09-10T14:28:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.131+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16cab0 con 0x7fa9540dc040 2024-09-10T14:28:51.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.131+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94624506357248] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.131+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.131+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94624506363584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16c790 con 0x7fa9540dc040 2024-09-10T14:28:51.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.131+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16d280 con 0x7fa9540dc040 2024-09-10T14:28:51.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94624506367312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16d6f0 con 0x7fa9540dc040 2024-09-10T14:28:51.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16e1d0 con 0x7fa9540dc040 2024-09-10T14:28:51.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94624506363584] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94624506367312] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94624506371296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16d240 con 0x7fa9540dc040 2024-09-10T14:28:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 20 add_watcher() i=0 2024-09-10T14:28:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 20 add_watcher() i=1 2024-09-10T14:28:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 20 add_watcher() i=2 2024-09-10T14:28:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 20 add_watcher() i=3 2024-09-10T14:28:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 20 add_watcher() i=4 2024-09-10T14:28:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 20 add_watcher() i=5 2024-09-10T14:28:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.135+0000 7fa9633f2980 20 add_watcher() i=6 2024-09-10T14:28:51.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94624506371296] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 20 add_watcher() i=7 2024-09-10T14:28:51.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:51.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1712d0 con 0x560f7c15da90 2024-09-10T14:28:51.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94624506364640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16e750 con 0x560f7c15da90 2024-09-10T14:28:51.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94624506364640] v33'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa816fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 5 note: GC not initialized 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa815fe3640 20 reqs_thread_entry: start 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 20 Filter name: none 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa7877fe640 20 reqs_thread_entry: start 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1947e0 con 0x560f7c15da90 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T14:28:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.139+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1954b0 con 0x7fa958018810 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-10T14:28:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c19b280 con 0x560f7c15da90 2024-09-10T14:28:51.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v33'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94624506555664 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c196d90 con 0x560f7c15da90 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 94624506357248 notify 141733920775 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7fa950010040 con 0x560f7c15da90 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa837fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94624506357248 notifier 4386 bl.length()=849 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa837fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa837fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(65 notify.4 [notify cookie 94624506555664 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa837fff640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa824003eb0 con 0x560f7c15da90 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 94624506555664 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa95000be30 con 0x560f7c15da90 2024-09-10T14:28:51.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.143+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c19ad10 con 0x7fa958018810 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94624506555664 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f7c196d90 con 0x7fa958018810 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== watch-notify(notify (1) cookie 94624506346896 notify 141733920771 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fa9540e6060 con 0x7fa958018810 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa837fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94624506346896 notifier 4386 bl.length()=166 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa837fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa837fff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(68 notify.0 [notify cookie 94624506555664 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa837fff640 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa824003eb0 con 0x7fa958018810 2024-09-10T14:28:51.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== watch-notify(notify_complete (2) cookie 94624506555664 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f7c036540 con 0x7fa958018810 2024-09-10T14:28:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.152 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T14:28:51.147492Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa816fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94624506364640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1925d0 con 0x560f7c15da90 2024-09-10T14:28:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94624506364640] v33'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94624506346896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1925d0 con 0x7fa958018810 2024-09-10T14:28:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94624506346896] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 20 remove_watcher() i=0 2024-09-10T14:28:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 2 removed watcher, disabling cache 2024-09-10T14:28:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.147+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94624506350064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c167d90 con 0x560f7c15da90 2024-09-10T14:28:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.151+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94624506350064] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.151+0000 7fa9633f2980 20 remove_watcher() i=1 2024-09-10T14:28:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.151+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94624506354912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1925d0 con 0x560f7c162450 2024-09-10T14:28:51.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa960f02640 1 -- 172.21.15.151:0/3571408018 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94624506354912] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x560f7c162450 2024-09-10T14:28:51.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa9633f2980 20 remove_watcher() i=2 2024-09-10T14:28:51.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94624506352192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c167d90 con 0x7fa958018810 2024-09-10T14:28:51.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa960701640 1 -- 172.21.15.151:0/3571408018 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94624506352192] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540c9030 con 0x7fa958018810 2024-09-10T14:28:51.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa9633f2980 20 remove_watcher() i=3 2024-09-10T14:28:51.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94624506357248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c169ce0 con 0x560f7c15da90 2024-09-10T14:28:51.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94624506357248] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x560f7c15da90 2024-09-10T14:28:51.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa9633f2980 20 remove_watcher() i=4 2024-09-10T14:28:51.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.155+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94624506363584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c1925d0 con 0x7fa9540dc040 2024-09-10T14:28:51.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.159+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94624506363584] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.159+0000 7fa9633f2980 20 remove_watcher() i=5 2024-09-10T14:28:51.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.159+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94624506367312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c167d90 con 0x7fa9540dc040 2024-09-10T14:28:51.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.159+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94624506367312] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.159+0000 7fa9633f2980 20 remove_watcher() i=6 2024-09-10T14:28:51.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.159+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94624506371296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f7c16a600 con 0x7fa9540dc040 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94624506371296] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x7fa9540dc040 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 20 remove_watcher() i=7 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa9540dc040 msgr2=0x7fa9540ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa9540dc040 0x7fa9540ce430 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c15da90 msgr2=0x560f7c15ff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c15da90 0x560f7c15ff50 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa958018810 msgr2=0x7fa958072640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa958018810 0x7fa958072640 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c162450 msgr2=0x560f7c164840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c162450 0x560f7c164840 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa82c034650 msgr2=0x7fa82c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa82c034650 0x7fa82c036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa9540abaa0 tx=0x7fa9540b9040 comp rx=0 tx=0).stop 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 msgr2=0x560f7c152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa961703640 1 -- 172.21.15.151:0/3571408018 reap_dead start 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c152980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa958047240 tx=0x7fa95803bf30 comp rx=0 tx=0).stop 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 shutdown_connections 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3571408018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c14b780 0x560f7c152980 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 >> 172.21.15.151:0/3571408018 conn(0x560f7c147bb0 msgr2=0x560f7c145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 shutdown_connections 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3571408018 wait complete. 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3606739146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa838034650 msgr2=0x7fa838036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3606739146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa838034650 0x7fa838036b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa95401b2c0 tx=0x7fa954005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:51.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3606739146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c13eec0 msgr2=0x560f7c13f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3606739146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c13eec0 0x560f7c13f2e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa958010410 tx=0x7fa958029840 comp rx=0 tx=0).stop 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3606739146 shutdown_connections 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3606739146 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa838034650 0x7fa838036b10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3606739146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c13eec0 0x560f7c13f2e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3606739146 >> 172.21.15.151:0/3606739146 conn(0x560f7c134010 msgr2=0x560f7c136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3606739146 shutdown_connections 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3606739146 wait complete. 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560f7c12e8d0 msgr2=0x560f7c130cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560f7c12e8d0 0x560f7c130cc0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c032c00 msgr2=0x560f7c128060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560f7c032c00 0x560f7c128060 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c12a9d0 msgr2=0x560f7c12cdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560f7c12a9d0 0x560f7c12cdc0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa848034650 msgr2=0x7fa848036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa848034650 0x7fa848036b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa9540ad000 tx=0x7fa9540a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 msgr2=0x560f7c121050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 --2- 172.21.15.151:0/3246700525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f7c02e880 0x560f7c121050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x560f7c11ae40 tx=0x7fa958000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa961703640 1 -- 172.21.15.151:0/3246700525 reap_dead start 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 shutdown_connections 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 >> 172.21.15.151:0/3246700525 conn(0x560f7bfa21d0 msgr2=0x560f7c114410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 shutdown_connections 2024-09-10T14:28:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.163+0000 7fa9633f2980 1 -- 172.21.15.151:0/3246700525 wait complete. 2024-09-10T14:28:51.177 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T14:28:51.147492Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:51.177 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:28:51.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:28:51.178 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:28:51.253 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:51.254 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:51.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2cd9a980 1 Processor -- start 2024-09-10T14:28:51.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2cd9a980 1 -- start start 2024-09-10T14:28:51.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2cd9a980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5645b1000ec0 0x5645b10032b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2cd9a980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5645b0e82ae0 con 0x5645b0f6f290 2024-09-10T14:28:51.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2cd9a980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5645b0ea6e30 con 0x5645b1000ec0 2024-09-10T14:28:51.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2a0a9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5645b1000ec0 0x5645b10032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2a0a9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5645b1000ec0 0x5645b10032b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41792/0 (socket says 172.21.15.151:41792) 2024-09-10T14:28:51.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2a8aa640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5645b0f6f290 0x5645b0fff7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34228/0 (socket says 172.21.15.151:34228) 2024-09-10T14:28:51.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2a0a9640 1 -- 172.21.15.151:0/274897324 learned_addr learned my addr 172.21.15.151:0/274897324 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2a0a9640 1 -- 172.21.15.151:0/274897324 >> v1:172.21.15.52:6789/0 conn(0x5645b0f6f290 legacy=0x5645b0fff7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2a0a9640 1 -- 172.21.15.151:0/274897324 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b0f6f670 con 0x5645b1000ec0 2024-09-10T14:28:51.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/274897324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1000ec0 0x5645b10032b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feb2000a5c0 tx=0x7feb2001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5fec3349990025 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.251+0000 7feb298a8640 1 -- 172.21.15.151:0/274897324 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb200a6070 con 0x5645b1000ec0 2024-09-10T14:28:51.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb298a8640 1 -- 172.21.15.151:0/274897324 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb200af070 con 0x5645b1000ec0 2024-09-10T14:28:51.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb298a8640 1 -- 172.21.15.151:0/274897324 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb200aa5c0 con 0x5645b1000ec0 2024-09-10T14:28:51.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb2cd9a980 1 -- 172.21.15.151:0/274897324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1000ec0 msgr2=0x5645b10032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/274897324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1000ec0 0x5645b10032b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feb2000a5c0 tx=0x7feb2001b340 comp rx=0 tx=0).stop 2024-09-10T14:28:51.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb2cd9a980 1 -- 172.21.15.151:0/274897324 shutdown_connections 2024-09-10T14:28:51.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/274897324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1000ec0 0x5645b10032b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb2cd9a980 1 -- 172.21.15.151:0/274897324 >> 172.21.15.151:0/274897324 conn(0x5645b0ff5090 msgr2=0x5645b0ff74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb2cd9a980 1 -- 172.21.15.151:0/274897324 shutdown_connections 2024-09-10T14:28:51.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.255+0000 7feb2cd9a980 1 -- 172.21.15.151:0/274897324 wait complete. 2024-09-10T14:28:51.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2cd9a980 1 Processor -- start 2024-09-10T14:28:51.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2cd9a980 1 -- start start 2024-09-10T14:28:51.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2cd9a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2cd9a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645b0ea8200 con 0x5645b0f6f290 2024-09-10T14:28:51.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10e7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41796/0 (socket says 172.21.15.151:41796) 2024-09-10T14:28:51.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2a8aa640 1 -- 172.21.15.151:0/1155218456 learned_addr learned my addr 172.21.15.151:0/1155218456 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2a8aa640 1 -- 172.21.15.151:0/1155218456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b10e8230 con 0x5645b0f6f290 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/1155218456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10e7c60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feb1c001e50 tx=0x7feb1c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40427bf098a52d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7fea18e09640 1 -- 172.21.15.151:0/1155218456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c00e5d0 con 0x5645b0f6f290 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7fea18e09640 1 -- 172.21.15.151:0/1155218456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c00e770 con 0x5645b0f6f290 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.267+0000 7fea18e09640 1 -- 172.21.15.151:0/1155218456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c00eab0 con 0x5645b0f6f290 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- 172.21.15.151:0/1155218456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 msgr2=0x5645b10e7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/1155218456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10e7c60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feb1c001e50 tx=0x7feb1c001e80 comp rx=0 tx=0).stop 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- 172.21.15.151:0/1155218456 shutdown_connections 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/1155218456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10e7c60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- 172.21.15.151:0/1155218456 >> 172.21.15.151:0/1155218456 conn(0x5645b0ff5090 msgr2=0x5645b10e3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- 172.21.15.151:0/1155218456 shutdown_connections 2024-09-10T14:28:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- 172.21.15.151:0/1155218456 wait complete. 2024-09-10T14:28:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 Processor -- start 2024-09-10T14:28:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- start start 2024-09-10T14:28:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10eef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645b1006220 con 0x5645b0f6f290 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10eef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10eef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41798/0 (socket says 172.21.15.151:41798) 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2a8aa640 1 -- 172.21.15.151:0/156882927 learned_addr learned my addr 172.21.15.151:0/156882927 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2a8aa640 1 -- 172.21.15.151:0/156882927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b10ef4d0 con 0x5645b0f6f290 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10eef90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5645b10e8e40 tx=0x7feb1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7fea17606640 1 -- 172.21.15.151:0/156882927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c001260 con 0x5645b0f6f290 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645b10ef760 con 0x5645b0f6f290 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b10f2440 con 0x5645b0f6f290 2024-09-10T14:28:51.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7fea17606640 1 -- 172.21.15.151:0/156882927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c00fa40 con 0x5645b0f6f290 2024-09-10T14:28:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7fea17606640 1 -- 172.21.15.151:0/156882927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c02c060 con 0x5645b0f6f290 2024-09-10T14:28:51.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7fea17606640 1 -- 172.21.15.151:0/156882927 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb1c017070 con 0x5645b0f6f290 2024-09-10T14:28:51.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7fea17606640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea10034650 0x7fea10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7fea17606640 1 -- 172.21.15.151:0/156882927 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7feb1c015020 con 0x5645b0f6f290 2024-09-10T14:28:51.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea10034650 0x7fea10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b1000ec0 0x5645b10f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.271+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b10f65f0 con 0x5645b1000ec0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2b0ab640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b1000ec0 0x5645b10f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea10034650 0x7fea10036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feb200ae000 tx=0x7feb200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2b0ab640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b1000ec0 0x5645b10f5fd0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2b0ab640 1 -- 172.21.15.151:0/156882927 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b1000ec0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b10f3640 con 0x5645b1000ec0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2b0ab640 1 -- 172.21.15.151:0/156882927 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b1000ec0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b10f8920 0x5645b10fad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b10fb400 con 0x5645b10f8920 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b10f8920 0x5645b10fad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b10f8920 0x5645b10fad10 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2a8aa640 1 -- 172.21.15.151:0/156882927 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feb1c02e070 con 0x5645b10f8920 2024-09-10T14:28:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b10f77c0 con 0x5645b1000ec0 2024-09-10T14:28:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2b0ab640 1 -- 172.21.15.151:0/156882927 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b1000ec0 2024-09-10T14:28:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5645b10fc860 0x5645b10fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b10ff390 con 0x5645b10fc860 2024-09-10T14:28:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5645b10fc860 0x5645b10fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5645b10fc860 0x5645b10fec50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.275+0000 7feb2a0a9640 1 -- 172.21.15.151:0/156882927 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feb200aaa80 con 0x5645b10fc860 2024-09-10T14:28:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 Processor -- start 2024-09-10T14:28:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 -- start start 2024-09-10T14:28:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b110ce60 0x5645b110d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645b0f01800 con 0x5645b110ce60 2024-09-10T14:28:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b110ce60 0x5645b110d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b110ce60 0x5645b110d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41814/0 (socket says 172.21.15.151:41814) 2024-09-10T14:28:51.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2a8aa640 1 -- 172.21.15.151:0/2344030456 learned_addr learned my addr 172.21.15.151:0/2344030456 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2a8aa640 1 -- 172.21.15.151:0/2344030456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b110d7c0 con 0x5645b110ce60 2024-09-10T14:28:51.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/2344030456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b110ce60 0x5645b110d280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feb1c048ea0 tx=0x7feb1c01bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7fea14e01640 1 -- 172.21.15.151:0/2344030456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c027ac0 con 0x5645b110ce60 2024-09-10T14:28:51.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 -- 172.21.15.151:0/2344030456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645b110da50 con 0x5645b110ce60 2024-09-10T14:28:51.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7fea14e01640 1 -- 172.21.15.151:0/2344030456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c027c60 con 0x5645b110ce60 2024-09-10T14:28:51.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7fea14e01640 1 -- 172.21.15.151:0/2344030456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c0424d0 con 0x5645b110ce60 2024-09-10T14:28:51.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 -- 172.21.15.151:0/2344030456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b110da50 con 0x5645b110ce60 2024-09-10T14:28:51.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7fea14e01640 1 -- 172.21.15.151:0/2344030456 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb1c03b020 con 0x5645b110ce60 2024-09-10T14:28:51.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7fea14e01640 1 --2- 172.21.15.151:0/2344030456 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea04034650 0x7fea04036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7fea14e01640 1 -- 172.21.15.151:0/2344030456 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7feb1c033ce0 con 0x5645b110ce60 2024-09-10T14:28:51.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/2344030456 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea04034650 0x7fea04036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 Processor -- start 2024-09-10T14:28:51.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 -- start start 2024-09-10T14:28:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/2344030456 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea04034650 0x7fea04036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x5645b10f6ac0 tx=0x7feb20005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1119a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.279+0000 7feb2cd9a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645b10e85b0 con 0x5645b1119610 2024-09-10T14:28:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1119a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1119a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41824/0 (socket says 172.21.15.151:41824) 2024-09-10T14:28:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 -- 172.21.15.151:0/3450514079 learned_addr learned my addr 172.21.15.151:0/3450514079 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 -- 172.21.15.151:0/3450514079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b1119fe0 con 0x5645b1119610 2024-09-10T14:28:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/3450514079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1119a10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feb1c01dfd0 tx=0x7feb1c0305c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af6a41f0147ab45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7fea0e7fc640 1 -- 172.21.15.151:0/3450514079 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c047950 con 0x5645b1119610 2024-09-10T14:28:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7fea0e7fc640 1 -- 172.21.15.151:0/3450514079 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c05b070 con 0x5645b1119610 2024-09-10T14:28:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7fea0e7fc640 1 -- 172.21.15.151:0/3450514079 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c04a3f0 con 0x5645b1119610 2024-09-10T14:28:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- 172.21.15.151:0/3450514079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 msgr2=0x5645b1119a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/3450514079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1119a10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feb1c01dfd0 tx=0x7feb1c0305c0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- 172.21.15.151:0/3450514079 shutdown_connections 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/3450514079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1119a10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- 172.21.15.151:0/3450514079 >> 172.21.15.151:0/3450514079 conn(0x5645b11159a0 msgr2=0x5645b1113aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- 172.21.15.151:0/3450514079 shutdown_connections 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- 172.21.15.151:0/3450514079 wait complete. 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 Processor -- start 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- start start 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1120720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645b111a530 con 0x5645b1119610 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1120720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1120720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41834/0 (socket says 172.21.15.151:41834) 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 learned_addr learned my addr 172.21.15.151:0/192489251 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b1120c60 con 0x5645b1119610 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1120720 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feb1c047cc0 tx=0x7feb1c01e560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7fea0cff9640 1 -- 172.21.15.151:0/192489251 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c047160 con 0x5645b1119610 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645b1120c60 con 0x5645b1119610 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b1120c60 con 0x5645b1119610 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7fea0cff9640 1 -- 172.21.15.151:0/192489251 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c01e040 con 0x5645b1119610 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.283+0000 7fea0cff9640 1 -- 172.21.15.151:0/192489251 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c072060 con 0x5645b1119610 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7fea0cff9640 1 -- 172.21.15.151:0/192489251 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb1c0473c0 con 0x5645b1119610 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7fea0cff9640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe9f4034650 0x7fe9f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7fea0cff9640 1 -- 172.21.15.151:0/192489251 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7feb1c06ec60 con 0x5645b1119610 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe9f4034650 0x7fe9f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b112b870 0x5645b112dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b112e480 con 0x5645b112b870 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2b0ab640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b112b870 0x5645b112dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe9f4034650 0x7fe9f4036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feb200aafd0 tx=0x7feb200c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2b0ab640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b112b870 0x5645b112dd30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 realm 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b112e890 con 0x5645b112b870 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f130 con 0x5645b112b870 2024-09-10T14:28:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b1130230 0x5645b1132620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b1132ba0 con 0x5645b1130230 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b1130230 0x5645b1132620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b1130230 0x5645b1132620 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 20 searching for the correct realm 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b1134440 con 0x5645b1130230 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a8aa640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7feb1c06d020 0x7feb1c04e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b1134440 con 0x7feb1c06d020 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.287+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7feb1c06d020 0x7feb1c04e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7feb1c06d020 0x7feb1c04e1f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2a0a9640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7feb200e0040 0x7feb200e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b1134440 con 0x7feb200e0040 2024-09-10T14:28:51.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7feb200e0040 0x7feb200e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7feb200e0040 0x7feb200e0420 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb200e0040 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb200e0040 2024-09-10T14:28:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.291+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb1c06d020 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b1130230 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb200e0040 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb1c06d020 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b1130230 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b1130230 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb200e0040 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b1130230 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b1130230 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.295+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb200e0040 2024-09-10T14:28:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b1130230 2024-09-10T14:28:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb1c06d020 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb200e0040 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b1130230 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb200e0040 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb1c06d020 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b1130230 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.299+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb200e0040 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x5645b112b870 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5645b112f4d0 con 0x7feb1c06d020 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b11333f0 con 0x5645b112b870 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b11337e0 con 0x5645b112b870 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b11337e0 con 0x7feb200e0040 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 zone default found 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 4 Realm: () 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 zonegroup default 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b1133c00 con 0x7feb200e0040 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b1133c00 con 0x5645b1130230 2024-09-10T14:28:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b11362f0 con 0x5645b1130230 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 started sync module instance, tier type = 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.303+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1135790 con 0x7feb1c06d020 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.307+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.307+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94857323568000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1136b40 con 0x7feb1c06d020 2024-09-10T14:28:51.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.307+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1137390 con 0x5645b112b870 2024-09-10T14:28:51.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.307+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94857323568000] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.307+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.307+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94857323570832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1137390 con 0x5645b112b870 2024-09-10T14:28:51.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.307+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1137d90 con 0x5645b1130230 2024-09-10T14:28:51.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94857323575456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1138630 con 0x5645b1130230 2024-09-10T14:28:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1139030 con 0x7feb1c06d020 2024-09-10T14:28:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94857323570832] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94857323572960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1139420 con 0x7feb1c06d020 2024-09-10T14:28:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1139de0 con 0x5645b112b870 2024-09-10T14:28:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94857323572960] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94857323575456] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94857323580224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1139de0 con 0x5645b112b870 2024-09-10T14:28:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.311+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b113a630 con 0x7feb200e0040 2024-09-10T14:28:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.315+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94857323580224] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.315+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.315+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94857323584064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b113a370 con 0x7feb200e0040 2024-09-10T14:28:51.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.315+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b113ae80 con 0x7feb200e0040 2024-09-10T14:28:51.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94857323584064] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94857323587888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b113ae40 con 0x7feb200e0040 2024-09-10T14:28:51.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b113b860 con 0x7feb200e0040 2024-09-10T14:28:51.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94857323587888] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94857323590480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b113b820 con 0x7feb200e0040 2024-09-10T14:28:51.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 20 add_watcher() i=0 2024-09-10T14:28:51.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 20 add_watcher() i=1 2024-09-10T14:28:51.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 20 add_watcher() i=2 2024-09-10T14:28:51.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 20 add_watcher() i=3 2024-09-10T14:28:51.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 20 add_watcher() i=4 2024-09-10T14:28:51.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 20 add_watcher() i=5 2024-09-10T14:28:51.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.319+0000 7feb2cd9a980 20 add_watcher() i=6 2024-09-10T14:28:51.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94857323590480] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 20 add_watcher() i=7 2024-09-10T14:28:51.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:51.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b113ec80 con 0x5645b112b870 2024-09-10T14:28:51.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94857323585120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b113c1a0 con 0x5645b112b870 2024-09-10T14:28:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94857323585120] v33'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7fe9e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 5 note: GC not initialized 2024-09-10T14:28:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7fe95bfff640 20 reqs_thread_entry: start 2024-09-10T14:28:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 20 Filter name: none 2024-09-10T14:28:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7fe959ffb640 20 reqs_thread_entry: start 2024-09-10T14:28:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5645b1161e30 con 0x5645b112b870 2024-09-10T14:28:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.323+0000 7feb2cd9a980 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T14:28:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T14:28:51.147492Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:51.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.327+0000 7fe9e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.327+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94857323585120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1162370 con 0x5645b112b870 2024-09-10T14:28:51.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.327+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94857323585120] v33'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.327+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94857323568000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1139e60 con 0x7feb1c06d020 2024-09-10T14:28:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.327+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94857323568000] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.327+0000 7feb2cd9a980 20 remove_watcher() i=0 2024-09-10T14:28:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.327+0000 7feb2cd9a980 2 removed watcher, disabling cache 2024-09-10T14:28:51.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.327+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94857323570832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1135b80 con 0x5645b112b870 2024-09-10T14:28:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94857323570832] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2cd9a980 20 remove_watcher() i=1 2024-09-10T14:28:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94857323575456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1135b80 con 0x5645b1130230 2024-09-10T14:28:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2a8aa640 1 -- 172.21.15.151:0/192489251 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94857323575456] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb1c074070 con 0x5645b1130230 2024-09-10T14:28:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2cd9a980 20 remove_watcher() i=2 2024-09-10T14:28:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94857323572960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1135b80 con 0x7feb1c06d020 2024-09-10T14:28:51.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2a0a9640 1 -- 172.21.15.151:0/192489251 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94857323572960] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb200aaa80 con 0x7feb1c06d020 2024-09-10T14:28:51.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2cd9a980 20 remove_watcher() i=3 2024-09-10T14:28:51.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.331+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94857323580224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1136ee0 con 0x5645b112b870 2024-09-10T14:28:51.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.335+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94857323580224] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x5645b112b870 2024-09-10T14:28:51.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.335+0000 7feb2cd9a980 20 remove_watcher() i=4 2024-09-10T14:28:51.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.335+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94857323584064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1138b40 con 0x7feb200e0040 2024-09-10T14:28:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.335+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94857323584064] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.335+0000 7feb2cd9a980 20 remove_watcher() i=5 2024-09-10T14:28:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.335+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94857323587888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1136ee0 con 0x7feb200e0040 2024-09-10T14:28:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94857323587888] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 20 remove_watcher() i=6 2024-09-10T14:28:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94857323590480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645b1138b40 con 0x7feb200e0040 2024-09-10T14:28:51.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94857323590480] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb2400a4d0 con 0x7feb200e0040 2024-09-10T14:28:51.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 20 remove_watcher() i=7 2024-09-10T14:28:51.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7feb200e0040 msgr2=0x7feb200e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7feb200e0040 0x7feb200e0420 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b112b870 msgr2=0x5645b112dd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b112b870 0x5645b112dd30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7feb1c06d020 msgr2=0x7feb1c04e1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7feb1c06d020 0x7feb1c04e1f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b1130230 msgr2=0x5645b1132620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b1130230 0x5645b1132620 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe9f4034650 msgr2=0x7fe9f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe9f4034650 0x7fe9f4036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feb200aafd0 tx=0x7feb200c1040 comp rx=0 tx=0).stop 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 msgr2=0x5645b1120720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/192489251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b1119610 0x5645b1120720 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feb1c047cc0 tx=0x7feb1c01e560 comp rx=0 tx=0).stop 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2b0ab640 1 -- 172.21.15.151:0/192489251 reap_dead start 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 shutdown_connections 2024-09-10T14:28:51.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 >> 172.21.15.151:0/192489251 conn(0x5645b11159a0 msgr2=0x5645b1113a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 shutdown_connections 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/192489251 wait complete. 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/2344030456 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea04034650 msgr2=0x7fea04036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/2344030456 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea04034650 0x7fea04036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x5645b10f6ac0 tx=0x7feb20005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/2344030456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b110ce60 msgr2=0x5645b110d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/2344030456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b110ce60 0x5645b110d280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feb1c048ea0 tx=0x7feb1c01bd30 comp rx=0 tx=0).stop 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/2344030456 shutdown_connections 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/2344030456 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea04034650 0x7fea04036b10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/2344030456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b110ce60 0x5645b110d280 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/2344030456 >> 172.21.15.151:0/2344030456 conn(0x5645b1101fb0 msgr2=0x5645b1104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/2344030456 shutdown_connections 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.339+0000 7feb2cd9a980 1 -- 172.21.15.151:0/2344030456 wait complete. 2024-09-10T14:28:51.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5645b10fc860 msgr2=0x5645b10fec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5645b10fc860 0x5645b10fec50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b1000ec0 msgr2=0x5645b10f5fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5645b1000ec0 0x5645b10f5fd0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b10f8920 msgr2=0x5645b10fad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5645b10f8920 0x5645b10fad10 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea10034650 msgr2=0x7fea10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fea10034650 0x7fea10036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feb200ae000 tx=0x7feb200a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 msgr2=0x5645b10eef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 --2- 172.21.15.151:0/156882927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645b0f6f290 0x5645b10eef90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5645b10e8e40 tx=0x7feb1c000bd0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2b0ab640 1 -- 172.21.15.151:0/156882927 reap_dead start 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 shutdown_connections 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 >> 172.21.15.151:0/156882927 conn(0x5645b0ff5090 msgr2=0x5645b10e2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 shutdown_connections 2024-09-10T14:28:51.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.343+0000 7feb2cd9a980 1 -- 172.21.15.151:0/156882927 wait complete. 2024-09-10T14:28:51.354 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T14:28:51.147492Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:51.354 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T14:28:51.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T14:28:51.355 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-10T14:28:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb1712a0980 1 Processor -- start 2024-09-10T14:28:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb1712a0980 1 -- start start 2024-09-10T14:28:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb1712a0980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5611fd40f2e0 0x5611fd49d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb1712a0980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611fd322ae0 con 0x5611fd49d8b0 2024-09-10T14:28:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb1712a0980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5611fd346e30 con 0x5611fd40f2e0 2024-09-10T14:28:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb16edb0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5611fd40f2e0 0x5611fd49d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb16edb0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5611fd40f2e0 0x5611fd49d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41840/0 (socket says 172.21.15.151:41840) 2024-09-10T14:28:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb16edb0640 1 -- 172.21.15.151:0/1819949716 learned_addr learned my addr 172.21.15.151:0/1819949716 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb16edb0640 1 -- 172.21.15.151:0/1819949716 >> v1:172.21.15.52:6789/0 conn(0x5611fd49d8b0 legacy=0x5611fd49fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.423+0000 7fb16edb0640 1 -- 172.21.15.151:0/1819949716 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fd4a23d0 con 0x5611fd40f2e0 2024-09-10T14:28:51.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb16edb0640 1 --2- 172.21.15.151:0/1819949716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49d370 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb16000a5c0 tx=0x7fb16001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d202805c7c6bd825 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb16ddae640 1 -- 172.21.15.151:0/1819949716 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600a6070 con 0x5611fd40f2e0 2024-09-10T14:28:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb16ddae640 1 -- 172.21.15.151:0/1819949716 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600af070 con 0x5611fd40f2e0 2024-09-10T14:28:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb16ddae640 1 -- 172.21.15.151:0/1819949716 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600aa5c0 con 0x5611fd40f2e0 2024-09-10T14:28:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb1712a0980 1 -- 172.21.15.151:0/1819949716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 msgr2=0x5611fd49d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1819949716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49d370 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb16000a5c0 tx=0x7fb16001b340 comp rx=0 tx=0).stop 2024-09-10T14:28:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb1712a0980 1 -- 172.21.15.151:0/1819949716 shutdown_connections 2024-09-10T14:28:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1819949716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49d370 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb1712a0980 1 -- 172.21.15.151:0/1819949716 >> 172.21.15.151:0/1819949716 conn(0x5611fd4950a0 msgr2=0x5611fd4974c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb1712a0980 1 -- 172.21.15.151:0/1819949716 shutdown_connections 2024-09-10T14:28:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.427+0000 7fb1712a0980 1 -- 172.21.15.151:0/1819949716 wait complete. 2024-09-10T14:28:51.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.439+0000 7fb1712a0980 1 Processor -- start 2024-09-10T14:28:51.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.439+0000 7fb1712a0980 1 -- start start 2024-09-10T14:28:51.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.439+0000 7fb1712a0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.439+0000 7fb1712a0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5611fd348200 con 0x5611fd40f2e0 2024-09-10T14:28:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.439+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.439+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41850/0 (socket says 172.21.15.151:41850) 2024-09-10T14:28:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.439+0000 7fb16edb0640 1 -- 172.21.15.151:0/4205770937 learned_addr learned my addr 172.21.15.151:0/4205770937 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb16edb0640 1 -- 172.21.15.151:0/4205770937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fd49b0a0 con 0x5611fd40f2e0 2024-09-10T14:28:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb16edb0640 1 --2- 172.21.15.151:0/4205770937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49aad0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1600199f0 tx=0x7fb160003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8c1e519e05ce33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb05ce09640 1 -- 172.21.15.151:0/4205770937 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600aaa00 con 0x5611fd40f2e0 2024-09-10T14:28:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb05ce09640 1 -- 172.21.15.151:0/4205770937 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600aaba0 con 0x5611fd40f2e0 2024-09-10T14:28:51.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb05ce09640 1 -- 172.21.15.151:0/4205770937 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600bd3f0 con 0x5611fd40f2e0 2024-09-10T14:28:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- 172.21.15.151:0/4205770937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 msgr2=0x5611fd49aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 --2- 172.21.15.151:0/4205770937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49aad0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1600199f0 tx=0x7fb160003030 comp rx=0 tx=0).stop 2024-09-10T14:28:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- 172.21.15.151:0/4205770937 shutdown_connections 2024-09-10T14:28:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 --2- 172.21.15.151:0/4205770937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd40f2e0 0x5611fd49aad0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- 172.21.15.151:0/4205770937 >> 172.21.15.151:0/4205770937 conn(0x5611fd4950a0 msgr2=0x5611fd5815e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- 172.21.15.151:0/4205770937 shutdown_connections 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- 172.21.15.151:0/4205770937 wait complete. 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 Processor -- start 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- start start 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd49d8b0 0x5611fd58eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5611fd4a1e40 con 0x5611fd49d8b0 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd49d8b0 0x5611fd58eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd49d8b0 0x5611fd58eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41866/0 (socket says 172.21.15.151:41866) 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb16edb0640 1 -- 172.21.15.151:0/1949851820 learned_addr learned my addr 172.21.15.151:0/1949851820 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb16edb0640 1 -- 172.21.15.151:0/1949851820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fd58f530 con 0x5611fd49d8b0 2024-09-10T14:28:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb16edb0640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd49d8b0 0x5611fd58eff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1600199f0 tx=0x7fb1600180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb05b606640 1 -- 172.21.15.151:0/1949851820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600c6690 con 0x5611fd49d8b0 2024-09-10T14:28:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611fd58f7c0 con 0x5611fd49d8b0 2024-09-10T14:28:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611fd5924a0 con 0x5611fd49d8b0 2024-09-10T14:28:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb05b606640 1 -- 172.21.15.151:0/1949851820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600c6830 con 0x5611fd49d8b0 2024-09-10T14:28:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.443+0000 7fb05b606640 1 -- 172.21.15.151:0/1949851820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600c6b10 con 0x5611fd49d8b0 2024-09-10T14:28:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb05b606640 1 -- 172.21.15.151:0/1949851820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb1600ce020 con 0x5611fd49d8b0 2024-09-10T14:28:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb05b606640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0540346a0 0x7fb054036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb05b606640 1 -- 172.21.15.151:0/1949851820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb1600cc020 con 0x5611fd49d8b0 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16e5af640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0540346a0 0x7fb054036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd593f70 0x5611fd596360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5969b0 con 0x5611fd593f70 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16f5b1640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd593f70 0x5611fd596360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16e5af640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0540346a0 0x7fb054036b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb164000f70 tx=0x7fb164001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16f5b1640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd593f70 0x5611fd596360 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16f5b1640 1 -- 172.21.15.151:0/1949851820 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd593f70 2024-09-10T14:28:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd597270 con 0x5611fd593f70 2024-09-10T14:28:51.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16f5b1640 1 -- 172.21.15.151:0/1949851820 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd593f70 2024-09-10T14:28:51.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd598bc0 0x5611fd59b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd59b7e0 con 0x5611fd598bc0 2024-09-10T14:28:51.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16edb0640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd598bc0 0x5611fd59b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16edb0640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd598bc0 0x5611fd59b050 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16edb0640 1 -- 172.21.15.151:0/1949851820 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb1600bda00 con 0x5611fd598bc0 2024-09-10T14:28:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd597ac0 con 0x5611fd593f70 2024-09-10T14:28:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb16f5b1640 1 -- 172.21.15.151:0/1949851820 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd593f70 2024-09-10T14:28:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5611fd59cc40 0x5611fd59f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.447+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd59f770 con 0x5611fd59cc40 2024-09-10T14:28:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb16e5af640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5611fd59cc40 0x5611fd59f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb16e5af640 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5611fd59cc40 0x5611fd59f030 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb16e5af640 1 -- 172.21.15.151:0/1949851820 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb16400d040 con 0x5611fd59cc40 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb1712a0980 1 Processor -- start 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb1712a0980 1 -- start start 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb1712a0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5ad220 0x5611fd5ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb1712a0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5611fd3a1800 con 0x5611fd5ad220 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5ad220 0x5611fd5ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5ad220 0x5611fd5ad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41868/0 (socket says 172.21.15.151:41868) 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb16edb0640 1 -- 172.21.15.151:0/2946376326 learned_addr learned my addr 172.21.15.151:0/2946376326 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb16edb0640 1 -- 172.21.15.151:0/2946376326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fd5adb80 con 0x5611fd5ad220 2024-09-10T14:28:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb16edb0640 1 --2- 172.21.15.151:0/2946376326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5ad220 0x5611fd5ad640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb160000c10 tx=0x7fb160006680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb058e01640 1 -- 172.21.15.151:0/2946376326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600eb070 con 0x5611fd5ad220 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb1712a0980 1 -- 172.21.15.151:0/2946376326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611fd5ade10 con 0x5611fd5ad220 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb1712a0980 1 -- 172.21.15.151:0/2946376326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611fd5b0a90 con 0x5611fd5ad220 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb058e01640 1 -- 172.21.15.151:0/2946376326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600a9590 con 0x5611fd5ad220 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.451+0000 7fb058e01640 1 -- 172.21.15.151:0/2946376326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600e3560 con 0x5611fd5ad220 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb058e01640 1 -- 172.21.15.151:0/2946376326 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb1600ee070 con 0x5611fd5ad220 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb058e01640 1 --2- 172.21.15.151:0/2946376326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0480346a0 0x7fb048036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb058e01640 1 -- 172.21.15.151:0/2946376326 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb1600e7cb0 con 0x5611fd5ad220 2024-09-10T14:28:51.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb16e5af640 1 --2- 172.21.15.151:0/2946376326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0480346a0 0x7fb048036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 Processor -- start 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- start start 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb16e5af640 1 --2- 172.21.15.151:0/2946376326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0480346a0 0x7fb048036b60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5611fd593820 tx=0x7fb164006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5b9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5611fd499200 con 0x5611fd5b9be0 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5b9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5b9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41882/0 (socket says 172.21.15.151:41882) 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb16edb0640 1 -- 172.21.15.151:0/1200432696 learned_addr learned my addr 172.21.15.151:0/1200432696 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb16edb0640 1 -- 172.21.15.151:0/1200432696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fd5ba590 con 0x5611fd5b9be0 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb16edb0640 1 --2- 172.21.15.151:0/1200432696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5b9fc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb16001bbe0 tx=0x7fb1600c7d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65b279fdba42316 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb0527fc640 1 -- 172.21.15.151:0/1200432696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600daa90 con 0x5611fd5b9be0 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb0527fc640 1 -- 172.21.15.151:0/1200432696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600dad50 con 0x5611fd5b9be0 2024-09-10T14:28:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb0527fc640 1 -- 172.21.15.151:0/1200432696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600bca60 con 0x5611fd5b9be0 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- 172.21.15.151:0/1200432696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 msgr2=0x5611fd5b9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1200432696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5b9fc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb16001bbe0 tx=0x7fb1600c7d80 comp rx=0 tx=0).stop 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- 172.21.15.151:0/1200432696 shutdown_connections 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1200432696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5b9fc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- 172.21.15.151:0/1200432696 >> 172.21.15.151:0/1200432696 conn(0x5611fd5b5fc0 msgr2=0x5611fd5b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- 172.21.15.151:0/1200432696 shutdown_connections 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- 172.21.15.151:0/1200432696 wait complete. 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 Processor -- start 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- start start 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb1712a0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5611fd5baa30 con 0x5611fd5b9be0 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.455+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16edb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5c0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41890/0 (socket says 172.21.15.151:41890) 2024-09-10T14:28:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 learned_addr learned my addr 172.21.15.151:0/3796142087 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611fd5c12e0 con 0x5611fd5b9be0 2024-09-10T14:28:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16edb0640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5c0da0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb1600daa40 tx=0x7fb1600cbec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb050ff9640 1 -- 172.21.15.151:0/3796142087 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb16010c070 con 0x5611fd5b9be0 2024-09-10T14:28:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611fd5c12e0 con 0x5611fd5b9be0 2024-09-10T14:28:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611fd5c1750 con 0x5611fd5b9be0 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb050ff9640 1 -- 172.21.15.151:0/3796142087 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600b2a90 con 0x5611fd5b9be0 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb050ff9640 1 -- 172.21.15.151:0/3796142087 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1600b2d70 con 0x5611fd5b9be0 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb050ff9640 1 -- 172.21.15.151:0/3796142087 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb160105040 con 0x5611fd5b9be0 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb050ff9640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 0x7fb038036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb050ff9640 1 -- 172.21.15.151:0/3796142087 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb1600e01b0 con 0x5611fd5b9be0 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16e5af640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 0x7fb038036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd5cbd40 0x5611fd5ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5ce950 con 0x5611fd5cbd40 2024-09-10T14:28:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16f5b1640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd5cbd40 0x5611fd5ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16e5af640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 0x7fb038036b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb164010fd0 tx=0x7fb164011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16f5b1640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd5cbd40 0x5611fd5ce200 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 20 realm 2024-09-10T14:28:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5ced60 con 0x5611fd5cbd40 2024-09-10T14:28:51.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:51.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf600 con 0x5611fd5cbd40 2024-09-10T14:28:51.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.459+0000 7fb1712a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd5d0700 0x5611fd5d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d3190 con 0x5611fd5d0700 2024-09-10T14:28:51.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16edb0640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd5d0700 0x5611fd5d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16edb0640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd5d0700 0x5611fd5d2af0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:51.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 20 searching for the correct realm 2024-09-10T14:28:51.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d49f0 con 0x5611fd5d0700 2024-09-10T14:28:51.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16edb0640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb160108040 0x7fb1600b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d49f0 con 0x7fb160108040 2024-09-10T14:28:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16e5af640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb160108040 0x7fb1600b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16e5af640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb160108040 0x7fb1600b5510 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16e5af640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb16400f3d0 0x7fb16400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d49f0 con 0x7fb16400f3d0 2024-09-10T14:28:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16f5b1640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb16400f3d0 0x7fb16400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16f5b1640 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb16400f3d0 0x7fb16400f7f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.463+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb16400f3d0 2024-09-10T14:28:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb16400f3d0 2024-09-10T14:28:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb160108040 2024-09-10T14:28:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5d0700 2024-09-10T14:28:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb16400f3d0 2024-09-10T14:28:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb160108040 2024-09-10T14:28:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5d0700 2024-09-10T14:28:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5d0700 2024-09-10T14:28:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.467+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb16400f3d0 2024-09-10T14:28:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5d0700 2024-09-10T14:28:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5d0700 2024-09-10T14:28:51.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb16400f3d0 2024-09-10T14:28:51.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5d0700 2024-09-10T14:28:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb160108040 2024-09-10T14:28:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb16400f3d0 2024-09-10T14:28:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5d0700 2024-09-10T14:28:51.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.471+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb16400f3d0 2024-09-10T14:28:51.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb160108040 2024-09-10T14:28:51.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5d0700 2024-09-10T14:28:51.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb16400f3d0 2024-09-10T14:28:51.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x5611fd5cbd40 2024-09-10T14:28:51.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5cf9a0 con 0x7fb160108040 2024-09-10T14:28:51.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:51.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:51.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:51.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:51.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:51.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:51.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d3b10 con 0x5611fd5cbd40 2024-09-10T14:28:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d4360 con 0x5611fd5cbd40 2024-09-10T14:28:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d3770 con 0x7fb16400f3d0 2024-09-10T14:28:51.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:51.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 zone default found 2024-09-10T14:28:51.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 4 Realm: () 2024-09-10T14:28:51.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:51.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:51.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:51.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 zonegroup default 2024-09-10T14:28:51.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.475+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d48c0 con 0x7fb16400f3d0 2024-09-10T14:28:51.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d6800 con 0x5611fd5d0700 2024-09-10T14:28:51.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d6ca0 con 0x5611fd5d0700 2024-09-10T14:28:51.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 20 started sync module instance, tier type = 2024-09-10T14:28:51.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:51.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d5ca0 con 0x7fb160108040 2024-09-10T14:28:51.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94635265187984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d75b0 con 0x7fb160108040 2024-09-10T14:28:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d7e00 con 0x5611fd5cbd40 2024-09-10T14:28:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94635265187984] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.479+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94635265192192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d7e00 con 0x5611fd5cbd40 2024-09-10T14:28:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d88c0 con 0x5611fd5d0700 2024-09-10T14:28:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94635265196944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d9160 con 0x5611fd5d0700 2024-09-10T14:28:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d9b80 con 0x7fb160108040 2024-09-10T14:28:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94635265192192] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94635265201776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d9f70 con 0x7fb160108040 2024-09-10T14:28:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.483+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5da930 con 0x5611fd5cbd40 2024-09-10T14:28:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.487+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94635265196944] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.487+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94635265201776] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.487+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.487+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94635265194320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5da480 con 0x5611fd5cbd40 2024-09-10T14:28:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.487+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5dad10 con 0x7fb16400f3d0 2024-09-10T14:28:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.487+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94635265194320] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.491+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.491+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94635265199280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5da930 con 0x7fb16400f3d0 2024-09-10T14:28:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.491+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5db720 con 0x7fb16400f3d0 2024-09-10T14:28:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.491+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.491+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94635265208944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5dbb40 con 0x7fb16400f3d0 2024-09-10T14:28:51.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.491+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5dc570 con 0x7fb16400f3d0 2024-09-10T14:28:51.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.491+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94635265199280] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94635265205376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5dc530 con 0x7fb16400f3d0 2024-09-10T14:28:51.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 add_watcher() i=0 2024-09-10T14:28:51.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 add_watcher() i=1 2024-09-10T14:28:51.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 add_watcher() i=2 2024-09-10T14:28:51.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 add_watcher() i=3 2024-09-10T14:28:51.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 add_watcher() i=4 2024-09-10T14:28:51.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 add_watcher() i=5 2024-09-10T14:28:51.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94635265208944] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 add_watcher() i=6 2024-09-10T14:28:51.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94635265205376] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 add_watcher() i=7 2024-09-10T14:28:51.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:51.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5db690 con 0x5611fd5cbd40 2024-09-10T14:28:51.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94635265210000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5dc990 con 0x5611fd5cbd40 2024-09-10T14:28:51.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94635265210000] v33'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb0257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:51.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:51.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7fb1712a0980 5 note: GC not initialized 2024-09-10T14:28:51.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.495+0000 7faf9ffff640 20 reqs_thread_entry: start 2024-09-10T14:28:51.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:51.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 20 Filter name: none 2024-09-10T14:28:51.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7faf9dffb640 20 reqs_thread_entry: start 2024-09-10T14:28:51.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:51.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd602b00 con 0x5611fd5cbd40 2024-09-10T14:28:51.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T14:28:51.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:51.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:51.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd6096d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v33'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:51.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:51.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94635265397056 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd604e40 con 0x5611fd5cbd40 2024-09-10T14:28:51.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 94635265194320 notify 141733920776 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7fb16802d060 con 0x5611fd5cbd40 2024-09-10T14:28:51.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb0527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94635265194320 notifier 4400 bl.length()=758 2024-09-10T14:28:51.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb0527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:51.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb0527fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(64 notify.4 [notify cookie 94635265397056 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb0527fc640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb034003eb0 con 0x5611fd5cbd40 2024-09-10T14:28:51.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 94635265397056 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb16801e040 con 0x5611fd5cbd40 2024-09-10T14:28:51.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.499+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd609140 con 0x5611fd5cbd40 2024-09-10T14:28:51.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(66 foo:foo1 [delete] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb1712a0980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T14:28:51.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94635265397056 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5611fd604990 con 0x7fb160108040 2024-09-10T14:28:51.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== watch-notify(notify (1) cookie 94635265187984 notify 141733920772 ret 0) ==== 201+0+0 (crc 0 0 0) 0x5611fd322ae0 con 0x7fb160108040 2024-09-10T14:28:51.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb051ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94635265187984 notifier 4400 bl.length()=159 2024-09-10T14:28:51.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.0 [notify cookie 94635265397056 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb051ffb640 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fafa40032d0 con 0x7fb160108040 2024-09-10T14:28:51.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== watch-notify(notify_complete (2) cookie 94635265397056 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb16400fd30 con 0x7fb160108040 2024-09-10T14:28:51.533 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T14:28:51.147492Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:51.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb0257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94635265210000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd600930 con 0x5611fd5cbd40 2024-09-10T14:28:51.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94635265210000] v33'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94635265187984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd600930 con 0x7fb160108040 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94635265187984] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb1712a0980 20 remove_watcher() i=0 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb1712a0980 2 removed watcher, disabling cache 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.503+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94635265192192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd600930 con 0x5611fd5cbd40 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.507+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94635265192192] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.507+0000 7fb1712a0980 20 remove_watcher() i=1 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.507+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94635265196944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d7100 con 0x5611fd5d0700 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb16edb0640 1 -- 172.21.15.151:0/3796142087 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94635265196944] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1600fb070 con 0x5611fd5d0700 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb1712a0980 20 remove_watcher() i=2 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94635265201776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd600930 con 0x7fb160108040 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb16e5af640 1 -- 172.21.15.151:0/3796142087 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94635265201776] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb164036040 con 0x7fb160108040 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb1712a0980 20 remove_watcher() i=3 2024-09-10T14:28:51.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94635265194320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d8390 con 0x5611fd5cbd40 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94635265194320] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x5611fd5cbd40 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb1712a0980 20 remove_watcher() i=4 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.511+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94635265199280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd600930 con 0x7fb16400f3d0 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.515+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94635265199280] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.515+0000 7fb1712a0980 20 remove_watcher() i=5 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.515+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94635265208944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d7950 con 0x7fb16400f3d0 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.515+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94635265208944] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.515+0000 7fb1712a0980 20 remove_watcher() i=6 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.515+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94635265205376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5611fd5d8390 con 0x7fb16400f3d0 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94635265205376] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16800a4d0 con 0x7fb16400f3d0 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 20 remove_watcher() i=7 2024-09-10T14:28:51.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb16400f3d0 msgr2=0x7fb16400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb16400f3d0 0x7fb16400f7f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd5cbd40 msgr2=0x5611fd5ce200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd5cbd40 0x5611fd5ce200 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb160108040 msgr2=0x7fb1600b5510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb160108040 0x7fb1600b5510 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd5d0700 msgr2=0x5611fd5d2af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd5d0700 0x5611fd5d2af0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 msgr2=0x7fb038036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 0x7fb038036b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb164010fd0 tx=0x7fb164011000 comp rx=0 tx=0).stop 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb16f5b1640 1 -- 172.21.15.151:0/3796142087 reap_dead start 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 msgr2=0x5611fd5c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5c0da0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb1600daa40 tx=0x7fb1600cbec0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 shutdown_connections 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/3796142087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5b9be0 0x5611fd5c0da0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 >> 172.21.15.151:0/3796142087 conn(0x5611fd5b5fc0 msgr2=0x5611fd5b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 shutdown_connections 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/3796142087 wait complete. 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/2946376326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0480346a0 msgr2=0x7fb048036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/2946376326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0480346a0 0x7fb048036b60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x5611fd593820 tx=0x7fb164006000 comp rx=0 tx=0).stop 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/2946376326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5ad220 msgr2=0x5611fd5ad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/2946376326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5ad220 0x5611fd5ad640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb160000c10 tx=0x7fb160006680 comp rx=0 tx=0).stop 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/2946376326 shutdown_connections 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/2946376326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0480346a0 0x7fb048036b60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/2946376326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd5ad220 0x5611fd5ad640 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/2946376326 >> 172.21.15.151:0/2946376326 conn(0x5611fd5a2370 msgr2=0x5611fd5a4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/2946376326 shutdown_connections 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/2946376326 wait complete. 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5611fd59cc40 msgr2=0x5611fd59f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5611fd59cc40 0x5611fd59f030 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd593f70 msgr2=0x5611fd596360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5611fd593f70 0x5611fd596360 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd598bc0 msgr2=0x5611fd59b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5611fd598bc0 0x5611fd59b050 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0540346a0 msgr2=0x7fb054036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0540346a0 0x7fb054036b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb164000f70 tx=0x7fb164001420 comp rx=0 tx=0).stop 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd49d8b0 msgr2=0x5611fd58eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 --2- 172.21.15.151:0/1949851820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611fd49d8b0 0x5611fd58eff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1600199f0 tx=0x7fb1600180e0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb16f5b1640 1 -- 172.21.15.151:0/1949851820 reap_dead start 2024-09-10T14:28:51.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 shutdown_connections 2024-09-10T14:28:51.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 >> 172.21.15.151:0/1949851820 conn(0x5611fd4950a0 msgr2=0x5611fd4997a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 shutdown_connections 2024-09-10T14:28:51.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.519+0000 7fb1712a0980 1 -- 172.21.15.151:0/1949851820 wait complete. 2024-09-10T14:28:51.544 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T14:28:51.147492Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:51.544 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T14:28:51.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T14:28:51.545 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-10T14:28:51.618 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:51.618 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517e9b0980 1 Processor -- start 2024-09-10T14:28:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517e9b0980 1 -- start start 2024-09-10T14:28:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517e9b0980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e1baf353b0 0x55e1baf33b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517e9b0980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e1bae46ae0 con 0x55e1baf357c0 2024-09-10T14:28:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517e9b0980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55e1bae6ae30 con 0x55e1baf353b0 2024-09-10T14:28:51.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517c4c0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e1baf353b0 0x55e1baf33b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517c4c0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e1baf353b0 0x55e1baf33b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41904/0 (socket says 172.21.15.151:41904) 2024-09-10T14:28:51.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517c4c0640 1 -- 172.21.15.151:0/418151448 learned_addr learned my addr 172.21.15.151:0/418151448 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517c4c0640 1 -- 172.21.15.151:0/418151448 >> v1:172.21.15.52:6789/0 conn(0x55e1baf357c0 legacy=0x55e1baf340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.615+0000 7f517c4c0640 1 -- 172.21.15.151:0/418151448 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1baf348e0 con 0x55e1baf353b0 2024-09-10T14:28:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517c4c0640 1 --2- 172.21.15.151:0/418151448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1baf33b70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f517400a5c0 tx=0x7f517401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f401558939ed18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517b4be640 1 -- 172.21.15.151:0/418151448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740a6070 con 0x55e1baf353b0 2024-09-10T14:28:51.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517b4be640 1 -- 172.21.15.151:0/418151448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51740af070 con 0x55e1baf353b0 2024-09-10T14:28:51.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517b4be640 1 -- 172.21.15.151:0/418151448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740aa5c0 con 0x55e1baf353b0 2024-09-10T14:28:51.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517e9b0980 1 -- 172.21.15.151:0/418151448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 msgr2=0x55e1baf33b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517e9b0980 1 --2- 172.21.15.151:0/418151448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1baf33b70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f517400a5c0 tx=0x7f517401b340 comp rx=0 tx=0).stop 2024-09-10T14:28:51.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517e9b0980 1 -- 172.21.15.151:0/418151448 shutdown_connections 2024-09-10T14:28:51.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517e9b0980 1 --2- 172.21.15.151:0/418151448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1baf33b70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517e9b0980 1 -- 172.21.15.151:0/418151448 >> 172.21.15.151:0/418151448 conn(0x55e1bafba1b0 msgr2=0x55e1bafbc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517e9b0980 1 -- 172.21.15.151:0/418151448 shutdown_connections 2024-09-10T14:28:51.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.619+0000 7f517e9b0980 1 -- 172.21.15.151:0/418151448 wait complete. 2024-09-10T14:28:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.631+0000 7f517e9b0980 1 Processor -- start 2024-09-10T14:28:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.631+0000 7f517e9b0980 1 -- start start 2024-09-10T14:28:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.631+0000 7f517e9b0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.631+0000 7f517e9b0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1bae6c200 con 0x55e1baf353b0 2024-09-10T14:28:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41908/0 (socket says 172.21.15.151:41908) 2024-09-10T14:28:51.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 -- 172.21.15.151:0/1471074424 learned_addr learned my addr 172.21.15.151:0/1471074424 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 -- 172.21.15.151:0/1471074424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1bb0ac160 con 0x55e1baf353b0 2024-09-10T14:28:51.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 --2- 172.21.15.151:0/1471074424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0abb90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5174017f50 tx=0x7f5174003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a277f1185716e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f506a60c640 1 -- 172.21.15.151:0/1471074424 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740aa8f0 con 0x55e1baf353b0 2024-09-10T14:28:51.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f506a60c640 1 -- 172.21.15.151:0/1471074424 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51740aaa90 con 0x55e1baf353b0 2024-09-10T14:28:51.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f506a60c640 1 -- 172.21.15.151:0/1471074424 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740aad70 con 0x55e1baf353b0 2024-09-10T14:28:51.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 -- 172.21.15.151:0/1471074424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 msgr2=0x55e1bb0abb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1471074424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0abb90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5174017f50 tx=0x7f5174003030 comp rx=0 tx=0).stop 2024-09-10T14:28:51.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 -- 172.21.15.151:0/1471074424 shutdown_connections 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1471074424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0abb90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 -- 172.21.15.151:0/1471074424 >> 172.21.15.151:0/1471074424 conn(0x55e1bafba1b0 msgr2=0x55e1bb0a77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 -- 172.21.15.151:0/1471074424 shutdown_connections 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 -- 172.21.15.151:0/1471074424 wait complete. 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 Processor -- start 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 -- start start 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517e9b0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1bafca200 con 0x55e1baf353b0 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41922/0 (socket says 172.21.15.151:41922) 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 -- 172.21.15.151:0/1830895077 learned_addr learned my addr 172.21.15.151:0/1830895077 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 -- 172.21.15.151:0/1830895077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1bb0b3320 con 0x55e1baf353b0 2024-09-10T14:28:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.635+0000 7f517c4c0640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0b2de0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f517401b820 tx=0x7f51740180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f5068e09640 1 -- 172.21.15.151:0/1830895077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740aa890 con 0x55e1baf353b0 2024-09-10T14:28:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1bb0b35b0 con 0x55e1baf353b0 2024-09-10T14:28:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1bb0b6290 con 0x55e1baf353b0 2024-09-10T14:28:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f5068e09640 1 -- 172.21.15.151:0/1830895077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51740cd070 con 0x55e1baf353b0 2024-09-10T14:28:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f5068e09640 1 -- 172.21.15.151:0/1830895077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740bda80 con 0x55e1baf353b0 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f5068e09640 1 -- 172.21.15.151:0/1830895077 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51740bdc20 con 0x55e1baf353b0 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f5068e09640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50640346a0 0x7f5064036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f5068e09640 1 -- 172.21.15.151:0/1830895077 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f51740e59e0 con 0x55e1baf353b0 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517bcbf640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50640346a0 0x7f5064036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1baf357c0 0x55e1bb0b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0ba420 con 0x55e1baf357c0 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517ccc1640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1baf357c0 0x55e1bb0b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517bcbf640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50640346a0 0x7f5064036b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5164001e20 tx=0x7f51640013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517ccc1640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1baf357c0 0x55e1bb0b9ee0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517ccc1640 1 -- 172.21.15.151:0/1830895077 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1baf357c0 2024-09-10T14:28:51.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0bacf0 con 0x55e1baf357c0 2024-09-10T14:28:51.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517ccc1640 1 -- 172.21.15.151:0/1830895077 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1baf357c0 2024-09-10T14:28:51.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0bc640 0x55e1bb0bead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0bf260 con 0x55e1bb0bc640 2024-09-10T14:28:51.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517c4c0640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0bc640 0x55e1bb0bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517c4c0640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0bc640 0x55e1bb0bead0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517c4c0640 1 -- 172.21.15.151:0/1830895077 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51740c8470 con 0x55e1bb0bc640 2024-09-10T14:28:51.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0bb540 con 0x55e1baf357c0 2024-09-10T14:28:51.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517ccc1640 1 -- 172.21.15.151:0/1830895077 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1baf357c0 2024-09-10T14:28:51.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1bb0c06c0 0x55e1bb0c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.639+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0c3220 con 0x55e1bb0c06c0 2024-09-10T14:28:51.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517bcbf640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1bb0c06c0 0x55e1bb0c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517bcbf640 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1bb0c06c0 0x55e1bb0c2ab0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517bcbf640 1 -- 172.21.15.151:0/1830895077 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f516400d040 con 0x55e1bb0c06c0 2024-09-10T14:28:51.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517e9b0980 1 Processor -- start 2024-09-10T14:28:51.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517e9b0980 1 -- start start 2024-09-10T14:28:51.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517e9b0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0d0c90 0x55e1bb0d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517e9b0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1baec5800 con 0x55e1bb0d0c90 2024-09-10T14:28:51.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0d0c90 0x55e1bb0d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0d0c90 0x55e1bb0d10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41936/0 (socket says 172.21.15.151:41936) 2024-09-10T14:28:51.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517c4c0640 1 -- 172.21.15.151:0/2684841243 learned_addr learned my addr 172.21.15.151:0/2684841243 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517c4c0640 1 -- 172.21.15.151:0/2684841243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1bb0d15f0 con 0x55e1bb0d0c90 2024-09-10T14:28:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f517c4c0640 1 --2- 172.21.15.151:0/2684841243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0d0c90 0x55e1bb0d10b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51740e5010 tx=0x7f51740b4280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.643+0000 7f5061ffb640 1 -- 172.21.15.151:0/2684841243 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740b3d60 con 0x55e1bb0d0c90 2024-09-10T14:28:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f5061ffb640 1 -- 172.21.15.151:0/2684841243 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51740c0a90 con 0x55e1bb0d0c90 2024-09-10T14:28:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f5061ffb640 1 -- 172.21.15.151:0/2684841243 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740c0d70 con 0x55e1bb0d0c90 2024-09-10T14:28:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517e9b0980 1 -- 172.21.15.151:0/2684841243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1bb0d1880 con 0x55e1bb0d0c90 2024-09-10T14:28:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517e9b0980 1 -- 172.21.15.151:0/2684841243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1bb0d4500 con 0x55e1bb0d0c90 2024-09-10T14:28:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f5061ffb640 1 -- 172.21.15.151:0/2684841243 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51740b33f0 con 0x55e1bb0d0c90 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f5061ffb640 1 --2- 172.21.15.151:0/2684841243 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5054034650 0x7f5054036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f5061ffb640 1 -- 172.21.15.151:0/2684841243 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f51740efce0 con 0x55e1bb0d0c90 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517bcbf640 1 --2- 172.21.15.151:0/2684841243 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5054034650 0x7f5054036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517e9b0980 1 Processor -- start 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517e9b0980 1 -- start start 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517bcbf640 1 --2- 172.21.15.151:0/2684841243 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5054034650 0x7f5054036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55e1bb0c3600 tx=0x7f5164006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517e9b0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0dd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517e9b0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1bb0ac420 con 0x55e1bb0dd560 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0dd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41944/0 (socket says 172.21.15.151:41944) 2024-09-10T14:28:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517c4c0640 1 -- 172.21.15.151:0/1279239138 learned_addr learned my addr 172.21.15.151:0/1279239138 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517c4c0640 1 -- 172.21.15.151:0/1279239138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1bb0ddf30 con 0x55e1bb0dd560 2024-09-10T14:28:51.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f517c4c0640 1 --2- 172.21.15.151:0/1279239138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0dd960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f51740bd690 tx=0x7f51740a7b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11056562ae7399a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f50537fe640 1 -- 172.21.15.151:0/1279239138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740dbe60 con 0x55e1bb0dd560 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f50537fe640 1 -- 172.21.15.151:0/1279239138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51740c6480 con 0x55e1bb0dd560 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.647+0000 7f50537fe640 1 -- 172.21.15.151:0/1279239138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740c0120 con 0x55e1bb0dd560 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- 172.21.15.151:0/1279239138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 msgr2=0x55e1bb0dd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1279239138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0dd960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f51740bd690 tx=0x7f51740a7b70 comp rx=0 tx=0).stop 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- 172.21.15.151:0/1279239138 shutdown_connections 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1279239138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0dd960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- 172.21.15.151:0/1279239138 >> 172.21.15.151:0/1279239138 conn(0x55e1bb0d9990 msgr2=0x55e1bb0d7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- 172.21.15.151:0/1279239138 shutdown_connections 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- 172.21.15.151:0/1279239138 wait complete. 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 Processor -- start 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- start start 2024-09-10T14:28:51.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0e4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e1bb0de400 con 0x55e1bb0dd560 2024-09-10T14:28:51.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517c4c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0e4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41948/0 (socket says 172.21.15.151:41948) 2024-09-10T14:28:51.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 learned_addr learned my addr 172.21.15.151:0/3171690236 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1bb0e4cb0 con 0x55e1bb0dd560 2024-09-10T14:28:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517c4c0640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0e4770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f51740e54c0 tx=0x7f51740d4100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f5051ffb640 1 -- 172.21.15.151:0/3171690236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740e50b0 con 0x55e1bb0dd560 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1bb0e4cb0 con 0x55e1bb0dd560 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f5051ffb640 1 -- 172.21.15.151:0/3171690236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51740dbe60 con 0x55e1bb0dd560 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1bb0e4cb0 con 0x55e1bb0dd560 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f5051ffb640 1 -- 172.21.15.151:0/3171690236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51740c05b0 con 0x55e1bb0dd560 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f5051ffb640 1 -- 172.21.15.151:0/3171690236 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51740bc7d0 con 0x55e1bb0dd560 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f5051ffb640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5044034650 0x7f5044036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f5051ffb640 1 -- 172.21.15.151:0/3171690236 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f51740fe070 con 0x55e1bb0dd560 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517bcbf640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5044034650 0x7f5044036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.651+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1bb0ef750 0x55e1bb0f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f2340 con 0x55e1bb0ef750 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517ccc1640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1bb0ef750 0x55e1bb0f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517bcbf640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5044034650 0x7f5044036b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51640207d0 tx=0x7f5164011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517ccc1640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1bb0ef750 0x55e1bb0f1bf0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 realm 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f2750 con 0x55e1bb0ef750 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f2ff0 con 0x55e1bb0ef750 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0f40f0 0x55e1bb0f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f6b30 con 0x55e1bb0f40f0 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517c4c0640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0f40f0 0x55e1bb0f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517c4c0640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0f40f0 0x55e1bb0f64e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 20 searching for the correct realm 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f8390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517c4c0640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f517410c040 0x7f51740bb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f8390 con 0x7f517410c040 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517bcbf640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f517410c040 0x7f51740bb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517bcbf640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f517410c040 0x7f51740bb8a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517bcbf640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f516400f3d0 0x7f516400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f8390 con 0x7f516400f3d0 2024-09-10T14:28:51.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.655+0000 7f517ccc1640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f516400f3d0 0x7f516400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f516400f3d0 0x7f516400f7f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f516400f3d0 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f516400f3d0 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f517410c040 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.659+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f516400f3d0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f517410c040 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f516400f3d0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f516400f3d0 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.663+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f517410c040 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f516400f3d0 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f516400f3d0 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f517410c040 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0f40f0 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f516400f3d0 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x55e1bb0ef750 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f3390 con 0x7f517410c040 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517e9b0980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517e9b0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517e9b0980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517e9b0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517e9b0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517e9b0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.667+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f7480 con 0x55e1bb0ef750 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f7cd0 con 0x55e1bb0ef750 2024-09-10T14:28:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f7820 con 0x7f516400f3d0 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 zone default found 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 4 Realm: () 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 zonegroup default 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f7c50 con 0x7f516400f3d0 2024-09-10T14:28:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fa1a0 con 0x55e1bb0f40f0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fa540 con 0x55e1bb0f40f0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 started sync module instance, tier type = 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:51.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f9640 con 0x7f517410c040 2024-09-10T14:28:51.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94427994364464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f92a0 con 0x7f517410c040 2024-09-10T14:28:51.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.671+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fb240 con 0x55e1bb0ef750 2024-09-10T14:28:51.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.675+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94427994364464] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.675+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.675+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94427994368496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fb630 con 0x55e1bb0ef750 2024-09-10T14:28:51.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.675+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fbff0 con 0x55e1bb0f40f0 2024-09-10T14:28:51.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.675+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.675+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94427994372928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fc840 con 0x55e1bb0f40f0 2024-09-10T14:28:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.675+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fd240 con 0x7f517410c040 2024-09-10T14:28:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94427994368496] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94427994369648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fd630 con 0x7f517410c040 2024-09-10T14:28:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fdff0 con 0x55e1bb0ef750 2024-09-10T14:28:51.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94427994369648] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94427994372928] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94427994375056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fdb40 con 0x55e1bb0ef750 2024-09-10T14:28:51.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.679+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fe890 con 0x7f516400f3d0 2024-09-10T14:28:51.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.683+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94427994375056] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.683+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.683+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94427994377552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fe5b0 con 0x7f516400f3d0 2024-09-10T14:28:51.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.683+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fee00 con 0x7f516400f3d0 2024-09-10T14:28:51.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.683+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.683+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94427994384064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0ff190 con 0x7f516400f3d0 2024-09-10T14:28:51.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.683+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0ffcb0 con 0x7f516400f3d0 2024-09-10T14:28:51.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.683+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94427994377552] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94427994388352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0ffc70 con 0x7f516400f3d0 2024-09-10T14:28:51.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 20 add_watcher() i=0 2024-09-10T14:28:51.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 20 add_watcher() i=1 2024-09-10T14:28:51.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 20 add_watcher() i=2 2024-09-10T14:28:51.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 20 add_watcher() i=3 2024-09-10T14:28:51.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 20 add_watcher() i=4 2024-09-10T14:28:51.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 20 add_watcher() i=5 2024-09-10T14:28:51.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94427994384064] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 20 add_watcher() i=6 2024-09-10T14:28:51.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94427994388352] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 20 add_watcher() i=7 2024-09-10T14:28:51.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:51.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fec20 con 0x55e1bb0ef750 2024-09-10T14:28:51.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.687+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94427994385376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb1000a0 con 0x55e1bb0ef750 2024-09-10T14:28:51.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94427994385376] v33'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f50327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:51.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:51.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 5 note: GC not initialized 2024-09-10T14:28:51.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f50317e2640 20 reqs_thread_entry: start 2024-09-10T14:28:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 20 Filter name: none 2024-09-10T14:28:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f4fa2ffd640 20 reqs_thread_entry: start 2024-09-10T14:28:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb126210 con 0x55e1bb0ef750 2024-09-10T14:28:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 20 rados_obj.operate() r=0 bl.length=582 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb12c830 con 0x55e1bb0ef750 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v33'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94427994571424 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb1281d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 94427994375056 notify 141733920777 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f516c02d040 con 0x55e1bb0ef750 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f50537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94427994375056 notifier 4407 bl.length()=732 2024-09-10T14:28:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f50537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f50537fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(64 notify.4 [notify cookie 94427994571424 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f50537fe640 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5040003eb0 con 0x55e1bb0ef750 2024-09-10T14:28:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.691+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 94427994571424 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f516c01e040 con 0x55e1bb0ef750 2024-09-10T14:28:51.698 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T14:28:51.147492Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:51.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.695+0000 7f50327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.695+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94427994385376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb124040 con 0x55e1bb0ef750 2024-09-10T14:28:51.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.695+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94427994385376] v33'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.695+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94427994364464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb124040 con 0x7f517410c040 2024-09-10T14:28:51.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.695+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94427994364464] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.695+0000 7f517e9b0980 20 remove_watcher() i=0 2024-09-10T14:28:51.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.695+0000 7f517e9b0980 2 removed watcher, disabling cache 2024-09-10T14:28:51.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.695+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94427994368496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f9a30 con 0x55e1bb0ef750 2024-09-10T14:28:51.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94427994368496] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517e9b0980 20 remove_watcher() i=1 2024-09-10T14:28:51.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94427994372928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb124040 con 0x55e1bb0f40f0 2024-09-10T14:28:51.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517c4c0640 1 -- 172.21.15.151:0/3171690236 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94427994372928] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f517411b020 con 0x55e1bb0f40f0 2024-09-10T14:28:51.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517e9b0980 20 remove_watcher() i=2 2024-09-10T14:28:51.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94427994369648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fa9f0 con 0x7f517410c040 2024-09-10T14:28:51.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517bcbf640 1 -- 172.21.15.151:0/3171690236 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94427994369648] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5164036040 con 0x7f517410c040 2024-09-10T14:28:51.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517e9b0980 20 remove_watcher() i=3 2024-09-10T14:28:51.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.699+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94427994375056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0f9a30 con 0x55e1bb0ef750 2024-09-10T14:28:51.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.703+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94427994375056] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x55e1bb0ef750 2024-09-10T14:28:51.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.703+0000 7f517e9b0980 20 remove_watcher() i=4 2024-09-10T14:28:51.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.703+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94427994377552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fbb40 con 0x7f516400f3d0 2024-09-10T14:28:51.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.703+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94427994377552] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.703+0000 7f517e9b0980 20 remove_watcher() i=5 2024-09-10T14:28:51.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.703+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94427994384064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb124040 con 0x7f516400f3d0 2024-09-10T14:28:51.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94427994384064] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 20 remove_watcher() i=6 2024-09-10T14:28:51.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94427994388352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e1bb0fa9f0 con 0x7f516400f3d0 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94427994388352] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f516400f3d0 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 20 remove_watcher() i=7 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f516400f3d0 msgr2=0x7f516400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f516400f3d0 0x7f516400f7f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1bb0ef750 msgr2=0x55e1bb0f1bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1bb0ef750 0x55e1bb0f1bf0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f517410c040 msgr2=0x7f51740bb8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f517410c040 0x7f51740bb8a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0f40f0 msgr2=0x55e1bb0f64e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.707+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0f40f0 0x55e1bb0f64e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5044034650 msgr2=0x7f5044036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5044034650 0x7f5044036b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51640207d0 tx=0x7f5164011000 comp rx=0 tx=0).stop 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 msgr2=0x55e1bb0e4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517ccc1640 1 -- 172.21.15.151:0/3171690236 reap_dead start 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0e4770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f51740e54c0 tx=0x7f51740d4100 comp rx=0 tx=0).stop 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 shutdown_connections 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/3171690236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0dd560 0x55e1bb0e4770 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 >> 172.21.15.151:0/3171690236 conn(0x55e1bb0d9990 msgr2=0x55e1bb0d7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 shutdown_connections 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/3171690236 wait complete. 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/2684841243 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5054034650 msgr2=0x7f5054036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/2684841243 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5054034650 0x7f5054036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55e1bb0c3600 tx=0x7f5164006000 comp rx=0 tx=0).stop 2024-09-10T14:28:51.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/2684841243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0d0c90 msgr2=0x55e1bb0d10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/2684841243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0d0c90 0x55e1bb0d10b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51740e5010 tx=0x7f51740b4280 comp rx=0 tx=0).stop 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/2684841243 shutdown_connections 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/2684841243 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5054034650 0x7f5054036b10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/2684841243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1bb0d0c90 0x55e1bb0d10b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/2684841243 >> 172.21.15.151:0/2684841243 conn(0x55e1bb0c5de0 msgr2=0x55e1bb0c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/2684841243 shutdown_connections 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/2684841243 wait complete. 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1bb0c06c0 msgr2=0x55e1bb0c2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e1bb0c06c0 0x55e1bb0c2ab0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1baf357c0 msgr2=0x55e1bb0b9ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e1baf357c0 0x55e1bb0b9ee0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0bc640 msgr2=0x55e1bb0bead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e1bb0bc640 0x55e1bb0bead0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50640346a0 msgr2=0x7f5064036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50640346a0 0x7f5064036b60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5164001e20 tx=0x7f51640013a0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 msgr2=0x55e1bb0b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 --2- 172.21.15.151:0/1830895077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e1baf353b0 0x55e1bb0b2de0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f517401b820 tx=0x7f51740180e0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517ccc1640 1 -- 172.21.15.151:0/1830895077 reap_dead start 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 shutdown_connections 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 >> 172.21.15.151:0/1830895077 conn(0x55e1bafba1b0 msgr2=0x55e1bb0a6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 shutdown_connections 2024-09-10T14:28:51.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.711+0000 7f517e9b0980 1 -- 172.21.15.151:0/1830895077 wait complete. 2024-09-10T14:28:51.723 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T14:28:51.147492Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:51.723 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T14:28:51.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T14:28:51.724 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-10T14:28:51.796 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:51.796 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:51.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.791+0000 7f74f1acc980 1 Processor -- start 2024-09-10T14:28:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.791+0000 7f74f1acc980 1 -- start start 2024-09-10T14:28:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.791+0000 7f74f1acc980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55563d0df270 0x55563d16d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.791+0000 7f74f1acc980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55563cff2ae0 con 0x55563d16d840 2024-09-10T14:28:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.791+0000 7f74f1acc980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55563d016e30 con 0x55563d0df270 2024-09-10T14:28:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ef5dc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55563d0df270 0x55563d16d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ef5dc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55563d0df270 0x55563d16d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41954/0 (socket says 172.21.15.151:41954) 2024-09-10T14:28:51.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ef5dc640 1 -- 172.21.15.151:0/1903164313 learned_addr learned my addr 172.21.15.151:0/1903164313 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74eeddb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55563d16d840 0x55563d16fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34246/0 (socket says 172.21.15.151:34246) 2024-09-10T14:28:51.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ef5dc640 1 -- 172.21.15.151:0/1903164313 >> v1:172.21.15.52:6789/0 conn(0x55563d16d840 legacy=0x55563d16fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ef5dc640 1 -- 172.21.15.151:0/1903164313 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563d172360 con 0x55563d0df270 2024-09-10T14:28:51.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/1903164313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d16d300 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f74e000a5c0 tx=0x7f74e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6205953f3133a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ee5da640 1 -- 172.21.15.151:0/1903164313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00a6070 con 0x55563d0df270 2024-09-10T14:28:51.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ee5da640 1 -- 172.21.15.151:0/1903164313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e00af070 con 0x55563d0df270 2024-09-10T14:28:51.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.795+0000 7f74ee5da640 1 -- 172.21.15.151:0/1903164313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00aa5c0 con 0x55563d0df270 2024-09-10T14:28:51.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.799+0000 7f74f1acc980 1 -- 172.21.15.151:0/1903164313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 msgr2=0x55563d16d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.799+0000 7f74f1acc980 1 --2- 172.21.15.151:0/1903164313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d16d300 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f74e000a5c0 tx=0x7f74e001b340 comp rx=0 tx=0).stop 2024-09-10T14:28:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.799+0000 7f74f1acc980 1 -- 172.21.15.151:0/1903164313 shutdown_connections 2024-09-10T14:28:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.799+0000 7f74f1acc980 1 --2- 172.21.15.151:0/1903164313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d16d300 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.799+0000 7f74f1acc980 1 -- 172.21.15.151:0/1903164313 >> 172.21.15.151:0/1903164313 conn(0x55563d165030 msgr2=0x55563d167450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.799+0000 7f74f1acc980 1 -- 172.21.15.151:0/1903164313 shutdown_connections 2024-09-10T14:28:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.799+0000 7f74f1acc980 1 -- 172.21.15.151:0/1903164313 wait complete. 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 Processor -- start 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- start start 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d255940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55563d018200 con 0x55563d0df270 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d255940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d255940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41970/0 (socket says 172.21.15.151:41970) 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74ef5dc640 1 -- 172.21.15.151:0/671957215 learned_addr learned my addr 172.21.15.151:0/671957215 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74ef5dc640 1 -- 172.21.15.151:0/671957215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563d255f10 con 0x55563d0df270 2024-09-10T14:28:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/671957215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d255940 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f74e00199f0 tx=0x7f74e0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18542295160498ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f73dd60a640 1 -- 172.21.15.151:0/671957215 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00aaa00 con 0x55563d0df270 2024-09-10T14:28:51.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f73dd60a640 1 -- 172.21.15.151:0/671957215 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e00aaba0 con 0x55563d0df270 2024-09-10T14:28:51.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f73dd60a640 1 -- 172.21.15.151:0/671957215 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00bd3f0 con 0x55563d0df270 2024-09-10T14:28:51.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- 172.21.15.151:0/671957215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 msgr2=0x55563d255940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 --2- 172.21.15.151:0/671957215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d255940 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f74e00199f0 tx=0x7f74e0003030 comp rx=0 tx=0).stop 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- 172.21.15.151:0/671957215 shutdown_connections 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 --2- 172.21.15.151:0/671957215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d255940 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- 172.21.15.151:0/671957215 >> 172.21.15.151:0/671957215 conn(0x55563d165030 msgr2=0x55563d251570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- 172.21.15.151:0/671957215 shutdown_connections 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- 172.21.15.151:0/671957215 wait complete. 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 Processor -- start 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- start start 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d25cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.811+0000 7f74f1acc980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55563d171dd0 con 0x55563d0df270 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d25cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d25cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:41986/0 (socket says 172.21.15.151:41986) 2024-09-10T14:28:51.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74ef5dc640 1 -- 172.21.15.151:0/643858346 learned_addr learned my addr 172.21.15.151:0/643858346 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74ef5dc640 1 -- 172.21.15.151:0/643858346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563d25d110 con 0x55563d0df270 2024-09-10T14:28:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d25cbd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f74e00199f0 tx=0x7f74e00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f73dbe07640 1 -- 172.21.15.151:0/643858346 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00bd7c0 con 0x55563d0df270 2024-09-10T14:28:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f73dbe07640 1 -- 172.21.15.151:0/643858346 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e00bd960 con 0x55563d0df270 2024-09-10T14:28:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55563d25d3a0 con 0x55563d0df270 2024-09-10T14:28:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f73dbe07640 1 -- 172.21.15.151:0/643858346 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00bdc40 con 0x55563d0df270 2024-09-10T14:28:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55563d260080 con 0x55563d0df270 2024-09-10T14:28:51.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f73dbe07640 1 -- 172.21.15.151:0/643858346 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74e00ce020 con 0x55563d0df270 2024-09-10T14:28:51.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f73dbe07640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73d40346a0 0x7f73d4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f73dbe07640 1 -- 172.21.15.151:0/643858346 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f74e00cc020 con 0x55563d0df270 2024-09-10T14:28:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74eeddb640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73d40346a0 0x7f73d4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74f1acc980 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d16d840 0x55563d263ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d264210 con 0x55563d16d840 2024-09-10T14:28:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.815+0000 7f74efddd640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d16d840 0x55563d263ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74eeddb640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73d40346a0 0x7f73d4036b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f74e4001e50 tx=0x7f74e40013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74efddd640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d16d840 0x55563d263ba0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74efddd640 1 -- 172.21.15.151:0/643858346 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d16d840 2024-09-10T14:28:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d264ab0 con 0x55563d16d840 2024-09-10T14:28:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74efddd640 1 -- 172.21.15.151:0/643858346 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d16d840 2024-09-10T14:28:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74f1acc980 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2663c0 0x55563d268880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d269010 con 0x55563d2663c0 2024-09-10T14:28:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2663c0 0x55563d268880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2663c0 0x55563d268880 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74ef5dc640 1 -- 172.21.15.151:0/643858346 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f74e00e5050 con 0x55563d2663c0 2024-09-10T14:28:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d265300 con 0x55563d16d840 2024-09-10T14:28:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74efddd640 1 -- 172.21.15.151:0/643858346 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d16d840 2024-09-10T14:28:51.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74f1acc980 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55563d26a470 0x55563d26c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d26cf50 con 0x55563d26a470 2024-09-10T14:28:51.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74eeddb640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55563d26a470 0x55563d26c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74eeddb640 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55563d26a470 0x55563d26c860 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.819+0000 7f74eeddb640 1 -- 172.21.15.151:0/643858346 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74e400f700 con 0x55563d26a470 2024-09-10T14:28:51.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 Processor -- start 2024-09-10T14:28:51.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 -- start start 2024-09-10T14:28:51.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d27aa20 0x55563d27ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55563d071800 con 0x55563d27aa20 2024-09-10T14:28:51.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d27aa20 0x55563d27ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d27aa20 0x55563d27ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42002/0 (socket says 172.21.15.151:42002) 2024-09-10T14:28:51.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3003935933 learned_addr learned my addr 172.21.15.151:0/3003935933 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3003935933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563d27b380 con 0x55563d27aa20 2024-09-10T14:28:51.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/3003935933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d27aa20 0x55563d27ae40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f74e0006fc0 tx=0x7f74e00bcf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f73d9602640 1 -- 172.21.15.151:0/3003935933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00e34e0 con 0x55563d27aa20 2024-09-10T14:28:51.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 -- 172.21.15.151:0/3003935933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55563d27b610 con 0x55563d27aa20 2024-09-10T14:28:51.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 -- 172.21.15.151:0/3003935933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55563d27e290 con 0x55563d27aa20 2024-09-10T14:28:51.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f73d9602640 1 -- 172.21.15.151:0/3003935933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e00e3680 con 0x55563d27aa20 2024-09-10T14:28:51.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f73d9602640 1 -- 172.21.15.151:0/3003935933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00f2060 con 0x55563d27aa20 2024-09-10T14:28:51.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f73d9602640 1 -- 172.21.15.151:0/3003935933 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74e00cfaa0 con 0x55563d27aa20 2024-09-10T14:28:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f73d9602640 1 --2- 172.21.15.151:0/3003935933 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73c8034650 0x7f73c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f73d9602640 1 -- 172.21.15.151:0/3003935933 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f74e00c05d0 con 0x55563d27aa20 2024-09-10T14:28:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74eeddb640 1 --2- 172.21.15.151:0/3003935933 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73c8034650 0x7f73c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 Processor -- start 2024-09-10T14:28:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 -- start start 2024-09-10T14:28:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74eeddb640 1 --2- 172.21.15.151:0/3003935933 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73c8034650 0x7f73c8036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55563d2612e0 tx=0x7f74e400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d2876a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74f1acc980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55563d2561d0 con 0x55563d2872c0 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.823+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d2876a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d2876a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42014/0 (socket says 172.21.15.151:42014) 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3189617646 learned_addr learned my addr 172.21.15.151:0/3189617646 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3189617646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563d287c70 con 0x55563d2872c0 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/3189617646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d2876a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74e00aab70 tx=0x7f74e0006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c5be56f38fee71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f73d2ffd640 1 -- 172.21.15.151:0/3189617646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e0100070 con 0x55563d2872c0 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f73d2ffd640 1 -- 172.21.15.151:0/3189617646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e00c9770 con 0x55563d2872c0 2024-09-10T14:28:51.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f73d2ffd640 1 -- 172.21.15.151:0/3189617646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00e39a0 con 0x55563d2872c0 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- 172.21.15.151:0/3189617646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 msgr2=0x55563d2876a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3189617646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d2876a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74e00aab70 tx=0x7f74e0006660 comp rx=0 tx=0).stop 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- 172.21.15.151:0/3189617646 shutdown_connections 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3189617646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d2876a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- 172.21.15.151:0/3189617646 >> 172.21.15.151:0/3189617646 conn(0x55563d2836a0 msgr2=0x55563d2817a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- 172.21.15.151:0/3189617646 shutdown_connections 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- 172.21.15.151:0/3189617646 wait complete. 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 Processor -- start 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- start start 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d16ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55563d288110 con 0x55563d2872c0 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d16ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d16ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42020/0 (socket says 172.21.15.151:42020) 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 learned_addr learned my addr 172.21.15.151:0/3645805231 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563d169320 con 0x55563d2872c0 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d16ac00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f74e00aab70 tx=0x7f74e00fd000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f73d17fa640 1 -- 172.21.15.151:0/3645805231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e0006390 con 0x55563d2872c0 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55563d169320 con 0x55563d2872c0 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f73d17fa640 1 -- 172.21.15.151:0/3645805231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e00a4ce0 con 0x55563d2872c0 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55563d169320 con 0x55563d2872c0 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.827+0000 7f73d17fa640 1 -- 172.21.15.151:0/3645805231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74e00bc3a0 con 0x55563d2872c0 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f73d17fa640 1 -- 172.21.15.151:0/3645805231 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f74e0112020 con 0x55563d2872c0 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f73d17fa640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73b8034650 0x7f73b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f73d17fa640 1 -- 172.21.15.151:0/3645805231 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f74e010f250 con 0x55563d2872c0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74eeddb640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73b8034650 0x7f73b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d29b7e0 0x55563d29dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d29e3f0 con 0x55563d29b7e0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74efddd640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d29b7e0 0x55563d29dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74efddd640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d29b7e0 0x55563d29dca0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74eeddb640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73b8034650 0x7f73b8036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55563d26d350 tx=0x7f74e4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 realm 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d29e800 con 0x55563d29b7e0 2024-09-10T14:28:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f0a0 con 0x55563d29b7e0 2024-09-10T14:28:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2a01a0 0x55563d2a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a2be0 con 0x55563d2a01a0 2024-09-10T14:28:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2a01a0 0x55563d2a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2a01a0 0x55563d2a2590 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 20 searching for the correct realm 2024-09-10T14:28:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a4440 con 0x55563d2a01a0 2024-09-10T14:28:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74ef5dc640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f74e0009040 0x7f74e00a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a4440 con 0x7f74e0009040 2024-09-10T14:28:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.831+0000 7f74eeddb640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f74e0009040 0x7f74e00a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74eeddb640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f74e0009040 0x7f74e00a4440 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74eeddb640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f74e401fc60 0x7f74e403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a4440 con 0x7f74e401fc60 2024-09-10T14:28:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f74e401fc60 0x7f74e403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f74e401fc60 0x7f74e403a3c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e401fc60 2024-09-10T14:28:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e401fc60 2024-09-10T14:28:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e0009040 2024-09-10T14:28:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.835+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d2a01a0 2024-09-10T14:28:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e401fc60 2024-09-10T14:28:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e0009040 2024-09-10T14:28:51.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d2a01a0 2024-09-10T14:28:51.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d2a01a0 2024-09-10T14:28:51.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e401fc60 2024-09-10T14:28:51.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d2a01a0 2024-09-10T14:28:51.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d2a01a0 2024-09-10T14:28:51.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.839+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e401fc60 2024-09-10T14:28:51.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d2a01a0 2024-09-10T14:28:51.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e0009040 2024-09-10T14:28:51.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e401fc60 2024-09-10T14:28:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d2a01a0 2024-09-10T14:28:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e401fc60 2024-09-10T14:28:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e0009040 2024-09-10T14:28:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d2a01a0 2024-09-10T14:28:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.843+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e401fc60 2024-09-10T14:28:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x55563d29b7e0 2024-09-10T14:28:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55563d29f440 con 0x7f74e0009040 2024-09-10T14:28:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a3560 con 0x55563d29b7e0 2024-09-10T14:28:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a3db0 con 0x55563d29b7e0 2024-09-10T14:28:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a3900 con 0x7f74e401fc60 2024-09-10T14:28:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:51.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 zone default found 2024-09-10T14:28:51.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 4 Realm: () 2024-09-10T14:28:51.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:51.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:51.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 zonegroup default 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a3d30 con 0x7f74e401fc60 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a6250 con 0x55563d2a01a0 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a65f0 con 0x55563d2a01a0 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 started sync module instance, tier type = 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.847+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a56f0 con 0x7f74e0009040 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.851+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.851+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93828881732160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a6990 con 0x7f74e0009040 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.851+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a7240 con 0x55563d29b7e0 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.851+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93828881732160] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.851+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.851+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93828881739056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a7630 con 0x55563d29b7e0 2024-09-10T14:28:51.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.851+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a8030 con 0x55563d2a01a0 2024-09-10T14:28:51.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93828881742656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a88d0 con 0x55563d2a01a0 2024-09-10T14:28:51.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a92d0 con 0x7f74e0009040 2024-09-10T14:28:51.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93828881739056] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93828881734416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a96c0 con 0x7f74e0009040 2024-09-10T14:28:51.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2aa080 con 0x55563d29b7e0 2024-09-10T14:28:51.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93828881742656] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.855+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93828881734416] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.859+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.859+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93828881744928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2aa080 con 0x55563d29b7e0 2024-09-10T14:28:51.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.859+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2aa920 con 0x7f74e401fc60 2024-09-10T14:28:51.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.859+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.859+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93828881752464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2aabc0 con 0x7f74e401fc60 2024-09-10T14:28:51.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.859+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2ab6c0 con 0x7f74e401fc60 2024-09-10T14:28:51.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.859+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93828881744928] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93828881752464] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93828881756592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2aa610 con 0x7f74e401fc60 2024-09-10T14:28:51.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2abca0 con 0x7f74e401fc60 2024-09-10T14:28:51.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93828881756592] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93828881750992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2abca0 con 0x7f74e401fc60 2024-09-10T14:28:51.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 20 add_watcher() i=0 2024-09-10T14:28:51.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 20 add_watcher() i=1 2024-09-10T14:28:51.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 20 add_watcher() i=2 2024-09-10T14:28:51.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 20 add_watcher() i=3 2024-09-10T14:28:51.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 20 add_watcher() i=4 2024-09-10T14:28:51.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 20 add_watcher() i=5 2024-09-10T14:28:51.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.863+0000 7f74f1acc980 20 add_watcher() i=6 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93828881750992] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 20 add_watcher() i=7 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2aef30 con 0x55563d29b7e0 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93828881770704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2abca0 con 0x55563d29b7e0 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93828881770704] v33'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f73a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:51.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 5 note: GC not initialized 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f73a4fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 20 Filter name: none 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f731e7fc640 20 reqs_thread_entry: start 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 20 rados->read ofs=0 len=0 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d2630 con 0x55563d29b7e0 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:51.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.867+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d8d90 con 0x55563d29b7e0 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74f1acc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74f1acc980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74f1acc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93828881942528 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d4500 con 0x55563d29b7e0 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 93828881744928 notify 141733920778 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f74e802d040 con 0x55563d29b7e0 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f73d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 93828881744928 notifier 4414 bl.length()=567 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f73d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:51.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f73d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f73d2ffd640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f73b4003eb0 con 0x55563d29b7e0 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(64 notify.4 [notify cookie 93828881942528 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 93828881942528 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f74e801e040 con 0x55563d29b7e0 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d8800 con 0x7f74e0009040 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 foo:foo2 [delete] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74f1acc980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.871+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93828881942528 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d4050 con 0x7f74e0009040 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== watch-notify(notify (1) cookie 93828881732160 notify 141733920773 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f74e4018040 con 0x7f74e0009040 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(67 notify.0 [notify cookie 93828881942528 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f73d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 93828881732160 notifier 4414 bl.length()=159 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f73d27fc640 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f73240032d0 con 0x7f74e0009040 2024-09-10T14:28:51.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== watch-notify(notify_complete (2) cookie 93828881942528 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55563cff2ae0 con 0x7f74e0009040 2024-09-10T14:28:51.898 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:51.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f73a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:51.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93828881770704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d4500 con 0x55563d29b7e0 2024-09-10T14:28:51.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93828881770704] v33'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93828881732160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d44d0 con 0x7f74e0009040 2024-09-10T14:28:51.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93828881732160] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74f1acc980 20 remove_watcher() i=0 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74f1acc980 2 removed watcher, disabling cache 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.875+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93828881739056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d0460 con 0x55563d29b7e0 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.879+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93828881739056] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.879+0000 7f74f1acc980 20 remove_watcher() i=1 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.879+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93828881742656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d0460 con 0x55563d2a01a0 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.879+0000 7f74ef5dc640 1 -- 172.21.15.151:0/3645805231 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93828881742656] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e00eb070 con 0x55563d2a01a0 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.879+0000 7f74f1acc980 20 remove_watcher() i=2 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.879+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93828881734416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d0460 con 0x7f74e0009040 2024-09-10T14:28:51.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.883+0000 7f74eeddb640 1 -- 172.21.15.151:0/3645805231 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93828881734416] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e4037040 con 0x7f74e0009040 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.883+0000 7f74f1acc980 20 remove_watcher() i=3 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.883+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93828881744928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d0460 con 0x55563d29b7e0 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.883+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93828881744928] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x55563d29b7e0 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.883+0000 7f74f1acc980 20 remove_watcher() i=4 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.883+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93828881752464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2a8420 con 0x7f74e401fc60 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.887+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93828881752464] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.887+0000 7f74f1acc980 20 remove_watcher() i=5 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.887+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93828881756592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2d0460 con 0x7f74e401fc60 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.887+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93828881756592] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.887+0000 7f74f1acc980 20 remove_watcher() i=6 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.887+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93828881750992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55563d2aa190 con 0x7f74e401fc60 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93828881750992] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74e800a4d0 con 0x7f74e401fc60 2024-09-10T14:28:51.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 20 remove_watcher() i=7 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f74e401fc60 msgr2=0x7f74e403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f74e401fc60 0x7f74e403a3c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d29b7e0 msgr2=0x55563d29dca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d29b7e0 0x55563d29dca0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f74e0009040 msgr2=0x7f74e00a4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f74e0009040 0x7f74e00a4440 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2a01a0 msgr2=0x55563d2a2590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2a01a0 0x55563d2a2590 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73b8034650 msgr2=0x7f73b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73b8034650 0x7f73b8036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55563d26d350 tx=0x7f74e4010000 comp rx=0 tx=0).stop 2024-09-10T14:28:51.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74efddd640 1 -- 172.21.15.151:0/3645805231 reap_dead start 2024-09-10T14:28:51.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 msgr2=0x55563d16ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d16ac00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f74e00aab70 tx=0x7f74e00fd000 comp rx=0 tx=0).stop 2024-09-10T14:28:51.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 shutdown_connections 2024-09-10T14:28:51.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3645805231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d2872c0 0x55563d16ac00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 >> 172.21.15.151:0/3645805231 conn(0x55563d2836a0 msgr2=0x55563d281770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 shutdown_connections 2024-09-10T14:28:51.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3645805231 wait complete. 2024-09-10T14:28:51.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3003935933 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73c8034650 msgr2=0x7f73c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3003935933 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73c8034650 0x7f73c8036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55563d2612e0 tx=0x7f74e400f000 comp rx=0 tx=0).stop 2024-09-10T14:28:51.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3003935933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d27aa20 msgr2=0x55563d27ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3003935933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d27aa20 0x55563d27ae40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f74e0006fc0 tx=0x7f74e00bcf00 comp rx=0 tx=0).stop 2024-09-10T14:28:51.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3003935933 shutdown_connections 2024-09-10T14:28:51.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3003935933 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73c8034650 0x7f73c8036b10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/3003935933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d27aa20 0x55563d27ae40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3003935933 >> 172.21.15.151:0/3003935933 conn(0x55563d26fb70 msgr2=0x55563d2725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3003935933 shutdown_connections 2024-09-10T14:28:51.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/3003935933 wait complete. 2024-09-10T14:28:51.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55563d26a470 msgr2=0x55563d26c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55563d26a470 0x55563d26c860 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d16d840 msgr2=0x55563d263ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55563d16d840 0x55563d263ba0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2663c0 msgr2=0x55563d268880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55563d2663c0 0x55563d268880 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73d40346a0 msgr2=0x7f73d4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73d40346a0 0x7f73d4036b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f74e4001e50 tx=0x7f74e40013b0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 msgr2=0x55563d25cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 --2- 172.21.15.151:0/643858346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55563d0df270 0x55563d25cbd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f74e00199f0 tx=0x7f74e00180e0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74efddd640 1 -- 172.21.15.151:0/643858346 reap_dead start 2024-09-10T14:28:51.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 shutdown_connections 2024-09-10T14:28:51.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 >> 172.21.15.151:0/643858346 conn(0x55563d165030 msgr2=0x55563d2500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 shutdown_connections 2024-09-10T14:28:51.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.891+0000 7f74f1acc980 1 -- 172.21.15.151:0/643858346 wait complete. 2024-09-10T14:28:51.912 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:51.912 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T14:28:51.912 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T14:28:51.913 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T14:28:51.977 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:51.978 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:51.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a7989b980 1 Processor -- start 2024-09-10T14:28:51.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a7989b980 1 -- start start 2024-09-10T14:28:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a7989b980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559a54ee7570 0x559a54ee7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a7989b980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559a54d70ae0 con 0x559a54ee7ec0 2024-09-10T14:28:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a7989b980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x559a54d94e30 con 0x559a54ee7570 2024-09-10T14:28:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a773ab640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559a54ee7570 0x559a54ee7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a773ab640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x559a54ee7570 0x559a54ee7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42032/0 (socket says 172.21.15.151:42032) 2024-09-10T14:28:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a773ab640 1 -- 172.21.15.151:0/1209816205 learned_addr learned my addr 172.21.15.151:0/1209816205 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a773ab640 1 -- 172.21.15.151:0/1209816205 >> v1:172.21.15.52:6789/0 conn(0x559a54ee7ec0 legacy=0x559a54eec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.975+0000 7f6a773ab640 1 -- 172.21.15.151:0/1209816205 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a54eef140 con 0x559a54ee7570 2024-09-10T14:28:51.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a773ab640 1 --2- 172.21.15.151:0/1209816205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54ee7950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000a4e0 tx=0x7f6a7001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0976b6307bb75f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a763a9640 1 -- 172.21.15.151:0/1209816205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700aa540 con 0x559a54ee7570 2024-09-10T14:28:51.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a763a9640 1 -- 172.21.15.151:0/1209816205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700aa6e0 con 0x559a54ee7570 2024-09-10T14:28:51.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a763a9640 1 -- 172.21.15.151:0/1209816205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700aaa40 con 0x559a54ee7570 2024-09-10T14:28:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a7989b980 1 -- 172.21.15.151:0/1209816205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 msgr2=0x559a54ee7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1209816205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54ee7950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000a4e0 tx=0x7f6a7001b090 comp rx=0 tx=0).stop 2024-09-10T14:28:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a7989b980 1 -- 172.21.15.151:0/1209816205 shutdown_connections 2024-09-10T14:28:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1209816205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54ee7950 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a7989b980 1 -- 172.21.15.151:0/1209816205 >> 172.21.15.151:0/1209816205 conn(0x559a54ee3090 msgr2=0x559a54ee54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a7989b980 1 -- 172.21.15.151:0/1209816205 shutdown_connections 2024-09-10T14:28:51.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.979+0000 7f6a7989b980 1 -- 172.21.15.151:0/1209816205 wait complete. 2024-09-10T14:28:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 Processor -- start 2024-09-10T14:28:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- start start 2024-09-10T14:28:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fd2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559a54d96200 con 0x559a54ee7570 2024-09-10T14:28:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fd2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fd2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42036/0 (socket says 172.21.15.151:42036) 2024-09-10T14:28:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 -- 172.21.15.151:0/2118819496 learned_addr learned my addr 172.21.15.151:0/2118819496 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:51.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 -- 172.21.15.151:0/2118819496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a54fd2f00 con 0x559a54ee7570 2024-09-10T14:28:51.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 --2- 172.21.15.151:0/2118819496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fd2930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a70017ca0 tx=0x7f6a700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e07e809da06e368 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:51.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f696560a640 1 -- 172.21.15.151:0/2118819496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700b9030 con 0x559a54ee7570 2024-09-10T14:28:51.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f696560a640 1 -- 172.21.15.151:0/2118819496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700aaac0 con 0x559a54ee7570 2024-09-10T14:28:51.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f696560a640 1 -- 172.21.15.151:0/2118819496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700aada0 con 0x559a54ee7570 2024-09-10T14:28:52.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- 172.21.15.151:0/2118819496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 msgr2=0x559a54fd2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 --2- 172.21.15.151:0/2118819496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fd2930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a70017ca0 tx=0x7f6a700033b0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- 172.21.15.151:0/2118819496 shutdown_connections 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 --2- 172.21.15.151:0/2118819496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fd2930 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- 172.21.15.151:0/2118819496 >> 172.21.15.151:0/2118819496 conn(0x559a54ee3090 msgr2=0x559a54fce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- 172.21.15.151:0/2118819496 shutdown_connections 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- 172.21.15.151:0/2118819496 wait complete. 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 Processor -- start 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- start start 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fdac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a7989b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559a54eeeb80 con 0x559a54ee7570 2024-09-10T14:28:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fdac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fdac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42040/0 (socket says 172.21.15.151:42040) 2024-09-10T14:28:52.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 -- 172.21.15.151:0/1848259763 learned_addr learned my addr 172.21.15.151:0/1848259763 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.995+0000 7f6a773ab640 1 -- 172.21.15.151:0/1848259763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a54fdb150 con 0x559a54ee7570 2024-09-10T14:28:52.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a773ab640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fdac10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6a70005cc0 tx=0x7f6a70017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6963e07640 1 -- 172.21.15.151:0/1848259763 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700b9030 con 0x559a54ee7570 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a54fdb3e0 con 0x559a54ee7570 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6963e07640 1 -- 172.21.15.151:0/1848259763 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700c3070 con 0x559a54ee7570 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6963e07640 1 -- 172.21.15.151:0/1848259763 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700bf750 con 0x559a54ee7570 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a54fde070 con 0x559a54ee7570 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6963e07640 1 -- 172.21.15.151:0/1848259763 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a700c5030 con 0x559a54ee7570 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6963e07640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f695c034650 0x7f695c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6963e07640 1 -- 172.21.15.151:0/1848259763 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6a700ba070 con 0x559a54ee7570 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a76baa640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f695c034650 0x7f695c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a54ee7ec0 0x559a54fe1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a54fe21b0 con 0x559a54ee7ec0 2024-09-10T14:28:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a77bac640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a54ee7ec0 0x559a54fe1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a76baa640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f695c034650 0x7f695c036b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a60001e20 tx=0x7f6a600013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a77bac640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a54ee7ec0 0x559a54fe1b90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a77bac640 1 -- 172.21.15.151:0/1848259763 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a54ee7ec0 2024-09-10T14:28:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a54fe2a90 con 0x559a54ee7ec0 2024-09-10T14:28:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a77bac640 1 -- 172.21.15.151:0/1848259763 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a680083f0 con 0x559a54ee7ec0 2024-09-10T14:28:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a54fe43e0 0x559a54fe6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a54fe7000 con 0x559a54fe43e0 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a773ab640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a54fe43e0 0x559a54fe6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:51.999+0000 7f6a773ab640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a54fe43e0 0x559a54fe6870 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a773ab640 1 -- 172.21.15.151:0/1848259763 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a700ce070 con 0x559a54fe43e0 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a54fe32e0 con 0x559a54ee7ec0 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a77bac640 1 -- 172.21.15.151:0/1848259763 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a680083f0 con 0x559a54ee7ec0 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559a54fe8460 0x559a54fea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a54feaf90 con 0x559a54fe8460 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a76baa640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559a54fe8460 0x559a54fea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a76baa640 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559a54fe8460 0x559a54fea850 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a76baa640 1 -- 172.21.15.151:0/1848259763 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a6000d040 con 0x559a54fe8460 2024-09-10T14:28:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a7989b980 1 Processor -- start 2024-09-10T14:28:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a7989b980 1 -- start start 2024-09-10T14:28:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a7989b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54fd78b0 0x559a54fd5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a7989b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559a54def800 con 0x559a54fd78b0 2024-09-10T14:28:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54fd78b0 0x559a54fd5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54fd78b0 0x559a54fd5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42052/0 (socket says 172.21.15.151:42052) 2024-09-10T14:28:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a773ab640 1 -- 172.21.15.151:0/452088495 learned_addr learned my addr 172.21.15.151:0/452088495 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a773ab640 1 -- 172.21.15.151:0/452088495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a54fd7cd0 con 0x559a54fd78b0 2024-09-10T14:28:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.003+0000 7f6a773ab640 1 --2- 172.21.15.151:0/452088495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54fd78b0 0x559a54fd5f30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6a70008030 tx=0x7f6a700bdf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6961602640 1 -- 172.21.15.151:0/452088495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700a9930 con 0x559a54fd78b0 2024-09-10T14:28:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6961602640 1 -- 172.21.15.151:0/452088495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700c63c0 con 0x559a54fd78b0 2024-09-10T14:28:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6961602640 1 -- 172.21.15.151:0/452088495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700c66e0 con 0x559a54fd78b0 2024-09-10T14:28:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a7989b980 1 -- 172.21.15.151:0/452088495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a54fd6470 con 0x559a54fd78b0 2024-09-10T14:28:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a7989b980 1 -- 172.21.15.151:0/452088495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a54fd6940 con 0x559a54fd78b0 2024-09-10T14:28:52.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6961602640 1 -- 172.21.15.151:0/452088495 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a700b3040 con 0x559a54fd78b0 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6961602640 1 --2- 172.21.15.151:0/452088495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6950034650 0x7f6950036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6961602640 1 -- 172.21.15.151:0/452088495 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6a700d7070 con 0x559a54fd78b0 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a76baa640 1 --2- 172.21.15.151:0/452088495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6950034650 0x7f6950036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a7989b980 1 Processor -- start 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a7989b980 1 -- start start 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a7989b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a550078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a76baa640 1 --2- 172.21.15.151:0/452088495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6950034650 0x7f6950036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x559a54fdf3f0 tx=0x7f6a60006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a7989b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559a54fd3190 con 0x559a550074d0 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a550078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a550078d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42064/0 (socket says 172.21.15.151:42064) 2024-09-10T14:28:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a773ab640 1 -- 172.21.15.151:0/2988246552 learned_addr learned my addr 172.21.15.151:0/2988246552 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a773ab640 1 -- 172.21.15.151:0/2988246552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a55007ea0 con 0x559a550074d0 2024-09-10T14:28:52.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f6a773ab640 1 --2- 172.21.15.151:0/2988246552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a550078d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6a700bd010 tx=0x7f6a700c2ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813ca80965877db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f695affd640 1 -- 172.21.15.151:0/2988246552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700c9e00 con 0x559a550074d0 2024-09-10T14:28:52.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f695affd640 1 -- 172.21.15.151:0/2988246552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700dbd30 con 0x559a550074d0 2024-09-10T14:28:52.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.007+0000 7f695affd640 1 -- 172.21.15.151:0/2988246552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700a4160 con 0x559a550074d0 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- 172.21.15.151:0/2988246552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 msgr2=0x559a550078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 --2- 172.21.15.151:0/2988246552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a550078d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6a700bd010 tx=0x7f6a700c2ef0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- 172.21.15.151:0/2988246552 shutdown_connections 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 --2- 172.21.15.151:0/2988246552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a550078d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- 172.21.15.151:0/2988246552 >> 172.21.15.151:0/2988246552 conn(0x559a550038b0 msgr2=0x559a550019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- 172.21.15.151:0/2988246552 shutdown_connections 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- 172.21.15.151:0/2988246552 wait complete. 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 Processor -- start 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- start start 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a5500e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559a55008320 con 0x559a550074d0 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a5500e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a773ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a5500e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42078/0 (socket says 172.21.15.151:42078) 2024-09-10T14:28:52.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 learned_addr learned my addr 172.21.15.151:0/3887081532 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5500ec50 con 0x559a550074d0 2024-09-10T14:28:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a773ab640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a5500e710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6a700a9c10 tx=0x7f6a700f3070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f69597fa640 1 -- 172.21.15.151:0/3887081532 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a7010b070 con 0x559a550074d0 2024-09-10T14:28:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a5500ec50 con 0x559a550074d0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f69597fa640 1 -- 172.21.15.151:0/3887081532 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700e0c80 con 0x559a550074d0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f69597fa640 1 -- 172.21.15.151:0/3887081532 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700b9ae0 con 0x559a550074d0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5500f0c0 con 0x559a550074d0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f69597fa640 1 -- 172.21.15.151:0/3887081532 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a7010e070 con 0x559a550074d0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f69597fa640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6940034650 0x7f6940036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f69597fa640 1 -- 172.21.15.151:0/3887081532 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6a70103050 con 0x559a550074d0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a76baa640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6940034650 0x7f6940036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a55019590 0x559a5501ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a5501c1a0 con 0x559a55019590 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.011+0000 7f6a77bac640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a55019590 0x559a5501ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a76baa640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6940034650 0x7f6940036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x559a54feb370 tx=0x7f6a60011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a77bac640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a55019590 0x559a5501ba50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 realm 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a5501c5b0 con 0x559a55019590 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a5501ce50 con 0x559a55019590 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a5501df50 0x559a55020340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a55020880 con 0x559a5501df50 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a773ab640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a5501df50 0x559a55020340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a773ab640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a5501df50 0x559a55020340 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 20 searching for the correct realm 2024-09-10T14:28:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a55022120 con 0x559a5501df50 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a773ab640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6a70110060 0x7f6a700fc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a55022120 con 0x7f6a70110060 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a76baa640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6a70110060 0x7f6a700fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a76baa640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6a70110060 0x7f6a700fc480 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a76baa640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6a6000f3d0 0x7f6a6000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a55022120 con 0x7f6a6000f3d0 2024-09-10T14:28:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a77bac640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6a6000f3d0 0x7f6a6000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.015+0000 7f6a77bac640 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6a6000f3d0 0x7f6a6000f7f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a70110060 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a5501df50 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a70110060 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.019+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a5501df50 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a5501df50 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a5501df50 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a5501df50 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a5501df50 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a70110060 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.023+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a5501df50 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a70110060 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a5501df50 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x559a55019590 2024-09-10T14:28:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559a5501d1f0 con 0x7f6a70110060 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a550210d0 con 0x559a55019590 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a550214c0 con 0x559a55019590 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.027+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a550214c0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 zone default found 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 4 Realm: () 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 zonegroup default 2024-09-10T14:28:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a550218e0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a55021d00 con 0x559a5501df50 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a55023fd0 con 0x559a5501df50 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 started sync module instance, tier type = 2024-09-10T14:28:52.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:52.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55020cc0 con 0x7f6a70110060 2024-09-10T14:28:52.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94121339532576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a550243d0 con 0x7f6a70110060 2024-09-10T14:28:52.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.031+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55024ee0 con 0x559a55019590 2024-09-10T14:28:52.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.035+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94121339532576] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.035+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.035+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94121339537808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55025300 con 0x559a55019590 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.035+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55025cc0 con 0x559a5501df50 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.035+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.035+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94121339541520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55026560 con 0x559a5501df50 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.035+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55026f60 con 0x7f6a70110060 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.035+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94121339537808] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.039+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.039+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94121339533936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55027800 con 0x7f6a70110060 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.039+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55028050 con 0x559a55019590 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.039+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94121339541520] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.039+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94121339533936] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.039+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.039+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94121339548496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55027c20 con 0x559a55019590 2024-09-10T14:28:52.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.039+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a550288f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.043+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94121339548496] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.043+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.043+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94121339549552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55027b90 con 0x7f6a6000f3d0 2024-09-10T14:28:52.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.043+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55028db0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.043+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94121339549552] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.043+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.043+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94121339552480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55028db0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.043+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55029770 con 0x7f6a6000f3d0 2024-09-10T14:28:52.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94121339552480] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94121339554048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55029950 con 0x7f6a6000f3d0 2024-09-10T14:28:52.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 20 add_watcher() i=0 2024-09-10T14:28:52.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 20 add_watcher() i=1 2024-09-10T14:28:52.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 20 add_watcher() i=2 2024-09-10T14:28:52.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 20 add_watcher() i=3 2024-09-10T14:28:52.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 20 add_watcher() i=4 2024-09-10T14:28:52.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 20 add_watcher() i=5 2024-09-10T14:28:52.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 20 add_watcher() i=6 2024-09-10T14:28:52.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94121339554048] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 20 add_watcher() i=7 2024-09-10T14:28:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a5502cb30 con 0x559a55019590 2024-09-10T14:28:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.047+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94121339569440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a550298f0 con 0x559a55019590 2024-09-10T14:28:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94121339569440] v33'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f692dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 5 note: GC not initialized 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f692cfe1640 20 reqs_thread_entry: start 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 20 Filter name: none 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f68a67fc640 20 reqs_thread_entry: start 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a5504fd40 con 0x559a55019590 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a55050730 con 0x559a55019590 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559a55051740 con 0x7f6a70110060 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f692dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.051+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94121339569440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a5504dc00 con 0x559a55019590 2024-09-10T14:28:52.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.055+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94121339569440] v33'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.055+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94121339532576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a5504dc00 con 0x7f6a70110060 2024-09-10T14:28:52.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.055+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94121339532576] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.055+0000 7f6a7989b980 20 remove_watcher() i=0 2024-09-10T14:28:52.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.055+0000 7f6a7989b980 2 removed watcher, disabling cache 2024-09-10T14:28:52.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.055+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94121339537808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a5504dc00 con 0x559a55019590 2024-09-10T14:28:52.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.055+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94121339537808] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.055+0000 7f6a7989b980 20 remove_watcher() i=1 2024-09-10T14:28:52.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.059+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94121339541520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a5504dc00 con 0x559a5501df50 2024-09-10T14:28:52.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.059+0000 7f6a773ab640 1 -- 172.21.15.151:0/3887081532 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94121339541520] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7010d030 con 0x559a5501df50 2024-09-10T14:28:52.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.059+0000 7f6a7989b980 20 remove_watcher() i=2 2024-09-10T14:28:52.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.059+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94121339533936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55024990 con 0x7f6a70110060 2024-09-10T14:28:52.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.059+0000 7f6a76baa640 1 -- 172.21.15.151:0/3887081532 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94121339533936] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a60036040 con 0x7f6a70110060 2024-09-10T14:28:52.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.059+0000 7f6a7989b980 20 remove_watcher() i=3 2024-09-10T14:28:52.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.059+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94121339548496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55025810 con 0x559a55019590 2024-09-10T14:28:52.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.063+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94121339548496] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x559a55019590 2024-09-10T14:28:52.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.063+0000 7f6a7989b980 20 remove_watcher() i=4 2024-09-10T14:28:52.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.063+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94121339549552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55024990 con 0x7f6a6000f3d0 2024-09-10T14:28:52.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.063+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94121339549552] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.063+0000 7f6a7989b980 20 remove_watcher() i=5 2024-09-10T14:28:52.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.063+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94121339552480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55025810 con 0x7f6a6000f3d0 2024-09-10T14:28:52.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94121339552480] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 20 remove_watcher() i=6 2024-09-10T14:28:52.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94121339554048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559a55024990 con 0x7f6a6000f3d0 2024-09-10T14:28:52.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94121339554048] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a6000f3d0 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 20 remove_watcher() i=7 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6a6000f3d0 msgr2=0x7f6a6000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6a6000f3d0 0x7f6a6000f7f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a55019590 msgr2=0x559a5501ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a55019590 0x559a5501ba50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6a70110060 msgr2=0x7f6a700fc480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6a70110060 0x7f6a700fc480 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a5501df50 msgr2=0x559a55020340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a5501df50 0x559a55020340 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6940034650 msgr2=0x7f6940036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6940034650 0x7f6940036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x559a54feb370 tx=0x7f6a60011000 comp rx=0 tx=0).stop 2024-09-10T14:28:52.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 msgr2=0x559a5500e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a5500e710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6a700a9c10 tx=0x7f6a700f3070 comp rx=0 tx=0).stop 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a77bac640 1 -- 172.21.15.151:0/3887081532 reap_dead start 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 shutdown_connections 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 --2- 172.21.15.151:0/3887081532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a550074d0 0x559a5500e710 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 >> 172.21.15.151:0/3887081532 conn(0x559a550038b0 msgr2=0x559a55001980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 shutdown_connections 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.067+0000 7f6a7989b980 1 -- 172.21.15.151:0/3887081532 wait complete. 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/452088495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6950034650 msgr2=0x7f6950036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/452088495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6950034650 0x7f6950036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x559a54fdf3f0 tx=0x7f6a60006000 comp rx=0 tx=0).stop 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/452088495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54fd78b0 msgr2=0x559a54fd5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/452088495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54fd78b0 0x559a54fd5f30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6a70008030 tx=0x7f6a700bdf60 comp rx=0 tx=0).stop 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/452088495 shutdown_connections 2024-09-10T14:28:52.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/452088495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6950034650 0x7f6950036b10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/452088495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54fd78b0 0x559a54fd5f30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/452088495 >> 172.21.15.151:0/452088495 conn(0x559a54fedb90 msgr2=0x559a54ff0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/452088495 shutdown_connections 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/452088495 wait complete. 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559a54fe8460 msgr2=0x559a54fea850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559a54fe8460 0x559a54fea850 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a54ee7ec0 msgr2=0x559a54fe1b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559a54ee7ec0 0x559a54fe1b90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a54fe43e0 msgr2=0x559a54fe6870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x559a54fe43e0 0x559a54fe6870 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f695c034650 msgr2=0x7f695c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f695c034650 0x7f695c036b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a60001e20 tx=0x7f6a600013a0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 msgr2=0x559a54fdac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 --2- 172.21.15.151:0/1848259763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559a54ee7570 0x559a54fdac10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6a70005cc0 tx=0x7f6a70017e30 comp rx=0 tx=0).stop 2024-09-10T14:28:52.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a77bac640 1 -- 172.21.15.151:0/1848259763 reap_dead start 2024-09-10T14:28:52.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 shutdown_connections 2024-09-10T14:28:52.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 >> 172.21.15.151:0/1848259763 conn(0x559a54ee3090 msgr2=0x559a54fcd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 shutdown_connections 2024-09-10T14:28:52.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.071+0000 7f6a7989b980 1 -- 172.21.15.151:0/1848259763 wait complete. 2024-09-10T14:28:52.083 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-10T14:28:52.083 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T14:28:52.083 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T14:28:52.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T14:28:52.083 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T14:28:52.153 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:52.153 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:52.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bd2a09980 1 Processor -- start 2024-09-10T14:28:52.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bd2a09980 1 -- start start 2024-09-10T14:28:52.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bd2a09980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5599acb3b7c0 0x5599acb3a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bd2a09980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5599aca4cae0 con 0x5599acb3b3b0 2024-09-10T14:28:52.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bd2a09980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5599aca70e30 con 0x5599acb3b7c0 2024-09-10T14:28:52.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bcfd18640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5599acb3b7c0 0x5599acb3a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bd0519640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5599acb3b3b0 0x5599acb39b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34260/0 (socket says 172.21.15.151:34260) 2024-09-10T14:28:52.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bcfd18640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5599acb3b7c0 0x5599acb3a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42094/0 (socket says 172.21.15.151:42094) 2024-09-10T14:28:52.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bd0519640 1 -- 172.21.15.151:0/3902535068 learned_addr learned my addr 172.21.15.151:0/3902535068 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:52.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bcfd18640 1 -- 172.21.15.151:0/3902535068 >> v1:172.21.15.52:6789/0 conn(0x5599acb3b3b0 legacy=0x5599acb39b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.151+0000 7f9bcfd18640 1 -- 172.21.15.151:0/3902535068 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599acb3a8e0 con 0x5599acb3b7c0 2024-09-10T14:28:52.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/3902535068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b7c0 0x5599acb3a280 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400a420 tx=0x7f9bc401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f54bda1cbad30b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bcf517640 1 -- 172.21.15.151:0/3902535068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc40af070 con 0x5599acb3b7c0 2024-09-10T14:28:52.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bcf517640 1 -- 172.21.15.151:0/3902535068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc40aa530 con 0x5599acb3b7c0 2024-09-10T14:28:52.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bcf517640 1 -- 172.21.15.151:0/3902535068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc40aa850 con 0x5599acb3b7c0 2024-09-10T14:28:52.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bd2a09980 1 -- 172.21.15.151:0/3902535068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b7c0 msgr2=0x5599acb3a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/3902535068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b7c0 0x5599acb3a280 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400a420 tx=0x7f9bc401afd0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bd2a09980 1 -- 172.21.15.151:0/3902535068 shutdown_connections 2024-09-10T14:28:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/3902535068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b7c0 0x5599acb3a280 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bd2a09980 1 -- 172.21.15.151:0/3902535068 >> 172.21.15.151:0/3902535068 conn(0x5599acbc01b0 msgr2=0x5599acbc25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bd2a09980 1 -- 172.21.15.151:0/3902535068 shutdown_connections 2024-09-10T14:28:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.155+0000 7f9bd2a09980 1 -- 172.21.15.151:0/3902535068 wait complete. 2024-09-10T14:28:52.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.167+0000 7f9bd2a09980 1 Processor -- start 2024-09-10T14:28:52.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.167+0000 7f9bd2a09980 1 -- start start 2024-09-10T14:28:52.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.167+0000 7f9bd2a09980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.167+0000 7f9bd2a09980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5599aca72200 con 0x5599acb3b3b0 2024-09-10T14:28:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.167+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.167+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42104/0 (socket says 172.21.15.151:42104) 2024-09-10T14:28:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.167+0000 7f9bd0519640 1 -- 172.21.15.151:0/834755519 learned_addr learned my addr 172.21.15.151:0/834755519 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.167+0000 7f9bd0519640 1 -- 172.21.15.151:0/834755519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599accb2370 con 0x5599acb3b3b0 2024-09-10T14:28:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd0519640 1 --2- 172.21.15.151:0/834755519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb1da0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8001e20 tx=0x7f9bc800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2e030dbae0e1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9abe60c640 1 -- 172.21.15.151:0/834755519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc8012020 con 0x5599acb3b3b0 2024-09-10T14:28:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9abe60c640 1 -- 172.21.15.151:0/834755519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc800e7c0 con 0x5599acb3b3b0 2024-09-10T14:28:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9abe60c640 1 -- 172.21.15.151:0/834755519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc800eb00 con 0x5599acb3b3b0 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 -- 172.21.15.151:0/834755519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 msgr2=0x5599accb1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/834755519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb1da0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8001e20 tx=0x7f9bc800b790 comp rx=0 tx=0).stop 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 -- 172.21.15.151:0/834755519 shutdown_connections 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/834755519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb1da0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 -- 172.21.15.151:0/834755519 >> 172.21.15.151:0/834755519 conn(0x5599acbc01b0 msgr2=0x5599accad930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 -- 172.21.15.151:0/834755519 shutdown_connections 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 -- 172.21.15.151:0/834755519 wait complete. 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 Processor -- start 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 -- start start 2024-09-10T14:28:52.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd2a09980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5599acbd0200 con 0x5599acb3b3b0 2024-09-10T14:28:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42110/0 (socket says 172.21.15.151:42110) 2024-09-10T14:28:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd0519640 1 -- 172.21.15.151:0/2908649027 learned_addr learned my addr 172.21.15.151:0/2908649027 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd0519640 1 -- 172.21.15.151:0/2908649027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599accb9610 con 0x5599acb3b3b0 2024-09-10T14:28:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9bd0519640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb90d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8001e20 tx=0x7f9bc8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9abce09640 1 -- 172.21.15.151:0/2908649027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc8012030 con 0x5599acb3b3b0 2024-09-10T14:28:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9abce09640 1 -- 172.21.15.151:0/2908649027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc8001480 con 0x5599acb3b3b0 2024-09-10T14:28:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.171+0000 7f9abce09640 1 -- 172.21.15.151:0/2908649027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc801a910 con 0x5599acb3b3b0 2024-09-10T14:28:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599accb98a0 con 0x5599acb3b3b0 2024-09-10T14:28:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599accbc580 con 0x5599acb3b3b0 2024-09-10T14:28:52.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9abce09640 1 -- 172.21.15.151:0/2908649027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9bc8015020 con 0x5599acb3b3b0 2024-09-10T14:28:52.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9abce09640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ab8034650 0x7f9ab8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9abce09640 1 -- 172.21.15.151:0/2908649027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9bc8020030 con 0x5599acb3b3b0 2024-09-10T14:28:52.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ab8034650 0x7f9ab8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accbe050 0x5599accc0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accc0ad0 con 0x5599accbe050 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd0d1a640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accbe050 0x5599accc0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ab8034650 0x7f9ab8036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40ac000 tx=0x7f9bc40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd0d1a640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accbe050 0x5599accc0460 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/2908649027 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accbe050 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accbd7a0 con 0x5599accbe050 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/2908649027 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accbe050 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accc2e20 0x5599accc5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accc58e0 con 0x5599accc2e20 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd0519640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accc2e20 0x5599accc5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd0519640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accc2e20 0x5599accc5210 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd0519640 1 -- 172.21.15.151:0/2908649027 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9bc8043040 con 0x5599accc2e20 2024-09-10T14:28:52.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accc1cc0 con 0x5599accbe050 2024-09-10T14:28:52.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/2908649027 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accbe050 2024-09-10T14:28:52.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5599accc6d40 0x5599accc9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.175+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accc9830 con 0x5599accc6d40 2024-09-10T14:28:52.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5599accc6d40 0x5599accc9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5599accc6d40 0x5599accc9130 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bcfd18640 1 -- 172.21.15.151:0/2908649027 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9bc40b2040 con 0x5599accc6d40 2024-09-10T14:28:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd2a09980 1 Processor -- start 2024-09-10T14:28:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd2a09980 1 -- start start 2024-09-10T14:28:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd2a09980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599accd72d0 0x5599accd76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd2a09980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5599acacb800 con 0x5599accd72d0 2024-09-10T14:28:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599accd72d0 0x5599accd76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599accd72d0 0x5599accd76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42122/0 (socket says 172.21.15.151:42122) 2024-09-10T14:28:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd0519640 1 -- 172.21.15.151:0/4100335805 learned_addr learned my addr 172.21.15.151:0/4100335805 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd0519640 1 -- 172.21.15.151:0/4100335805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599accd7c30 con 0x5599accd72d0 2024-09-10T14:28:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9bd0519640 1 --2- 172.21.15.151:0/4100335805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599accd72d0 0x5599accd76f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800b2d0 tx=0x7f9bc800db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9ab5ffb640 1 -- 172.21.15.151:0/4100335805 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc8017c50 con 0x5599accd72d0 2024-09-10T14:28:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.179+0000 7f9ab5ffb640 1 -- 172.21.15.151:0/4100335805 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc8017df0 con 0x5599accd72d0 2024-09-10T14:28:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- 172.21.15.151:0/4100335805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599accd7e60 con 0x5599accd72d0 2024-09-10T14:28:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9ab5ffb640 1 -- 172.21.15.151:0/4100335805 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc80166c0 con 0x5599accd72d0 2024-09-10T14:28:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- 172.21.15.151:0/4100335805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599accd7e60 con 0x5599accd72d0 2024-09-10T14:28:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9ab5ffb640 1 -- 172.21.15.151:0/4100335805 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9bc8009070 con 0x5599accd72d0 2024-09-10T14:28:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9ab5ffb640 1 --2- 172.21.15.151:0/4100335805 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa80346a0 0x7f9aa8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9ab5ffb640 1 -- 172.21.15.151:0/4100335805 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9bc803b070 con 0x5599accd72d0 2024-09-10T14:28:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/4100335805 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa80346a0 0x7f9aa8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 Processor -- start 2024-09-10T14:28:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- start start 2024-09-10T14:28:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/4100335805 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa80346a0 0x7f9aa8036b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x5599accc13d0 tx=0x7f9bc4005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599acce3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5599accb26f0 con 0x5599acce3840 2024-09-10T14:28:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599acce3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599acce3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42126/0 (socket says 172.21.15.151:42126) 2024-09-10T14:28:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd0519640 1 -- 172.21.15.151:0/1574529417 learned_addr learned my addr 172.21.15.151:0/1574529417 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd0519640 1 -- 172.21.15.151:0/1574529417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599acce4210 con 0x5599acce3840 2024-09-10T14:28:52.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd0519640 1 --2- 172.21.15.151:0/1574529417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599acce3c40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9bc801a6f0 tx=0x7f9bc804da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f30cf865e54cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9aaf7fe640 1 -- 172.21.15.151:0/1574529417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc805e020 con 0x5599acce3840 2024-09-10T14:28:52.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9aaf7fe640 1 -- 172.21.15.151:0/1574529417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc80485b0 con 0x5599acce3840 2024-09-10T14:28:52.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9aaf7fe640 1 -- 172.21.15.151:0/1574529417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc8024940 con 0x5599acce3840 2024-09-10T14:28:52.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- 172.21.15.151:0/1574529417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 msgr2=0x5599acce3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/1574529417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599acce3c40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9bc801a6f0 tx=0x7f9bc804da90 comp rx=0 tx=0).stop 2024-09-10T14:28:52.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- 172.21.15.151:0/1574529417 shutdown_connections 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/1574529417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599acce3c40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- 172.21.15.151:0/1574529417 >> 172.21.15.151:0/1574529417 conn(0x5599accdfb70 msgr2=0x5599accddc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- 172.21.15.151:0/1574529417 shutdown_connections 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.183+0000 7f9bd2a09980 1 -- 172.21.15.151:0/1574529417 wait complete. 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 1 Processor -- start 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 1 -- start start 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599accea930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5599acce4700 con 0x5599acce3840 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599accea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd0519640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599accea930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42134/0 (socket says 172.21.15.151:42134) 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 learned_addr learned my addr 172.21.15.151:0/270978699 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599acceae70 con 0x5599acce3840 2024-09-10T14:28:52.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd0519640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599accea930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8048760 tx=0x7f9bc8012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9aadffb640 1 -- 172.21.15.151:0/270978699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc8073070 con 0x5599acce3840 2024-09-10T14:28:52.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599acceae70 con 0x5599acce3840 2024-09-10T14:28:52.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9aadffb640 1 -- 172.21.15.151:0/270978699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc80417b0 con 0x5599acce3840 2024-09-10T14:28:52.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599acceae70 con 0x5599acce3840 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9aadffb640 1 -- 172.21.15.151:0/270978699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bc803f620 con 0x5599acce3840 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9aadffb640 1 -- 172.21.15.151:0/270978699 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9bc8061020 con 0x5599acce3840 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9aadffb640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa0034650 0x7f9aa0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9aadffb640 1 -- 172.21.15.151:0/270978699 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9bc806a030 con 0x5599acce3840 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa0034650 0x7f9aa0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accf5980 0x5599accf7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accf8570 con 0x5599accf5980 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd0d1a640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accf5980 0x5599accf7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa0034650 0x7f9aa0036b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40aa500 tx=0x7f9bc40b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.187+0000 7f9bd0d1a640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accf5980 0x5599accf7e20 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 realm 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accf8980 con 0x5599accf5980 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accf9220 con 0x5599accf5980 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accfa320 0x5599accfc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accfcc50 con 0x5599accfa320 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0519640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accfa320 0x5599accfc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0519640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accfa320 0x5599accfc710 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 20 searching for the correct realm 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accfe4f0 con 0x5599accfa320 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0519640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9bc8063040 0x7f9bc8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accfe4f0 con 0x7f9bc8063040 2024-09-10T14:28:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9bc8063040 0x7f9bc8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9bc8063040 0x7f9bc8069930 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bcfd18640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9bc40db040 0x7f9bc40cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accfe4f0 con 0x7f9bc40db040 2024-09-10T14:28:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0d1a640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9bc40db040 0x7f9bc40cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.191+0000 7f9bd0d1a640 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9bc40db040 0x7f9bc40cd430 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc40db040 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc40db040 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc8063040 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accfa320 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc40db040 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc8063040 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.195+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accfa320 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accfa320 2024-09-10T14:28:52.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc40db040 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accfa320 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accfa320 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc40db040 2024-09-10T14:28:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accfa320 2024-09-10T14:28:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc8063040 2024-09-10T14:28:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.199+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc40db040 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accfa320 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc40db040 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc8063040 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accfa320 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc40db040 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x5599accf5980 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5599accf95c0 con 0x7f9bc8063040 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accfd4a0 con 0x5599accf5980 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accfd890 con 0x5599accf5980 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accfd890 con 0x7f9bc40db040 2024-09-10T14:28:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 zone default found 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 4 Realm: () 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 zonegroup default 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.203+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accfdcb0 con 0x7f9bc40db040 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599accfdcb0 con 0x5599accfa320 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599acd003a0 con 0x5599accfa320 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 20 started sync module instance, tier type = 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599accff840 con 0x7f9bc8063040 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94118517668912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd00bf0 con 0x7f9bc8063040 2024-09-10T14:28:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd01440 con 0x5599accf5980 2024-09-10T14:28:52.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.207+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94118517668912] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.211+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.211+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94118517671744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd01440 con 0x5599accf5980 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.211+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd01f20 con 0x5599accfa320 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.211+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94118517671744] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.211+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.211+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94118517673872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd013b0 con 0x5599accfa320 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.211+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd02cd0 con 0x7f9bc8063040 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94118517680064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd03570 con 0x7f9bc8063040 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd03f70 con 0x5599accf5980 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94118517673872] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94118517680064] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94118517682368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd03a80 con 0x5599accf5980 2024-09-10T14:28:52.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd04810 con 0x7f9bc40db040 2024-09-10T14:28:52.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.215+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94118517682368] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.219+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.219+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94118517678864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd04770 con 0x7f9bc40db040 2024-09-10T14:28:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.219+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd05130 con 0x7f9bc40db040 2024-09-10T14:28:52.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.219+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94118517678864] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.219+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.219+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94118517687248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd05130 con 0x7f9bc40db040 2024-09-10T14:28:52.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.219+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd05af0 con 0x7f9bc40db040 2024-09-10T14:28:52.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94118517687248] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94118517689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd05af0 con 0x7f9bc40db040 2024-09-10T14:28:52.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 20 add_watcher() i=0 2024-09-10T14:28:52.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 20 add_watcher() i=1 2024-09-10T14:28:52.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 20 add_watcher() i=2 2024-09-10T14:28:52.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 20 add_watcher() i=3 2024-09-10T14:28:52.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 20 add_watcher() i=4 2024-09-10T14:28:52.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 20 add_watcher() i=5 2024-09-10T14:28:52.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 20 add_watcher() i=6 2024-09-10T14:28:52.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94118517689952] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 20 add_watcher() i=7 2024-09-10T14:28:52.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:52.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.223+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599acd08e50 con 0x5599accf5980 2024-09-10T14:28:52.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94118517704784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd05c60 con 0x5599accf5980 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94118517704784] v33'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9a867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 5 note: GC not initialized 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9a857e2640 20 reqs_thread_entry: start 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 20 Filter name: none 2024-09-10T14:28:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f99f6ffd640 20 reqs_thread_entry: start 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599acd2c060 con 0x5599accf5980 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599acd2ca50 con 0x5599accf5980 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5599acd2da60 con 0x7f9bc8063040 2024-09-10T14:28:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9a867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:52.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.227+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94118517704784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x5599accf5980 2024-09-10T14:28:52.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94118517704784] v33'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94118517668912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x7f9bc8063040 2024-09-10T14:28:52.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94118517668912] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bd2a09980 20 remove_watcher() i=0 2024-09-10T14:28:52.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bd2a09980 2 removed watcher, disabling cache 2024-09-10T14:28:52.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94118517671744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x5599accf5980 2024-09-10T14:28:52.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94118517671744] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bd2a09980 20 remove_watcher() i=1 2024-09-10T14:28:52.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.231+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94118517673872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x5599accfa320 2024-09-10T14:28:52.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.235+0000 7f9bd0519640 1 -- 172.21.15.151:0/270978699 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94118517673872] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc804b070 con 0x5599accfa320 2024-09-10T14:28:52.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.235+0000 7f9bd2a09980 20 remove_watcher() i=2 2024-09-10T14:28:52.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.235+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94118517680064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x7f9bc8063040 2024-09-10T14:28:52.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.235+0000 7f9bcfd18640 1 -- 172.21.15.151:0/270978699 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94118517680064] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc40c8030 con 0x7f9bc8063040 2024-09-10T14:28:52.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.235+0000 7f9bd2a09980 20 remove_watcher() i=3 2024-09-10T14:28:52.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.235+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94118517682368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x5599accf5980 2024-09-10T14:28:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.239+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94118517682368] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x5599accf5980 2024-09-10T14:28:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.239+0000 7f9bd2a09980 20 remove_watcher() i=4 2024-09-10T14:28:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.239+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94118517678864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x7f9bc40db040 2024-09-10T14:28:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.239+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94118517678864] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.239+0000 7f9bd2a09980 20 remove_watcher() i=5 2024-09-10T14:28:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.239+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94118517687248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x7f9bc40db040 2024-09-10T14:28:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94118517687248] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 20 remove_watcher() i=6 2024-09-10T14:28:52.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94118517689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5599acd29f20 con 0x7f9bc40db040 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94118517689952] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc00083f0 con 0x7f9bc40db040 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 20 remove_watcher() i=7 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9bc40db040 msgr2=0x7f9bc40cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9bc40db040 0x7f9bc40cd430 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accf5980 msgr2=0x5599accf7e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accf5980 0x5599accf7e20 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9bc8063040 msgr2=0x7f9bc8069930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9bc8063040 0x7f9bc8069930 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accfa320 msgr2=0x5599accfc710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accfa320 0x5599accfc710 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa0034650 msgr2=0x7f9aa0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa0034650 0x7f9aa0036b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40aa500 tx=0x7f9bc40b8040 comp rx=0 tx=0).stop 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/270978699 reap_dead start 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 msgr2=0x5599accea930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599accea930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8048760 tx=0x7f9bc8012f60 comp rx=0 tx=0).stop 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 shutdown_connections 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/270978699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acce3840 0x5599accea930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 >> 172.21.15.151:0/270978699 conn(0x5599accdfb70 msgr2=0x5599accddc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 shutdown_connections 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/270978699 wait complete. 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/4100335805 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa80346a0 msgr2=0x7f9aa8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/4100335805 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa80346a0 0x7f9aa8036b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x5599accc13d0 tx=0x7f9bc4005d90 comp rx=0 tx=0).stop 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/4100335805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599accd72d0 msgr2=0x5599accd76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/4100335805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599accd72d0 0x5599accd76f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800b2d0 tx=0x7f9bc800db30 comp rx=0 tx=0).stop 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/4100335805 shutdown_connections 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/4100335805 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9aa80346a0 0x7f9aa8036b60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/4100335805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599accd72d0 0x5599accd76f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/4100335805 >> 172.21.15.151:0/4100335805 conn(0x5599acccc450 msgr2=0x5599accceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/4100335805 shutdown_connections 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/4100335805 wait complete. 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5599accc6d40 msgr2=0x5599accc9130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5599accc6d40 0x5599accc9130 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accbe050 msgr2=0x5599accc0460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599accbe050 0x5599accc0460 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accc2e20 msgr2=0x5599accc5210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599accc2e20 0x5599accc5210 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ab8034650 msgr2=0x7f9ab8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ab8034650 0x7f9ab8036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40ac000 tx=0x7f9bc40a5000 comp rx=0 tx=0).stop 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 msgr2=0x5599accb90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 --2- 172.21.15.151:0/2908649027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599acb3b3b0 0x5599accb90d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8001e20 tx=0x7f9bc8000ee0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd0d1a640 1 -- 172.21.15.151:0/2908649027 reap_dead start 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 shutdown_connections 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 >> 172.21.15.151:0/2908649027 conn(0x5599acbc01b0 msgr2=0x5599accac4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 shutdown_connections 2024-09-10T14:28:52.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.243+0000 7f9bd2a09980 1 -- 172.21.15.151:0/2908649027 wait complete. 2024-09-10T14:28:52.258 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-10T14:28:52.258 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T14:28:52.362 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:52.362 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T14:28:52.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T14:28:52.362 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T14:28:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:52.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bd691980 1 Processor -- start 2024-09-10T14:28:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bd691980 1 -- start start 2024-09-10T14:28:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bd691980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557a6cd858e0 0x557a6cd85cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bd691980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557a6cc0bae0 con 0x557a6cd86230 2024-09-10T14:28:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bd691980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x557a6cc2fe30 con 0x557a6cd858e0 2024-09-10T14:28:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bb1a1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557a6cd858e0 0x557a6cd85cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5ba9a0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x557a6cd86230 0x557a6cd8ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34264/0 (socket says 172.21.15.151:34264) 2024-09-10T14:28:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bb1a1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557a6cd858e0 0x557a6cd85cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42144/0 (socket says 172.21.15.151:42144) 2024-09-10T14:28:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1341830459 learned_addr learned my addr 172.21.15.151:0/1341830459 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1341830459 >> v1:172.21.15.52:6789/0 conn(0x557a6cd86230 legacy=0x557a6cd8ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.395+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1341830459 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6cd8d4b0 con 0x557a6cd858e0 2024-09-10T14:28:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/1341830459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd858e0 0x557a6cd85cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00a480 tx=0x7fa5ac01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab1c061ccd63cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5ba19f640 1 -- 172.21.15.151:0/1341830459 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0b0070 con 0x557a6cd858e0 2024-09-10T14:28:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5ba19f640 1 -- 172.21.15.151:0/1341830459 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0ab540 con 0x557a6cd858e0 2024-09-10T14:28:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5ba19f640 1 -- 172.21.15.151:0/1341830459 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0ab840 con 0x557a6cd858e0 2024-09-10T14:28:52.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5bd691980 1 -- 172.21.15.151:0/1341830459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd858e0 msgr2=0x557a6cd85cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1341830459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd858e0 0x557a6cd85cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00a480 tx=0x7fa5ac01b280 comp rx=0 tx=0).stop 2024-09-10T14:28:52.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5bd691980 1 -- 172.21.15.151:0/1341830459 shutdown_connections 2024-09-10T14:28:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1341830459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd858e0 0x557a6cd85cc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5bd691980 1 -- 172.21.15.151:0/1341830459 >> 172.21.15.151:0/1341830459 conn(0x557a6ccf9230 msgr2=0x557a6ccf9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5bd691980 1 -- 172.21.15.151:0/1341830459 shutdown_connections 2024-09-10T14:28:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.399+0000 7fa5bd691980 1 -- 172.21.15.151:0/1341830459 wait complete. 2024-09-10T14:28:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.411+0000 7fa5bd691980 1 Processor -- start 2024-09-10T14:28:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.411+0000 7fa5bd691980 1 -- start start 2024-09-10T14:28:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.411+0000 7fa5bd691980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce70d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.411+0000 7fa5bd691980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557a6cc31200 con 0x557a6cd86230 2024-09-10T14:28:52.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.411+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce70d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.411+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce70d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42148/0 (socket says 172.21.15.151:42148) 2024-09-10T14:28:52.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.411+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/3753266919 learned_addr learned my addr 172.21.15.151:0/3753266919 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/3753266919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6ce71330 con 0x557a6cd86230 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/3753266919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce70d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00a480 tx=0x7fa5ac003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccd2cf69152262 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa4a960a640 1 -- 172.21.15.151:0/3753266919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0b0070 con 0x557a6cd86230 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa4a960a640 1 -- 172.21.15.151:0/3753266919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0bc070 con 0x557a6cd86230 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa4a960a640 1 -- 172.21.15.151:0/3753266919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0abac0 con 0x557a6cd86230 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- 172.21.15.151:0/3753266919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 msgr2=0x557a6ce70d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 --2- 172.21.15.151:0/3753266919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce70d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00a480 tx=0x7fa5ac003030 comp rx=0 tx=0).stop 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- 172.21.15.151:0/3753266919 shutdown_connections 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 --2- 172.21.15.151:0/3753266919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce70d60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- 172.21.15.151:0/3753266919 >> 172.21.15.151:0/3753266919 conn(0x557a6ccf9230 msgr2=0x557a6ce6c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- 172.21.15.151:0/3753266919 shutdown_connections 2024-09-10T14:28:52.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- 172.21.15.151:0/3753266919 wait complete. 2024-09-10T14:28:52.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 Processor -- start 2024-09-10T14:28:52.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- start start 2024-09-10T14:28:52.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce77f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557a6cd8cef0 con 0x557a6cd86230 2024-09-10T14:28:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce77f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce77f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42154/0 (socket says 172.21.15.151:42154) 2024-09-10T14:28:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/2798807137 learned_addr learned my addr 172.21.15.151:0/2798807137 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/2798807137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6ce784d0 con 0x557a6cd86230 2024-09-10T14:28:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce77f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac018eb0 tx=0x7fa5ac018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa4a7e07640 1 -- 172.21.15.151:0/2798807137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0b7910 con 0x557a6cd86230 2024-09-10T14:28:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a6ce78760 con 0x557a6cd86230 2024-09-10T14:28:52.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa4a7e07640 1 -- 172.21.15.151:0/2798807137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0b1040 con 0x557a6cd86230 2024-09-10T14:28:52.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa4a7e07640 1 -- 172.21.15.151:0/2798807137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0b7be0 con 0x557a6cd86230 2024-09-10T14:28:52.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.415+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a6ce7b440 con 0x557a6cd86230 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa4a7e07640 1 -- 172.21.15.151:0/2798807137 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5ac0cc480 con 0x557a6cd86230 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa4a7e07640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4a0034650 0x7fa4a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa4a7e07640 1 -- 172.21.15.151:0/2798807137 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa5ac0a8070 con 0x557a6cd86230 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4a0034650 0x7fa4a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ce7cf10 0x557a6ce7f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ce7f920 con 0x557a6ce7cf10 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bb9a2640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ce7cf10 0x557a6ce7f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4a0034650 0x7fa4a0036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0001da0 tx=0x7fa5b0001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bb9a2640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ce7cf10 0x557a6ce7f300 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/2798807137 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ce7cf10 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ce801f0 con 0x557a6ce7cf10 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/2798807137 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ce7cf10 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ce81b00 0x557a6ce83fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ce84730 con 0x557a6ce81b00 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ce81b00 0x557a6ce83fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ce81b00 0x557a6ce83fa0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/2798807137 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa5ac0c1400 con 0x557a6ce81b00 2024-09-10T14:28:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ce80a40 con 0x557a6ce7cf10 2024-09-10T14:28:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/2798807137 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ce7cf10 2024-09-10T14:28:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557a6ce85b90 0x557a6ce87f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ce886f0 con 0x557a6ce85b90 2024-09-10T14:28:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.419+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557a6ce85b90 0x557a6ce87f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557a6ce85b90 0x557a6ce87f80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/2798807137 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa5b000e6c0 con 0x557a6ce85b90 2024-09-10T14:28:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bd691980 1 Processor -- start 2024-09-10T14:28:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bd691980 1 -- start start 2024-09-10T14:28:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bd691980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6ce961a0 0x557a6ce965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bd691980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557a6cc8a800 con 0x557a6ce961a0 2024-09-10T14:28:52.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6ce961a0 0x557a6ce965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6ce961a0 0x557a6ce965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42170/0 (socket says 172.21.15.151:42170) 2024-09-10T14:28:52.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/2679689233 learned_addr learned my addr 172.21.15.151:0/2679689233 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/2679689233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6ce96b00 con 0x557a6ce961a0 2024-09-10T14:28:52.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/2679689233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6ce961a0 0x557a6ce965c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0cdff0 tx=0x7fa5ac0aa6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa4a5602640 1 -- 172.21.15.151:0/2679689233 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0eb070 con 0x557a6ce961a0 2024-09-10T14:28:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bd691980 1 -- 172.21.15.151:0/2679689233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a6ce96d90 con 0x557a6ce961a0 2024-09-10T14:28:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa4a5602640 1 -- 172.21.15.151:0/2679689233 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0e3200 con 0x557a6ce961a0 2024-09-10T14:28:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa4a5602640 1 -- 172.21.15.151:0/2679689233 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0e34e0 con 0x557a6ce961a0 2024-09-10T14:28:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.423+0000 7fa5bd691980 1 -- 172.21.15.151:0/2679689233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a6ce99a10 con 0x557a6ce961a0 2024-09-10T14:28:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa4a5602640 1 -- 172.21.15.151:0/2679689233 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5ac0ee070 con 0x557a6ce961a0 2024-09-10T14:28:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa4a5602640 1 --2- 172.21.15.151:0/2679689233 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa494034650 0x7fa494036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa4a5602640 1 -- 172.21.15.151:0/2679689233 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa5ac0f1ca0 con 0x557a6ce961a0 2024-09-10T14:28:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/2679689233 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa494034650 0x7fa494036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 Processor -- start 2024-09-10T14:28:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- start start 2024-09-10T14:28:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/2679689233 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa494034650 0x7fa494036b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x557a6ce84ad0 tx=0x7fa5b000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557a6ce715f0 con 0x557a6cea2940 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42172/0 (socket says 172.21.15.151:42172) 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1610386245 learned_addr learned my addr 172.21.15.151:0/1610386245 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1610386245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6cea3310 con 0x557a6cea2940 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/1610386245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea2d40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac002f50 tx=0x7fa5ac0c2e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc5da0b8dc8b1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa49effd640 1 -- 172.21.15.151:0/1610386245 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac103070 con 0x557a6cea2940 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa49effd640 1 -- 172.21.15.151:0/1610386245 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0aa740 con 0x557a6cea2940 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa49effd640 1 -- 172.21.15.151:0/1610386245 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac0aaad0 con 0x557a6cea2940 2024-09-10T14:28:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- 172.21.15.151:0/1610386245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 msgr2=0x557a6cea2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1610386245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea2d40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac002f50 tx=0x7fa5ac0c2e80 comp rx=0 tx=0).stop 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- 172.21.15.151:0/1610386245 shutdown_connections 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1610386245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea2d40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- 172.21.15.151:0/1610386245 >> 172.21.15.151:0/1610386245 conn(0x557a6ce9ecd0 msgr2=0x557a6ce9cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- 172.21.15.151:0/1610386245 shutdown_connections 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- 172.21.15.151:0/1610386245 wait complete. 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 Processor -- start 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- start start 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bd691980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557a6cea3860 con 0x557a6cea2940 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bb1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:42188/0 (socket says 172.21.15.151:42188) 2024-09-10T14:28:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.427+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 learned_addr learned my addr 172.21.15.151:0/1623646665 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6ceaa080 con 0x557a6cea2940 2024-09-10T14:28:52.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea9b40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0c16e0 tx=0x7fa5ac0bef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa49d7fa640 1 -- 172.21.15.151:0/1623646665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac10d020 con 0x557a6cea2940 2024-09-10T14:28:52.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa49d7fa640 1 -- 172.21.15.151:0/1623646665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0aa8f0 con 0x557a6cea2940 2024-09-10T14:28:52.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa49d7fa640 1 -- 172.21.15.151:0/1623646665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5ac103040 con 0x557a6cea2940 2024-09-10T14:28:52.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557a6ceaa080 con 0x557a6cea2940 2024-09-10T14:28:52.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a6ceaa080 con 0x557a6cea2940 2024-09-10T14:28:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa49d7fa640 1 -- 172.21.15.151:0/1623646665 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5ac110020 con 0x557a6cea2940 2024-09-10T14:28:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa49d7fa640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4840346a0 0x7fa484036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa49d7fa640 1 -- 172.21.15.151:0/1623646665 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa5ac113c60 con 0x557a6cea2940 2024-09-10T14:28:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4840346a0 0x7fa484036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ceb4bd0 0x557a6ceb7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb77e0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bb9a2640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ceb4bd0 0x557a6ceb7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4840346a0 0x7fa484036b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x557a6ce88ad0 tx=0x7fa5b0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.431+0000 7fa5bb9a2640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ceb4bd0 0x557a6ceb7090 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 realm 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb7bf0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:52.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8490 con 0x557a6ceb4bd0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ceb9590 0x557a6cebb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebbf00 con 0x557a6ceb9590 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ceb9590 0x557a6cebb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ceb9590 0x557a6cebb980 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:52.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 20 searching for the correct realm 2024-09-10T14:28:52.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebd760 con 0x557a6ceb9590 2024-09-10T14:28:52.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb1a1640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa5ac112020 0x7fa5ac104910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebd760 con 0x7fa5ac112020 2024-09-10T14:28:52.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa5ac112020 0x7fa5ac104910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa5ac112020 0x7fa5ac104910 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5ba9a0640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa5b0037040 0x7fa5b0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebd760 con 0x7fa5b0037040 2024-09-10T14:28:52.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb9a2640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa5b0037040 0x7fa5b0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.435+0000 7fa5bb9a2640 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa5b0037040 0x7fa5b0036410 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5b0037040 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5b0037040 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5ac112020 2024-09-10T14:28:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb9590 2024-09-10T14:28:52.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5b0037040 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.439+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5ac112020 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb9590 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb9590 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5b0037040 2024-09-10T14:28:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb9590 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb9590 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5b0037040 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb9590 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5ac112020 2024-09-10T14:28:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.443+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5b0037040 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb9590 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5b0037040 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5ac112020 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb9590 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5b0037040 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x557a6ceb4bd0 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceb8830 con 0x7fa5ac112020 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebc880 con 0x557a6ceb4bd0 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebd120 con 0x557a6ceb4bd0 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.447+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebc4c0 con 0x7fa5b0037040 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:52.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 zone default found 2024-09-10T14:28:52.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 4 Realm: () 2024-09-10T14:28:52.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:52.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:52.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:52.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 zonegroup default 2024-09-10T14:28:52.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebcc70 con 0x7fa5b0037040 2024-09-10T14:28:52.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebd0b0 con 0x557a6ceb9590 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebf610 con 0x557a6ceb9590 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 started sync module instance, tier type = 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebeab0 con 0x7fa5ac112020 2024-09-10T14:28:52.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93984301772496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebe710 con 0x7fa5ac112020 2024-09-10T14:28:52.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.451+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec0480 con 0x557a6ceb4bd0 2024-09-10T14:28:52.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.455+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93984301772496] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.455+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.455+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93984301776848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec03f0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.455+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec1250 con 0x557a6ceb9590 2024-09-10T14:28:52.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.455+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.455+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93984301780256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec1af0 con 0x557a6ceb9590 2024-09-10T14:28:52.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.455+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec2510 con 0x7fa5ac112020 2024-09-10T14:28:52.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.455+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93984301776848] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.459+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.459+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93984301779056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec2db0 con 0x7fa5ac112020 2024-09-10T14:28:52.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.459+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec3600 con 0x557a6ceb4bd0 2024-09-10T14:28:52.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.459+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93984301780256] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.459+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93984301779056] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.459+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.459+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93984301782592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec3600 con 0x557a6ceb4bd0 2024-09-10T14:28:52.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.459+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec3ea0 con 0x7fa5b0037040 2024-09-10T14:28:52.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.463+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93984301782592] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.463+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.463+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93984301789792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec3bb0 con 0x7fa5b0037040 2024-09-10T14:28:52.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.463+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec46d0 con 0x7fa5b0037040 2024-09-10T14:28:52.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.463+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.463+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93984301789792] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.463+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93984301793696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec4690 con 0x7fa5b0037040 2024-09-10T14:28:52.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.463+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec50d0 con 0x7fa5b0037040 2024-09-10T14:28:52.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93984301793696] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93984301796256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec5090 con 0x7fa5b0037040 2024-09-10T14:28:52.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 20 add_watcher() i=0 2024-09-10T14:28:52.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 20 add_watcher() i=1 2024-09-10T14:28:52.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 20 add_watcher() i=2 2024-09-10T14:28:52.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 20 add_watcher() i=3 2024-09-10T14:28:52.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 20 add_watcher() i=4 2024-09-10T14:28:52.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 20 add_watcher() i=5 2024-09-10T14:28:52.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 20 add_watcher() i=6 2024-09-10T14:28:52.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93984301796256] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 20 add_watcher() i=7 2024-09-10T14:28:52.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:52.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.467+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec8520 con 0x557a6ceb4bd0 2024-09-10T14:28:52.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93984301790848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec5a70 con 0x557a6ceb4bd0 2024-09-10T14:28:52.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93984301790848] v33'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 5 note: GC not initialized 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa470fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 20 Filter name: none 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa3ea7fc640 20 reqs_thread_entry: start 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceeb690 con 0x557a6ceb4bd0 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:52.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceec080 con 0x557a6ceb4bd0 2024-09-10T14:28:52.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:52.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557a6ceed090 con 0x7fa5ac112020 2024-09-10T14:28:52.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.471+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.475+0000 7fa471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:52.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.475+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93984301790848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cee9550 con 0x557a6ceb4bd0 2024-09-10T14:28:52.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.475+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93984301790848] v33'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.475+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93984301772496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cee9550 con 0x7fa5ac112020 2024-09-10T14:28:52.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.475+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93984301772496] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.475+0000 7fa5bd691980 20 remove_watcher() i=0 2024-09-10T14:28:52.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.475+0000 7fa5bd691980 2 removed watcher, disabling cache 2024-09-10T14:28:52.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.475+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93984301776848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cee9550 con 0x557a6ceb4bd0 2024-09-10T14:28:52.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93984301776848] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5bd691980 20 remove_watcher() i=1 2024-09-10T14:28:52.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93984301780256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cee9550 con 0x557a6ceb9590 2024-09-10T14:28:52.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5bb1a1640 1 -- 172.21.15.151:0/1623646665 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93984301780256] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5ac0fc070 con 0x557a6ceb9590 2024-09-10T14:28:52.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5bd691980 20 remove_watcher() i=2 2024-09-10T14:28:52.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93984301779056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebffd0 con 0x7fa5ac112020 2024-09-10T14:28:52.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5ba9a0640 1 -- 172.21.15.151:0/1623646665 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93984301779056] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b000e6c0 con 0x7fa5ac112020 2024-09-10T14:28:52.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5bd691980 20 remove_watcher() i=3 2024-09-10T14:28:52.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.479+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93984301782592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec0d20 con 0x557a6ceb4bd0 2024-09-10T14:28:52.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.483+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93984301782592] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x557a6ceb4bd0 2024-09-10T14:28:52.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.483+0000 7fa5bd691980 20 remove_watcher() i=4 2024-09-10T14:28:52.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.483+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93984301789792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec0870 con 0x7fa5b0037040 2024-09-10T14:28:52.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.483+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93984301789792] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.483+0000 7fa5bd691980 20 remove_watcher() i=5 2024-09-10T14:28:52.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.483+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93984301793696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cebffd0 con 0x7fa5b0037040 2024-09-10T14:28:52.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.487+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93984301793696] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.487+0000 7fa5bd691980 20 remove_watcher() i=6 2024-09-10T14:28:52.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.487+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93984301796256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557a6cec1640 con 0x7fa5b0037040 2024-09-10T14:28:52.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93984301796256] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b400a4d0 con 0x7fa5b0037040 2024-09-10T14:28:52.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 20 remove_watcher() i=7 2024-09-10T14:28:52.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa5b0037040 msgr2=0x7fa5b0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa5b0037040 0x7fa5b0036410 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ceb4bd0 msgr2=0x557a6ceb7090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ceb4bd0 0x557a6ceb7090 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa5ac112020 msgr2=0x7fa5ac104910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa5ac112020 0x7fa5ac104910 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ceb9590 msgr2=0x557a6cebb980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ceb9590 0x557a6cebb980 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4840346a0 msgr2=0x7fa484036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4840346a0 0x7fa484036b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x557a6ce88ad0 tx=0x7fa5b0010000 comp rx=0 tx=0).stop 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 msgr2=0x557a6cea9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/1623646665 reap_dead start 2024-09-10T14:28:52.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea9b40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0c16e0 tx=0x7fa5ac0bef20 comp rx=0 tx=0).stop 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 shutdown_connections 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/1623646665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cea2940 0x557a6cea9b40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 >> 172.21.15.151:0/1623646665 conn(0x557a6ce9ecd0 msgr2=0x557a6ce9cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 shutdown_connections 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/1623646665 wait complete. 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2679689233 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa494034650 msgr2=0x7fa494036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2679689233 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa494034650 0x7fa494036b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x557a6ce84ad0 tx=0x7fa5b000f000 comp rx=0 tx=0).stop 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2679689233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6ce961a0 msgr2=0x557a6ce965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2679689233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6ce961a0 0x557a6ce965c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0cdff0 tx=0x7fa5ac0aa6a0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2679689233 shutdown_connections 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2679689233 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa494034650 0x7fa494036b10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2679689233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6ce961a0 0x557a6ce965c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2679689233 >> 172.21.15.151:0/2679689233 conn(0x557a6ce8b2f0 msgr2=0x557a6ce8dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2679689233 shutdown_connections 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2679689233 wait complete. 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557a6ce85b90 msgr2=0x557a6ce87f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557a6ce85b90 0x557a6ce87f80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ce7cf10 msgr2=0x557a6ce7f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557a6ce7cf10 0x557a6ce7f300 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ce81b00 msgr2=0x557a6ce83fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557a6ce81b00 0x557a6ce83fa0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4a0034650 msgr2=0x7fa4a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa4a0034650 0x7fa4a0036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0001da0 tx=0x7fa5b0001300 comp rx=0 tx=0).stop 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 msgr2=0x557a6ce77f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 --2- 172.21.15.151:0/2798807137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a6cd86230 0x557a6ce77f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac018eb0 tx=0x7fa5ac018020 comp rx=0 tx=0).stop 2024-09-10T14:28:52.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bb9a2640 1 -- 172.21.15.151:0/2798807137 reap_dead start 2024-09-10T14:28:52.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 shutdown_connections 2024-09-10T14:28:52.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 >> 172.21.15.151:0/2798807137 conn(0x557a6ccf9230 msgr2=0x557a6ce6b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 shutdown_connections 2024-09-10T14:28:52.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.491+0000 7fa5bd691980 1 -- 172.21.15.151:0/2798807137 wait complete. 2024-09-10T14:28:52.504 INFO:teuthology.orchestra.run.smithi151.stdout:["myfoo"] 2024-09-10T14:28:52.504 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T14:28:52.565 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:52.565 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T14:28:52.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T14:28:52.566 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T14:28:52.597 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:52.597 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:52.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24f154d980 1 Processor -- start 2024-09-10T14:28:52.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24f154d980 1 -- start start 2024-09-10T14:28:52.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24f154d980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564df149ab80 0x564df149cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24f154d980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564df131eae0 con 0x564df1494ab0 2024-09-10T14:28:52.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24f154d980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x564df1342e30 con 0x564df149ab80 2024-09-10T14:28:52.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24ee85c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564df149ab80 0x564df149cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24ef05d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564df1494ab0 0x564df1494e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:34280/0 (socket says 172.21.15.151:34280) 2024-09-10T14:28:52.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24ef05d640 1 -- 172.21.15.151:0/3043476497 learned_addr learned my addr 172.21.15.151:0/3043476497 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:52.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24ee85c640 1 -- 172.21.15.151:0/3043476497 >> v1:172.21.15.52:6789/0 conn(0x564df1494ab0 legacy=0x564df1494e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.595+0000 7f24ee85c640 1 -- 172.21.15.151:0/3043476497 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df14955a0 con 0x564df149ab80 2024-09-10T14:28:52.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24ee85c640 1 --2- 172.21.15.151:0/3043476497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df149ab80 0x564df149cf70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24d800a480 tx=0x7f24d801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1956932fa0587785 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24ee05b640 1 -- 172.21.15.151:0/3043476497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d80b0070 con 0x564df149ab80 2024-09-10T14:28:52.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24ee05b640 1 -- 172.21.15.151:0/3043476497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d80ab540 con 0x564df149ab80 2024-09-10T14:28:52.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24ee05b640 1 -- 172.21.15.151:0/3043476497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d80ab840 con 0x564df149ab80 2024-09-10T14:28:52.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24f154d980 1 -- 172.21.15.151:0/3043476497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df149ab80 msgr2=0x564df149cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24f154d980 1 --2- 172.21.15.151:0/3043476497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df149ab80 0x564df149cf70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24d800a480 tx=0x7f24d801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:52.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24f154d980 1 -- 172.21.15.151:0/3043476497 shutdown_connections 2024-09-10T14:28:52.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24f154d980 1 --2- 172.21.15.151:0/3043476497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df149ab80 0x564df149cf70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24f154d980 1 -- 172.21.15.151:0/3043476497 >> 172.21.15.151:0/3043476497 conn(0x564df1490790 msgr2=0x564df1492bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24f154d980 1 -- 172.21.15.151:0/3043476497 shutdown_connections 2024-09-10T14:28:52.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.599+0000 7f24f154d980 1 -- 172.21.15.151:0/3043476497 wait complete. 2024-09-10T14:28:52.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.611+0000 7f24f154d980 1 Processor -- start 2024-09-10T14:28:52.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.611+0000 7f24f154d980 1 -- start start 2024-09-10T14:28:52.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.611+0000 7f24f154d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1581a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.611+0000 7f24f154d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564df1344200 con 0x564df1494ab0 2024-09-10T14:28:52.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.611+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1581a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.611+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1581a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49050/0 (socket says 172.21.15.151:49050) 2024-09-10T14:28:52.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.611+0000 7f24ef05d640 1 -- 172.21.15.151:0/1663475731 learned_addr learned my addr 172.21.15.151:0/1663475731 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24ef05d640 1 -- 172.21.15.151:0/1663475731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df1581fd0 con 0x564df1494ab0 2024-09-10T14:28:52.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24ef05d640 1 --2- 172.21.15.151:0/1663475731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1581a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f24e00015f0 tx=0x7f24e0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e80076eb4d20f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f23dd60a640 1 -- 172.21.15.151:0/1663475731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e0004530 con 0x564df1494ab0 2024-09-10T14:28:52.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f23dd60a640 1 -- 172.21.15.151:0/1663475731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e00046f0 con 0x564df1494ab0 2024-09-10T14:28:52.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f23dd60a640 1 -- 172.21.15.151:0/1663475731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e0004a90 con 0x564df1494ab0 2024-09-10T14:28:52.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- 172.21.15.151:0/1663475731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 msgr2=0x564df1581a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 --2- 172.21.15.151:0/1663475731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1581a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f24e00015f0 tx=0x7f24e0001ab0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- 172.21.15.151:0/1663475731 shutdown_connections 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 --2- 172.21.15.151:0/1663475731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1581a00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- 172.21.15.151:0/1663475731 >> 172.21.15.151:0/1663475731 conn(0x564df1490790 msgr2=0x564df157d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- 172.21.15.151:0/1663475731 shutdown_connections 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- 172.21.15.151:0/1663475731 wait complete. 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 Processor -- start 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- start start 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1588d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564df149ffd0 con 0x564df1494ab0 2024-09-10T14:28:52.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1588d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1588d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49052/0 (socket says 172.21.15.151:49052) 2024-09-10T14:28:52.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24ef05d640 1 -- 172.21.15.151:0/2378121056 learned_addr learned my addr 172.21.15.151:0/2378121056 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24ef05d640 1 -- 172.21.15.151:0/2378121056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df15892b0 con 0x564df1494ab0 2024-09-10T14:28:52.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24ef05d640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1588d70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x564df1582be0 tx=0x7f24e0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f23dbe07640 1 -- 172.21.15.151:0/2378121056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e0013760 con 0x564df1494ab0 2024-09-10T14:28:52.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f23dbe07640 1 -- 172.21.15.151:0/2378121056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e0013900 con 0x564df1494ab0 2024-09-10T14:28:52.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564df1589540 con 0x564df1494ab0 2024-09-10T14:28:52.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f23dbe07640 1 -- 172.21.15.151:0/2378121056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e0013be0 con 0x564df1494ab0 2024-09-10T14:28:52.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.615+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df158c220 con 0x564df1494ab0 2024-09-10T14:28:52.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f23dbe07640 1 -- 172.21.15.151:0/2378121056 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f24e0010070 con 0x564df1494ab0 2024-09-10T14:28:52.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f23dbe07640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23d40346a0 0x7f23d4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f23dbe07640 1 -- 172.21.15.151:0/2378121056 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f24e0018070 con 0x564df1494ab0 2024-09-10T14:28:52.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ee85c640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23d40346a0 0x7f23d4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24f154d980 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df149ab80 0x564df158fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15903b0 con 0x564df149ab80 2024-09-10T14:28:52.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ef85e640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df149ab80 0x564df158fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ee85c640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23d40346a0 0x7f23d4036b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24d800a480 tx=0x7f24d80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ef85e640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df149ab80 0x564df158fd40 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ef85e640 1 -- 172.21.15.151:0/2378121056 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df149ab80 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df158d440 con 0x564df149ab80 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ef85e640 1 -- 172.21.15.151:0/2378121056 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24e80083f0 con 0x564df149ab80 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24f154d980 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df1592700 0x564df1594af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15951c0 con 0x564df1592700 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ef05d640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df1592700 0x564df1594af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ef05d640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df1592700 0x564df1594af0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ef05d640 1 -- 172.21.15.151:0/2378121056 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24e001b030 con 0x564df1592700 2024-09-10T14:28:52.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15915a0 con 0x564df149ab80 2024-09-10T14:28:52.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24ef85e640 1 -- 172.21.15.151:0/2378121056 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24e80083f0 con 0x564df149ab80 2024-09-10T14:28:52.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24f154d980 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564df1596600 0x564df15989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.619+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df1599180 con 0x564df1596600 2024-09-10T14:28:52.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24ee85c640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564df1596600 0x564df15989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24ee85c640 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564df1596600 0x564df15989f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24ee85c640 1 -- 172.21.15.151:0/2378121056 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24d80b3040 con 0x564df1596600 2024-09-10T14:28:52.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24f154d980 1 Processor -- start 2024-09-10T14:28:52.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24f154d980 1 -- start start 2024-09-10T14:28:52.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24f154d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15a6c10 0x564df15a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24f154d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564df139d800 con 0x564df15a6c10 2024-09-10T14:28:52.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15a6c10 0x564df15a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15a6c10 0x564df15a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49068/0 (socket says 172.21.15.151:49068) 2024-09-10T14:28:52.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24ef05d640 1 -- 172.21.15.151:0/1011157050 learned_addr learned my addr 172.21.15.151:0/1011157050 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24ef05d640 1 -- 172.21.15.151:0/1011157050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df15a7570 con 0x564df15a6c10 2024-09-10T14:28:52.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f24ef05d640 1 --2- 172.21.15.151:0/1011157050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15a6c10 0x564df15a7030 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f24e00483b0 tx=0x7f24e0012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f23d9602640 1 -- 172.21.15.151:0/1011157050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e0039030 con 0x564df15a6c10 2024-09-10T14:28:52.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.623+0000 7f23d9602640 1 -- 172.21.15.151:0/1011157050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e00413d0 con 0x564df15a6c10 2024-09-10T14:28:52.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 -- 172.21.15.151:0/1011157050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564df15a7800 con 0x564df15a6c10 2024-09-10T14:28:52.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f23d9602640 1 -- 172.21.15.151:0/1011157050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e0043040 con 0x564df15a6c10 2024-09-10T14:28:52.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 -- 172.21.15.151:0/1011157050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df15aa480 con 0x564df15a6c10 2024-09-10T14:28:52.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f23d9602640 1 -- 172.21.15.151:0/1011157050 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f24e0041a10 con 0x564df15a6c10 2024-09-10T14:28:52.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f23d9602640 1 --2- 172.21.15.151:0/1011157050 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23c8034650 0x7f23c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f23d9602640 1 -- 172.21.15.151:0/1011157050 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f24e003d070 con 0x564df15a6c10 2024-09-10T14:28:52.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24ee85c640 1 --2- 172.21.15.151:0/1011157050 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23c8034650 0x7f23c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 Processor -- start 2024-09-10T14:28:52.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 -- start start 2024-09-10T14:28:52.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24ee85c640 1 --2- 172.21.15.151:0/1011157050 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23c8034650 0x7f23c8036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24d801b2c0 tx=0x7f24d8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564df1582350 con 0x564df15b3550 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49076/0 (socket says 172.21.15.151:49076) 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24ef05d640 1 -- 172.21.15.151:0/3767934919 learned_addr learned my addr 172.21.15.151:0/3767934919 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24ef05d640 1 -- 172.21.15.151:0/3767934919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df15b3f20 con 0x564df15b3550 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24ef05d640 1 --2- 172.21.15.151:0/3767934919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15b3950 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f24e002cfc0 tx=0x7f24e00506f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446a49ae2a6ea312 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f23d2ffd640 1 -- 172.21.15.151:0/3767934919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e0028d10 con 0x564df15b3550 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f23d2ffd640 1 -- 172.21.15.151:0/3767934919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e00287f0 con 0x564df15b3550 2024-09-10T14:28:52.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f23d2ffd640 1 -- 172.21.15.151:0/3767934919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e00333d0 con 0x564df15b3550 2024-09-10T14:28:52.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 -- 172.21.15.151:0/3767934919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 msgr2=0x564df15b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 --2- 172.21.15.151:0/3767934919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15b3950 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f24e002cfc0 tx=0x7f24e00506f0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 -- 172.21.15.151:0/3767934919 shutdown_connections 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.627+0000 7f24f154d980 1 --2- 172.21.15.151:0/3767934919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15b3950 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 -- 172.21.15.151:0/3767934919 >> 172.21.15.151:0/3767934919 conn(0x564df15af930 msgr2=0x564df15ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 -- 172.21.15.151:0/3767934919 shutdown_connections 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 -- 172.21.15.151:0/3767934919 wait complete. 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 Processor -- start 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 -- start start 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15ba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564df15b43a0 con 0x564df15b3550 2024-09-10T14:28:52.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15ba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24ef05d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15ba6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49078/0 (socket says 172.21.15.151:49078) 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 learned_addr learned my addr 172.21.15.151:0/747049823 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df15bac00 con 0x564df15b3550 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24ef05d640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15ba6c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f24e00483e0 tx=0x7f24e0037910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f23d17fa640 1 -- 172.21.15.151:0/747049823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e00333d0 con 0x564df15b3550 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564df15bac00 con 0x564df15b3550 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f23d17fa640 1 -- 172.21.15.151:0/747049823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e0033570 con 0x564df15b3550 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f23d17fa640 1 -- 172.21.15.151:0/747049823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e0034c40 con 0x564df15b3550 2024-09-10T14:28:52.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df15bb070 con 0x564df15b3550 2024-09-10T14:28:52.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f23d17fa640 1 -- 172.21.15.151:0/747049823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f24e0071070 con 0x564df15b3550 2024-09-10T14:28:52.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f23d17fa640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23b8034650 0x7f23b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f23d17fa640 1 -- 172.21.15.151:0/747049823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f24e0075c80 con 0x564df15b3550 2024-09-10T14:28:52.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24ee85c640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23b8034650 0x7f23b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df15c57d0 0x564df15c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15c83e0 con 0x564df15c57d0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24ef85e640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df15c57d0 0x564df15c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.631+0000 7f24ee85c640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23b8034650 0x7f23b8036b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x564df1599580 tx=0x7f24d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef85e640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df15c57d0 0x564df15c7c90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 realm 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15c87f0 con 0x564df15c57d0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:52.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9090 con 0x564df15c57d0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x564df15c57d0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df15ca190 0x564df15cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15ccb00 con 0x564df15ca190 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef05d640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df15ca190 0x564df15cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef05d640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df15ca190 0x564df15cc580 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24e007a020 con 0x564df15ca190 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 20 searching for the correct realm 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15ce3a0 con 0x564df15ca190 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e007a020 con 0x564df15ca190 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef05d640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f24e005a070 0x7f24e0037240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15ce3a0 con 0x7f24e005a070 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ee85c640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f24e005a070 0x7f24e0037240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ee85c640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f24e005a070 0x7f24e0037240 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ee85c640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f24d80cd040 0x7f24d80da920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15ce3a0 con 0x7f24d80cd040 2024-09-10T14:28:52.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef85e640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f24d80cd040 0x7f24d80da920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:52.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.635+0000 7f24ef85e640 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f24d80cd040 0x7f24d80da920 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:52.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x564df15c57d0 2024-09-10T14:28:52.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x564df15c57d0 2024-09-10T14:28:52.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x7f24d80cd040 2024-09-10T14:28:52.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x7f24d80cd040 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x7f24e005a070 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x564df15ca190 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e007a020 con 0x564df15ca190 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x564df15c57d0 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.639+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x7f24d80cd040 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x564df15c57d0 2024-09-10T14:28:52.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15c9430 con 0x7f24e005a070 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15ca190 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f24e007a020 con 0x564df15ca190 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15ca190 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e007a020 con 0x564df15ca190 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x7f24d80cd040 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15ca190 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15ca190 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15c57d0 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15c57d0 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x7f24d80cd040 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15ca190 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x7f24e005a070 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.643+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15c57d0 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x7f24d80cd040 2024-09-10T14:28:52.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15ca190 2024-09-10T14:28:52.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x7f24d80cd040 2024-09-10T14:28:52.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x7f24e005a070 2024-09-10T14:28:52.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15ca190 2024-09-10T14:28:52.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x7f24d80cd040 2024-09-10T14:28:52.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x564df15c57d0 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f24d80e7060 con 0x7f24e005a070 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15cd350 con 0x564df15c57d0 2024-09-10T14:28:52.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15cd740 con 0x564df15c57d0 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.647+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15cd740 con 0x7f24d80cd040 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 zone default found 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 4 Realm: () 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:52.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 zonegroup default 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15cdb60 con 0x7f24d80cd040 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15cdf80 con 0x564df15ca190 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:52.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15d0250 con 0x564df15ca190 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 started sync module instance, tier type = 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15cf6f0 con 0x7f24e005a070 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94892761873120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15cf350 con 0x7f24e005a070 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.651+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d0f90 con 0x564df15c57d0 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.655+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94892761873120] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.655+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.655+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94892761875952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d1380 con 0x564df15c57d0 2024-09-10T14:28:52.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.655+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d1d40 con 0x564df15ca190 2024-09-10T14:28:52.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.655+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94892761875952] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.655+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.655+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94892761877008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d1d40 con 0x564df15ca190 2024-09-10T14:28:52.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.655+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2750 con 0x7f24e005a070 2024-09-10T14:28:52.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.659+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.659+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94892761883296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24e005a070 2024-09-10T14:28:52.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.659+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d39a0 con 0x564df15c57d0 2024-09-10T14:28:52.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.659+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94892761883296] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.659+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94892761877008] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.659+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.659+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94892761880720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d34b0 con 0x564df15c57d0 2024-09-10T14:28:52.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.659+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d4240 con 0x7f24d80cd040 2024-09-10T14:28:52.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.663+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94892761880720] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.663+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.663+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94892761885424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d4170 con 0x7f24d80cd040 2024-09-10T14:28:52.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.663+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d4b20 con 0x7f24d80cd040 2024-09-10T14:28:52.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.663+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94892761885424] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.663+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.663+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94892761892400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d4d00 con 0x7f24d80cd040 2024-09-10T14:28:52.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.663+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d5550 con 0x7f24d80cd040 2024-09-10T14:28:52.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94892761892400] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94892761894144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d55d0 con 0x7f24d80cd040 2024-09-10T14:28:52.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24f154d980 20 add_watcher() i=0 2024-09-10T14:28:52.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24f154d980 20 add_watcher() i=1 2024-09-10T14:28:52.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24f154d980 20 add_watcher() i=2 2024-09-10T14:28:52.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24f154d980 20 add_watcher() i=3 2024-09-10T14:28:52.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24f154d980 20 add_watcher() i=4 2024-09-10T14:28:52.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24f154d980 20 add_watcher() i=5 2024-09-10T14:28:52.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24f154d980 20 add_watcher() i=6 2024-09-10T14:28:52.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.667+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94892761894144] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 20 add_watcher() i=7 2024-09-10T14:28:52.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:52.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564df15d8870 con 0x564df15c57d0 2024-09-10T14:28:52.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94892761895568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d5b60 con 0x564df15c57d0 2024-09-10T14:28:52.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94892761895568] v33'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f23a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:52.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:52.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:52.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 5 note: GC not initialized 2024-09-10T14:28:52.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f23a4fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:52.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:52.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 20 Filter name: none 2024-09-10T14:28:52.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f231e7fc640 20 reqs_thread_entry: start 2024-09-10T14:28:52.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15fb630 con 0x564df15ca190 2024-09-10T14:28:52.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d0250 con 0x564df15ca190 2024-09-10T14:28:52.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d0250 con 0x564df15c57d0 2024-09-10T14:28:52.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15cd350 con 0x564df15c57d0 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v33'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15cd350 con 0x7f24e005a070 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15ca190 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15c57d0 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.671+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15ca190 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24e005a070 2024-09-10T14:28:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15ca190 2024-09-10T14:28:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15c57d0 2024-09-10T14:28:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24d80cd040 2024-09-10T14:28:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24d80cd040 2024-09-10T14:28:52.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15ca190 2024-09-10T14:28:52.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24d80cd040 2024-09-10T14:28:52.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.675+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24d80cd040 2024-09-10T14:28:52.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24d80cd040 2024-09-10T14:28:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15ca190 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24e005a070 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(80 [pgnls start_epoch 33 out=70b] v33'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15c57d0 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15c57d0 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15ca190 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24e005a070 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24d80cd040 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15c57d0 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(86 [pgnls start_epoch 33 out=127b] v33'2 uv2 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.679+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24d80cd040 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15ca190 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24e005a070 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24d80cd040 2024-09-10T14:28:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15c57d0 2024-09-10T14:28:52.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x564df15ca190 2024-09-10T14:28:52.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564df15d2fa0 con 0x7f24e005a070 2024-09-10T14:28:52.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24f154d980 20 RGWRados::pool_iterate: got myfoo 2024-09-10T14:28:52.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24f154d980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:52.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f23a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:52.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.683+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94892761895568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15d0250 con 0x564df15c57d0 2024-09-10T14:28:52.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94892761895568] v33'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94892761873120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15cd350 con 0x7f24e005a070 2024-09-10T14:28:52.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94892761873120] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24f154d980 20 remove_watcher() i=0 2024-09-10T14:28:52.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24f154d980 2 removed watcher, disabling cache 2024-09-10T14:28:52.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94892761875952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15cd350 con 0x564df15c57d0 2024-09-10T14:28:52.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94892761875952] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24f154d980 20 remove_watcher() i=1 2024-09-10T14:28:52.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.687+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94892761877008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15cd350 con 0x564df15ca190 2024-09-10T14:28:52.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.691+0000 7f24ef05d640 1 -- 172.21.15.151:0/747049823 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94892761877008] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e008f040 con 0x564df15ca190 2024-09-10T14:28:52.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.691+0000 7f24f154d980 20 remove_watcher() i=2 2024-09-10T14:28:52.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.691+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94892761883296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15f9970 con 0x7f24e005a070 2024-09-10T14:28:52.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.691+0000 7f24ee85c640 1 -- 172.21.15.151:0/747049823 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94892761883296] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d80d8070 con 0x7f24e005a070 2024-09-10T14:28:52.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.691+0000 7f24f154d980 20 remove_watcher() i=3 2024-09-10T14:28:52.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.691+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94892761880720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15f9970 con 0x564df15c57d0 2024-09-10T14:28:52.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.695+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94892761880720] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x564df15c57d0 2024-09-10T14:28:52.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.695+0000 7f24f154d980 20 remove_watcher() i=4 2024-09-10T14:28:52.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.695+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94892761885424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15f9970 con 0x7f24d80cd040 2024-09-10T14:28:52.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.695+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94892761885424] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.695+0000 7f24f154d980 20 remove_watcher() i=5 2024-09-10T14:28:52.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.695+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94892761892400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15f9970 con 0x7f24d80cd040 2024-09-10T14:28:52.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94892761892400] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 20 remove_watcher() i=6 2024-09-10T14:28:52.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94892761894144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564df15f9970 con 0x7f24d80cd040 2024-09-10T14:28:52.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94892761894144] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e80083f0 con 0x7f24d80cd040 2024-09-10T14:28:52.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 20 remove_watcher() i=7 2024-09-10T14:28:52.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f24d80cd040 msgr2=0x7f24d80da920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f24d80cd040 0x7f24d80da920 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df15c57d0 msgr2=0x564df15c7c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df15c57d0 0x564df15c7c90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f24e005a070 msgr2=0x7f24e0037240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f24e005a070 0x7f24e0037240 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df15ca190 msgr2=0x564df15cc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df15ca190 0x564df15cc580 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23b8034650 msgr2=0x7f23b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23b8034650 0x7f23b8036b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x564df1599580 tx=0x7f24d80a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24ef85e640 1 -- 172.21.15.151:0/747049823 reap_dead start 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 msgr2=0x564df15ba6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15ba6c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f24e00483e0 tx=0x7f24e0037910 comp rx=0 tx=0).stop 2024-09-10T14:28:52.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 shutdown_connections 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/747049823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15b3550 0x564df15ba6c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 >> 172.21.15.151:0/747049823 conn(0x564df15af930 msgr2=0x564df15ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 shutdown_connections 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/747049823 wait complete. 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/1011157050 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23c8034650 msgr2=0x7f23c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/1011157050 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23c8034650 0x7f23c8036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24d801b2c0 tx=0x7f24d8005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/1011157050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15a6c10 msgr2=0x564df15a7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/1011157050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15a6c10 0x564df15a7030 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f24e00483b0 tx=0x7f24e0012ef0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/1011157050 shutdown_connections 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/1011157050 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23c8034650 0x7f23c8036b10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 --2- 172.21.15.151:0/1011157050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df15a6c10 0x564df15a7030 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/1011157050 >> 172.21.15.151:0/1011157050 conn(0x564df159bd60 msgr2=0x564df159e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/1011157050 shutdown_connections 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.699+0000 7f24f154d980 1 -- 172.21.15.151:0/1011157050 wait complete. 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564df1596600 msgr2=0x564df15989f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564df1596600 0x564df15989f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df149ab80 msgr2=0x564df158fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564df149ab80 0x564df158fd40 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df1592700 msgr2=0x564df1594af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564df1592700 0x564df1594af0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23d40346a0 msgr2=0x7f23d4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f23d40346a0 0x7f23d4036b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24d800a480 tx=0x7f24d80a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 msgr2=0x564df1588d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 --2- 172.21.15.151:0/2378121056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564df1494ab0 0x564df1588d70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x564df1582be0 tx=0x7f24e0000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24ef85e640 1 -- 172.21.15.151:0/2378121056 reap_dead start 2024-09-10T14:28:52.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 shutdown_connections 2024-09-10T14:28:52.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 >> 172.21.15.151:0/2378121056 conn(0x564df1490790 msgr2=0x564df157c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:52.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 shutdown_connections 2024-09-10T14:28:52.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:52.703+0000 7f24f154d980 1 -- 172.21.15.151:0/2378121056 wait complete. 2024-09-10T14:28:52.714 INFO:teuthology.orchestra.run.smithi151.stdout:["myfoo"] 2024-09-10T14:28:52.715 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T14:28:52.727 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:52.740 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:52.752 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:52.797 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-10T14:28:52.862 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:52.939 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:52.997 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:52.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T14:28:52.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T14:28:52.998 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T14:28:53.033 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:53.033 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e72693980 1 Processor -- start 2024-09-10T14:28:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e72693980 1 -- start start 2024-09-10T14:28:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e72693980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5623c7304a90 0x5623c7306e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e72693980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5623c7188ae0 con 0x5623c7274ac0 2024-09-10T14:28:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e72693980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5623c71ace30 con 0x5623c7304a90 2024-09-10T14:28:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e6f9a2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5623c7304a90 0x5623c7306e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e6f9a2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5623c7304a90 0x5623c7306e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49082/0 (socket says 172.21.15.151:49082) 2024-09-10T14:28:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e701a3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5623c7274ac0 0x5623c7303370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44606/0 (socket says 172.21.15.151:44606) 2024-09-10T14:28:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/1146344125 learned_addr learned my addr 172.21.15.151:0/1146344125 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/1146344125 >> v1:172.21.15.52:6789/0 conn(0x5623c7274ac0 legacy=0x5623c7303370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.031+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/1146344125 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c73083d0 con 0x5623c7304a90 2024-09-10T14:28:53.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/1146344125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7304a90 0x5623c7306e80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800a4e0 tx=0x7f4e5801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8781de56a052df0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e6f1a1640 1 -- 172.21.15.151:0/1146344125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e580aa540 con 0x5623c7304a90 2024-09-10T14:28:53.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e6f1a1640 1 -- 172.21.15.151:0/1146344125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e580aa6e0 con 0x5623c7304a90 2024-09-10T14:28:53.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e6f1a1640 1 -- 172.21.15.151:0/1146344125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e580aaa40 con 0x5623c7304a90 2024-09-10T14:28:53.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e72693980 1 -- 172.21.15.151:0/1146344125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7304a90 msgr2=0x5623c7306e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e72693980 1 --2- 172.21.15.151:0/1146344125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7304a90 0x5623c7306e80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800a4e0 tx=0x7f4e5801b090 comp rx=0 tx=0).stop 2024-09-10T14:28:53.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e72693980 1 -- 172.21.15.151:0/1146344125 shutdown_connections 2024-09-10T14:28:53.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e72693980 1 --2- 172.21.15.151:0/1146344125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7304a90 0x5623c7306e80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e72693980 1 -- 172.21.15.151:0/1146344125 >> 172.21.15.151:0/1146344125 conn(0x5623c72fb060 msgr2=0x5623c72fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e72693980 1 -- 172.21.15.151:0/1146344125 shutdown_connections 2024-09-10T14:28:53.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.035+0000 7f4e72693980 1 -- 172.21.15.151:0/1146344125 wait complete. 2024-09-10T14:28:53.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e72693980 1 Processor -- start 2024-09-10T14:28:53.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e72693980 1 -- start start 2024-09-10T14:28:53.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e72693980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e72693980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5623c71ae200 con 0x5623c7274ac0 2024-09-10T14:28:53.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73ebae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49094/0 (socket says 172.21.15.151:49094) 2024-09-10T14:28:53.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e701a3640 1 -- 172.21.15.151:0/1251829675 learned_addr learned my addr 172.21.15.151:0/1251829675 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e701a3640 1 -- 172.21.15.151:0/1251829675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c73ec0b0 con 0x5623c7274ac0 2024-09-10T14:28:53.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4e701a3640 1 --2- 172.21.15.151:0/1251829675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73ebae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e60001e50 tx=0x7f4e60001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabd0e579900aeb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.051+0000 7f4d5e60c640 1 -- 172.21.15.151:0/1251829675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6000e5d0 con 0x5623c7274ac0 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4d5e60c640 1 -- 172.21.15.151:0/1251829675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6000e770 con 0x5623c7274ac0 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4d5e60c640 1 -- 172.21.15.151:0/1251829675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6000eab0 con 0x5623c7274ac0 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- 172.21.15.151:0/1251829675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 msgr2=0x5623c73ebae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 --2- 172.21.15.151:0/1251829675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73ebae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e60001e50 tx=0x7f4e60001e80 comp rx=0 tx=0).stop 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- 172.21.15.151:0/1251829675 shutdown_connections 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 --2- 172.21.15.151:0/1251829675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73ebae0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- 172.21.15.151:0/1251829675 >> 172.21.15.151:0/1251829675 conn(0x5623c72fb060 msgr2=0x5623c73e7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- 172.21.15.151:0/1251829675 shutdown_connections 2024-09-10T14:28:53.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- 172.21.15.151:0/1251829675 wait complete. 2024-09-10T14:28:53.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 Processor -- start 2024-09-10T14:28:53.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- start start 2024-09-10T14:28:53.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5623c7307e10 con 0x5623c7274ac0 2024-09-10T14:28:53.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49104/0 (socket says 172.21.15.151:49104) 2024-09-10T14:28:53.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e701a3640 1 -- 172.21.15.151:0/3387867840 learned_addr learned my addr 172.21.15.151:0/3387867840 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e701a3640 1 -- 172.21.15.151:0/3387867840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c73f3390 con 0x5623c7274ac0 2024-09-10T14:28:53.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e701a3640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73f2e50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x5623c73eccc0 tx=0x7f4e60000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4d5ce09640 1 -- 172.21.15.151:0/3387867840 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e60001260 con 0x5623c7274ac0 2024-09-10T14:28:53.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623c73f3620 con 0x5623c7274ac0 2024-09-10T14:28:53.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4d5ce09640 1 -- 172.21.15.151:0/3387867840 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6000fa40 con 0x5623c7274ac0 2024-09-10T14:28:53.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4d5ce09640 1 -- 172.21.15.151:0/3387867840 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6000fd80 con 0x5623c7274ac0 2024-09-10T14:28:53.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.055+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c73f6300 con 0x5623c7274ac0 2024-09-10T14:28:53.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4d5ce09640 1 -- 172.21.15.151:0/3387867840 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e60017070 con 0x5623c7274ac0 2024-09-10T14:28:53.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4d5ce09640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d580346a0 0x7f4d58036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4d5ce09640 1 -- 172.21.15.151:0/3387867840 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4e60015020 con 0x5623c7274ac0 2024-09-10T14:28:53.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d580346a0 0x7f4d58036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e72693980 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c7304a90 0x5623c73f9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c73fa4b0 con 0x5623c7304a90 2024-09-10T14:28:53.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e709a4640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c7304a90 0x5623c73f9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d580346a0 0x7f4d58036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e580ab000 tx=0x7f4e580a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e709a4640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c7304a90 0x5623c73f9e40 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e709a4640 1 -- 172.21.15.151:0/3387867840 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c7304a90 2024-09-10T14:28:53.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c73f7520 con 0x5623c7304a90 2024-09-10T14:28:53.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e709a4640 1 -- 172.21.15.151:0/3387867840 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c7304a90 2024-09-10T14:28:53.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e72693980 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c73fc7e0 0x5623c73febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c73ff2a0 con 0x5623c73fc7e0 2024-09-10T14:28:53.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e701a3640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c73fc7e0 0x5623c73febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e701a3640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c73fc7e0 0x5623c73febd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e701a3640 1 -- 172.21.15.151:0/3387867840 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4e6002e070 con 0x5623c73fc7e0 2024-09-10T14:28:53.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c73fb680 con 0x5623c7304a90 2024-09-10T14:28:53.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e709a4640 1 -- 172.21.15.151:0/3387867840 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c7304a90 2024-09-10T14:28:53.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e72693980 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5623c74006e0 0x5623c7402ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.059+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7403260 con 0x5623c74006e0 2024-09-10T14:28:53.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5623c74006e0 0x5623c7402ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5623c74006e0 0x5623c7402ad0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3387867840 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4e580bc040 con 0x5623c74006e0 2024-09-10T14:28:53.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e72693980 1 Processor -- start 2024-09-10T14:28:53.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e72693980 1 -- start start 2024-09-10T14:28:53.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e72693980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7410d30 0x5623c7411150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e72693980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5623c7207800 con 0x5623c7410d30 2024-09-10T14:28:53.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7410d30 0x5623c7411150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7410d30 0x5623c7411150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49118/0 (socket says 172.21.15.151:49118) 2024-09-10T14:28:53.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e701a3640 1 -- 172.21.15.151:0/3811719041 learned_addr learned my addr 172.21.15.151:0/3811719041 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e701a3640 1 -- 172.21.15.151:0/3811719041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c7411690 con 0x5623c7410d30 2024-09-10T14:28:53.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e701a3640 1 --2- 172.21.15.151:0/3811719041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7410d30 0x5623c7411150 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e60024000 tx=0x7f4e60017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4d55ffb640 1 -- 172.21.15.151:0/3811719041 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6003f020 con 0x5623c7410d30 2024-09-10T14:28:53.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e72693980 1 -- 172.21.15.151:0/3811719041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623c7411920 con 0x5623c7410d30 2024-09-10T14:28:53.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4d55ffb640 1 -- 172.21.15.151:0/3811719041 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60042850 con 0x5623c7410d30 2024-09-10T14:28:53.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4d55ffb640 1 -- 172.21.15.151:0/3811719041 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e60019860 con 0x5623c7410d30 2024-09-10T14:28:53.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.063+0000 7f4e72693980 1 -- 172.21.15.151:0/3811719041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c74145a0 con 0x5623c7410d30 2024-09-10T14:28:53.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4d55ffb640 1 -- 172.21.15.151:0/3811719041 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e6003a070 con 0x5623c7410d30 2024-09-10T14:28:53.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4d55ffb640 1 --2- 172.21.15.151:0/3811719041 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d48034650 0x7f4d48036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4d55ffb640 1 -- 172.21.15.151:0/3811719041 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4e6004fa40 con 0x5623c7410d30 2024-09-10T14:28:53.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3811719041 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d48034650 0x7f4d48036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e72693980 1 Processor -- start 2024-09-10T14:28:53.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e72693980 1 -- start start 2024-09-10T14:28:53.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3811719041 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d48034650 0x7f4d48036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5623c73fa9b0 tx=0x7f4e58005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e72693980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c741d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e72693980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5623c73ec430 con 0x5623c741d500 2024-09-10T14:28:53.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c741d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c741d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49120/0 (socket says 172.21.15.151:49120) 2024-09-10T14:28:53.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e701a3640 1 -- 172.21.15.151:0/1627080147 learned_addr learned my addr 172.21.15.151:0/1627080147 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e701a3640 1 -- 172.21.15.151:0/1627080147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c741ded0 con 0x5623c741d500 2024-09-10T14:28:53.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4e701a3640 1 --2- 172.21.15.151:0/1627080147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c741d900 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e600176e0 tx=0x7f4e60042440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291ce2132a09bff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4d4f7fe640 1 -- 172.21.15.151:0/1627080147 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6003de50 con 0x5623c741d500 2024-09-10T14:28:53.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4d4f7fe640 1 -- 172.21.15.151:0/1627080147 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6001d970 con 0x5623c741d500 2024-09-10T14:28:53.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.067+0000 7f4d4f7fe640 1 -- 172.21.15.151:0/1627080147 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6004fce0 con 0x5623c741d500 2024-09-10T14:28:53.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- 172.21.15.151:0/1627080147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 msgr2=0x5623c741d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 --2- 172.21.15.151:0/1627080147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c741d900 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e600176e0 tx=0x7f4e60042440 comp rx=0 tx=0).stop 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- 172.21.15.151:0/1627080147 shutdown_connections 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 --2- 172.21.15.151:0/1627080147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c741d900 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- 172.21.15.151:0/1627080147 >> 172.21.15.151:0/1627080147 conn(0x5623c7419880 msgr2=0x5623c7417980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- 172.21.15.151:0/1627080147 shutdown_connections 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- 172.21.15.151:0/1627080147 wait complete. 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 Processor -- start 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- start start 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c7424640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5623c741e290 con 0x5623c741d500 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c7424640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e701a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c7424640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49130/0 (socket says 172.21.15.151:49130) 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 learned_addr learned my addr 172.21.15.151:0/3101527017 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c7424b80 con 0x5623c741d500 2024-09-10T14:28:53.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e701a3640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c7424640 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4e600176e0 tx=0x7f4e600482f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4d4dffb640 1 -- 172.21.15.151:0/3101527017 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e600470d0 con 0x5623c741d500 2024-09-10T14:28:53.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4d4dffb640 1 -- 172.21.15.151:0/3101527017 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6003de50 con 0x5623c741d500 2024-09-10T14:28:53.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623c7424b80 con 0x5623c741d500 2024-09-10T14:28:53.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4d4dffb640 1 -- 172.21.15.151:0/3101527017 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6003b6f0 con 0x5623c741d500 2024-09-10T14:28:53.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c7424b80 con 0x5623c741d500 2024-09-10T14:28:53.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4d4dffb640 1 -- 172.21.15.151:0/3101527017 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e60061030 con 0x5623c741d500 2024-09-10T14:28:53.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4d4dffb640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d400346a0 0x7f4d40036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4d4dffb640 1 -- 172.21.15.151:0/3101527017 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4e6005f020 con 0x5623c741d500 2024-09-10T14:28:53.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.071+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d400346a0 0x7f4d40036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c742f720 0x5623c7431be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7432330 con 0x5623c742f720 2024-09-10T14:28:53.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e709a4640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c742f720 0x5623c7431be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d400346a0 0x7f4d40036b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5623c7403660 tx=0x7f4e580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e709a4640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c742f720 0x5623c7431be0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 realm 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7432790 con 0x5623c742f720 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7433030 con 0x5623c742f720 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c7434130 0x5623c7436520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7436aa0 con 0x5623c7434130 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e701a3640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c7434130 0x5623c7436520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e701a3640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c7434130 0x5623c7436520 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 20 searching for the correct realm 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c7438340 con 0x5623c7434130 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e701a3640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4e6005abc0 0x7f4e60019a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c7438340 con 0x7f4e6005abc0 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4e6005abc0 0x7f4e60019a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4e6005abc0 0x7f4e60019a00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.075+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e6f9a2640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4e580cd050 0x7f4e580cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c7438340 con 0x7f4e580cd050 2024-09-10T14:28:53.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4e580cd050 0x7f4e580cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4e580cd050 0x7f4e580cd430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e580cd050 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e580cd050 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.079+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e6005abc0 2024-09-10T14:28:53.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c7434130 2024-09-10T14:28:53.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e580cd050 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e6005abc0 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c7434130 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c7434130 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e580cd050 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c7434130 2024-09-10T14:28:53.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.083+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c7434130 2024-09-10T14:28:53.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e580cd050 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c7434130 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e6005abc0 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e580cd050 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c7434130 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.087+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e580cd050 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e6005abc0 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c7434130 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e580cd050 2024-09-10T14:28:53.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x5623c742f720 2024-09-10T14:28:53.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5623c74333d0 con 0x7f4e6005abc0 2024-09-10T14:28:53.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c74372f0 con 0x5623c742f720 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c74376e0 con 0x5623c742f720 2024-09-10T14:28:53.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c74376e0 con 0x7f4e580cd050 2024-09-10T14:28:53.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:53.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 zone default found 2024-09-10T14:28:53.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 4 Realm: () 2024-09-10T14:28:53.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:53.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:53.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 zonegroup default 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.091+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7437b00 con 0x7f4e580cd050 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7437b00 con 0x5623c7434130 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c743a1f0 con 0x5623c7434130 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 20 started sync module instance, tier type = 2024-09-10T14:28:53.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:53.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c7439690 con 0x7f4e6005abc0 2024-09-10T14:28:53.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94711666940592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743aa40 con 0x7f4e6005abc0 2024-09-10T14:28:53.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.095+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743b290 con 0x5623c742f720 2024-09-10T14:28:53.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.099+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94711666940592] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.099+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.099+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94711666943376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743b290 con 0x5623c742f720 2024-09-10T14:28:53.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.099+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743bd10 con 0x5623c7434130 2024-09-10T14:28:53.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.099+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94711666943376] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.099+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.099+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94711666945504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743b200 con 0x5623c7434130 2024-09-10T14:28:53.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.099+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743ca80 con 0x7f4e6005abc0 2024-09-10T14:28:53.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.103+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.103+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94711666953840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743d740 con 0x7f4e6005abc0 2024-09-10T14:28:53.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.103+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743e100 con 0x5623c742f720 2024-09-10T14:28:53.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.103+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94711666945504] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.103+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94711666953840] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.103+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.103+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94711666950400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743e100 con 0x5623c742f720 2024-09-10T14:28:53.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.103+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743e9a0 con 0x7f4e580cd050 2024-09-10T14:28:53.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.107+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94711666950400] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.107+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.107+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94711666957664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743e6f0 con 0x7f4e580cd050 2024-09-10T14:28:53.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.107+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743f1f0 con 0x7f4e580cd050 2024-09-10T14:28:53.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94711666957664] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94711666961632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743f1b0 con 0x7f4e580cd050 2024-09-10T14:28:53.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743fc30 con 0x7f4e580cd050 2024-09-10T14:28:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94711666964352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c7440050 con 0x7f4e580cd050 2024-09-10T14:28:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 20 add_watcher() i=0 2024-09-10T14:28:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 20 add_watcher() i=1 2024-09-10T14:28:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 20 add_watcher() i=2 2024-09-10T14:28:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 20 add_watcher() i=3 2024-09-10T14:28:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 20 add_watcher() i=4 2024-09-10T14:28:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 20 add_watcher() i=5 2024-09-10T14:28:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94711666961632] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.111+0000 7f4e72693980 20 add_watcher() i=6 2024-09-10T14:28:53.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94711666964352] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 20 add_watcher() i=7 2024-09-10T14:28:53.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:53.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c743e180 con 0x5623c742f720 2024-09-10T14:28:53.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94711666958720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c74405a0 con 0x5623c742f720 2024-09-10T14:28:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94711666958720] v33'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4d267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 5 note: GC not initialized 2024-09-10T14:28:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4d257e2640 20 reqs_thread_entry: start 2024-09-10T14:28:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4e72693980 20 Filter name: none 2024-09-10T14:28:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.115+0000 7f4c96ffd640 20 reqs_thread_entry: start 2024-09-10T14:28:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7466700 con 0x7f4e6005abc0 2024-09-10T14:28:53.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c74672e0 con 0x5623c742f720 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(63 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7467320 con 0x7f4e6005abc0 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7468ac0 con 0x5623c742f720 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:66 4.37 4:ec57f35b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7467fe0 con 0x7f4e580cd050 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 4.1c 4:380b0a52:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c746d630 con 0x7f4e580cd050 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 4.21 4:86275533:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c746fea0 con 0x7f4e580cd050 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 4.21 4:87e847a3:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c746d630 con 0x7f4e580cd050 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 4.32 4:4f67d3a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7474d80 con 0x5623c742f720 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 4.b 4:d373810a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7477790 con 0x7f4e6005abc0 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 4.2d 4:b51c8fd0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c747a200 con 0x7f4e580cd050 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 4.8 4:117e5d7e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c747d060 con 0x5623c7434130 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 4.35 4:afbf09d9:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c74777d0 con 0x5623c742f720 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 4.6 4:6014ede5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c74823f0 con 0x5623c7434130 2024-09-10T14:28:53.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:76 4.1f 4:f8a1c4a6:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5623c7484eb0 con 0x5623c7434130 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(71 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(73 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(70 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(66 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(68 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(74 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(75 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(76 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(67 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(72 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.119+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(69 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.123+0000 7f4d267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.123+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94711666958720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c7456e70 con 0x5623c742f720 2024-09-10T14:28:53.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.123+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94711666958720] v33'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.123+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94711666940592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c7456e70 con 0x7f4e6005abc0 2024-09-10T14:28:53.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.123+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94711666940592] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.123+0000 7f4e72693980 20 remove_watcher() i=0 2024-09-10T14:28:53.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.123+0000 7f4e72693980 2 removed watcher, disabling cache 2024-09-10T14:28:53.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.123+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94711666943376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c7439ab0 con 0x5623c742f720 2024-09-10T14:28:53.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.127+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94711666943376] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.127+0000 7f4e72693980 20 remove_watcher() i=1 2024-09-10T14:28:53.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.127+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94711666945504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c7456e70 con 0x5623c7434130 2024-09-10T14:28:53.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.127+0000 7f4e701a3640 1 -- 172.21.15.151:0/3101527017 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94711666945504] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e60041020 con 0x5623c7434130 2024-09-10T14:28:53.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.127+0000 7f4e72693980 20 remove_watcher() i=2 2024-09-10T14:28:53.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.127+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94711666953840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743ade0 con 0x7f4e6005abc0 2024-09-10T14:28:53.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.131+0000 7f4e6f9a2640 1 -- 172.21.15.151:0/3101527017 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94711666953840] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e580ca070 con 0x7f4e6005abc0 2024-09-10T14:28:53.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.131+0000 7f4e72693980 20 remove_watcher() i=3 2024-09-10T14:28:53.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.131+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94711666950400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c7456e70 con 0x5623c742f720 2024-09-10T14:28:53.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.131+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94711666950400] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x5623c742f720 2024-09-10T14:28:53.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.131+0000 7f4e72693980 20 remove_watcher() i=4 2024-09-10T14:28:53.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.131+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94711666957664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743ade0 con 0x7f4e580cd050 2024-09-10T14:28:53.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.135+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94711666957664] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.135+0000 7f4e72693980 20 remove_watcher() i=5 2024-09-10T14:28:53.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.135+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94711666961632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c7456e70 con 0x7f4e580cd050 2024-09-10T14:28:53.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.135+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94711666961632] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.135+0000 7f4e72693980 20 remove_watcher() i=6 2024-09-10T14:28:53.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.135+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94711666964352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5623c743ade0 con 0x7f4e580cd050 2024-09-10T14:28:53.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94711666964352] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e680083f0 con 0x7f4e580cd050 2024-09-10T14:28:53.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 20 remove_watcher() i=7 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4e580cd050 msgr2=0x7f4e580cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4e580cd050 0x7f4e580cd430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c742f720 msgr2=0x5623c7431be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c742f720 0x5623c7431be0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4e6005abc0 msgr2=0x7f4e60019a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4e6005abc0 0x7f4e60019a00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c7434130 msgr2=0x5623c7436520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c7434130 0x5623c7436520 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d400346a0 msgr2=0x7f4d40036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d400346a0 0x7f4d40036b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5623c7403660 tx=0x7f4e580a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:53.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e709a4640 1 -- 172.21.15.151:0/3101527017 reap_dead start 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 msgr2=0x5623c7424640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c7424640 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4e600176e0 tx=0x7f4e600482f0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 shutdown_connections 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3101527017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c741d500 0x5623c7424640 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 >> 172.21.15.151:0/3101527017 conn(0x5623c7419880 msgr2=0x5623c7417950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 shutdown_connections 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3101527017 wait complete. 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3811719041 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d48034650 msgr2=0x7f4d48036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3811719041 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d48034650 0x7f4d48036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5623c73fa9b0 tx=0x7f4e58005e50 comp rx=0 tx=0).stop 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3811719041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7410d30 msgr2=0x5623c7411150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3811719041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7410d30 0x5623c7411150 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e60024000 tx=0x7f4e60017d50 comp rx=0 tx=0).stop 2024-09-10T14:28:53.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3811719041 shutdown_connections 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3811719041 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d48034650 0x7f4d48036b10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3811719041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7410d30 0x5623c7411150 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3811719041 >> 172.21.15.151:0/3811719041 conn(0x5623c7405e80 msgr2=0x5623c7408900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3811719041 shutdown_connections 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3811719041 wait complete. 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5623c74006e0 msgr2=0x5623c7402ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5623c74006e0 0x5623c7402ad0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c7304a90 msgr2=0x5623c73f9e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5623c7304a90 0x5623c73f9e40 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c73fc7e0 msgr2=0x5623c73febd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5623c73fc7e0 0x5623c73febd0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d580346a0 msgr2=0x7f4d58036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4d580346a0 0x7f4d58036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e580ab000 tx=0x7f4e580a5000 comp rx=0 tx=0).stop 2024-09-10T14:28:53.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 msgr2=0x5623c73f2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 --2- 172.21.15.151:0/3387867840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5623c7274ac0 0x5623c73f2e50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x5623c73eccc0 tx=0x7f4e60000bd0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e709a4640 1 -- 172.21.15.151:0/3387867840 reap_dead start 2024-09-10T14:28:53.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 shutdown_connections 2024-09-10T14:28:53.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 >> 172.21.15.151:0/3387867840 conn(0x5623c72fb060 msgr2=0x5623c73e6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 shutdown_connections 2024-09-10T14:28:53.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.139+0000 7f4e72693980 1 -- 172.21.15.151:0/3387867840 wait complete. 2024-09-10T14:28:53.156 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"58a4d2fa-bc9c-4537-a4ac-e71f7240f583","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","marker":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T14:28:52.352054Z","creation_time":"2024-09-10T14:28:52.346429Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-10T14:28:53.156 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T14:28:52.352054Z', 'creation_time': '2024-09-10T14:28:52.346429Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-10T14:28:53.156 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T14:28:53.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T14:28:53.157 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T14:28:53.232 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:53.233 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:53.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec9c779980 1 Processor -- start 2024-09-10T14:28:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec9c779980 1 -- start start 2024-09-10T14:28:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec9c779980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555db5f30c60 0x555db5f33050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec9c779980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555db5db2ae0 con 0x555db5f2c8e0 2024-09-10T14:28:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec9c779980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x555db5dd6e30 con 0x555db5f30c60 2024-09-10T14:28:53.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec99a88640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555db5f30c60 0x555db5f33050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec99a88640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555db5f30c60 0x555db5f33050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49142/0 (socket says 172.21.15.151:49142) 2024-09-10T14:28:53.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec99a88640 1 -- 172.21.15.151:0/4018845705 learned_addr learned my addr 172.21.15.151:0/4018845705 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec99a88640 1 -- 172.21.15.151:0/4018845705 >> v1:172.21.15.52:6789/0 conn(0x555db5f2c8e0 legacy=0x555db5f2ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.231+0000 7fec99a88640 1 -- 172.21.15.151:0/4018845705 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db5f345a0 con 0x555db5f30c60 2024-09-10T14:28:53.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec99a88640 1 --2- 172.21.15.151:0/4018845705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f30c60 0x555db5f33050 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fec9000a5c0 tx=0x7fec9001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7262c02d9d011 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec99287640 1 -- 172.21.15.151:0/4018845705 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec900a6070 con 0x555db5f30c60 2024-09-10T14:28:53.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec99287640 1 -- 172.21.15.151:0/4018845705 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec900af070 con 0x555db5f30c60 2024-09-10T14:28:53.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec99287640 1 -- 172.21.15.151:0/4018845705 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec900aa5c0 con 0x555db5f30c60 2024-09-10T14:28:53.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec9c779980 1 -- 172.21.15.151:0/4018845705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f30c60 msgr2=0x555db5f33050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec9c779980 1 --2- 172.21.15.151:0/4018845705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f30c60 0x555db5f33050 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fec9000a5c0 tx=0x7fec9001b340 comp rx=0 tx=0).stop 2024-09-10T14:28:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec9c779980 1 -- 172.21.15.151:0/4018845705 shutdown_connections 2024-09-10T14:28:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec9c779980 1 --2- 172.21.15.151:0/4018845705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f30c60 0x555db5f33050 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec9c779980 1 -- 172.21.15.151:0/4018845705 >> 172.21.15.151:0/4018845705 conn(0x555db5ea0230 msgr2=0x555db5ea0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec9c779980 1 -- 172.21.15.151:0/4018845705 shutdown_connections 2024-09-10T14:28:53.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.235+0000 7fec9c779980 1 -- 172.21.15.151:0/4018845705 wait complete. 2024-09-10T14:28:53.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9c779980 1 Processor -- start 2024-09-10T14:28:53.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9c779980 1 -- start start 2024-09-10T14:28:53.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9c779980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db6017c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9c779980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555db5dd8200 con 0x555db5f2c8e0 2024-09-10T14:28:53.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db6017c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db6017c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49146/0 (socket says 172.21.15.151:49146) 2024-09-10T14:28:53.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9a289640 1 -- 172.21.15.151:0/3198490497 learned_addr learned my addr 172.21.15.151:0/3198490497 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9a289640 1 -- 172.21.15.151:0/3198490497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db6018200 con 0x555db5f2c8e0 2024-09-10T14:28:53.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7fec9a289640 1 --2- 172.21.15.151:0/3198490497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db6017c30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00b1f0 tx=0x7fec8c00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daaac51e9852c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7feb88608640 1 -- 172.21.15.151:0/3198490497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c00a040 con 0x555db5f2c8e0 2024-09-10T14:28:53.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7feb88608640 1 -- 172.21.15.151:0/3198490497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c00f750 con 0x555db5f2c8e0 2024-09-10T14:28:53.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.251+0000 7feb88608640 1 -- 172.21.15.151:0/3198490497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c00fa70 con 0x555db5f2c8e0 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- 172.21.15.151:0/3198490497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 msgr2=0x555db6017c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 --2- 172.21.15.151:0/3198490497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db6017c30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00b1f0 tx=0x7fec8c00b6b0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- 172.21.15.151:0/3198490497 shutdown_connections 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 --2- 172.21.15.151:0/3198490497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db6017c30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- 172.21.15.151:0/3198490497 >> 172.21.15.151:0/3198490497 conn(0x555db5ea0230 msgr2=0x555db6013860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- 172.21.15.151:0/3198490497 shutdown_connections 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- 172.21.15.151:0/3198490497 wait complete. 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 Processor -- start 2024-09-10T14:28:53.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- start start 2024-09-10T14:28:53.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db601efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555db5f340a0 con 0x555db5f2c8e0 2024-09-10T14:28:53.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db601efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db601efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49158/0 (socket says 172.21.15.151:49158) 2024-09-10T14:28:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9a289640 1 -- 172.21.15.151:0/26255817 learned_addr learned my addr 172.21.15.151:0/26255817 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9a289640 1 -- 172.21.15.151:0/26255817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db601f500 con 0x555db5f2c8e0 2024-09-10T14:28:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9a289640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db601efc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00b6f0 tx=0x7fec8c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7feb86e05640 1 -- 172.21.15.151:0/26255817 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c001300 con 0x555db5f2c8e0 2024-09-10T14:28:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7feb86e05640 1 -- 172.21.15.151:0/26255817 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c01c9c0 con 0x555db5f2c8e0 2024-09-10T14:28:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555db601f790 con 0x555db5f2c8e0 2024-09-10T14:28:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7feb86e05640 1 -- 172.21.15.151:0/26255817 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c01cca0 con 0x555db5f2c8e0 2024-09-10T14:28:53.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db6022470 con 0x555db5f2c8e0 2024-09-10T14:28:53.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.255+0000 7feb86e05640 1 -- 172.21.15.151:0/26255817 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec8c017050 con 0x555db5f2c8e0 2024-09-10T14:28:53.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7feb86e05640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb80034650 0x7feb80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7feb86e05640 1 -- 172.21.15.151:0/26255817 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fec8c015020 con 0x555db5f2c8e0 2024-09-10T14:28:53.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec99a88640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb80034650 0x7feb80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9c779980 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db5f30c60 0x555db60260c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6026600 con 0x555db5f30c60 2024-09-10T14:28:53.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9aa8a640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db5f30c60 0x555db60260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec99a88640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb80034650 0x7feb80036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fec900ae000 tx=0x7fec900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9aa8a640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db5f30c60 0x555db60260c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9aa8a640 1 -- 172.21.15.151:0/26255817 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db5f30c60 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6023690 con 0x555db5f30c60 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9aa8a640 1 -- 172.21.15.151:0/26255817 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db5f30c60 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9c779980 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db6028980 0x555db602ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db602b440 con 0x555db6028980 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9a289640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db6028980 0x555db602ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9a289640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db6028980 0x555db602ad70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9a289640 1 -- 172.21.15.151:0/26255817 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec8c02e070 con 0x555db6028980 2024-09-10T14:28:53.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6027820 con 0x555db5f30c60 2024-09-10T14:28:53.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9aa8a640 1 -- 172.21.15.151:0/26255817 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db5f30c60 2024-09-10T14:28:53.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9c779980 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555db602c880 0x555db602ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db602f400 con 0x555db602c880 2024-09-10T14:28:53.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec99a88640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555db602c880 0x555db602ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.259+0000 7fec99a88640 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555db602c880 0x555db602ec70 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec99a88640 1 -- 172.21.15.151:0/26255817 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec900aaad0 con 0x555db602c880 2024-09-10T14:28:53.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9c779980 1 Processor -- start 2024-09-10T14:28:53.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9c779980 1 -- start start 2024-09-10T14:28:53.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9c779980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db603ce50 0x555db603d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9c779980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555db5e31800 con 0x555db603ce50 2024-09-10T14:28:53.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db603ce50 0x555db603d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db603ce50 0x555db603d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49166/0 (socket says 172.21.15.151:49166) 2024-09-10T14:28:53.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9a289640 1 -- 172.21.15.151:0/2712982529 learned_addr learned my addr 172.21.15.151:0/2712982529 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9a289640 1 -- 172.21.15.151:0/2712982529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db603d7b0 con 0x555db603ce50 2024-09-10T14:28:53.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9a289640 1 --2- 172.21.15.151:0/2712982529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db603ce50 0x555db603d270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0186e0 tx=0x7fec8c028eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7feb7ffff640 1 -- 172.21.15.151:0/2712982529 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c041070 con 0x555db603ce50 2024-09-10T14:28:53.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7feb7ffff640 1 -- 172.21.15.151:0/2712982529 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c027640 con 0x555db603ce50 2024-09-10T14:28:53.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9c779980 1 -- 172.21.15.151:0/2712982529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555db603da40 con 0x555db603ce50 2024-09-10T14:28:53.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7feb7ffff640 1 -- 172.21.15.151:0/2712982529 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c048a70 con 0x555db603ce50 2024-09-10T14:28:53.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.263+0000 7fec9c779980 1 -- 172.21.15.151:0/2712982529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db60406c0 con 0x555db603ce50 2024-09-10T14:28:53.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7feb7ffff640 1 -- 172.21.15.151:0/2712982529 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec8c048c10 con 0x555db603ce50 2024-09-10T14:28:53.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7feb7ffff640 1 --2- 172.21.15.151:0/2712982529 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb74034650 0x7feb74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7feb7ffff640 1 -- 172.21.15.151:0/2712982529 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fec8c04bcb0 con 0x555db603ce50 2024-09-10T14:28:53.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec99a88640 1 --2- 172.21.15.151:0/2712982529 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb74034650 0x7feb74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 Processor -- start 2024-09-10T14:28:53.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 -- start start 2024-09-10T14:28:53.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec99a88640 1 --2- 172.21.15.151:0/2712982529 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb74034650 0x7feb74036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fec90017f50 tx=0x7fec90005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db6049ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555db6018580 con 0x555db6049700 2024-09-10T14:28:53.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db6049ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db6049ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49176/0 (socket says 172.21.15.151:49176) 2024-09-10T14:28:53.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9a289640 1 -- 172.21.15.151:0/2912130784 learned_addr learned my addr 172.21.15.151:0/2912130784 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9a289640 1 -- 172.21.15.151:0/2912130784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db604a0b0 con 0x555db6049700 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9a289640 1 --2- 172.21.15.151:0/2912130784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db6049ae0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fec8c013f50 tx=0x7fec8c018aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c4fc6bb6200c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7feb7dffb640 1 -- 172.21.15.151:0/2912130784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c013130 con 0x555db6049700 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7feb7dffb640 1 -- 172.21.15.151:0/2912130784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c01a480 con 0x555db6049700 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7feb7dffb640 1 -- 172.21.15.151:0/2912130784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c044050 con 0x555db6049700 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 -- 172.21.15.151:0/2912130784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 msgr2=0x555db6049ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 --2- 172.21.15.151:0/2912130784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db6049ae0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fec8c013f50 tx=0x7fec8c018aa0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 -- 172.21.15.151:0/2912130784 shutdown_connections 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 --2- 172.21.15.151:0/2912130784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db6049ae0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 -- 172.21.15.151:0/2912130784 >> 172.21.15.151:0/2912130784 conn(0x555db6045ae0 msgr2=0x555db6043be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 -- 172.21.15.151:0/2912130784 shutdown_connections 2024-09-10T14:28:53.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.267+0000 7fec9c779980 1 -- 172.21.15.151:0/2912130784 wait complete. 2024-09-10T14:28:53.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 1 Processor -- start 2024-09-10T14:28:53.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 1 -- start start 2024-09-10T14:28:53.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db60508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555db604a550 con 0x555db6049700 2024-09-10T14:28:53.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db60508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9a289640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db60508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49180/0 (socket says 172.21.15.151:49180) 2024-09-10T14:28:53.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 learned_addr learned my addr 172.21.15.151:0/2161949462 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db6050df0 con 0x555db6049700 2024-09-10T14:28:53.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9a289640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db60508b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fec8c01c630 tx=0x7fec8c036fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7feb6bfff640 1 -- 172.21.15.151:0/2161949462 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c063040 con 0x555db6049700 2024-09-10T14:28:53.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7feb6bfff640 1 -- 172.21.15.151:0/2161949462 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c06e070 con 0x555db6049700 2024-09-10T14:28:53.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555db6050df0 con 0x555db6049700 2024-09-10T14:28:53.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7feb6bfff640 1 -- 172.21.15.151:0/2161949462 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c019e60 con 0x555db6049700 2024-09-10T14:28:53.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db6050df0 con 0x555db6049700 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7feb6bfff640 1 -- 172.21.15.151:0/2161949462 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec8c041540 con 0x555db6049700 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7feb6bfff640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb64034650 0x7feb64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7feb6bfff640 1 -- 172.21.15.151:0/2161949462 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fec8c007150 con 0x555db6049700 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec99a88640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb64034650 0x7feb64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db605b820 0x555db605dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db605e410 con 0x555db605b820 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.271+0000 7fec9aa8a640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db605b820 0x555db605dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec99a88640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb64034650 0x7feb64036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec90000c10 tx=0x7fec900c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9aa8a640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db605b820 0x555db605dcc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 realm 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db605e820 con 0x555db605b820 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db605f0c0 con 0x555db605b820 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db60601c0 0x555db60625b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6062b30 con 0x555db60601c0 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9a289640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db60601c0 0x555db60625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9a289640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db60601c0 0x555db60625b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 20 searching for the correct realm 2024-09-10T14:28:53.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db6064390 con 0x555db60601c0 2024-09-10T14:28:53.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9a289640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec8c073ae0 0x7fec8c015220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db6064390 con 0x7fec8c073ae0 2024-09-10T14:28:53.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec99a88640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec8c073ae0 0x7fec8c015220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec99a88640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec8c073ae0 0x7fec8c015220 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec99a88640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec900e0040 0x7fec900e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db6064390 con 0x7fec900e0040 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.275+0000 7fec9aa8a640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec900e0040 0x7fec900e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec900e0040 0x7fec900e0420 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec900e0040 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec900e0040 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec8c073ae0 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.279+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db60601c0 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec900e0040 2024-09-10T14:28:53.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec8c073ae0 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db60601c0 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db60601c0 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec900e0040 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db60601c0 2024-09-10T14:28:53.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db60601c0 2024-09-10T14:28:53.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.283+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec900e0040 2024-09-10T14:28:53.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db60601c0 2024-09-10T14:28:53.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec8c073ae0 2024-09-10T14:28:53.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec900e0040 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db60601c0 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec900e0040 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.287+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec8c073ae0 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db60601c0 2024-09-10T14:28:53.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec900e0040 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x555db605b820 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555db605f460 con 0x7fec8c073ae0 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:53.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60634b0 con 0x555db605b820 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6063d50 con 0x555db605b820 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60630f0 con 0x7fec900e0040 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 zone default found 2024-09-10T14:28:53.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 4 Realm: () 2024-09-10T14:28:53.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:53.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:53.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:53.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 zonegroup default 2024-09-10T14:28:53.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.291+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60638a0 con 0x7fec900e0040 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6063cc0 con 0x555db60601c0 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6066240 con 0x555db60601c0 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 20 started sync module instance, tier type = 2024-09-10T14:28:53.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:53.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db60656e0 con 0x7fec8c073ae0 2024-09-10T14:28:53.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93860974189312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6065340 con 0x7fec8c073ae0 2024-09-10T14:28:53.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db60670b0 con 0x555db605b820 2024-09-10T14:28:53.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.295+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93860974189312] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.299+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.299+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93860974193664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db60674d0 con 0x555db605b820 2024-09-10T14:28:53.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.299+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6067d80 con 0x555db60601c0 2024-09-10T14:28:53.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.299+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.299+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93860974196224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6068620 con 0x555db60601c0 2024-09-10T14:28:53.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.299+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6069020 con 0x7fec8c073ae0 2024-09-10T14:28:53.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.299+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93860974193664] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.299+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.303+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93860974194720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db60698c0 con 0x7fec8c073ae0 2024-09-10T14:28:53.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.303+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606a110 con 0x555db605b820 2024-09-10T14:28:53.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.303+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93860974196224] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.303+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93860974194720] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.303+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.303+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93860974199152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606a110 con 0x555db605b820 2024-09-10T14:28:53.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.303+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606a9b0 con 0x7fec900e0040 2024-09-10T14:28:53.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.307+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.307+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93860974207520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606ac70 con 0x7fec900e0040 2024-09-10T14:28:53.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.307+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606b790 con 0x7fec900e0040 2024-09-10T14:28:53.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.307+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93860974199152] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.307+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93860974207520] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.307+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.307+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93860974211680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606a6c0 con 0x7fec900e0040 2024-09-10T14:28:53.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.307+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606bd70 con 0x7fec900e0040 2024-09-10T14:28:53.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93860974213312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606c190 con 0x7fec900e0040 2024-09-10T14:28:53.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 20 add_watcher() i=0 2024-09-10T14:28:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 20 add_watcher() i=1 2024-09-10T14:28:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 20 add_watcher() i=2 2024-09-10T14:28:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 20 add_watcher() i=3 2024-09-10T14:28:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 20 add_watcher() i=4 2024-09-10T14:28:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 20 add_watcher() i=5 2024-09-10T14:28:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93860974211680] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 20 add_watcher() i=6 2024-09-10T14:28:53.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93860974213312] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 20 add_watcher() i=7 2024-09-10T14:28:53.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:53.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db606f1c0 con 0x555db605b820 2024-09-10T14:28:53.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.311+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93860974214368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db606c5b0 con 0x555db605b820 2024-09-10T14:28:53.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93860974214368] v33'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7feb517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:53.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:53.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 5 note: GC not initialized 2024-09-10T14:28:53.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7feb4b7fe640 20 reqs_thread_entry: start 2024-09-10T14:28:53.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:53.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 Filter name: none 2024-09-10T14:28:53.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7feb497fa640 20 reqs_thread_entry: start 2024-09-10T14:28:53.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6092240 con 0x555db605b820 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6092c30 con 0x555db605b820 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6093c40 con 0x7fec8c073ae0 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60914f0 con 0x7fec8c073ae0 2024-09-10T14:28:53.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db6093c40 con 0x555db605b820 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 4.37 4:ec57f35b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60935d0 con 0x7fec900e0040 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 4.1c 4:380b0a52:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60982f0 con 0x7fec900e0040 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 4.21 4:86275533:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db609ae30 con 0x7fec900e0040 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 4.21 4:87e847a3:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60982f0 con 0x7fec900e0040 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 4.32 4:4f67d3a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db609ff70 con 0x555db605b820 2024-09-10T14:28:53.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 4.b 4:d373810a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60a27e0 con 0x7fec8c073ae0 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 4.2d 4:b51c8fd0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60a5090 con 0x7fec900e0040 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:74 4.8 4:117e5d7e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60a7f30 con 0x555db60601c0 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 4.35 4:afbf09d9:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60aa820 con 0x555db605b820 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:76 4.6 4:6014ede5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60ad340 con 0x555db60601c0 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 4.1f 4:f8a1c4a6:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555db60a7f30 con 0x555db60601c0 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(74 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(76 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(71 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(75 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.315+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(77 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(67 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(68 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(69 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(73 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(70 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7feb517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93860974214368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x555db605b820 2024-09-10T14:28:53.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93860974214368] v33'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.319+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93860974189312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x7fec8c073ae0 2024-09-10T14:28:53.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.323+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93860974189312] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.323+0000 7fec9c779980 20 remove_watcher() i=0 2024-09-10T14:28:53.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.323+0000 7fec9c779980 2 removed watcher, disabling cache 2024-09-10T14:28:53.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.323+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93860974193664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x555db605b820 2024-09-10T14:28:53.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.323+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93860974193664] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.323+0000 7fec9c779980 20 remove_watcher() i=1 2024-09-10T14:28:53.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.323+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93860974196224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x555db60601c0 2024-09-10T14:28:53.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec9a289640 1 -- 172.21.15.151:0/2161949462 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93860974196224] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8c051070 con 0x555db60601c0 2024-09-10T14:28:53.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec9c779980 20 remove_watcher() i=2 2024-09-10T14:28:53.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93860974194720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x7fec8c073ae0 2024-09-10T14:28:53.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec99a88640 1 -- 172.21.15.151:0/2161949462 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93860974194720] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec900aaad0 con 0x7fec8c073ae0 2024-09-10T14:28:53.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec9c779980 20 remove_watcher() i=3 2024-09-10T14:28:53.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93860974199152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x555db605b820 2024-09-10T14:28:53.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93860974199152] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x555db605b820 2024-09-10T14:28:53.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec9c779980 20 remove_watcher() i=4 2024-09-10T14:28:53.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.327+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93860974207520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x7fec900e0040 2024-09-10T14:28:53.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.331+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93860974207520] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.331+0000 7fec9c779980 20 remove_watcher() i=5 2024-09-10T14:28:53.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.331+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93860974211680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x7fec900e0040 2024-09-10T14:28:53.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93860974211680] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 20 remove_watcher() i=6 2024-09-10T14:28:53.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93860974213312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555db6082f00 con 0x7fec900e0040 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93860974213312] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9400a4d0 con 0x7fec900e0040 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 20 remove_watcher() i=7 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec900e0040 msgr2=0x7fec900e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec900e0040 0x7fec900e0420 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db605b820 msgr2=0x555db605dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db605b820 0x555db605dcc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec8c073ae0 msgr2=0x7fec8c015220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec8c073ae0 0x7fec8c015220 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db60601c0 msgr2=0x555db60625b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db60601c0 0x555db60625b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb64034650 msgr2=0x7feb64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb64034650 0x7feb64036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec90000c10 tx=0x7fec900c1040 comp rx=0 tx=0).stop 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 msgr2=0x555db60508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2161949462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db6049700 0x555db60508b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fec8c01c630 tx=0x7fec8c036fd0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 reap_dead start 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9aa8a640 1 -- 172.21.15.151:0/2161949462 reap_dead start 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 shutdown_connections 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 >> 172.21.15.151:0/2161949462 conn(0x555db6045ae0 msgr2=0x555db6043bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 shutdown_connections 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2161949462 wait complete. 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2712982529 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb74034650 msgr2=0x7feb74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2712982529 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb74034650 0x7feb74036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fec90017f50 tx=0x7fec90005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2712982529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db603ce50 msgr2=0x555db603d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2712982529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db603ce50 0x555db603d270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0186e0 tx=0x7fec8c028eb0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2712982529 shutdown_connections 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2712982529 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb74034650 0x7feb74036b10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 --2- 172.21.15.151:0/2712982529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db603ce50 0x555db603d270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2712982529 >> 172.21.15.151:0/2712982529 conn(0x555db6031fa0 msgr2=0x555db6034a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2712982529 shutdown_connections 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.335+0000 7fec9c779980 1 -- 172.21.15.151:0/2712982529 wait complete. 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555db602c880 msgr2=0x555db602ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555db602c880 0x555db602ec70 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db5f30c60 msgr2=0x555db60260c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555db5f30c60 0x555db60260c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db6028980 msgr2=0x555db602ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555db6028980 0x555db602ad70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb80034650 msgr2=0x7feb80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb80034650 0x7feb80036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fec900ae000 tx=0x7fec900a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 msgr2=0x555db601efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 --2- 172.21.15.151:0/26255817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555db5f2c8e0 0x555db601efc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00b6f0 tx=0x7fec8c000ee0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9aa8a640 1 -- 172.21.15.151:0/26255817 reap_dead start 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 shutdown_connections 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 >> 172.21.15.151:0/26255817 conn(0x555db5ea0230 msgr2=0x555db60123e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 shutdown_connections 2024-09-10T14:28:53.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.339+0000 7fec9c779980 1 -- 172.21.15.151:0/26255817 wait complete. 2024-09-10T14:28:53.352 INFO:teuthology.orchestra.run.smithi151.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"58a4d2fa-bc9c-4537-a4ac-e71f7240f583","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","marker":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T14:28:52.352054Z","creation_time":"2024-09-10T14:28:52.346429Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-10T14:28:53.352 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T14:28:52.352054Z', 'creation_time': '2024-09-10T14:28:52.346429Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-10T14:28:53.362 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T14:28:53.362 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T14:28:53.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T14:28:53.362 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T14:28:53.423 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:53.423 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:53.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.419+0000 7f535f720980 1 Processor -- start 2024-09-10T14:28:53.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.419+0000 7f535f720980 1 -- start start 2024-09-10T14:28:53.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.419+0000 7f535f720980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562e59802c60 0x562e59805050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.419+0000 7f535f720980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e59684ae0 con 0x562e597fe8e0 2024-09-10T14:28:53.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.419+0000 7f535f720980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x562e596a8e30 con 0x562e59802c60 2024-09-10T14:28:53.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f535ca2f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562e59802c60 0x562e59805050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f535d230640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x562e597fe8e0 0x562e597fecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44624/0 (socket says 172.21.15.151:44624) 2024-09-10T14:28:53.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f535d230640 1 -- 172.21.15.151:0/266583475 learned_addr learned my addr 172.21.15.151:0/266583475 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:53.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f535ca2f640 1 -- 172.21.15.151:0/266583475 >> v1:172.21.15.52:6789/0 conn(0x562e597fe8e0 legacy=0x562e597fecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f535ca2f640 1 -- 172.21.15.151:0/266583475 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e598065a0 con 0x562e59802c60 2024-09-10T14:28:53.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f535ca2f640 1 --2- 172.21.15.151:0/266583475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e59802c60 0x562e59805050 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f534800a480 tx=0x7f534801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ee861f2596632c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f5357fff640 1 -- 172.21.15.151:0/266583475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53480b0070 con 0x562e59802c60 2024-09-10T14:28:53.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f5357fff640 1 -- 172.21.15.151:0/266583475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53480ab540 con 0x562e59802c60 2024-09-10T14:28:53.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.423+0000 7f5357fff640 1 -- 172.21.15.151:0/266583475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53480ab840 con 0x562e59802c60 2024-09-10T14:28:53.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.427+0000 7f535f720980 1 -- 172.21.15.151:0/266583475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e59802c60 msgr2=0x562e59805050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.427+0000 7f535f720980 1 --2- 172.21.15.151:0/266583475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e59802c60 0x562e59805050 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f534800a480 tx=0x7f534801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:53.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.427+0000 7f535f720980 1 -- 172.21.15.151:0/266583475 shutdown_connections 2024-09-10T14:28:53.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.427+0000 7f535f720980 1 --2- 172.21.15.151:0/266583475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e59802c60 0x562e59805050 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.427+0000 7f535f720980 1 -- 172.21.15.151:0/266583475 >> 172.21.15.151:0/266583475 conn(0x562e59772230 msgr2=0x562e59772640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.427+0000 7f535f720980 1 -- 172.21.15.151:0/266583475 shutdown_connections 2024-09-10T14:28:53.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.427+0000 7f535f720980 1 -- 172.21.15.151:0/266583475 wait complete. 2024-09-10T14:28:53.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 Processor -- start 2024-09-10T14:28:53.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- start start 2024-09-10T14:28:53.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e596aa200 con 0x562e597fe8e0 2024-09-10T14:28:53.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49194/0 (socket says 172.21.15.151:49194) 2024-09-10T14:28:53.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535d230640 1 -- 172.21.15.151:0/2116591362 learned_addr learned my addr 172.21.15.151:0/2116591362 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535d230640 1 -- 172.21.15.151:0/2116591362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e598ea210 con 0x562e597fe8e0 2024-09-10T14:28:53.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535d230640 1 --2- 172.21.15.151:0/2116591362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598e9c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f53500017b0 tx=0x7f5350001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5dfc196b2c9cae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f524a614640 1 -- 172.21.15.151:0/2116591362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350016070 con 0x562e597fe8e0 2024-09-10T14:28:53.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f524a614640 1 -- 172.21.15.151:0/2116591362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350004530 con 0x562e597fe8e0 2024-09-10T14:28:53.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f524a614640 1 -- 172.21.15.151:0/2116591362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350004870 con 0x562e597fe8e0 2024-09-10T14:28:53.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- 172.21.15.151:0/2116591362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 msgr2=0x562e598e9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 --2- 172.21.15.151:0/2116591362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598e9c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f53500017b0 tx=0x7f5350001c70 comp rx=0 tx=0).stop 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- 172.21.15.151:0/2116591362 shutdown_connections 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 --2- 172.21.15.151:0/2116591362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598e9c40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- 172.21.15.151:0/2116591362 >> 172.21.15.151:0/2116591362 conn(0x562e59772230 msgr2=0x562e598e5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- 172.21.15.151:0/2116591362 shutdown_connections 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- 172.21.15.151:0/2116591362 wait complete. 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 Processor -- start 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- start start 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535f720980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e598060a0 con 0x562e597fe8e0 2024-09-10T14:28:53.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598f0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49206/0 (socket says 172.21.15.151:49206) 2024-09-10T14:28:53.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.443+0000 7f535d230640 1 -- 172.21.15.151:0/2586556626 learned_addr learned my addr 172.21.15.151:0/2586556626 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535d230640 1 -- 172.21.15.151:0/2586556626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e598f1530 con 0x562e597fe8e0 2024-09-10T14:28:53.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535d230640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598f0ff0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5350000f90 tx=0x7f5350001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f5248e11640 1 -- 172.21.15.151:0/2586556626 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350020070 con 0x562e597fe8e0 2024-09-10T14:28:53.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e598f17c0 con 0x562e597fe8e0 2024-09-10T14:28:53.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f5248e11640 1 -- 172.21.15.151:0/2586556626 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350011400 con 0x562e597fe8e0 2024-09-10T14:28:53.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f5248e11640 1 -- 172.21.15.151:0/2586556626 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350016040 con 0x562e597fe8e0 2024-09-10T14:28:53.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e598f44a0 con 0x562e597fe8e0 2024-09-10T14:28:53.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f5248e11640 1 -- 172.21.15.151:0/2586556626 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5350023070 con 0x562e597fe8e0 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f5248e11640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5244034650 0x7f5244036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f5248e11640 1 -- 172.21.15.151:0/2586556626 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f53500491e0 con 0x562e597fe8e0 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5244034650 0x7f5244036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535f720980 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e59802c60 0x562e598f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e598f8630 con 0x562e59802c60 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535da31640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e59802c60 0x562e598f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5244034650 0x7f5244036b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f53480ad000 tx=0x7f53480a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535da31640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e59802c60 0x562e598f80f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535da31640 1 -- 172.21.15.151:0/2586556626 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e59802c60 2024-09-10T14:28:53.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.447+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e598f56c0 con 0x562e59802c60 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535da31640 1 -- 172.21.15.151:0/2586556626 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53580083f0 con 0x562e59802c60 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e598fa960 0x562e598fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e598fd420 con 0x562e598fa960 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535d230640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e598fa960 0x562e598fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535d230640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e598fa960 0x562e598fcd50 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535d230640 1 -- 172.21.15.151:0/2586556626 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f535002c070 con 0x562e598fa960 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e598f97d0 con 0x562e59802c60 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535da31640 1 -- 172.21.15.151:0/2586556626 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53580083f0 con 0x562e59802c60 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e598fe880 0x562e59900c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59901360 con 0x562e598fe880 2024-09-10T14:28:53.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e598fe880 0x562e59900c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e598fe880 0x562e59900c70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535ca2f640 1 -- 172.21.15.151:0/2586556626 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f53480b3040 con 0x562e598fe880 2024-09-10T14:28:53.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 Processor -- start 2024-09-10T14:28:53.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 -- start start 2024-09-10T14:28:53.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5990ee10 0x562e5990f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.451+0000 7f535f720980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e59703800 con 0x562e5990ee10 2024-09-10T14:28:53.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5990ee10 0x562e5990f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5990ee10 0x562e5990f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49208/0 (socket says 172.21.15.151:49208) 2024-09-10T14:28:53.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535d230640 1 -- 172.21.15.151:0/399332216 learned_addr learned my addr 172.21.15.151:0/399332216 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535d230640 1 -- 172.21.15.151:0/399332216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e5990f770 con 0x562e5990ee10 2024-09-10T14:28:53.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535d230640 1 --2- 172.21.15.151:0/399332216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5990ee10 0x562e5990f230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5350047570 tx=0x7f535001bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f5241ffb640 1 -- 172.21.15.151:0/399332216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535003f070 con 0x562e5990ee10 2024-09-10T14:28:53.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f5241ffb640 1 -- 172.21.15.151:0/399332216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350011810 con 0x562e5990ee10 2024-09-10T14:28:53.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535f720980 1 -- 172.21.15.151:0/399332216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e5990fa00 con 0x562e5990ee10 2024-09-10T14:28:53.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f5241ffb640 1 -- 172.21.15.151:0/399332216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350011b30 con 0x562e5990ee10 2024-09-10T14:28:53.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535f720980 1 -- 172.21.15.151:0/399332216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e59912680 con 0x562e5990ee10 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f5241ffb640 1 -- 172.21.15.151:0/399332216 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5350026970 con 0x562e5990ee10 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f5241ffb640 1 --2- 172.21.15.151:0/399332216 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5234034650 0x7f5234036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f5241ffb640 1 -- 172.21.15.151:0/399332216 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f535004ad60 con 0x562e5990ee10 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535ca2f640 1 --2- 172.21.15.151:0/399332216 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5234034650 0x7f5234036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535f720980 1 Processor -- start 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535f720980 1 -- start start 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535ca2f640 1 --2- 172.21.15.151:0/399332216 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5234034650 0x7f5234036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x562e598f8f10 tx=0x7f5348005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535f720980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e5991bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535f720980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e598ea590 con 0x562e5991b7c0 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e5991bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e5991bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49212/0 (socket says 172.21.15.151:49212) 2024-09-10T14:28:53.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.455+0000 7f535d230640 1 -- 172.21.15.151:0/332993312 learned_addr learned my addr 172.21.15.151:0/332993312 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535d230640 1 -- 172.21.15.151:0/332993312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e5991c190 con 0x562e5991b7c0 2024-09-10T14:28:53.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535d230640 1 --2- 172.21.15.151:0/332993312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e5991bbc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5350030fd0 tx=0x7f5350049070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5859e6470ad446bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f523b7fe640 1 -- 172.21.15.151:0/332993312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350040cd0 con 0x562e5991b7c0 2024-09-10T14:28:53.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f523b7fe640 1 -- 172.21.15.151:0/332993312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350025450 con 0x562e5991b7c0 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f523b7fe640 1 -- 172.21.15.151:0/332993312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350005030 con 0x562e5991b7c0 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- 172.21.15.151:0/332993312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 msgr2=0x562e5991bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 --2- 172.21.15.151:0/332993312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e5991bbc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5350030fd0 tx=0x7f5350049070 comp rx=0 tx=0).stop 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- 172.21.15.151:0/332993312 shutdown_connections 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 --2- 172.21.15.151:0/332993312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e5991bbc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- 172.21.15.151:0/332993312 >> 172.21.15.151:0/332993312 conn(0x562e59917af0 msgr2=0x562e59915bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- 172.21.15.151:0/332993312 shutdown_connections 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- 172.21.15.151:0/332993312 wait complete. 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 Processor -- start 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- start start 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e59922900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e5991c680 con 0x562e5991b7c0 2024-09-10T14:28:53.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e59922900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535d230640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e59922900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49224/0 (socket says 172.21.15.151:49224) 2024-09-10T14:28:53.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 learned_addr learned my addr 172.21.15.151:0/2200149868 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e59922e40 con 0x562e5991b7c0 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535d230640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e59922900 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5350030fd0 tx=0x7f53500053c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f5239ffb640 1 -- 172.21.15.151:0/2200149868 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5350026e70 con 0x562e5991b7c0 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e59922e40 con 0x562e5991b7c0 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f5239ffb640 1 -- 172.21.15.151:0/2200149868 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535006c070 con 0x562e5991b7c0 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f5239ffb640 1 -- 172.21.15.151:0/2200149868 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535002d690 con 0x562e5991b7c0 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.459+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e59922e40 con 0x562e5991b7c0 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f5239ffb640 1 -- 172.21.15.151:0/2200149868 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f535002daf0 con 0x562e5991b7c0 2024-09-10T14:28:53.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f5239ffb640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f522c034650 0x7f522c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f5239ffb640 1 -- 172.21.15.151:0/2200149868 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f5350072cc0 con 0x562e5991b7c0 2024-09-10T14:28:53.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f522c034650 0x7f522c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e5992d8a0 0x562e5992fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59930490 con 0x562e5992d8a0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535da31640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e5992d8a0 0x562e5992fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f522c034650 0x7f522c036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5348000c10 tx=0x7f53480b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535da31640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e5992d8a0 0x562e5992fd40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 realm 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e599308a0 con 0x562e5992d8a0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59931140 con 0x562e5992d8a0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e59932240 0x562e59934630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59934bb0 con 0x562e59932240 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535d230640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e59932240 0x562e59934630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.463+0000 7f535d230640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e59932240 0x562e59934630 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535f720980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:53.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535f720980 20 searching for the correct realm 2024-09-10T14:28:53.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e59936430 con 0x562e59932240 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535d230640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5350025070 0x7f5350005740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e59936430 con 0x7f5350025070 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5350025070 0x7f5350005740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5350025070 0x7f5350005740 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535ca2f640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53480dc040 0x7f53480dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e59936430 con 0x7f53480dc040 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535da31640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53480dc040 0x7f53480dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535da31640 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53480dc040 0x7f53480dd430 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.467+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f53480dc040 2024-09-10T14:28:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f53480dc040 2024-09-10T14:28:53.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f5350025070 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e59932240 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f53480dc040 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f5350025070 2024-09-10T14:28:53.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.471+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e59932240 2024-09-10T14:28:53.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e59932240 2024-09-10T14:28:53.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f53480dc040 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e59932240 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e59932240 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f53480dc040 2024-09-10T14:28:53.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e59932240 2024-09-10T14:28:53.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f5350025070 2024-09-10T14:28:53.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.475+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f53480dc040 2024-09-10T14:28:53.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e59932240 2024-09-10T14:28:53.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f53480dc040 2024-09-10T14:28:53.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f5350025070 2024-09-10T14:28:53.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e59932240 2024-09-10T14:28:53.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f53480dc040 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x562e5992d8a0 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562e599314e0 con 0x7f5350025070 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535f720980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535f720980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535f720980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535f720980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535f720980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535f720980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:53.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.479+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59935400 con 0x562e5992d8a0 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e599357f0 con 0x562e5992d8a0 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e599357f0 con 0x7f53480dc040 2024-09-10T14:28:53.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 zone default found 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 4 Realm: () 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 zonegroup default 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59935c10 con 0x7f53480dc040 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59935c10 con 0x562e59932240 2024-09-10T14:28:53.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e599382e0 con 0x562e59932240 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 started sync module instance, tier type = 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.483+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59937780 con 0x7f5350025070 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.487+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.487+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94757071322016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59938b30 con 0x7f5350025070 2024-09-10T14:28:53.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.487+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59939380 con 0x562e5992d8a0 2024-09-10T14:28:53.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.487+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94757071322016] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.487+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.487+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94757071324800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59939380 con 0x562e5992d8a0 2024-09-10T14:28:53.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.487+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59939d80 con 0x562e59932240 2024-09-10T14:28:53.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94757071329424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993a620 con 0x562e59932240 2024-09-10T14:28:53.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94757071324800] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59938ed0 con 0x7f5350025070 2024-09-10T14:28:53.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94757071334464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993b630 con 0x7f5350025070 2024-09-10T14:28:53.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993c120 con 0x562e5992d8a0 2024-09-10T14:28:53.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94757071329424] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.491+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94757071334464] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.495+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.495+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94757071338480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993b0a0 con 0x562e5992d8a0 2024-09-10T14:28:53.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.495+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993c9c0 con 0x7f53480dc040 2024-09-10T14:28:53.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.495+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94757071338480] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.495+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.495+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94757071331696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993c910 con 0x7f53480dc040 2024-09-10T14:28:53.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.495+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993d1a0 con 0x7f53480dc040 2024-09-10T14:28:53.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94757071341840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993d850 con 0x7f53480dc040 2024-09-10T14:28:53.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993e100 con 0x7f53480dc040 2024-09-10T14:28:53.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94757071331696] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94757071341840] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94757071340640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993d850 con 0x7f53480dc040 2024-09-10T14:28:53.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 20 add_watcher() i=0 2024-09-10T14:28:53.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 20 add_watcher() i=1 2024-09-10T14:28:53.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 20 add_watcher() i=2 2024-09-10T14:28:53.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 20 add_watcher() i=3 2024-09-10T14:28:53.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 20 add_watcher() i=4 2024-09-10T14:28:53.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 20 add_watcher() i=5 2024-09-10T14:28:53.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.499+0000 7f535f720980 20 add_watcher() i=6 2024-09-10T14:28:53.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94757071340640] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535f720980 20 add_watcher() i=7 2024-09-10T14:28:53.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535f720980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:53.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59941200 con 0x562e5992d8a0 2024-09-10T14:28:53.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94757071344544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e5993e680 con 0x562e5992d8a0 2024-09-10T14:28:53.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94757071344544] v33'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f52127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535f720980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:53.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.503+0000 7f535f720980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:53.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 5 note: GC not initialized 2024-09-10T14:28:53.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f52117e2640 20 reqs_thread_entry: start 2024-09-10T14:28:53.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:53.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 Filter name: none 2024-09-10T14:28:53.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f5182ffd640 20 reqs_thread_entry: start 2024-09-10T14:28:53.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e599646b0 con 0x7f5350025070 2024-09-10T14:28:53.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:53.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59964f40 con 0x562e5992d8a0 2024-09-10T14:28:53.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(63 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:53.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T14:28:53.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59963a50 con 0x7f5350025070 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f53480c9030 con 0x7f5350025070 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59966570 con 0x562e5992d8a0 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:66 4.37 4:ec57f35b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59965fd0 con 0x7f53480dc040 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 4.1c 4:380b0a52:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e5996ae90 con 0x7f53480dc040 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 4.21 4:86275533:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e5996d820 con 0x7f53480dc040 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 4.21 4:87e847a3:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59970430 con 0x7f53480dc040 2024-09-10T14:28:53.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 4.32 4:4f67d3a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59972f50 con 0x562e5992d8a0 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 4.b 4:d373810a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59975840 con 0x7f5350025070 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 4.2d 4:b51c8fd0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59978200 con 0x7f53480dc040 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 4.8 4:117e5d7e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e5997aca0 con 0x562e59932240 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 4.35 4:afbf09d9:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59978200 con 0x562e5992d8a0 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 4.6 4:6014ede5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e5997fd00 con 0x562e59932240 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:76 4.1f 4:f8a1c4a6:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562e59982b90 con 0x562e59932240 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(70 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(71 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f53480ee040 con 0x7f5350025070 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(73 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(74 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(66 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(67 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(76 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(75 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(68 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.507+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(72 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(69 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f52127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94757071344544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59982b90 con 0x562e5992d8a0 2024-09-10T14:28:53.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94757071344544] v33'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94757071322016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59954e40 con 0x7f5350025070 2024-09-10T14:28:53.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94757071322016] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53480ee040 con 0x7f5350025070 2024-09-10T14:28:53.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f535f720980 20 remove_watcher() i=0 2024-09-10T14:28:53.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f535f720980 2 removed watcher, disabling cache 2024-09-10T14:28:53.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.511+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94757071324800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59954e40 con 0x562e5992d8a0 2024-09-10T14:28:53.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.515+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94757071324800] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.515+0000 7f535f720980 20 remove_watcher() i=1 2024-09-10T14:28:53.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.515+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94757071329424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59954e40 con 0x562e59932240 2024-09-10T14:28:53.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535d230640 1 -- 172.21.15.151:0/2200149868 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94757071329424] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5350038070 con 0x562e59932240 2024-09-10T14:28:53.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535f720980 20 remove_watcher() i=2 2024-09-10T14:28:53.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94757071334464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59954e40 con 0x7f5350025070 2024-09-10T14:28:53.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535ca2f640 1 -- 172.21.15.151:0/2200149868 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94757071334464] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53480ee040 con 0x7f5350025070 2024-09-10T14:28:53.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535f720980 20 remove_watcher() i=3 2024-09-10T14:28:53.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94757071338480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59954e40 con 0x562e5992d8a0 2024-09-10T14:28:53.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94757071338480] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x562e5992d8a0 2024-09-10T14:28:53.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535f720980 20 remove_watcher() i=4 2024-09-10T14:28:53.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.519+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94757071331696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59954e40 con 0x7f53480dc040 2024-09-10T14:28:53.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.523+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94757071331696] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.523+0000 7f535f720980 20 remove_watcher() i=5 2024-09-10T14:28:53.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.523+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94757071341840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59954e40 con 0x7f53480dc040 2024-09-10T14:28:53.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.523+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94757071341840] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.523+0000 7f535f720980 20 remove_watcher() i=6 2024-09-10T14:28:53.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.523+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94757071340640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562e59954e40 con 0x7f53480dc040 2024-09-10T14:28:53.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94757071340640] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f53480dc040 2024-09-10T14:28:53.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 20 remove_watcher() i=7 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53480dc040 msgr2=0x7f53480dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53480dc040 0x7f53480dd430 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e5992d8a0 msgr2=0x562e5992fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e5992d8a0 0x562e5992fd40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5350025070 msgr2=0x7f5350005740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5350025070 0x7f5350005740 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e59932240 msgr2=0x562e59934630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e59932240 0x562e59934630 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f522c034650 msgr2=0x7f522c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f522c034650 0x7f522c036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5348000c10 tx=0x7f53480b9040 comp rx=0 tx=0).stop 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 msgr2=0x562e59922900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535da31640 1 -- 172.21.15.151:0/2200149868 reap_dead start 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e59922900 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5350030fd0 tx=0x7f53500053c0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 shutdown_connections 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2200149868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5991b7c0 0x562e59922900 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 >> 172.21.15.151:0/2200149868 conn(0x562e59917af0 msgr2=0x562e59915bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 shutdown_connections 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2200149868 wait complete. 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/399332216 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5234034650 msgr2=0x7f5234036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/399332216 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5234034650 0x7f5234036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x562e598f8f10 tx=0x7f5348005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/399332216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5990ee10 msgr2=0x562e5990f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/399332216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5990ee10 0x562e5990f230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5350047570 tx=0x7f535001bdc0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/399332216 shutdown_connections 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/399332216 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5234034650 0x7f5234036b10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/399332216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e5990ee10 0x562e5990f230 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/399332216 >> 172.21.15.151:0/399332216 conn(0x562e59903f60 msgr2=0x562e599069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/399332216 shutdown_connections 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/399332216 wait complete. 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e598fe880 msgr2=0x562e59900c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e598fe880 0x562e59900c70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e59802c60 msgr2=0x562e598f80f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e59802c60 0x562e598f80f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e598fa960 msgr2=0x562e598fcd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e598fa960 0x562e598fcd50 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5244034650 msgr2=0x7f5244036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5244034650 0x7f5244036b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f53480ad000 tx=0x7f53480a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:53.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 msgr2=0x562e598f0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 --2- 172.21.15.151:0/2586556626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e597fe8e0 0x562e598f0ff0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5350000f90 tx=0x7f5350001260 comp rx=0 tx=0).stop 2024-09-10T14:28:53.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535da31640 1 -- 172.21.15.151:0/2586556626 reap_dead start 2024-09-10T14:28:53.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 shutdown_connections 2024-09-10T14:28:53.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 >> 172.21.15.151:0/2586556626 conn(0x562e59772230 msgr2=0x562e598e43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 shutdown_connections 2024-09-10T14:28:53.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.527+0000 7f535f720980 1 -- 172.21.15.151:0/2586556626 wait complete. 2024-09-10T14:28:53.544 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"58a4d2fa-bc9c-4537-a4ac-e71f7240f583","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","marker":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T14:28:52.352054Z","creation_time":"2024-09-10T14:28:52.346429Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-10T14:28:53.544 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T14:28:52.352054Z', 'creation_time': '2024-09-10T14:28:52.346429Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-10T14:28:53.544 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T14:28:53.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T14:28:53.545 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-10T14:28:53.621 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:53.621 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:53.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa637e24980 1 Processor -- start 2024-09-10T14:28:53.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa637e24980 1 -- start start 2024-09-10T14:28:53.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa637e24980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55747a2df2e0 0x55747a36b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa637e24980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55747a1f2ae0 con 0x55747a36b6a0 2024-09-10T14:28:53.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa637e24980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55747a216e30 con 0x55747a2df2e0 2024-09-10T14:28:53.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa635934640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55747a2df2e0 0x55747a36b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa635133640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55747a36b6a0 0x55747a36dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44628/0 (socket says 172.21.15.151:44628) 2024-09-10T14:28:53.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa635133640 1 -- 172.21.15.151:0/3537932145 learned_addr learned my addr 172.21.15.151:0/3537932145 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:53.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa635934640 1 -- 172.21.15.151:0/3537932145 >> v1:172.21.15.52:6789/0 conn(0x55747a36b6a0 legacy=0x55747a36dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.619+0000 7fa635934640 1 -- 172.21.15.151:0/3537932145 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747a36f1e0 con 0x55747a2df2e0 2024-09-10T14:28:53.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa635934640 1 --2- 172.21.15.151:0/3537932145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a36b160 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa62800a480 tx=0x7fa62801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171606c4f1d51d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa634932640 1 -- 172.21.15.151:0/3537932145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280af070 con 0x55747a2df2e0 2024-09-10T14:28:53.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa634932640 1 -- 172.21.15.151:0/3537932145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6280a3e50 con 0x55747a2df2e0 2024-09-10T14:28:53.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa634932640 1 -- 172.21.15.151:0/3537932145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280aa680 con 0x55747a2df2e0 2024-09-10T14:28:53.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa637e24980 1 -- 172.21.15.151:0/3537932145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 msgr2=0x55747a36b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa637e24980 1 --2- 172.21.15.151:0/3537932145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a36b160 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa62800a480 tx=0x7fa62801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:53.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa637e24980 1 -- 172.21.15.151:0/3537932145 shutdown_connections 2024-09-10T14:28:53.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa637e24980 1 --2- 172.21.15.151:0/3537932145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a36b160 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa637e24980 1 -- 172.21.15.151:0/3537932145 >> 172.21.15.151:0/3537932145 conn(0x55747a3650a0 msgr2=0x55747a3674c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa637e24980 1 -- 172.21.15.151:0/3537932145 shutdown_connections 2024-09-10T14:28:53.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.623+0000 7fa637e24980 1 -- 172.21.15.151:0/3537932145 wait complete. 2024-09-10T14:28:53.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa637e24980 1 Processor -- start 2024-09-10T14:28:53.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa637e24980 1 -- start start 2024-09-10T14:28:53.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa637e24980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a45c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa637e24980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55747a218200 con 0x55747a2df2e0 2024-09-10T14:28:53.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a45c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a45c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49254/0 (socket says 172.21.15.151:49254) 2024-09-10T14:28:53.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa635934640 1 -- 172.21.15.151:0/1396193480 learned_addr learned my addr 172.21.15.151:0/1396193480 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa635934640 1 -- 172.21.15.151:0/1396193480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747a45ca50 con 0x55747a2df2e0 2024-09-10T14:28:53.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa635934640 1 --2- 172.21.15.151:0/1396193480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a45c480 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa6280ad040 tx=0x7fa628003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4552eac5784db98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa523e07640 1 -- 172.21.15.151:0/1396193480 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280af040 con 0x55747a2df2e0 2024-09-10T14:28:53.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa523e07640 1 -- 172.21.15.151:0/1396193480 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6280aa870 con 0x55747a2df2e0 2024-09-10T14:28:53.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.639+0000 7fa523e07640 1 -- 172.21.15.151:0/1396193480 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280aab90 con 0x55747a2df2e0 2024-09-10T14:28:53.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- 172.21.15.151:0/1396193480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 msgr2=0x55747a45c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 --2- 172.21.15.151:0/1396193480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a45c480 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa6280ad040 tx=0x7fa628003030 comp rx=0 tx=0).stop 2024-09-10T14:28:53.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- 172.21.15.151:0/1396193480 shutdown_connections 2024-09-10T14:28:53.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 --2- 172.21.15.151:0/1396193480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a45c480 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- 172.21.15.151:0/1396193480 >> 172.21.15.151:0/1396193480 conn(0x55747a3650a0 msgr2=0x55747a4580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- 172.21.15.151:0/1396193480 shutdown_connections 2024-09-10T14:28:53.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- 172.21.15.151:0/1396193480 wait complete. 2024-09-10T14:28:53.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 Processor -- start 2024-09-10T14:28:53.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- start start 2024-09-10T14:28:53.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a463730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55747a37aa10 con 0x55747a2df2e0 2024-09-10T14:28:53.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a463730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a463730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49260/0 (socket says 172.21.15.151:49260) 2024-09-10T14:28:53.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa635934640 1 -- 172.21.15.151:0/1650067919 learned_addr learned my addr 172.21.15.151:0/1650067919 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa635934640 1 -- 172.21.15.151:0/1650067919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747a463c70 con 0x55747a2df2e0 2024-09-10T14:28:53.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa635934640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a463730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b7040 tx=0x7fa628018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa522604640 1 -- 172.21.15.151:0/1650067919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280c2070 con 0x55747a2df2e0 2024-09-10T14:28:53.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa522604640 1 -- 172.21.15.151:0/1650067919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6280b57b0 con 0x55747a2df2e0 2024-09-10T14:28:53.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55747a463f00 con 0x55747a2df2e0 2024-09-10T14:28:53.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa522604640 1 -- 172.21.15.151:0/1650067919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280af050 con 0x55747a2df2e0 2024-09-10T14:28:53.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.643+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55747a466be0 con 0x55747a2df2e0 2024-09-10T14:28:53.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa522604640 1 -- 172.21.15.151:0/1650067919 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa6280c5070 con 0x55747a2df2e0 2024-09-10T14:28:53.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa522604640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa51c034650 0x7fa51c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa522604640 1 -- 172.21.15.151:0/1650067919 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa6280ba070 con 0x55747a2df2e0 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa635133640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa51c034650 0x7fa51c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa637e24980 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a36b6a0 0x55747a46a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a46ac90 con 0x55747a36b6a0 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa636135640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a36b6a0 0x55747a46a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa635133640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa51c034650 0x7fa51c036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa62c000f70 tx=0x7fa62c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa636135640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a36b6a0 0x55747a46a6c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa636135640 1 -- 172.21.15.151:0/1650067919 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a36b6a0 2024-09-10T14:28:53.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a467e00 con 0x55747a36b6a0 2024-09-10T14:28:53.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa636135640 1 -- 172.21.15.151:0/1650067919 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a36b6a0 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa637e24980 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a46d010 0x55747a46f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a46fad0 con 0x55747a46d010 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa635934640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a46d010 0x55747a46f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa635934640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a46d010 0x55747a46f400 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa635934640 1 -- 172.21.15.151:0/1650067919 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a46d010 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a46beb0 con 0x55747a36b6a0 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa636135640 1 -- 172.21.15.151:0/1650067919 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a36b6a0 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa637e24980 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55747a470f30 0x55747a473320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a473a20 con 0x55747a470f30 2024-09-10T14:28:53.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.647+0000 7fa635133640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55747a470f30 0x55747a473320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa635133640 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55747a470f30 0x55747a473320 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa635133640 1 -- 172.21.15.151:0/1650067919 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa62c00e620 con 0x55747a470f30 2024-09-10T14:28:53.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa637e24980 1 Processor -- start 2024-09-10T14:28:53.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa637e24980 1 -- start start 2024-09-10T14:28:53.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa637e24980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a4814c0 0x55747a4818e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa637e24980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55747a271800 con 0x55747a4814c0 2024-09-10T14:28:53.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a4814c0 0x55747a4818e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a4814c0 0x55747a4818e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49270/0 (socket says 172.21.15.151:49270) 2024-09-10T14:28:53.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa635934640 1 -- 172.21.15.151:0/2198228201 learned_addr learned my addr 172.21.15.151:0/2198228201 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa635934640 1 -- 172.21.15.151:0/2198228201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747a481e20 con 0x55747a4814c0 2024-09-10T14:28:53.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa635934640 1 --2- 172.21.15.151:0/2198228201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a4814c0 0x55747a4818e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa628006530 tx=0x7fa6280be460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa51b7fe640 1 -- 172.21.15.151:0/2198228201 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280b4500 con 0x55747a4814c0 2024-09-10T14:28:53.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa51b7fe640 1 -- 172.21.15.151:0/2198228201 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6280b5b60 con 0x55747a4814c0 2024-09-10T14:28:53.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa637e24980 1 -- 172.21.15.151:0/2198228201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55747a4820b0 con 0x55747a4814c0 2024-09-10T14:28:53.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa51b7fe640 1 -- 172.21.15.151:0/2198228201 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280e4a10 con 0x55747a4814c0 2024-09-10T14:28:53.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.651+0000 7fa637e24980 1 -- 172.21.15.151:0/2198228201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55747a484d30 con 0x55747a4814c0 2024-09-10T14:28:53.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa51b7fe640 1 -- 172.21.15.151:0/2198228201 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa6280a93a0 con 0x55747a4814c0 2024-09-10T14:28:53.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa51b7fe640 1 --2- 172.21.15.151:0/2198228201 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5100346a0 0x7fa510036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa51b7fe640 1 -- 172.21.15.151:0/2198228201 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa6280bf070 con 0x55747a4814c0 2024-09-10T14:28:53.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa635133640 1 --2- 172.21.15.151:0/2198228201 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5100346a0 0x7fa510036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 Processor -- start 2024-09-10T14:28:53.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- start start 2024-09-10T14:28:53.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a48e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55747a45cd10 con 0x55747a48de80 2024-09-10T14:28:53.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa635133640 1 --2- 172.21.15.151:0/2198228201 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5100346a0 0x7fa510036b60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00bf60 tx=0x7fa62c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a48e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a48e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49284/0 (socket says 172.21.15.151:49284) 2024-09-10T14:28:53.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa635934640 1 -- 172.21.15.151:0/1590712933 learned_addr learned my addr 172.21.15.151:0/1590712933 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa635934640 1 -- 172.21.15.151:0/1590712933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747a48e850 con 0x55747a48de80 2024-09-10T14:28:53.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa635934640 1 --2- 172.21.15.151:0/1590712933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a48e280 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa6280e1810 tx=0x7fa6280e5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71915cf53697fa8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa5197fa640 1 -- 172.21.15.151:0/1590712933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280d2830 con 0x55747a48de80 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa5197fa640 1 -- 172.21.15.151:0/1590712933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6280dedc0 con 0x55747a48de80 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa5197fa640 1 -- 172.21.15.151:0/1590712933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280a9870 con 0x55747a48de80 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- 172.21.15.151:0/1590712933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 msgr2=0x55747a48e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 --2- 172.21.15.151:0/1590712933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a48e280 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa6280e1810 tx=0x7fa6280e5f90 comp rx=0 tx=0).stop 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- 172.21.15.151:0/1590712933 shutdown_connections 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 --2- 172.21.15.151:0/1590712933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a48e280 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- 172.21.15.151:0/1590712933 >> 172.21.15.151:0/1590712933 conn(0x55747a48a1c0 msgr2=0x55747a488310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- 172.21.15.151:0/1590712933 shutdown_connections 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- 172.21.15.151:0/1590712933 wait complete. 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 Processor -- start 2024-09-10T14:28:53.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- start start 2024-09-10T14:28:53.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a494fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.655+0000 7fa637e24980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55747a48ec20 con 0x55747a48de80 2024-09-10T14:28:53.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a494fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa635934640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a494fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49298/0 (socket says 172.21.15.151:49298) 2024-09-10T14:28:53.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 learned_addr learned my addr 172.21.15.151:0/4230615916 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747a495510 con 0x55747a48de80 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa635934640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a494fd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6280becb0 tx=0x7fa6280c2f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa5077fe640 1 -- 172.21.15.151:0/4230615916 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa628100040 con 0x55747a48de80 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa5077fe640 1 -- 172.21.15.151:0/4230615916 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6280a9870 con 0x55747a48de80 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55747a495510 con 0x55747a48de80 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa5077fe640 1 -- 172.21.15.151:0/4230615916 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6280e11c0 con 0x55747a48de80 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55747a495510 con 0x55747a48de80 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa5077fe640 1 -- 172.21.15.151:0/4230615916 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa62810d020 con 0x55747a48de80 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa5077fe640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5000346a0 0x7fa500036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa5077fe640 1 -- 172.21.15.151:0/4230615916 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa62810b020 con 0x55747a48de80 2024-09-10T14:28:53.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa635133640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5000346a0 0x7fa500036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a4a00d0 0x55747a4a2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a2cc0 con 0x55747a4a00d0 2024-09-10T14:28:53.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa636135640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a4a00d0 0x55747a4a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.659+0000 7fa635133640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5000346a0 0x7fa500036b60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55747a46b5c0 tx=0x7fa62c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa636135640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a4a00d0 0x55747a4a2570 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 realm 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a30d0 con 0x55747a4a00d0 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3970 con 0x55747a4a00d0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a4a4a70 0x55747a4a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a73e0 con 0x55747a4a4a70 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635934640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a4a4a70 0x55747a4a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635934640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a4a4a70 0x55747a4a6e60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 20 searching for the correct realm 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a8c40 con 0x55747a4a4a70 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635934640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa6280c7070 0x7fa628119800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a8c40 con 0x7fa6280c7070 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635133640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa6280c7070 0x7fa628119800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635133640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa6280c7070 0x7fa628119800 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635133640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa62c037040 0x7fa62c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a8c40 con 0x7fa62c037040 2024-09-10T14:28:53.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.663+0000 7fa636135640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa62c037040 0x7fa62c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa62c037040 0x7fa62c036410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa62c037040 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa62c037040 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa6280c7070 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a4a70 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.667+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa62c037040 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa6280c7070 2024-09-10T14:28:53.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a4a70 2024-09-10T14:28:53.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a4a70 2024-09-10T14:28:53.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa62c037040 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a4a70 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a4a70 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.671+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa62c037040 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a4a70 2024-09-10T14:28:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa6280c7070 2024-09-10T14:28:53.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa62c037040 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a4a70 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa62c037040 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa6280c7070 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a4a70 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.675+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa62c037040 2024-09-10T14:28:53.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x55747a4a00d0 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a3d10 con 0x7fa6280c7070 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a7d60 con 0x55747a4a00d0 2024-09-10T14:28:53.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a8600 con 0x55747a4a00d0 2024-09-10T14:28:53.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a79a0 con 0x7fa62c037040 2024-09-10T14:28:53.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:53.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 zone default found 2024-09-10T14:28:53.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 4 Realm: () 2024-09-10T14:28:53.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 zonegroup default 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a8150 con 0x7fa62c037040 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a8570 con 0x55747a4a4a70 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4aaaf0 con 0x55747a4a4a70 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 started sync module instance, tier type = 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.679+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4a9f90 con 0x7fa6280c7070 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.683+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.683+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93958756279088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4aac00 con 0x7fa6280c7070 2024-09-10T14:28:53.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.683+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ab5c0 con 0x55747a4a00d0 2024-09-10T14:28:53.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.683+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93958756279088] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.683+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.683+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93958756282640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ab530 con 0x55747a4a00d0 2024-09-10T14:28:53.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.683+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ac340 con 0x55747a4a4a70 2024-09-10T14:28:53.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.687+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.687+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93958756286096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ac2b0 con 0x55747a4a4a70 2024-09-10T14:28:53.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.687+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ad280 con 0x7fa6280c7070 2024-09-10T14:28:53.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.687+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93958756282640] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.687+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.687+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93958756289872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ad670 con 0x7fa6280c7070 2024-09-10T14:28:53.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.687+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ae030 con 0x55747a4a00d0 2024-09-10T14:28:53.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.691+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93958756286096] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.691+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93958756289872] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.691+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.691+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93958756288304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4abaf0 con 0x55747a4a00d0 2024-09-10T14:28:53.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.691+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ae030 con 0x7fa62c037040 2024-09-10T14:28:53.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.691+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93958756288304] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.695+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.695+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93958756296256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4ae030 con 0x7fa62c037040 2024-09-10T14:28:53.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.695+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4af0f0 con 0x7fa62c037040 2024-09-10T14:28:53.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.695+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93958756296256] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.695+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.695+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93958756297664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4af2d0 con 0x7fa62c037040 2024-09-10T14:28:53.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.695+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4afb20 con 0x7fa62c037040 2024-09-10T14:28:53.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93958756297664] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93958756299472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4afba0 con 0x7fa62c037040 2024-09-10T14:28:53.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa637e24980 20 add_watcher() i=0 2024-09-10T14:28:53.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa637e24980 20 add_watcher() i=1 2024-09-10T14:28:53.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa637e24980 20 add_watcher() i=2 2024-09-10T14:28:53.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa637e24980 20 add_watcher() i=3 2024-09-10T14:28:53.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa637e24980 20 add_watcher() i=4 2024-09-10T14:28:53.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa637e24980 20 add_watcher() i=5 2024-09-10T14:28:53.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa637e24980 20 add_watcher() i=6 2024-09-10T14:28:53.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.699+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93958756299472] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 20 add_watcher() i=7 2024-09-10T14:28:53.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:53.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4b2e80 con 0x55747a4a00d0 2024-09-10T14:28:53.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93958756300896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4b0130 con 0x55747a4a00d0 2024-09-10T14:28:53.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93958756300896] v33'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa4e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 5 note: GC not initialized 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa4e67fc640 20 reqs_thread_entry: start 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 20 Filter name: none 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa457fff640 20 reqs_thread_entry: start 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d60c0 con 0x55747a4a00d0 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:53.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d7610 con 0x7fa6280c7070 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.703+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d7610 con 0x55747a4a00d0 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:65 4.37 4:ec57f35b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d9110 con 0x7fa62c037040 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:66 4.1c 4:380b0a52:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4dbda0 con 0x7fa62c037040 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 4.21 4:86275533:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4de760 con 0x7fa62c037040 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 4.21 4:87e847a3:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4e0fd0 con 0x7fa62c037040 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 4.32 4:4f67d3a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4e3ac0 con 0x55747a4a00d0 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 4.b 4:d373810a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4e6330 con 0x7fa6280c7070 2024-09-10T14:28:53.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 4.2d 4:b51c8fd0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4e8ba0 con 0x7fa62c037040 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:72 4.8 4:117e5d7e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4eb410 con 0x55747a4a4a70 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:73 4.35 4:afbf09d9:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4edc80 con 0x55747a4a00d0 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:74 4.6 4:6014ede5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4edc80 con 0x55747a4a4a70 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 4.1f 4:f8a1c4a6:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4f2e80 con 0x55747a4a4a70 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(69 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(72 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(73 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(75 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(74 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(67 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(65 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(66 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(71 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(68 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.707+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x7fa6280c7070 2024-09-10T14:28:53.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(76 foo.buckets [call] v33'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x7fa6280c7070 2024-09-10T14:28:53.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(77 foo.buckets [call] v33'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa637e24980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x55747a4a00d0 2024-09-10T14:28:53.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa637e24980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:53.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x7fa6280c7070 2024-09-10T14:28:53.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.711+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.715+0000 7fa4e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.715+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93958756300896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x55747a4a00d0 2024-09-10T14:28:53.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.715+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93958756300896] v33'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.715+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93958756279088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x7fa6280c7070 2024-09-10T14:28:53.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.715+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93958756279088] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.715+0000 7fa637e24980 20 remove_watcher() i=0 2024-09-10T14:28:53.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.715+0000 7fa637e24980 2 removed watcher, disabling cache 2024-09-10T14:28:53.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.715+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93958756282640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x55747a4a00d0 2024-09-10T14:28:53.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.719+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93958756282640] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.719+0000 7fa637e24980 20 remove_watcher() i=1 2024-09-10T14:28:53.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.719+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93958756286096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x55747a4a4a70 2024-09-10T14:28:53.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa635934640 1 -- 172.21.15.151:0/4230615916 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93958756286096] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6280ce070 con 0x55747a4a4a70 2024-09-10T14:28:53.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa637e24980 20 remove_watcher() i=2 2024-09-10T14:28:53.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93958756289872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d5200 con 0x7fa6280c7070 2024-09-10T14:28:53.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa635133640 1 -- 172.21.15.151:0/4230615916 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93958756289872] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa62c00e620 con 0x7fa6280c7070 2024-09-10T14:28:53.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa637e24980 20 remove_watcher() i=3 2024-09-10T14:28:53.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93958756288304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x55747a4a00d0 2024-09-10T14:28:53.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93958756288304] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x55747a4a00d0 2024-09-10T14:28:53.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa637e24980 20 remove_watcher() i=4 2024-09-10T14:28:53.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.723+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93958756296256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x7fa62c037040 2024-09-10T14:28:53.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.727+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93958756296256] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.727+0000 7fa637e24980 20 remove_watcher() i=5 2024-09-10T14:28:53.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.727+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93958756297664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x7fa62c037040 2024-09-10T14:28:53.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.727+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93958756297664] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.727+0000 7fa637e24980 20 remove_watcher() i=6 2024-09-10T14:28:53.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.727+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93958756299472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55747a4d75d0 con 0x7fa62c037040 2024-09-10T14:28:53.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93958756299472] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa63000a4d0 con 0x7fa62c037040 2024-09-10T14:28:53.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 20 remove_watcher() i=7 2024-09-10T14:28:53.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa62c037040 msgr2=0x7fa62c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa62c037040 0x7fa62c036410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a4a00d0 msgr2=0x55747a4a2570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a4a00d0 0x55747a4a2570 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa6280c7070 msgr2=0x7fa628119800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa6280c7070 0x7fa628119800 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a4a4a70 msgr2=0x55747a4a6e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a4a4a70 0x55747a4a6e60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5000346a0 msgr2=0x7fa500036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5000346a0 0x7fa500036b60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55747a46b5c0 tx=0x7fa62c010000 comp rx=0 tx=0).stop 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 msgr2=0x55747a494fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa636135640 1 -- 172.21.15.151:0/4230615916 reap_dead start 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a494fd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6280becb0 tx=0x7fa6280c2f60 comp rx=0 tx=0).stop 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 shutdown_connections 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/4230615916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a48de80 0x55747a494fd0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 >> 172.21.15.151:0/4230615916 conn(0x55747a48a1c0 msgr2=0x55747a488280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 shutdown_connections 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/4230615916 wait complete. 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/2198228201 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5100346a0 msgr2=0x7fa510036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/2198228201 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5100346a0 0x7fa510036b60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00bf60 tx=0x7fa62c00f000 comp rx=0 tx=0).stop 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/2198228201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a4814c0 msgr2=0x55747a4818e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/2198228201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a4814c0 0x55747a4818e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa628006530 tx=0x7fa6280be460 comp rx=0 tx=0).stop 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/2198228201 shutdown_connections 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/2198228201 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5100346a0 0x7fa510036b60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/2198228201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a4814c0 0x55747a4818e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/2198228201 >> 172.21.15.151:0/2198228201 conn(0x55747a476640 msgr2=0x55747a4790c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/2198228201 shutdown_connections 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/2198228201 wait complete. 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55747a470f30 msgr2=0x55747a473320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55747a470f30 0x55747a473320 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a36b6a0 msgr2=0x55747a46a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55747a36b6a0 0x55747a46a6c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a46d010 msgr2=0x55747a46f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55747a46d010 0x55747a46f400 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa51c034650 msgr2=0x7fa51c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa51c034650 0x7fa51c036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa62c000f70 tx=0x7fa62c0012c0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 msgr2=0x55747a463730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 --2- 172.21.15.151:0/1650067919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55747a2df2e0 0x55747a463730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b7040 tx=0x7fa628018020 comp rx=0 tx=0).stop 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa636135640 1 -- 172.21.15.151:0/1650067919 reap_dead start 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 shutdown_connections 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 >> 172.21.15.151:0/1650067919 conn(0x55747a3650a0 msgr2=0x55747a456c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 shutdown_connections 2024-09-10T14:28:53.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.731+0000 7fa637e24980 1 -- 172.21.15.151:0/1650067919 wait complete. 2024-09-10T14:28:53.748 INFO:teuthology.orchestra.run.smithi151.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-10T14:28:53.715902Z","last_stats_update":"2024-09-10T14:28:53.713671Z"} 2024-09-10T14:28:53.748 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-10T14:28:53.715902Z', 'last_stats_update': '2024-09-10T14:28:53.713671Z'} 2024-09-10T14:28:53.756 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:53.756 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T14:28:53.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T14:28:53.757 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-10T14:28:53.827 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:53.827 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:53.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f8732809980 1 Processor -- start 2024-09-10T14:28:53.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f8732809980 1 -- start start 2024-09-10T14:28:53.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f8732809980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55dad4887ad0 0x55dad4918780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f8732809980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dad479bae0 con 0x55dad4918cc0 2024-09-10T14:28:53.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f8732809980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55dad47bfe30 con 0x55dad4887ad0 2024-09-10T14:28:53.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f8730319640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55dad4887ad0 0x55dad4918780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f8730319640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55dad4887ad0 0x55dad4918780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49306/0 (socket says 172.21.15.151:49306) 2024-09-10T14:28:53.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f8730319640 1 -- 172.21.15.151:0/2502370513 learned_addr learned my addr 172.21.15.151:0/2502370513 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.823+0000 7f872fb18640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55dad4918cc0 0x55dad491b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44640/0 (socket says 172.21.15.151:44640) 2024-09-10T14:28:53.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.827+0000 7f8730319640 1 -- 172.21.15.151:0/2502370513 >> v1:172.21.15.52:6789/0 conn(0x55dad4918cc0 legacy=0x55dad491b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.827+0000 7f8730319640 1 -- 172.21.15.151:0/2502370513 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad4887eb0 con 0x55dad4887ad0 2024-09-10T14:28:53.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.827+0000 7f8730319640 1 --2- 172.21.15.151:0/2502370513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4918780 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f872800a4e0 tx=0x7f872801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab728b6a2c7647b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.827+0000 7f872f317640 1 -- 172.21.15.151:0/2502370513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280aa540 con 0x55dad4887ad0 2024-09-10T14:28:53.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.827+0000 7f872f317640 1 -- 172.21.15.151:0/2502370513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87280aa6e0 con 0x55dad4887ad0 2024-09-10T14:28:53.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.827+0000 7f872f317640 1 -- 172.21.15.151:0/2502370513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280aaa40 con 0x55dad4887ad0 2024-09-10T14:28:53.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.831+0000 7f8732809980 1 -- 172.21.15.151:0/2502370513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 msgr2=0x55dad4918780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.831+0000 7f8732809980 1 --2- 172.21.15.151:0/2502370513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4918780 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f872800a4e0 tx=0x7f872801b090 comp rx=0 tx=0).stop 2024-09-10T14:28:53.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.831+0000 7f8732809980 1 -- 172.21.15.151:0/2502370513 shutdown_connections 2024-09-10T14:28:53.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.831+0000 7f8732809980 1 --2- 172.21.15.151:0/2502370513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4918780 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.831+0000 7f8732809980 1 -- 172.21.15.151:0/2502370513 >> 172.21.15.151:0/2502370513 conn(0x55dad490e070 msgr2=0x55dad4910490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.831+0000 7f8732809980 1 -- 172.21.15.151:0/2502370513 shutdown_connections 2024-09-10T14:28:53.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.831+0000 7f8732809980 1 -- 172.21.15.151:0/2502370513 wait complete. 2024-09-10T14:28:53.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.843+0000 7f8732809980 1 Processor -- start 2024-09-10T14:28:53.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.843+0000 7f8732809980 1 -- start start 2024-09-10T14:28:53.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.843+0000 7f8732809980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a00c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.843+0000 7f8732809980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dad47c1200 con 0x55dad4887ad0 2024-09-10T14:28:53.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a00c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a00c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49314/0 (socket says 172.21.15.151:49314) 2024-09-10T14:28:53.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 -- 172.21.15.151:0/3423907073 learned_addr learned my addr 172.21.15.151:0/3423907073 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 -- 172.21.15.151:0/3423907073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad4a01200 con 0x55dad4887ad0 2024-09-10T14:28:53.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 --2- 172.21.15.151:0/3423907073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a00c30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8728017ca0 tx=0x7f87280033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456f3223f8cf3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f861e60c640 1 -- 172.21.15.151:0/3423907073 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280b9030 con 0x55dad4887ad0 2024-09-10T14:28:53.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f861e60c640 1 -- 172.21.15.151:0/3423907073 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87280aaaa0 con 0x55dad4887ad0 2024-09-10T14:28:53.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f861e60c640 1 -- 172.21.15.151:0/3423907073 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280aadc0 con 0x55dad4887ad0 2024-09-10T14:28:53.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 -- 172.21.15.151:0/3423907073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 msgr2=0x55dad4a00c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 --2- 172.21.15.151:0/3423907073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a00c30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8728017ca0 tx=0x7f87280033b0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 -- 172.21.15.151:0/3423907073 shutdown_connections 2024-09-10T14:28:53.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 --2- 172.21.15.151:0/3423907073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a00c30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 -- 172.21.15.151:0/3423907073 >> 172.21.15.151:0/3423907073 conn(0x55dad490e070 msgr2=0x55dad49fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 -- 172.21.15.151:0/3423907073 shutdown_connections 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 -- 172.21.15.151:0/3423907073 wait complete. 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 Processor -- start 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 -- start start 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a07e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8732809980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dad491f260 con 0x55dad4887ad0 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a07e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a07e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49318/0 (socket says 172.21.15.151:49318) 2024-09-10T14:28:53.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 -- 172.21.15.151:0/1655239373 learned_addr learned my addr 172.21.15.151:0/1655239373 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.847+0000 7f8730319640 1 -- 172.21.15.151:0/1655239373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad4a08370 con 0x55dad4887ad0 2024-09-10T14:28:53.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8730319640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a07e30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f872801b930 tx=0x7f8728017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f861ce09640 1 -- 172.21.15.151:0/1655239373 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280b9070 con 0x55dad4887ad0 2024-09-10T14:28:53.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dad4a08600 con 0x55dad4887ad0 2024-09-10T14:28:53.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f861ce09640 1 -- 172.21.15.151:0/1655239373 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87280c2070 con 0x55dad4887ad0 2024-09-10T14:28:53.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad4a0b2e0 con 0x55dad4887ad0 2024-09-10T14:28:53.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f861ce09640 1 -- 172.21.15.151:0/1655239373 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280b5c40 con 0x55dad4887ad0 2024-09-10T14:28:53.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f861ce09640 1 -- 172.21.15.151:0/1655239373 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f87280b3040 con 0x55dad4887ad0 2024-09-10T14:28:53.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f861ce09640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8618034650 0x7f8618036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f861ce09640 1 -- 172.21.15.151:0/1655239373 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f87280ba070 con 0x55dad4887ad0 2024-09-10T14:28:53.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f872fb18640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8618034650 0x7f8618036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8732809980 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4918cc0 0x55dad4a0edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a0f410 con 0x55dad4918cc0 2024-09-10T14:28:53.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8730b1a640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4918cc0 0x55dad4a0edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f872fb18640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8618034650 0x7f8618036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8724001e50 tx=0x7f87240013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8730b1a640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4918cc0 0x55dad4a0edc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8730b1a640 1 -- 172.21.15.151:0/1655239373 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4918cc0 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a0c4e0 con 0x55dad4918cc0 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8730b1a640 1 -- 172.21.15.151:0/1655239373 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4918cc0 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8732809980 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a11740 0x55dad4a13b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a14220 con 0x55dad4a11740 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.851+0000 7f8730319640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a11740 0x55dad4a13b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8730319640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a11740 0x55dad4a13b30 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8730319640 1 -- 172.21.15.151:0/1655239373 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87280c6cc0 con 0x55dad4a11740 2024-09-10T14:28:53.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a105e0 con 0x55dad4918cc0 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8730b1a640 1 -- 172.21.15.151:0/1655239373 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4918cc0 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8732809980 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dad4a15680 0x55dad4a17a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a181e0 con 0x55dad4a15680 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f872fb18640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dad4a15680 0x55dad4a17a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f872fb18640 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dad4a15680 0x55dad4a17a70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f872fb18640 1 -- 172.21.15.151:0/1655239373 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f872400f700 con 0x55dad4a15680 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8732809980 1 Processor -- start 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8732809980 1 -- start start 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8732809980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a25c50 0x55dad4a26070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8732809980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dad481a800 con 0x55dad4a25c50 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a25c50 0x55dad4a26070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a25c50 0x55dad4a26070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49328/0 (socket says 172.21.15.151:49328) 2024-09-10T14:28:53.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.855+0000 7f8730319640 1 -- 172.21.15.151:0/503282422 learned_addr learned my addr 172.21.15.151:0/503282422 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8730319640 1 -- 172.21.15.151:0/503282422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad4a265b0 con 0x55dad4a25c50 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8730319640 1 --2- 172.21.15.151:0/503282422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a25c50 0x55dad4a26070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f87280b4740 tx=0x7f87280cede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8615ffb640 1 -- 172.21.15.151:0/503282422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280b49e0 con 0x55dad4a25c50 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8615ffb640 1 -- 172.21.15.151:0/503282422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87280e9070 con 0x55dad4a25c50 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8732809980 1 -- 172.21.15.151:0/503282422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dad4a26840 con 0x55dad4a25c50 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8615ffb640 1 -- 172.21.15.151:0/503282422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280b4d30 con 0x55dad4a25c50 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8732809980 1 -- 172.21.15.151:0/503282422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad4a294c0 con 0x55dad4a25c50 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8615ffb640 1 -- 172.21.15.151:0/503282422 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f87280e4d10 con 0x55dad4a25c50 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8615ffb640 1 --2- 172.21.15.151:0/503282422 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f86080346a0 0x7f8608036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8615ffb640 1 -- 172.21.15.151:0/503282422 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f87280db070 con 0x55dad4a25c50 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f872fb18640 1 --2- 172.21.15.151:0/503282422 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f86080346a0 0x7f8608036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8732809980 1 Processor -- start 2024-09-10T14:28:53.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8732809980 1 -- start start 2024-09-10T14:28:53.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f872fb18640 1 --2- 172.21.15.151:0/503282422 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f86080346a0 0x7f8608036b60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55dad4a185c0 tx=0x7f872400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8732809980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a32920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8732809980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dad4a014c0 con 0x55dad4a32540 2024-09-10T14:28:53.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a32920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a32920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49344/0 (socket says 172.21.15.151:49344) 2024-09-10T14:28:53.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.859+0000 7f8730319640 1 -- 172.21.15.151:0/3977955908 learned_addr learned my addr 172.21.15.151:0/3977955908 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8730319640 1 -- 172.21.15.151:0/3977955908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad4a32ef0 con 0x55dad4a32540 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8730319640 1 --2- 172.21.15.151:0/3977955908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a32920 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f87280f0030 tx=0x7f87280eebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7380752a9f185c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f860f7fe640 1 -- 172.21.15.151:0/3977955908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280fd070 con 0x55dad4a32540 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f860f7fe640 1 -- 172.21.15.151:0/3977955908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87280d4e30 con 0x55dad4a32540 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f860f7fe640 1 -- 172.21.15.151:0/3977955908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280e1130 con 0x55dad4a32540 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- 172.21.15.151:0/3977955908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 msgr2=0x55dad4a32920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 --2- 172.21.15.151:0/3977955908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a32920 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f87280f0030 tx=0x7f87280eebb0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- 172.21.15.151:0/3977955908 shutdown_connections 2024-09-10T14:28:53.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 --2- 172.21.15.151:0/3977955908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a32920 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- 172.21.15.151:0/3977955908 >> 172.21.15.151:0/3977955908 conn(0x55dad4a2e920 msgr2=0x55dad4a2ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- 172.21.15.151:0/3977955908 shutdown_connections 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- 172.21.15.151:0/3977955908 wait complete. 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 Processor -- start 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- start start 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dad4a33390 con 0x55dad4a32540 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8730319640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a396c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49350/0 (socket says 172.21.15.151:49350) 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 learned_addr learned my addr 172.21.15.151:0/3263218809 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:53.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad4a39c00 con 0x55dad4a32540 2024-09-10T14:28:53.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8730319640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a396c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f87280e46b0 tx=0x7f87280ccf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f860dffb640 1 -- 172.21.15.151:0/3263218809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280eecf0 con 0x55dad4a32540 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dad4a39c00 con 0x55dad4a32540 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f860dffb640 1 -- 172.21.15.151:0/3263218809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87280d7e50 con 0x55dad4a32540 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f860dffb640 1 -- 172.21.15.151:0/3263218809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87280e1360 con 0x55dad4a32540 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.863+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad4a39c00 con 0x55dad4a32540 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f860dffb640 1 -- 172.21.15.151:0/3263218809 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f87280ee460 con 0x55dad4a32540 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f860dffb640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8600034600 0x7f8600036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f860dffb640 1 -- 172.21.15.151:0/3263218809 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f872810ec60 con 0x55dad4a32540 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f872fb18640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8600034600 0x7f8600036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4a447e0 0x55dad4a46ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a473f0 con 0x55dad4a447e0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8730b1a640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4a447e0 0x55dad4a46ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f872fb18640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8600034600 0x7f8600036ac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f872400baa0 tx=0x7f8724010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8730b1a640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4a447e0 0x55dad4a46ca0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 realm 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a47800 con 0x55dad4a447e0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a480d0 con 0x55dad4a447e0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a491d0 0x55dad4a4b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4bb80 con 0x55dad4a491d0 2024-09-10T14:28:53.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8730319640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a491d0 0x55dad4a4b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.867+0000 7f8730319640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a491d0 0x55dad4a4b5c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8732809980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8732809980 20 searching for the correct realm 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4d450 con 0x55dad4a491d0 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730319640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f87280e1910 0x7f87280bc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4d450 con 0x7f87280e1910 2024-09-10T14:28:53.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f872fb18640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f87280e1910 0x7f87280bc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f872fb18640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f87280e1910 0x7f87280bc960 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f872fb18640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f872403a3c0 0x7f872403a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4d450 con 0x7f872403a3c0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730b1a640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f872403a3c0 0x7f872403a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730b1a640 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f872403a3c0 0x7f872403a800 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.871+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f872403a3c0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f872403a3c0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f87280e1910 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a491d0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f872403a3c0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f87280e1910 2024-09-10T14:28:53.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a491d0 2024-09-10T14:28:53.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a491d0 2024-09-10T14:28:53.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.875+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f872403a3c0 2024-09-10T14:28:53.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a491d0 2024-09-10T14:28:53.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a491d0 2024-09-10T14:28:53.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f872403a3c0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a491d0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f87280e1910 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f872403a3c0 2024-09-10T14:28:53.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.879+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a491d0 2024-09-10T14:28:53.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f872403a3c0 2024-09-10T14:28:53.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f87280e1910 2024-09-10T14:28:53.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a491d0 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f872403a3c0 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x55dad4a447e0 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a48470 con 0x7f87280e1910 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4c570 con 0x55dad4a447e0 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4c1b0 con 0x55dad4a447e0 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:53.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.883+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4ce90 con 0x7f872403a3c0 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 zone default found 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 4 Realm: () 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 zonegroup default 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4d2c0 con 0x7f872403a3c0 2024-09-10T14:28:53.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4d2c0 con 0x55dad4a491d0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4f300 con 0x55dad4a491d0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 started sync module instance, tier type = 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:53.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4e700 con 0x7f87280e1910 2024-09-10T14:28:53.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94398358809328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4fc10 con 0x7f87280e1910 2024-09-10T14:28:53.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.887+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a50460 con 0x55dad4a447e0 2024-09-10T14:28:53.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.891+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94398358809328] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.891+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.891+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94398358812512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a50460 con 0x55dad4a447e0 2024-09-10T14:28:53.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.891+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a50f20 con 0x55dad4a491d0 2024-09-10T14:28:53.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.891+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94398358812512] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94398358814640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a503d0 con 0x55dad4a491d0 2024-09-10T14:28:53.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a51cb0 con 0x7f87280e1910 2024-09-10T14:28:53.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94398358823072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a52970 con 0x7f87280e1910 2024-09-10T14:28:53.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a53330 con 0x55dad4a447e0 2024-09-10T14:28:53.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94398358814640] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94398358823072] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94398358819600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a525d0 con 0x55dad4a447e0 2024-09-10T14:28:53.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.895+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a53330 con 0x7f872403a3c0 2024-09-10T14:28:53.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.899+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94398358819600] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.899+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.899+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94398358829376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a53330 con 0x7f872403a3c0 2024-09-10T14:28:53.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.899+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a543f0 con 0x7f872403a3c0 2024-09-10T14:28:53.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94398358830784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a54860 con 0x7f872403a3c0 2024-09-10T14:28:53.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a55340 con 0x7f872403a3c0 2024-09-10T14:28:53.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94398358829376] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94398358830784] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94398358834768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a543b0 con 0x7f872403a3c0 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 20 add_watcher() i=0 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 20 add_watcher() i=1 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 20 add_watcher() i=2 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 20 add_watcher() i=3 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 20 add_watcher() i=4 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 20 add_watcher() i=5 2024-09-10T14:28:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.903+0000 7f8732809980 20 add_watcher() i=6 2024-09-10T14:28:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94398358834768] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 20 add_watcher() i=7 2024-09-10T14:28:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a58440 con 0x55dad4a447e0 2024-09-10T14:28:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94398358826624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a558c0 con 0x55dad4a447e0 2024-09-10T14:28:53.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94398358826624] v33'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f85e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:53.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:53.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 5 note: GC not initialized 2024-09-10T14:28:53.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f85e57e2640 20 reqs_thread_entry: start 2024-09-10T14:28:53.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:53.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 20 Filter name: none 2024-09-10T14:28:53.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8556ffd640 20 reqs_thread_entry: start 2024-09-10T14:28:53.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:53.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a7b8c0 con 0x55dad4a447e0 2024-09-10T14:28:53.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.907+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a7d9a0 con 0x7f87280e1910 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a7f220 con 0x55dad4a447e0 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T14:28:53.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a80730 con 0x7f87280e1910 2024-09-10T14:28:53.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(65 foo.buckets [call] v33'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T14:28:53.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 20 rados->read ofs=0 len=0 2024-09-10T14:28:53.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a80280 con 0x7f87280e1910 2024-09-10T14:28:53.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:53.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T14:28:53.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:53.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:53.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.911+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a86760 con 0x7f87280e1910 2024-09-10T14:28:53.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f8732809980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T14:28:53.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f8732809980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:53.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f8732809980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T14:28:53.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94398359020144 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a83c50 con 0x7f872403a3c0 2024-09-10T14:28:53.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== watch-notify(notify (1) cookie 94398358830784 notify 141733920769 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55dad4a7f610 con 0x7f872403a3c0 2024-09-10T14:28:53.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f860f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94398358830784 notifier 4477 bl.length()=338 2024-09-10T14:28:53.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f860f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T14:28:53.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f860f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:53.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(68 notify.6 [notify cookie 94398359020144 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f860f7fe640 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f85f4003eb0 con 0x7f872403a3c0 2024-09-10T14:28:53.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.915+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== watch-notify(notify_complete (2) cookie 94398359020144 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dad4a7e790 con 0x7f872403a3c0 2024-09-10T14:28:53.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.919+0000 7f85e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:53.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.919+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94398358826624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a796f0 con 0x55dad4a447e0 2024-09-10T14:28:53.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.919+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94398358826624] v33'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.919+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94398358809328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a796f0 con 0x7f87280e1910 2024-09-10T14:28:53.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.919+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94398358809328] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.919+0000 7f8732809980 20 remove_watcher() i=0 2024-09-10T14:28:53.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.919+0000 7f8732809980 2 removed watcher, disabling cache 2024-09-10T14:28:53.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.919+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94398358812512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4eaf0 con 0x55dad4a447e0 2024-09-10T14:28:53.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.923+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94398358812512] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.923+0000 7f8732809980 20 remove_watcher() i=1 2024-09-10T14:28:53.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.923+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94398358814640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a796f0 con 0x55dad4a491d0 2024-09-10T14:28:53.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.923+0000 7f8730319640 1 -- 172.21.15.151:0/3263218809 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94398358814640] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8728113020 con 0x55dad4a491d0 2024-09-10T14:28:53.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.923+0000 7f8732809980 20 remove_watcher() i=2 2024-09-10T14:28:53.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.923+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94398358823072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4ffb0 con 0x7f87280e1910 2024-09-10T14:28:53.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.927+0000 7f872fb18640 1 -- 172.21.15.151:0/3263218809 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94398358823072] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8724037040 con 0x7f87280e1910 2024-09-10T14:28:53.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.927+0000 7f8732809980 20 remove_watcher() i=3 2024-09-10T14:28:53.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.927+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94398358819600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a520a0 con 0x55dad4a447e0 2024-09-10T14:28:53.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.927+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94398358819600] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x55dad4a447e0 2024-09-10T14:28:53.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.927+0000 7f8732809980 20 remove_watcher() i=4 2024-09-10T14:28:53.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.927+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94398358829376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a4ffb0 con 0x7f872403a3c0 2024-09-10T14:28:53.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.931+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94398358829376] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.931+0000 7f8732809980 20 remove_watcher() i=5 2024-09-10T14:28:53.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.931+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94398358830784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a51310 con 0x7f872403a3c0 2024-09-10T14:28:53.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.931+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94398358830784] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.931+0000 7f8732809980 20 remove_watcher() i=6 2024-09-10T14:28:53.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.931+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94398358834768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dad4a520a0 con 0x7f872403a3c0 2024-09-10T14:28:53.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94398358834768] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87200083f0 con 0x7f872403a3c0 2024-09-10T14:28:53.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 20 remove_watcher() i=7 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f872403a3c0 msgr2=0x7f872403a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f872403a3c0 0x7f872403a800 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4a447e0 msgr2=0x55dad4a46ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4a447e0 0x55dad4a46ca0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f87280e1910 msgr2=0x7f87280bc960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f87280e1910 0x7f87280bc960 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a491d0 msgr2=0x55dad4a4b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a491d0 0x55dad4a4b5c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8600034600 msgr2=0x7f8600036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8600034600 0x7f8600036ac0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f872400baa0 tx=0x7f8724010000 comp rx=0 tx=0).stop 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 msgr2=0x55dad4a396c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8730b1a640 1 -- 172.21.15.151:0/3263218809 reap_dead start 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a396c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f87280e46b0 tx=0x7f87280ccf70 comp rx=0 tx=0).stop 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 shutdown_connections 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/3263218809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a32540 0x55dad4a396c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 >> 172.21.15.151:0/3263218809 conn(0x55dad4a2e920 msgr2=0x55dad4a2c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 shutdown_connections 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/3263218809 wait complete. 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/503282422 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f86080346a0 msgr2=0x7f8608036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/503282422 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f86080346a0 0x7f8608036b60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55dad4a185c0 tx=0x7f872400f000 comp rx=0 tx=0).stop 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/503282422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a25c50 msgr2=0x55dad4a26070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/503282422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a25c50 0x55dad4a26070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f87280b4740 tx=0x7f87280cede0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/503282422 shutdown_connections 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/503282422 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f86080346a0 0x7f8608036b60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/503282422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4a25c50 0x55dad4a26070 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/503282422 >> 172.21.15.151:0/503282422 conn(0x55dad4a1ada0 msgr2=0x55dad4a1d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/503282422 shutdown_connections 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/503282422 wait complete. 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dad4a15680 msgr2=0x55dad4a17a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55dad4a15680 0x55dad4a17a70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4918cc0 msgr2=0x55dad4a0edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55dad4918cc0 0x55dad4a0edc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a11740 msgr2=0x55dad4a13b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55dad4a11740 0x55dad4a13b30 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8618034650 msgr2=0x7f8618036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8618034650 0x7f8618036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8724001e50 tx=0x7f87240013b0 comp rx=0 tx=0).stop 2024-09-10T14:28:53.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 msgr2=0x55dad4a07e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:53.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 --2- 172.21.15.151:0/1655239373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dad4887ad0 0x55dad4a07e30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f872801b930 tx=0x7f8728017e30 comp rx=0 tx=0).stop 2024-09-10T14:28:53.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8730b1a640 1 -- 172.21.15.151:0/1655239373 reap_dead start 2024-09-10T14:28:53.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 shutdown_connections 2024-09-10T14:28:53.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 >> 172.21.15.151:0/1655239373 conn(0x55dad490e070 msgr2=0x55dad49fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:53.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 shutdown_connections 2024-09-10T14:28:53.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:53.935+0000 7f8732809980 1 -- 172.21.15.151:0/1655239373 wait complete. 2024-09-10T14:28:53.951 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T14:28:53.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T14:28:53.951 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T14:28:54.035 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:54.035 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:54.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58fbc47980 1 Processor -- start 2024-09-10T14:28:54.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58fbc47980 1 -- start start 2024-09-10T14:28:54.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58fbc47980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563a13bf7ad0 0x563a13bf9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58fbc47980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563a13a7bae0 con 0x563a13b67b00 2024-09-10T14:28:54.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58fbc47980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x563a13a9fe30 con 0x563a13bf7ad0 2024-09-10T14:28:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58f0f56640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563a13bf7ad0 0x563a13bf9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58f0f56640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563a13bf7ad0 0x563a13bf9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49358/0 (socket says 172.21.15.151:49358) 2024-09-10T14:28:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58f9757640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x563a13b67b00 0x563a13bf63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44656/0 (socket says 172.21.15.151:44656) 2024-09-10T14:28:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.031+0000 7f58f0f56640 1 -- 172.21.15.151:0/1230619091 learned_addr learned my addr 172.21.15.151:0/1230619091 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58f0f56640 1 -- 172.21.15.151:0/1230619091 >> v1:172.21.15.52:6789/0 conn(0x563a13b67b00 legacy=0x563a13bf63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58f0f56640 1 -- 172.21.15.151:0/1230619091 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a13bfb410 con 0x563a13bf7ad0 2024-09-10T14:28:54.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58f0f56640 1 --2- 172.21.15.151:0/1230619091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 0x563a13bf9ec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f58e400a5c0 tx=0x7f58e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d279dbb632ab0cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58f8f56640 1 -- 172.21.15.151:0/1230619091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e40a6070 con 0x563a13bf7ad0 2024-09-10T14:28:54.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58f8f56640 1 -- 172.21.15.151:0/1230619091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e40af070 con 0x563a13bf7ad0 2024-09-10T14:28:54.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58f8f56640 1 -- 172.21.15.151:0/1230619091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e40aa5c0 con 0x563a13bf7ad0 2024-09-10T14:28:54.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58fbc47980 1 -- 172.21.15.151:0/1230619091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 msgr2=0x563a13bf9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58fbc47980 1 --2- 172.21.15.151:0/1230619091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 0x563a13bf9ec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f58e400a5c0 tx=0x7f58e401b340 comp rx=0 tx=0).stop 2024-09-10T14:28:54.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58fbc47980 1 -- 172.21.15.151:0/1230619091 shutdown_connections 2024-09-10T14:28:54.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58fbc47980 1 --2- 172.21.15.151:0/1230619091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 0x563a13bf9ec0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58fbc47980 1 -- 172.21.15.151:0/1230619091 >> 172.21.15.151:0/1230619091 conn(0x563a13bee0a0 msgr2=0x563a13bf04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58fbc47980 1 -- 172.21.15.151:0/1230619091 shutdown_connections 2024-09-10T14:28:54.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.035+0000 7f58fbc47980 1 -- 172.21.15.151:0/1230619091 wait complete. 2024-09-10T14:28:54.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.051+0000 7f58fbc47980 1 Processor -- start 2024-09-10T14:28:54.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.051+0000 7f58fbc47980 1 -- start start 2024-09-10T14:28:54.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.051+0000 7f58fbc47980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13b67b00 0x563a13bf3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.051+0000 7f58fbc47980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563a13aa1200 con 0x563a13b67b00 2024-09-10T14:28:54.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.051+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13b67b00 0x563a13bf3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.051+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13b67b00 0x563a13bf3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49370/0 (socket says 172.21.15.151:49370) 2024-09-10T14:28:54.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.051+0000 7f58f9757640 1 -- 172.21.15.151:0/377826999 learned_addr learned my addr 172.21.15.151:0/377826999 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.051+0000 7f58f9757640 1 -- 172.21.15.151:0/377826999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a13bf40e0 con 0x563a13b67b00 2024-09-10T14:28:54.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58f9757640 1 --2- 172.21.15.151:0/377826999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13b67b00 0x563a13bf3b10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f58ec001e50 tx=0x7f58ec001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74dc3136750bb10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f57e7606640 1 -- 172.21.15.151:0/377826999 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec00e5d0 con 0x563a13b67b00 2024-09-10T14:28:54.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f57e7606640 1 -- 172.21.15.151:0/377826999 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec00e770 con 0x563a13b67b00 2024-09-10T14:28:54.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f57e7606640 1 -- 172.21.15.151:0/377826999 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec00eab0 con 0x563a13b67b00 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- 172.21.15.151:0/377826999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13b67b00 msgr2=0x563a13bf3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 --2- 172.21.15.151:0/377826999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13b67b00 0x563a13bf3b10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f58ec001e50 tx=0x7f58ec001e80 comp rx=0 tx=0).stop 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- 172.21.15.151:0/377826999 shutdown_connections 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 --2- 172.21.15.151:0/377826999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13b67b00 0x563a13bf3b10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- 172.21.15.151:0/377826999 >> 172.21.15.151:0/377826999 conn(0x563a13bee0a0 msgr2=0x563a13cda790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- 172.21.15.151:0/377826999 shutdown_connections 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- 172.21.15.151:0/377826999 wait complete. 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 Processor -- start 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- start start 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 0x563a13ce8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563a13bfae50 con 0x563a13bf7ad0 2024-09-10T14:28:54.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 0x563a13ce8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 0x563a13ce8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49382/0 (socket says 172.21.15.151:49382) 2024-09-10T14:28:54.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58f9757640 1 -- 172.21.15.151:0/3821974509 learned_addr learned my addr 172.21.15.151:0/3821974509 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58f9757640 1 -- 172.21.15.151:0/3821974509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a13ce88c0 con 0x563a13bf7ad0 2024-09-10T14:28:54.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58f9757640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 0x563a13ce8380 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f58ec004000 tx=0x7f58ec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f57e5e03640 1 -- 172.21.15.151:0/3821974509 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec001260 con 0x563a13bf7ad0 2024-09-10T14:28:54.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a13ce8b50 con 0x563a13bf7ad0 2024-09-10T14:28:54.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a13ceb830 con 0x563a13bf7ad0 2024-09-10T14:28:54.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f57e5e03640 1 -- 172.21.15.151:0/3821974509 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec00f920 con 0x563a13bf7ad0 2024-09-10T14:28:54.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.055+0000 7f57e5e03640 1 -- 172.21.15.151:0/3821974509 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec02c060 con 0x563a13bf7ad0 2024-09-10T14:28:54.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f57e5e03640 1 -- 172.21.15.151:0/3821974509 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58ec017070 con 0x563a13bf7ad0 2024-09-10T14:28:54.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f57e5e03640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57e00346f0 0x7f57e0036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f57e5e03640 1 -- 172.21.15.151:0/3821974509 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58ec015020 con 0x563a13bf7ad0 2024-09-10T14:28:54.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57e00346f0 0x7f57e0036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13ced300 0x563a13cef730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13cefd20 con 0x563a13ced300 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f9f58640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13ced300 0x563a13cef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57e00346f0 0x7f57e0036bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f58e40ae000 tx=0x7f58e40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f9f58640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13ced300 0x563a13cef730 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f9f58640 1 -- 172.21.15.151:0/3821974509 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13ced300 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13ceca50 con 0x563a13ced300 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f9f58640 1 -- 172.21.15.151:0/3821974509 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13ced300 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13cf2070 0x563a13cf4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13cf4b30 con 0x563a13cf2070 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f9757640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13cf2070 0x563a13cf4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f9757640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13cf2070 0x563a13cf4460 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58f9757640 1 -- 172.21.15.151:0/3821974509 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13cf2070 2024-09-10T14:28:54.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.059+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13cf0f10 con 0x563a13ced300 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f9f58640 1 -- 172.21.15.151:0/3821974509 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13ced300 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563a13cf5f70 0x563a13cf8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13cf8af0 con 0x563a13cf5f70 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563a13cf5f70 0x563a13cf8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563a13cf5f70 0x563a13cf8360 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f0f56640 1 -- 172.21.15.151:0/3821974509 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f58e40aab60 con 0x563a13cf5f70 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58fbc47980 1 Processor -- start 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58fbc47980 1 -- start start 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58fbc47980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d06580 0x563a13d069a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58fbc47980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563a13afa800 con 0x563a13d06580 2024-09-10T14:28:54.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d06580 0x563a13d069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d06580 0x563a13d069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49394/0 (socket says 172.21.15.151:49394) 2024-09-10T14:28:54.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f9757640 1 -- 172.21.15.151:0/4209216329 learned_addr learned my addr 172.21.15.151:0/4209216329 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f9757640 1 -- 172.21.15.151:0/4209216329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a13d06ee0 con 0x563a13d06580 2024-09-10T14:28:54.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.063+0000 7f58f9757640 1 --2- 172.21.15.151:0/4209216329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d06580 0x563a13d069a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f58ec01ce20 tx=0x7f58ec012d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57deffd640 1 -- 172.21.15.151:0/4209216329 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec041070 con 0x563a13d06580 2024-09-10T14:28:54.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58fbc47980 1 -- 172.21.15.151:0/4209216329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a13d07170 con 0x563a13d06580 2024-09-10T14:28:54.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57deffd640 1 -- 172.21.15.151:0/4209216329 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec042460 con 0x563a13d06580 2024-09-10T14:28:54.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58fbc47980 1 -- 172.21.15.151:0/4209216329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a13d07170 con 0x563a13d06580 2024-09-10T14:28:54.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57deffd640 1 -- 172.21.15.151:0/4209216329 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec04f060 con 0x563a13d06580 2024-09-10T14:28:54.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57deffd640 1 -- 172.21.15.151:0/4209216329 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58ec03a070 con 0x563a13d06580 2024-09-10T14:28:54.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57deffd640 1 --2- 172.21.15.151:0/4209216329 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57d00346a0 0x7f57d0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57deffd640 1 -- 172.21.15.151:0/4209216329 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58ec047bb0 con 0x563a13d06580 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58f0f56640 1 --2- 172.21.15.151:0/4209216329 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57d00346a0 0x7f57d0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58fbc47980 1 Processor -- start 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58fbc47980 1 -- start start 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58f0f56640 1 --2- 172.21.15.151:0/4209216329 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57d00346a0 0x7f57d0036b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58e4018f70 tx=0x7f58e4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58fbc47980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d130f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58fbc47980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563a13bf2300 con 0x563a13d12d10 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49406/0 (socket says 172.21.15.151:49406) 2024-09-10T14:28:54.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58f9757640 1 -- 172.21.15.151:0/1604699838 learned_addr learned my addr 172.21.15.151:0/1604699838 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58f9757640 1 -- 172.21.15.151:0/1604699838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a13d136c0 con 0x563a13d12d10 2024-09-10T14:28:54.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f58f9757640 1 --2- 172.21.15.151:0/1604699838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d130f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f58ec012fd0 tx=0x7f58ec01dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c859f381f19f4794 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57dcff9640 1 -- 172.21.15.151:0/1604699838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec01be20 con 0x563a13d12d10 2024-09-10T14:28:54.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57dcff9640 1 -- 172.21.15.151:0/1604699838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec04a110 con 0x563a13d12d10 2024-09-10T14:28:54.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.067+0000 7f57dcff9640 1 -- 172.21.15.151:0/1604699838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec01d450 con 0x563a13d12d10 2024-09-10T14:28:54.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- 172.21.15.151:0/1604699838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 msgr2=0x563a13d130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 --2- 172.21.15.151:0/1604699838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d130f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f58ec012fd0 tx=0x7f58ec01dda0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- 172.21.15.151:0/1604699838 shutdown_connections 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 --2- 172.21.15.151:0/1604699838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d130f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- 172.21.15.151:0/1604699838 >> 172.21.15.151:0/1604699838 conn(0x563a13d0f040 msgr2=0x563a13d0d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- 172.21.15.151:0/1604699838 shutdown_connections 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- 172.21.15.151:0/1604699838 wait complete. 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 Processor -- start 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- start start 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d19e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563a13d13a50 con 0x563a13d12d10 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d19e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58f9757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d19e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49416/0 (socket says 172.21.15.151:49416) 2024-09-10T14:28:54.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 learned_addr learned my addr 172.21.15.151:0/3354915783 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a13d1a3c0 con 0x563a13d12d10 2024-09-10T14:28:54.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58f9757640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d19e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f58ec012fd0 tx=0x7f58ec03cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f57ceffd640 1 -- 172.21.15.151:0/3354915783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec06c020 con 0x563a13d12d10 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a13d1a3c0 con 0x563a13d12d10 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a13d1a3c0 con 0x563a13d12d10 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f57ceffd640 1 -- 172.21.15.151:0/3354915783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec0470d0 con 0x563a13d12d10 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f57ceffd640 1 -- 172.21.15.151:0/3354915783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ec0473b0 con 0x563a13d12d10 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f57ceffd640 1 -- 172.21.15.151:0/3354915783 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58ec06f020 con 0x563a13d12d10 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f57ceffd640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57c4034650 0x7f57c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f57ceffd640 1 -- 172.21.15.151:0/3354915783 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58ec06cce0 con 0x563a13d12d10 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57c4034650 0x7f57c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13d24f50 0x563a13d27410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.071+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d27b60 con 0x563a13d24f50 2024-09-10T14:28:54.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9f58640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13d24f50 0x563a13d27410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57c4034650 0x7f57c4036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58e401b380 tx=0x7f58e40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9f58640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13d24f50 0x563a13d27410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 realm 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d27f70 con 0x563a13d24f50 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28840 con 0x563a13d24f50 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13d29940 0x563a13d2bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2c300 con 0x563a13d29940 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9757640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13d29940 0x563a13d2bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9757640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13d29940 0x563a13d2bd30 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 20 searching for the correct realm 2024-09-10T14:28:54.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2dbd0 con 0x563a13d29940 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9757640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f58ec07a040 0x7f58ec0211e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2dbd0 con 0x7f58ec07a040 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f58ec07a040 0x7f58ec0211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f58ec07a040 0x7f58ec0211e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f0f56640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f58e40e0040 0x7f58e40e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.075+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2dbd0 con 0x7f58e40e0040 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f58e40e0040 0x7f58e40e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f58e40e0040 0x7f58e40e0930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58e40e0040 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58e40e0040 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58ec07a040 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.079+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d29940 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58e40e0040 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58ec07a040 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d29940 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d29940 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58e40e0040 2024-09-10T14:28:54.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d29940 2024-09-10T14:28:54.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d29940 2024-09-10T14:28:54.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.083+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58e40e0040 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d29940 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58ec07a040 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58e40e0040 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d29940 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58e40e0040 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58ec07a040 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d29940 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.087+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58e40e0040 2024-09-10T14:28:54.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x563a13d24f50 2024-09-10T14:28:54.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563a13d28be0 con 0x7f58ec07a040 2024-09-10T14:28:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2ccc0 con 0x563a13d24f50 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2c900 con 0x563a13d24f50 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2d5e0 con 0x7f58e40e0040 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 zone default found 2024-09-10T14:28:54.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 4 Realm: () 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 zonegroup default 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2da10 con 0x7f58e40e0040 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2da10 con 0x563a13d29940 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2fa60 con 0x563a13d29940 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 started sync module instance, tier type = 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.091+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2ee80 con 0x7f58ec07a040 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.095+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.095+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94807440683632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d2eae0 con 0x7f58ec07a040 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.095+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d30990 con 0x563a13d24f50 2024-09-10T14:28:54.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.095+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94807440683632] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.095+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.095+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94807440688352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d30db0 con 0x563a13d24f50 2024-09-10T14:28:54.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.095+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d31660 con 0x563a13d29940 2024-09-10T14:28:54.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.099+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.099+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94807440688352] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.099+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94807440690912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d31f30 con 0x563a13d29940 2024-09-10T14:28:54.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.099+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d30900 con 0x7f58ec07a040 2024-09-10T14:28:54.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.099+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.099+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94807440696656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d32f60 con 0x7f58ec07a040 2024-09-10T14:28:54.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.099+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d33a00 con 0x563a13d24f50 2024-09-10T14:28:54.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.099+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94807440690912] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.103+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94807440696656] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.103+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.103+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94807440700656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d329b0 con 0x563a13d24f50 2024-09-10T14:28:54.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.103+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d342d0 con 0x7f58e40e0040 2024-09-10T14:28:54.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.103+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94807440700656] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.103+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.103+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94807440693888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d34260 con 0x7f58e40e0040 2024-09-10T14:28:54.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.103+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d34c20 con 0x7f58e40e0040 2024-09-10T14:28:54.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.107+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.107+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94807440693888] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.107+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94807440705392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d34b90 con 0x7f58e40e0040 2024-09-10T14:28:54.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.107+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d35550 con 0x7f58e40e0040 2024-09-10T14:28:54.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.107+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94807440705392] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94807440702896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d35550 con 0x7f58e40e0040 2024-09-10T14:28:54.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 20 add_watcher() i=0 2024-09-10T14:28:54.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 20 add_watcher() i=1 2024-09-10T14:28:54.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 20 add_watcher() i=2 2024-09-10T14:28:54.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 20 add_watcher() i=3 2024-09-10T14:28:54.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 20 add_watcher() i=4 2024-09-10T14:28:54.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 20 add_watcher() i=5 2024-09-10T14:28:54.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 20 add_watcher() i=6 2024-09-10T14:28:54.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94807440702896] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 20 add_watcher() i=7 2024-09-10T14:28:54.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:54.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d38980 con 0x563a13d24f50 2024-09-10T14:28:54.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.111+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94807440708208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d35ed0 con 0x563a13d24f50 2024-09-10T14:28:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94807440708208] v33'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f57affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 5 note: GC not initialized 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f57aefe5640 20 reqs_thread_entry: start 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 20 Filter name: none 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f57acfe1640 20 reqs_thread_entry: start 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d5c090 con 0x7f58e40e0040 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T14:28:54.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d5a830 con 0x7f58e40e0040 2024-09-10T14:28:54.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T14:28:54.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:54.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T14:28:54.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T14:28:54.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.115+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d5b100 con 0x7f58e40e0040 2024-09-10T14:28:54.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v33'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58fbc47980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T14:28:54.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58fbc47980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:54.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58fbc47980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T14:28:54.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94807440862288 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d5fb30 con 0x7f58e40e0040 2024-09-10T14:28:54.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== watch-notify(notify (1) cookie 94807440693888 notify 141733920770 ret 0) ==== 598+0+0 (crc 0 0 0) 0x563a13d5b4a0 con 0x7f58e40e0040 2024-09-10T14:28:54.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f57dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94807440693888 notifier 4484 bl.length()=556 2024-09-10T14:28:54.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f57dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T14:28:54.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f57dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:54.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f57dcff9640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f57bc003eb0 con 0x7f58e40e0040 2024-09-10T14:28:54.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(65 notify.5 [notify cookie 94807440862288 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== watch-notify(notify_complete (2) cookie 94807440862288 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563a13d5bae0 con 0x7f58e40e0040 2024-09-10T14:28:54.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.119+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d5d660 con 0x7f58e40e0040 2024-09-10T14:28:54.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58fbc47980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T14:28:54.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58fbc47980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:54.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58fbc47980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T14:28:54.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94807440862128 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563a13d5fb30 con 0x563a13d29940 2024-09-10T14:28:54.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== watch-notify(notify (1) cookie 94807440690912 notify 141733920770 ret 0) ==== 219+0+0 (crc 0 0 0) 0x563a13d06ee0 con 0x563a13d29940 2024-09-10T14:28:54.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f57cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94807440690912 notifier 4484 bl.length()=177 2024-09-10T14:28:54.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f57cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T14:28:54.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f57cffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:54.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(68 notify.2 [notify cookie 94807440862128 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f57cffff640 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5720003410 con 0x563a13d29940 2024-09-10T14:28:54.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== watch-notify(notify_complete (2) cookie 94807440862128 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563a13ceb830 con 0x563a13d29940 2024-09-10T14:28:54.128 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T14:28:54.121440Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:54.121426Z","tags":[],"group_ids":[]} 2024-09-10T14:28:54.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f57affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94807440708208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d59e30 con 0x563a13d24f50 2024-09-10T14:28:54.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94807440708208] v33'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.123+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94807440683632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d59e30 con 0x7f58ec07a040 2024-09-10T14:28:54.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.127+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94807440683632] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.127+0000 7f58fbc47980 20 remove_watcher() i=0 2024-09-10T14:28:54.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.127+0000 7f58fbc47980 2 removed watcher, disabling cache 2024-09-10T14:28:54.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.127+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94807440688352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d59e30 con 0x563a13d24f50 2024-09-10T14:28:54.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.127+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94807440688352] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.127+0000 7f58fbc47980 20 remove_watcher() i=1 2024-09-10T14:28:54.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.127+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94807440690912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d304e0 con 0x563a13d29940 2024-09-10T14:28:54.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.131+0000 7f58f9757640 1 -- 172.21.15.151:0/3354915783 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94807440690912] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58ec02e070 con 0x563a13d29940 2024-09-10T14:28:54.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.131+0000 7f58fbc47980 20 remove_watcher() i=2 2024-09-10T14:28:54.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.131+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94807440696656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d59e30 con 0x7f58ec07a040 2024-09-10T14:28:54.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.131+0000 7f58f0f56640 1 -- 172.21.15.151:0/3354915783 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94807440696656] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e40aab60 con 0x7f58ec07a040 2024-09-10T14:28:54.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.131+0000 7f58fbc47980 20 remove_watcher() i=3 2024-09-10T14:28:54.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.131+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94807440700656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d304e0 con 0x563a13d24f50 2024-09-10T14:28:54.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.135+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94807440700656] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x563a13d24f50 2024-09-10T14:28:54.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.135+0000 7f58fbc47980 20 remove_watcher() i=4 2024-09-10T14:28:54.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.135+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94807440693888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d59e30 con 0x7f58e40e0040 2024-09-10T14:28:54.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.135+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94807440693888] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.135+0000 7f58fbc47980 20 remove_watcher() i=5 2024-09-10T14:28:54.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.135+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94807440705392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d334f0 con 0x7f58e40e0040 2024-09-10T14:28:54.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94807440705392] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 20 remove_watcher() i=6 2024-09-10T14:28:54.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94807440702896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563a13d304e0 con 0x7f58e40e0040 2024-09-10T14:28:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94807440702896] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f400a4d0 con 0x7f58e40e0040 2024-09-10T14:28:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 20 remove_watcher() i=7 2024-09-10T14:28:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f58e40e0040 msgr2=0x7f58e40e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f58e40e0040 0x7f58e40e0930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13d24f50 msgr2=0x563a13d27410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13d24f50 0x563a13d27410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f58ec07a040 msgr2=0x7f58ec0211e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f58ec07a040 0x7f58ec0211e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13d29940 msgr2=0x563a13d2bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13d29940 0x563a13d2bd30 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57c4034650 msgr2=0x7f57c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57c4034650 0x7f57c4036b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58e401b380 tx=0x7f58e40c1040 comp rx=0 tx=0).stop 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 msgr2=0x563a13d19e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58f9f58640 1 -- 172.21.15.151:0/3354915783 reap_dead start 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d19e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f58ec012fd0 tx=0x7f58ec03cf40 comp rx=0 tx=0).stop 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 shutdown_connections 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3354915783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d12d10 0x563a13d19e80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 >> 172.21.15.151:0/3354915783 conn(0x563a13d0f040 msgr2=0x563a13d0d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 shutdown_connections 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/3354915783 wait complete. 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/4209216329 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57d00346a0 msgr2=0x7f57d0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/4209216329 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57d00346a0 0x7f57d0036b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58e4018f70 tx=0x7f58e4005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/4209216329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d06580 msgr2=0x563a13d069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/4209216329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d06580 0x563a13d069a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f58ec01ce20 tx=0x7f58ec012d80 comp rx=0 tx=0).stop 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/4209216329 shutdown_connections 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/4209216329 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57d00346a0 0x7f57d0036b60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 --2- 172.21.15.151:0/4209216329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13d06580 0x563a13d069a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/4209216329 >> 172.21.15.151:0/4209216329 conn(0x563a13cfb6d0 msgr2=0x563a13cfe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/4209216329 shutdown_connections 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.139+0000 7f58fbc47980 1 -- 172.21.15.151:0/4209216329 wait complete. 2024-09-10T14:28:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563a13cf5f70 msgr2=0x563a13cf8360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563a13cf5f70 0x563a13cf8360 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13ced300 msgr2=0x563a13cef730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563a13ced300 0x563a13cef730 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13cf2070 msgr2=0x563a13cf4460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563a13cf2070 0x563a13cf4460 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57e00346f0 msgr2=0x7f57e0036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f57e00346f0 0x7f57e0036bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f58e40ae000 tx=0x7f58e40a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 msgr2=0x563a13ce8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 --2- 172.21.15.151:0/3821974509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a13bf7ad0 0x563a13ce8380 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f58ec004000 tx=0x7f58ec000bd0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58f9f58640 1 -- 172.21.15.151:0/3821974509 reap_dead start 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 shutdown_connections 2024-09-10T14:28:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 >> 172.21.15.151:0/3821974509 conn(0x563a13bee0a0 msgr2=0x563a13cda3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 shutdown_connections 2024-09-10T14:28:54.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.143+0000 7f58fbc47980 1 -- 172.21.15.151:0/3821974509 wait complete. 2024-09-10T14:28:54.157 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T14:28:54.121440Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:54.121426Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:54.164 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T14:28:54.170 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:54.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-10T14:28:54.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-10T14:28:54.171 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-10T14:28:54.235 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:54.235 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:54.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f7eef980 1 Processor -- start 2024-09-10T14:28:54.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f7eef980 1 -- start start 2024-09-10T14:28:54.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f7eef980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d0f710fc60 0x55d0f7112050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f7eef980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d0f6f91ae0 con 0x55d0f710b8e0 2024-09-10T14:28:54.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f7eef980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55d0f6fb5e30 con 0x55d0f710fc60 2024-09-10T14:28:54.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f51fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d0f710fc60 0x55d0f7112050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f51fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d0f710fc60 0x55d0f7112050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49432/0 (socket says 172.21.15.151:49432) 2024-09-10T14:28:54.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f59ff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d0f710b8e0 0x55d0f710bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44664/0 (socket says 172.21.15.151:44664) 2024-09-10T14:28:54.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f51fe640 1 -- 172.21.15.151:0/2360532178 learned_addr learned my addr 172.21.15.151:0/2360532178 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f51fe640 1 -- 172.21.15.151:0/2360532178 >> v1:172.21.15.52:6789/0 conn(0x55d0f710b8e0 legacy=0x55d0f710bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.231+0000 7f01f51fe640 1 -- 172.21.15.151:0/2360532178 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f71135a0 con 0x55d0f710fc60 2024-09-10T14:28:54.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f51fe640 1 --2- 172.21.15.151:0/2360532178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710fc60 0x55d0f7112050 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f01e000a5c0 tx=0x7f01e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe58974adb203c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f49fd640 1 -- 172.21.15.151:0/2360532178 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e00a6070 con 0x55d0f710fc60 2024-09-10T14:28:54.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f49fd640 1 -- 172.21.15.151:0/2360532178 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e00af070 con 0x55d0f710fc60 2024-09-10T14:28:54.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f49fd640 1 -- 172.21.15.151:0/2360532178 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e00aa5c0 con 0x55d0f710fc60 2024-09-10T14:28:54.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f7eef980 1 -- 172.21.15.151:0/2360532178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710fc60 msgr2=0x55d0f7112050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f7eef980 1 --2- 172.21.15.151:0/2360532178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710fc60 0x55d0f7112050 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f01e000a5c0 tx=0x7f01e001b340 comp rx=0 tx=0).stop 2024-09-10T14:28:54.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f7eef980 1 -- 172.21.15.151:0/2360532178 shutdown_connections 2024-09-10T14:28:54.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f7eef980 1 --2- 172.21.15.151:0/2360532178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710fc60 0x55d0f7112050 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f7eef980 1 -- 172.21.15.151:0/2360532178 >> 172.21.15.151:0/2360532178 conn(0x55d0f707f230 msgr2=0x55d0f707f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f7eef980 1 -- 172.21.15.151:0/2360532178 shutdown_connections 2024-09-10T14:28:54.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.235+0000 7f01f7eef980 1 -- 172.21.15.151:0/2360532178 wait complete. 2024-09-10T14:28:54.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f7eef980 1 Processor -- start 2024-09-10T14:28:54.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f7eef980 1 -- start start 2024-09-10T14:28:54.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f7eef980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f7eef980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0f6fb7200 con 0x55d0f710b8e0 2024-09-10T14:28:54.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49446/0 (socket says 172.21.15.151:49446) 2024-09-10T14:28:54.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f59ff640 1 -- 172.21.15.151:0/2906362083 learned_addr learned my addr 172.21.15.151:0/2906362083 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f59ff640 1 -- 172.21.15.151:0/2906362083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f71f71c0 con 0x55d0f710b8e0 2024-09-10T14:28:54.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.251+0000 7f01f59ff640 1 --2- 172.21.15.151:0/2906362083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71f6bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f01f0001690 tx=0x7f01f0001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e64cb50fd6969c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f00e3e07640 1 -- 172.21.15.151:0/2906362083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0003460 con 0x55d0f710b8e0 2024-09-10T14:28:54.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f00e3e07640 1 -- 172.21.15.151:0/2906362083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f0003600 con 0x55d0f710b8e0 2024-09-10T14:28:54.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f00e3e07640 1 -- 172.21.15.151:0/2906362083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0003920 con 0x55d0f710b8e0 2024-09-10T14:28:54.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- 172.21.15.151:0/2906362083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 msgr2=0x55d0f71f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 --2- 172.21.15.151:0/2906362083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71f6bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f01f0001690 tx=0x7f01f0001b50 comp rx=0 tx=0).stop 2024-09-10T14:28:54.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- 172.21.15.151:0/2906362083 shutdown_connections 2024-09-10T14:28:54.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 --2- 172.21.15.151:0/2906362083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71f6bf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- 172.21.15.151:0/2906362083 >> 172.21.15.151:0/2906362083 conn(0x55d0f707f230 msgr2=0x55d0f71f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- 172.21.15.151:0/2906362083 shutdown_connections 2024-09-10T14:28:54.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- 172.21.15.151:0/2906362083 wait complete. 2024-09-10T14:28:54.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 Processor -- start 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- start start 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71fdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0f71130a0 con 0x55d0f710b8e0 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71fdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71fdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49456/0 (socket says 172.21.15.151:49456) 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f59ff640 1 -- 172.21.15.151:0/3879564660 learned_addr learned my addr 172.21.15.151:0/3879564660 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f59ff640 1 -- 172.21.15.151:0/3879564660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f71fe460 con 0x55d0f710b8e0 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71fdf20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f01f0002260 tx=0x7f01f0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f00e2604640 1 -- 172.21.15.151:0/3879564660 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0022020 con 0x55d0f710b8e0 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0f71fe6f0 con 0x55d0f710b8e0 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f72013d0 con 0x55d0f710b8e0 2024-09-10T14:28:54.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f00e2604640 1 -- 172.21.15.151:0/3879564660 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f0006780 con 0x55d0f710b8e0 2024-09-10T14:28:54.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.255+0000 7f00e2604640 1 -- 172.21.15.151:0/3879564660 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f001e7c0 con 0x55d0f710b8e0 2024-09-10T14:28:54.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f00e2604640 1 -- 172.21.15.151:0/3879564660 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01f0025020 con 0x55d0f710b8e0 2024-09-10T14:28:54.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f00e2604640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00dc0346a0 0x7f00dc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f00e2604640 1 -- 172.21.15.151:0/3879564660 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f01f0049870 con 0x55d0f710b8e0 2024-09-10T14:28:54.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00dc0346a0 0x7f00dc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f710fc60 0x55d0f7205020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7205560 con 0x55d0f710fc60 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f6200640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f710fc60 0x55d0f7205020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00dc0346a0 0x7f00dc036b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01e00ae000 tx=0x7f01e00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f6200640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f710fc60 0x55d0f7205020 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f6200640 1 -- 172.21.15.151:0/3879564660 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f710fc60 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f72025f0 con 0x55d0f710fc60 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f6200640 1 -- 172.21.15.151:0/3879564660 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f710fc60 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f7207890 0x55d0f7209c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f720a350 con 0x55d0f7207890 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f7207890 0x55d0f7209c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f7207890 0x55d0f7209c80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f59ff640 1 -- 172.21.15.151:0/3879564660 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f7207890 2024-09-10T14:28:54.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7206730 con 0x55d0f710fc60 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f6200640 1 -- 172.21.15.151:0/3879564660 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f710fc60 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d0f720b790 0x55d0f720db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.259+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f720e310 con 0x55d0f720b790 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d0f720b790 0x55d0f720db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d0f720b790 0x55d0f720db80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f51fe640 1 -- 172.21.15.151:0/3879564660 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f01e00aaae0 con 0x55d0f720b790 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f7eef980 1 Processor -- start 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f7eef980 1 -- start start 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f7eef980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f721bda0 0x55d0f721c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f7eef980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7010800 con 0x55d0f721bda0 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f721bda0 0x55d0f721c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f721bda0 0x55d0f721c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49462/0 (socket says 172.21.15.151:49462) 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f59ff640 1 -- 172.21.15.151:0/3401841714 learned_addr learned my addr 172.21.15.151:0/3401841714 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f59ff640 1 -- 172.21.15.151:0/3401841714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f721c700 con 0x55d0f721bda0 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3401841714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f721bda0 0x55d0f721c1c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f01f0010fb0 tx=0x7f01f001ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f00db7fe640 1 -- 172.21.15.151:0/3401841714 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0041420 con 0x55d0f721bda0 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f7eef980 1 -- 172.21.15.151:0/3401841714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0f721c990 con 0x55d0f721bda0 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f00db7fe640 1 -- 172.21.15.151:0/3401841714 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f00415c0 con 0x55d0f721bda0 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f00db7fe640 1 -- 172.21.15.151:0/3401841714 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0049070 con 0x55d0f721bda0 2024-09-10T14:28:54.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.263+0000 7f01f7eef980 1 -- 172.21.15.151:0/3401841714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f721f610 con 0x55d0f721bda0 2024-09-10T14:28:54.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f00db7fe640 1 -- 172.21.15.151:0/3401841714 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01f0049210 con 0x55d0f721bda0 2024-09-10T14:28:54.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f00db7fe640 1 --2- 172.21.15.151:0/3401841714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00d0034650 0x7f00d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f00db7fe640 1 -- 172.21.15.151:0/3401841714 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f01f0013be0 con 0x55d0f721bda0 2024-09-10T14:28:54.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3401841714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00d0034650 0x7f00d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 Processor -- start 2024-09-10T14:28:54.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 -- start start 2024-09-10T14:28:54.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3401841714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00d0034650 0x7f00d0036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f01e0000c10 tx=0x7f01e0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f7228ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0f71f74e0 con 0x55d0f72286e0 2024-09-10T14:28:54.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f7228ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f7228ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49476/0 (socket says 172.21.15.151:49476) 2024-09-10T14:28:54.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f59ff640 1 -- 172.21.15.151:0/3977705440 learned_addr learned my addr 172.21.15.151:0/3977705440 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f59ff640 1 -- 172.21.15.151:0/3977705440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f72290b0 con 0x55d0f72286e0 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3977705440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f7228ae0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f01f0004fb0 tx=0x7f01f004afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4070e184643b480 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f00d97fa640 1 -- 172.21.15.151:0/3977705440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0058020 con 0x55d0f72286e0 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f00d97fa640 1 -- 172.21.15.151:0/3977705440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f0032d40 con 0x55d0f72286e0 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f00d97fa640 1 -- 172.21.15.151:0/3977705440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0041040 con 0x55d0f72286e0 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 -- 172.21.15.151:0/3977705440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 msgr2=0x55d0f7228ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3977705440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f7228ae0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f01f0004fb0 tx=0x7f01f004afb0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 -- 172.21.15.151:0/3977705440 shutdown_connections 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3977705440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f7228ae0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 -- 172.21.15.151:0/3977705440 >> 172.21.15.151:0/3977705440 conn(0x55d0f7224b10 msgr2=0x55d0f7222c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 -- 172.21.15.151:0/3977705440 shutdown_connections 2024-09-10T14:28:54.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.267+0000 7f01f7eef980 1 -- 172.21.15.151:0/3977705440 wait complete. 2024-09-10T14:28:54.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 1 Processor -- start 2024-09-10T14:28:54.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 1 -- start start 2024-09-10T14:28:54.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f722f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0f72290b0 con 0x55d0f72286e0 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f722f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f59ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f722f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49482/0 (socket says 172.21.15.151:49482) 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 learned_addr learned my addr 172.21.15.151:0/3538446228 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f722fcb0 con 0x55d0f72286e0 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f722f770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f01f001c4b0 tx=0x7f01f0013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f00c77fe640 1 -- 172.21.15.151:0/3538446228 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f001c690 con 0x55d0f72286e0 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0f722fcb0 con 0x55d0f72286e0 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f00c77fe640 1 -- 172.21.15.151:0/3538446228 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f001c8d0 con 0x55d0f72286e0 2024-09-10T14:28:54.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f00c77fe640 1 -- 172.21.15.151:0/3538446228 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0027400 con 0x55d0f72286e0 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f7230120 con 0x55d0f72286e0 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f00c77fe640 1 -- 172.21.15.151:0/3538446228 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01f005b020 con 0x55d0f72286e0 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f00c77fe640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00c0034650 0x7f00c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f00c77fe640 1 -- 172.21.15.151:0/3538446228 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f01f004f050 con 0x55d0f72286e0 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00c0034650 0x7f00c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f723a6d0 0x55d0f723cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.271+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723d2c0 con 0x55d0f723a6d0 2024-09-10T14:28:54.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f6200640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f723a6d0 0x55d0f723cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00c0034650 0x7f00c0036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01e00aa910 tx=0x7f01e00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f6200640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f723a6d0 0x55d0f723cb70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 realm 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723d6d0 con 0x55d0f723a6d0 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723df70 con 0x55d0f723a6d0 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f723f070 0x55d0f7241460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f72419e0 con 0x55d0f723f070 2024-09-10T14:28:54.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f723f070 0x55d0f7241460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f723f070 0x55d0f7241460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 20 searching for the correct realm 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7243280 con 0x55d0f723f070 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f59ff640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f01f005d040 0x7f01f00401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7243280 con 0x7f01f005d040 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f01f005d040 0x7f01f00401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f01f005d040 0x7f01f00401a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f51fe640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f01e00e0040 0x7f01e00e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.275+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7243280 con 0x7f01e00e0040 2024-09-10T14:28:54.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f01e00e0040 0x7f01e00e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f01e00e0040 0x7f01e00e0420 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01e00e0040 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01e00e0040 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01f005d040 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723f070 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.279+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01e00e0040 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01f005d040 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723f070 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723f070 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01e00e0040 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723f070 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723f070 2024-09-10T14:28:54.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.283+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01e00e0040 2024-09-10T14:28:54.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723f070 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01f005d040 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01e00e0040 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723f070 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01e00e0040 2024-09-10T14:28:54.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01f005d040 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723f070 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.287+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01e00e0040 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x55d0f723a6d0 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d0f723e310 con 0x7f01f005d040 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:54.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7242230 con 0x55d0f723a6d0 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7242620 con 0x55d0f723a6d0 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7242620 con 0x7f01e00e0040 2024-09-10T14:28:54.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:54.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 zone default found 2024-09-10T14:28:54.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 4 Realm: () 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 zonegroup default 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7242a40 con 0x7f01e00e0040 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7242a40 con 0x55d0f723f070 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.291+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7245130 con 0x55d0f723f070 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f7eef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f7eef980 20 started sync module instance, tier type = 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f7eef980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f72445d0 con 0x7f01f005d040 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94355987909056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7245980 con 0x7f01f005d040 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f72461d0 con 0x55d0f723a6d0 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94355987909056] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94355987911888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f72461d0 con 0x55d0f723a6d0 2024-09-10T14:28:54.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.295+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7246bf0 con 0x55d0f723f070 2024-09-10T14:28:54.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.299+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94355987911888] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.299+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.299+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94355987914016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7246140 con 0x55d0f723f070 2024-09-10T14:28:54.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.299+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7247940 con 0x7f01f005d040 2024-09-10T14:28:54.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.299+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.299+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94355987922224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7248600 con 0x7f01f005d040 2024-09-10T14:28:54.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.299+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7248fc0 con 0x55d0f723a6d0 2024-09-10T14:28:54.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.303+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94355987914016] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.303+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94355987922224] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.303+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.303+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94355987918816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7248260 con 0x55d0f723a6d0 2024-09-10T14:28:54.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.303+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7248fc0 con 0x7f01e00e0040 2024-09-10T14:28:54.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.307+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94355987918816] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.307+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.307+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94355987928528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7248fc0 con 0x7f01e00e0040 2024-09-10T14:28:54.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.307+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724a170 con 0x7f01e00e0040 2024-09-10T14:28:54.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.307+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94355987928528] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.307+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.307+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94355987926048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724a170 con 0x7f01e00e0040 2024-09-10T14:28:54.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.307+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724ab30 con 0x7f01e00e0040 2024-09-10T14:28:54.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94355987926048] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94355987930576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724ab30 con 0x7f01e00e0040 2024-09-10T14:28:54.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 20 add_watcher() i=0 2024-09-10T14:28:54.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 20 add_watcher() i=1 2024-09-10T14:28:54.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 20 add_watcher() i=2 2024-09-10T14:28:54.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 20 add_watcher() i=3 2024-09-10T14:28:54.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 20 add_watcher() i=4 2024-09-10T14:28:54.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 20 add_watcher() i=5 2024-09-10T14:28:54.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 20 add_watcher() i=6 2024-09-10T14:28:54.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94355987930576] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.311+0000 7f01f7eef980 20 add_watcher() i=7 2024-09-10T14:28:54.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:54.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724de30 con 0x55d0f723a6d0 2024-09-10T14:28:54.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94355987933168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724b0c0 con 0x55d0f723a6d0 2024-09-10T14:28:54.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94355987933168] v33'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f00a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 5 note: GC not initialized 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f00a67fc640 20 reqs_thread_entry: start 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 20 Filter name: none 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f0017fff640 20 reqs_thread_entry: start 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7270fb0 con 0x7f01f005d040 2024-09-10T14:28:54.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.315+0000 7f01f7eef980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:54.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.319+0000 7f00a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.319+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94355987933168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f726ef00 con 0x55d0f723a6d0 2024-09-10T14:28:54.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.319+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94355987933168] v33'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.319+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94355987909056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724a7f0 con 0x7f01f005d040 2024-09-10T14:28:54.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.319+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94355987909056] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.319+0000 7f01f7eef980 20 remove_watcher() i=0 2024-09-10T14:28:54.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.319+0000 7f01f7eef980 2 removed watcher, disabling cache 2024-09-10T14:28:54.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.319+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94355987911888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724a7f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.323+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94355987911888] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.323+0000 7f01f7eef980 20 remove_watcher() i=1 2024-09-10T14:28:54.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.323+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94355987914016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f72454d0 con 0x55d0f723f070 2024-09-10T14:28:54.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.323+0000 7f01f59ff640 1 -- 172.21.15.151:0/3538446228 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94355987914016] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01f001b040 con 0x55d0f723f070 2024-09-10T14:28:54.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.323+0000 7f01f7eef980 20 remove_watcher() i=2 2024-09-10T14:28:54.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.323+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94355987922224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724a7f0 con 0x7f01f005d040 2024-09-10T14:28:54.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.327+0000 7f01f51fe640 1 -- 172.21.15.151:0/3538446228 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94355987922224] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e00aaae0 con 0x7f01f005d040 2024-09-10T14:28:54.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.327+0000 7f01f7eef980 20 remove_watcher() i=3 2024-09-10T14:28:54.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.327+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94355987918816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7245d20 con 0x55d0f723a6d0 2024-09-10T14:28:54.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.327+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94355987918816] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x55d0f723a6d0 2024-09-10T14:28:54.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.327+0000 7f01f7eef980 20 remove_watcher() i=4 2024-09-10T14:28:54.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.327+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94355987928528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7247d30 con 0x7f01e00e0040 2024-09-10T14:28:54.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.331+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94355987928528] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.331+0000 7f01f7eef980 20 remove_watcher() i=5 2024-09-10T14:28:54.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.331+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94355987926048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f724a7f0 con 0x7f01e00e0040 2024-09-10T14:28:54.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.331+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94355987926048] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.331+0000 7f01f7eef980 20 remove_watcher() i=6 2024-09-10T14:28:54.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.331+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94355987930576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d0f7246fe0 con 0x7f01e00e0040 2024-09-10T14:28:54.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94355987930576] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e80083f0 con 0x7f01e00e0040 2024-09-10T14:28:54.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 20 remove_watcher() i=7 2024-09-10T14:28:54.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f01e00e0040 msgr2=0x7f01e00e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f01e00e0040 0x7f01e00e0420 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f723a6d0 msgr2=0x55d0f723cb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f723a6d0 0x55d0f723cb70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f01f005d040 msgr2=0x7f01f00401a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f01f005d040 0x7f01f00401a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f723f070 msgr2=0x55d0f7241460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f723f070 0x55d0f7241460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00c0034650 msgr2=0x7f00c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00c0034650 0x7f00c0036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01e00aa910 tx=0x7f01e00c1040 comp rx=0 tx=0).stop 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 msgr2=0x55d0f722f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3538446228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f72286e0 0x55d0f722f770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f01f001c4b0 tx=0x7f01f0013830 comp rx=0 tx=0).stop 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f6200640 1 -- 172.21.15.151:0/3538446228 reap_dead start 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 shutdown_connections 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 >> 172.21.15.151:0/3538446228 conn(0x55d0f7224b10 msgr2=0x55d0f7222be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 shutdown_connections 2024-09-10T14:28:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3538446228 wait complete. 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3401841714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00d0034650 msgr2=0x7f00d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3401841714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00d0034650 0x7f00d0036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f01e0000c10 tx=0x7f01e0005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3401841714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f721bda0 msgr2=0x55d0f721c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3401841714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f721bda0 0x55d0f721c1c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f01f0010fb0 tx=0x7f01f001ee30 comp rx=0 tx=0).stop 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3401841714 shutdown_connections 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3401841714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00d0034650 0x7f00d0036b10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3401841714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f721bda0 0x55d0f721c1c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3401841714 >> 172.21.15.151:0/3401841714 conn(0x55d0f7210ef0 msgr2=0x55d0f7213970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3401841714 shutdown_connections 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3401841714 wait complete. 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d0f720b790 msgr2=0x55d0f720db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d0f720b790 0x55d0f720db80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f710fc60 msgr2=0x55d0f7205020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d0f710fc60 0x55d0f7205020 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f7207890 msgr2=0x55d0f7209c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d0f7207890 0x55d0f7209c80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00dc0346a0 msgr2=0x7f00dc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f00dc0346a0 0x7f00dc036b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01e00ae000 tx=0x7f01e00a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 msgr2=0x55d0f71fdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 --2- 172.21.15.151:0/3879564660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f710b8e0 0x55d0f71fdf20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f01f0002260 tx=0x7f01f0001260 comp rx=0 tx=0).stop 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f6200640 1 -- 172.21.15.151:0/3879564660 reap_dead start 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 shutdown_connections 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 >> 172.21.15.151:0/3879564660 conn(0x55d0f707f230 msgr2=0x55d0f71f13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 shutdown_connections 2024-09-10T14:28:54.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.335+0000 7f01f7eef980 1 -- 172.21.15.151:0/3879564660 wait complete. 2024-09-10T14:28:54.351 INFO:teuthology.orchestra.run.smithi151.stdout:{"key":"bucket:myfoo","ver":{"tag":"_p8l1Iu5nSTIbMITH3ks-R8H","ver":2},"mtime":"2024-09-10T14:28:53.918615Z","data":{"bucket":{"name":"myfoo","marker":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","bucket_id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-10T14:28:52.346429Z","linked":false,"has_bucket_info":false}} 2024-09-10T14:28:54.351 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_p8l1Iu5nSTIbMITH3ks-R8H', 'ver': 2}, 'mtime': '2024-09-10T14:28:53.918615Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'bucket_id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-10T14:28:52.346429Z', 'linked': False, 'has_bucket_info': False}} 2024-09-10T14:28:54.351 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1'] 2024-09-10T14:28:54.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1'] 2024-09-10T14:28:54.351 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:54.435 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:54.435 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:54.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f49f6b980 1 Processor -- start 2024-09-10T14:28:54.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f49f6b980 1 -- start start 2024-09-10T14:28:54.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f49f6b980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x558cc563e630 0x558cc563ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f49f6b980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558cc54c6ae0 con 0x558cc563ef80 2024-09-10T14:28:54.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f49f6b980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x558cc54eae30 con 0x558cc563e630 2024-09-10T14:28:54.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f47a7b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x558cc563e630 0x558cc563ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f47a7b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x558cc563e630 0x558cc563ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49492/0 (socket says 172.21.15.151:49492) 2024-09-10T14:28:54.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f4727a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x558cc563ef80 0x558cc56439b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44676/0 (socket says 172.21.15.151:44676) 2024-09-10T14:28:54.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f47a7b640 1 -- 172.21.15.151:0/529078737 learned_addr learned my addr 172.21.15.151:0/529078737 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f47a7b640 1 -- 172.21.15.151:0/529078737 >> v1:172.21.15.52:6789/0 conn(0x558cc563ef80 legacy=0x558cc56439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.431+0000 7f6f47a7b640 1 -- 172.21.15.151:0/529078737 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc5646200 con 0x558cc563e630 2024-09-10T14:28:54.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/529078737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc563ea10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800a5c0 tx=0x7f6f3801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25003411cce8b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f46a79640 1 -- 172.21.15.151:0/529078737 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380a6070 con 0x558cc563e630 2024-09-10T14:28:54.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f46a79640 1 -- 172.21.15.151:0/529078737 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380af070 con 0x558cc563e630 2024-09-10T14:28:54.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f46a79640 1 -- 172.21.15.151:0/529078737 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380aa5c0 con 0x558cc563e630 2024-09-10T14:28:54.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f49f6b980 1 -- 172.21.15.151:0/529078737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 msgr2=0x558cc563ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/529078737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc563ea10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800a5c0 tx=0x7f6f3801b340 comp rx=0 tx=0).stop 2024-09-10T14:28:54.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f49f6b980 1 -- 172.21.15.151:0/529078737 shutdown_connections 2024-09-10T14:28:54.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/529078737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc563ea10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f49f6b980 1 -- 172.21.15.151:0/529078737 >> 172.21.15.151:0/529078737 conn(0x558cc563a150 msgr2=0x558cc563c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f49f6b980 1 -- 172.21.15.151:0/529078737 shutdown_connections 2024-09-10T14:28:54.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.435+0000 7f6f49f6b980 1 -- 172.21.15.151:0/529078737 wait complete. 2024-09-10T14:28:54.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.451+0000 7f6f49f6b980 1 Processor -- start 2024-09-10T14:28:54.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.451+0000 7f6f49f6b980 1 -- start start 2024-09-10T14:28:54.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.451+0000 7f6f49f6b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc5729a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.451+0000 7f6f49f6b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558cc54ec200 con 0x558cc563e630 2024-09-10T14:28:54.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.451+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc5729a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.451+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc5729a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49504/0 (socket says 172.21.15.151:49504) 2024-09-10T14:28:54.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.451+0000 7f6f47a7b640 1 -- 172.21.15.151:0/8148242 learned_addr learned my addr 172.21.15.151:0/8148242 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.451+0000 7f6f47a7b640 1 -- 172.21.15.151:0/8148242 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc572a000 con 0x558cc563e630 2024-09-10T14:28:54.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/8148242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc5729a30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6f380199f0 tx=0x7f6f38003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510829f699d69e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6e35e0b640 1 -- 172.21.15.151:0/8148242 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380aaa00 con 0x558cc563e630 2024-09-10T14:28:54.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6e35e0b640 1 -- 172.21.15.151:0/8148242 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380aaba0 con 0x558cc563e630 2024-09-10T14:28:54.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6e35e0b640 1 -- 172.21.15.151:0/8148242 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380bd3f0 con 0x558cc563e630 2024-09-10T14:28:54.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- 172.21.15.151:0/8148242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 msgr2=0x558cc5729a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/8148242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc5729a30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6f380199f0 tx=0x7f6f38003030 comp rx=0 tx=0).stop 2024-09-10T14:28:54.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- 172.21.15.151:0/8148242 shutdown_connections 2024-09-10T14:28:54.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/8148242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563e630 0x558cc5729a30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- 172.21.15.151:0/8148242 >> 172.21.15.151:0/8148242 conn(0x558cc563a150 msgr2=0x558cc5725660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- 172.21.15.151:0/8148242 shutdown_connections 2024-09-10T14:28:54.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- 172.21.15.151:0/8148242 wait complete. 2024-09-10T14:28:54.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 Processor -- start 2024-09-10T14:28:54.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- start start 2024-09-10T14:28:54.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563ef80 0x558cc55b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558cc5645c40 con 0x558cc563ef80 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563ef80 0x558cc55b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563ef80 0x558cc55b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49514/0 (socket says 172.21.15.151:49514) 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f47a7b640 1 -- 172.21.15.151:0/951890579 learned_addr learned my addr 172.21.15.151:0/951890579 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f47a7b640 1 -- 172.21.15.151:0/951890579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc55b59d0 con 0x558cc563ef80 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563ef80 0x558cc55b5490 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6f380199f0 tx=0x7f6f380180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6e2ffff640 1 -- 172.21.15.151:0/951890579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380c6690 con 0x558cc563ef80 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc55b3bb0 con 0x558cc563ef80 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc55b40a0 con 0x558cc563ef80 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6e2ffff640 1 -- 172.21.15.151:0/951890579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380c6830 con 0x558cc563ef80 2024-09-10T14:28:54.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.455+0000 7f6e2ffff640 1 -- 172.21.15.151:0/951890579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380c6b10 con 0x558cc563ef80 2024-09-10T14:28:54.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6e2ffff640 1 -- 172.21.15.151:0/951890579 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6f380ce020 con 0x558cc563ef80 2024-09-10T14:28:54.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6e2ffff640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e300346f0 0x7f6e30036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6e2ffff640 1 -- 172.21.15.151:0/951890579 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6f380cc020 con 0x558cc563ef80 2024-09-10T14:28:54.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f4727a640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e300346f0 0x7f6e30036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5738300 0x558cc573a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc573ac30 con 0x558cc5738300 2024-09-10T14:28:54.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f4827c640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5738300 0x558cc573a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f4727a640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e300346f0 0x7f6e30036bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c001e50 tx=0x7f6f3c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f4827c640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5738300 0x558cc573a6f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f4827c640 1 -- 172.21.15.151:0/951890579 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5738300 2024-09-10T14:28:54.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc573afd0 con 0x558cc5738300 2024-09-10T14:28:54.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f4827c640 1 -- 172.21.15.151:0/951890579 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5738300 2024-09-10T14:28:54.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc573cdc0 0x558cc573f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc573f880 con 0x558cc573cdc0 2024-09-10T14:28:54.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc573cdc0 0x558cc573f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.459+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc573cdc0 0x558cc573f1b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f47a7b640 1 -- 172.21.15.151:0/951890579 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6f380d09d0 con 0x558cc573cdc0 2024-09-10T14:28:54.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc573bc60 con 0x558cc5738300 2024-09-10T14:28:54.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f4827c640 1 -- 172.21.15.151:0/951890579 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5738300 2024-09-10T14:28:54.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x558cc5740cc0 0x558cc57430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc5743840 con 0x558cc5740cc0 2024-09-10T14:28:54.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f4727a640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x558cc5740cc0 0x558cc57430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f4727a640 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x558cc5740cc0 0x558cc57430b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f4727a640 1 -- 172.21.15.151:0/951890579 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6f3c00f700 con 0x558cc5740cc0 2024-09-10T14:28:54.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f49f6b980 1 Processor -- start 2024-09-10T14:28:54.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f49f6b980 1 -- start start 2024-09-10T14:28:54.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f49f6b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc57512d0 0x558cc57516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f49f6b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558cc5545800 con 0x558cc57512d0 2024-09-10T14:28:54.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc57512d0 0x558cc57516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc57512d0 0x558cc57516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49528/0 (socket says 172.21.15.151:49528) 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f47a7b640 1 -- 172.21.15.151:0/800787564 learned_addr learned my addr 172.21.15.151:0/800787564 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.463+0000 7f6f47a7b640 1 -- 172.21.15.151:0/800787564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc5751c30 con 0x558cc57512d0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/800787564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc57512d0 0x558cc57516f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6f380e3660 tx=0x7f6f380de0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6e2d7fa640 1 -- 172.21.15.151:0/800787564 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380e3130 con 0x558cc57512d0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f49f6b980 1 -- 172.21.15.151:0/800787564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc5751ec0 con 0x558cc57512d0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6e2d7fa640 1 -- 172.21.15.151:0/800787564 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380e32d0 con 0x558cc57512d0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6e2d7fa640 1 -- 172.21.15.151:0/800787564 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380c53e0 con 0x558cc57512d0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f49f6b980 1 -- 172.21.15.151:0/800787564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc5754b40 con 0x558cc57512d0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6e2d7fa640 1 -- 172.21.15.151:0/800787564 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6f380c5580 con 0x558cc57512d0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6e2d7fa640 1 --2- 172.21.15.151:0/800787564 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e20034650 0x7f6e20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6e2d7fa640 1 -- 172.21.15.151:0/800787564 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6f380efc50 con 0x558cc57512d0 2024-09-10T14:28:54.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f4727a640 1 --2- 172.21.15.151:0/800787564 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e20034650 0x7f6e20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f49f6b980 1 Processor -- start 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f49f6b980 1 -- start start 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f4727a640 1 --2- 172.21.15.151:0/800787564 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e20034650 0x7f6e20036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x558cc5743c40 tx=0x7f6f3c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f49f6b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc575dbf0 0x558cc575dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f49f6b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558cc572a2c0 con 0x558cc575dbf0 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc575dbf0 0x558cc575dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc575dbf0 0x558cc575dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49530/0 (socket says 172.21.15.151:49530) 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f47a7b640 1 -- 172.21.15.151:0/2135322992 learned_addr learned my addr 172.21.15.151:0/2135322992 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f47a7b640 1 -- 172.21.15.151:0/2135322992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc575e5c0 con 0x558cc575dbf0 2024-09-10T14:28:54.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/2135322992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc575dbf0 0x558cc575dff0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6f380d8f80 tx=0x7f6f380b3610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21010940120911a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6e26ffd640 1 -- 172.21.15.151:0/2135322992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380a7290 con 0x558cc575dbf0 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.467+0000 7f6e26ffd640 1 -- 172.21.15.151:0/2135322992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380c73f0 con 0x558cc575dbf0 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6e26ffd640 1 -- 172.21.15.151:0/2135322992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380dc450 con 0x558cc575dbf0 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- 172.21.15.151:0/2135322992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc575dbf0 msgr2=0x558cc575dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/2135322992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc575dbf0 0x558cc575dff0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6f380d8f80 tx=0x7f6f380b3610 comp rx=0 tx=0).stop 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- 172.21.15.151:0/2135322992 shutdown_connections 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/2135322992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc575dbf0 0x558cc575dff0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- 172.21.15.151:0/2135322992 >> 172.21.15.151:0/2135322992 conn(0x558cc5759fd0 msgr2=0x558cc57580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- 172.21.15.151:0/2135322992 shutdown_connections 2024-09-10T14:28:54.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- 172.21.15.151:0/2135322992 wait complete. 2024-09-10T14:28:54.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 Processor -- start 2024-09-10T14:28:54.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- start start 2024-09-10T14:28:54.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc5764f50 0x558cc5765370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558cc575ea40 con 0x558cc5764f50 2024-09-10T14:28:54.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc5764f50 0x558cc5765370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f47a7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc5764f50 0x558cc5765370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49536/0 (socket says 172.21.15.151:49536) 2024-09-10T14:28:54.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 learned_addr learned my addr 172.21.15.151:0/56999648 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc57658b0 con 0x558cc5764f50 2024-09-10T14:28:54.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc5764f50 0x558cc5765370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6f380c3fd0 tx=0x7f6f380d8f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6e257fa640 1 -- 172.21.15.151:0/56999648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380a7290 con 0x558cc5764f50 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc57658b0 con 0x558cc5764f50 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc57658b0 con 0x558cc5764f50 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6e257fa640 1 -- 172.21.15.151:0/56999648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380b7ac0 con 0x558cc5764f50 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.471+0000 7f6e257fa640 1 -- 172.21.15.151:0/56999648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f380b7da0 con 0x558cc5764f50 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6e257fa640 1 -- 172.21.15.151:0/56999648 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6f38114020 con 0x558cc5764f50 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6e257fa640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e100346a0 0x7f6e10036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6e257fa640 1 -- 172.21.15.151:0/56999648 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6f38112020 con 0x558cc5764f50 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4727a640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e100346a0 0x7f6e10036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5770400 0x558cc57728c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc5773010 con 0x558cc5770400 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4827c640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5770400 0x558cc57728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4727a640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e100346a0 0x7f6e10036b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00baa0 tx=0x7f6f3c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4827c640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5770400 0x558cc57728c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 realm 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc5773420 con 0x558cc5770400 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:54.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc5773cf0 con 0x558cc5770400 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc5774df0 0x558cc57771e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57777b0 con 0x558cc5774df0 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc5774df0 0x558cc57771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc5774df0 0x558cc57771e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 20 searching for the correct realm 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5779080 con 0x558cc5774df0 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f47a7b640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x558cc575dbf0 0x7f6f380d87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5779080 con 0x558cc575dbf0 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.475+0000 7f6f4727a640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x558cc575dbf0 0x7f6f380d87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4727a640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x558cc575dbf0 0x7f6f380d87d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4727a640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6f3c03a3c0 0x7f6f3c03a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5779080 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6f3c03a3c0 0x7f6f3c03a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6f3c03a3c0 0x7f6f3c03a800 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.479+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc575dbf0 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5774df0 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc575dbf0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5774df0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5774df0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5774df0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.483+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5774df0 2024-09-10T14:28:54.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5774df0 2024-09-10T14:28:54.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc575dbf0 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5774df0 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.487+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc575dbf0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5774df0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc5770400 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558cc5774090 con 0x558cc575dbf0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57781a0 con 0x558cc5770400 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc5778a40 con 0x558cc5770400 2024-09-10T14:28:54.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc5778590 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 zone default found 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 4 Realm: () 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 zonegroup default 2024-09-10T14:28:54.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.491+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57789c0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc577ae90 con 0x558cc5774df0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc577b230 con 0x558cc5774df0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 20 started sync module instance, tier type = 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577a330 con 0x558cc575dbf0 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94063096733312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577b230 con 0x558cc575dbf0 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577bae0 con 0x558cc5770400 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.495+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94063096733312] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.499+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.499+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94063096739280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577bed0 con 0x558cc5770400 2024-09-10T14:28:54.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.499+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577c890 con 0x558cc5774df0 2024-09-10T14:28:54.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.499+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94063096739280] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.499+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.499+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94063096735568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577c890 con 0x558cc5774df0 2024-09-10T14:28:54.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.499+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577d2a0 con 0x558cc575dbf0 2024-09-10T14:28:54.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.503+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.503+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94063096745456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577daf0 con 0x558cc575dbf0 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.503+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577e510 con 0x558cc5770400 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.503+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94063096735568] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.503+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94063096745456] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.503+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.503+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94063096747584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577c3e0 con 0x558cc5770400 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.503+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577edb0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.507+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94063096747584] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.507+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.507+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94063096750080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577ed10 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.507+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577f6d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.507+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.507+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94063096754720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577faf0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.507+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc5780570 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.507+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94063096750080] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94063096754720] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94063096752224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577faf0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 20 add_watcher() i=0 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 20 add_watcher() i=1 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 20 add_watcher() i=2 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 20 add_watcher() i=3 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 20 add_watcher() i=4 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 20 add_watcher() i=5 2024-09-10T14:28:54.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 20 add_watcher() i=6 2024-09-10T14:28:54.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94063096752224] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 20 add_watcher() i=7 2024-09-10T14:28:54.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:54.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.511+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57835a0 con 0x558cc5770400 2024-09-10T14:28:54.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94063096756240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc5780a20 con 0x558cc5770400 2024-09-10T14:28:54.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94063096756240] v33'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6dfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 5 note: GC not initialized 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6dfcfe1640 20 reqs_thread_entry: start 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 Filter name: none 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6d767fc640 20 reqs_thread_entry: start 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a6ae0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a8bc0 con 0x558cc575dbf0 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:54.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.515+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57aa490 con 0x558cc5770400 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(64 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:54.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:54.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T14:28:54.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57aea90 con 0x558cc575dbf0 2024-09-10T14:28:54.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(65 foo.buckets [call] v33'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.519+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57b49b0 con 0x558cc5770400 2024-09-10T14:28:54.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(66 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:54.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1, ofs0, ns] 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94063096929600 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57aeec0 con 0x558cc575dbf0 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== watch-notify(notify (1) cookie 94063096733312 notify 141733920787 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f6f3c018040 con 0x558cc575dbf0 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6e26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 94063096733312 notifier 4498 bl.length()=752 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6e26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6e26ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6e26ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [notify cookie 94063096929600 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6e26ffd640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f6e0c003eb0 con 0x558cc575dbf0 2024-09-10T14:28:54.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== watch-notify(notify_complete (2) cookie 94063096929600 notify 141733920787 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558cc54c6ae0 con 0x558cc575dbf0 2024-09-10T14:28:54.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_sources= new_sources= 2024-09-10T14:28:54.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential sources added=[] removed=[] 2024-09-10T14:28:54.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_dests= new_dests= 2024-09-10T14:28:54.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential dests added=[] removed=[] 2024-09-10T14:28:54.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.523+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a9d40 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 fud.buckets [call] v33'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a9d40 con 0x558cc575dbf0 2024-09-10T14:28:54.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f49f6b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T14:28:54.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f49f6b980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:54.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f49f6b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T14:28:54.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94063096929600 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558cc57b3660 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== watch-notify(notify (1) cookie 94063096754720 notify 141733920771 ret 0) ==== 356+0+0 (crc 0 0 0) 0x558cc57a99b0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6e267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94063096754720 notifier 4498 bl.length()=314 2024-09-10T14:28:54.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6e267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T14:28:54.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6e267fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:54.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(71 notify.6 [notify cookie 94063096929600 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.527+0000 7f6e267fc640 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f6d7c003410 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.531+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== watch-notify(notify_complete (2) cookie 94063096929600 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6f4002d040 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.531+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.531+0000 7f6dfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.531+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94063096756240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a4910 con 0x558cc5770400 2024-09-10T14:28:54.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.531+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94063096756240] v33'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.531+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94063096733312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a4910 con 0x558cc575dbf0 2024-09-10T14:28:54.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.535+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94063096733312] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.535+0000 7f6f49f6b980 20 remove_watcher() i=0 2024-09-10T14:28:54.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.535+0000 7f6f49f6b980 2 removed watcher, disabling cache 2024-09-10T14:28:54.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.535+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94063096739280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a4910 con 0x558cc5770400 2024-09-10T14:28:54.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.535+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94063096739280] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.535+0000 7f6f49f6b980 20 remove_watcher() i=1 2024-09-10T14:28:54.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.535+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94063096735568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a4910 con 0x558cc5774df0 2024-09-10T14:28:54.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.539+0000 7f6f47a7b640 1 -- 172.21.15.151:0/56999648 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94063096735568] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f380f5070 con 0x558cc5774df0 2024-09-10T14:28:54.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.539+0000 7f6f49f6b980 20 remove_watcher() i=2 2024-09-10T14:28:54.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.539+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94063096745456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577a750 con 0x558cc575dbf0 2024-09-10T14:28:54.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.539+0000 7f6f4727a640 1 -- 172.21.15.151:0/56999648 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94063096745456] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f3c037040 con 0x558cc575dbf0 2024-09-10T14:28:54.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.539+0000 7f6f49f6b980 20 remove_watcher() i=3 2024-09-10T14:28:54.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.539+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94063096747584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a4910 con 0x558cc5770400 2024-09-10T14:28:54.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.543+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94063096747584] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x558cc5770400 2024-09-10T14:28:54.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.543+0000 7f6f49f6b980 20 remove_watcher() i=4 2024-09-10T14:28:54.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.543+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94063096750080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577d640 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.543+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94063096750080] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.543+0000 7f6f49f6b980 20 remove_watcher() i=5 2024-09-10T14:28:54.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.543+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94063096754720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc57a4910 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94063096754720] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 20 remove_watcher() i=6 2024-09-10T14:28:54.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94063096752224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558cc577d640 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94063096752224] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f4000a4d0 con 0x7f6f3c03a3c0 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 20 remove_watcher() i=7 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6f3c03a3c0 msgr2=0x7f6f3c03a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6f3c03a3c0 0x7f6f3c03a800 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5770400 msgr2=0x558cc57728c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5770400 0x558cc57728c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x558cc575dbf0 msgr2=0x7f6f380d87d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x558cc575dbf0 0x7f6f380d87d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc5774df0 msgr2=0x558cc57771e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc5774df0 0x558cc57771e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e100346a0 msgr2=0x7f6e10036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e100346a0 0x7f6e10036b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00baa0 tx=0x7f6f3c010000 comp rx=0 tx=0).stop 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc5764f50 msgr2=0x558cc5765370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/56999648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc5764f50 0x558cc5765370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6f380c3fd0 tx=0x7f6f380d8f10 comp rx=0 tx=0).stop 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 reap_dead start 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f4827c640 1 -- 172.21.15.151:0/56999648 reap_dead start 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 shutdown_connections 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 >> 172.21.15.151:0/56999648 conn(0x558cc5759fd0 msgr2=0x558cc57580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 shutdown_connections 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/56999648 wait complete. 2024-09-10T14:28:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/800787564 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e20034650 msgr2=0x7f6e20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/800787564 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e20034650 0x7f6e20036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x558cc5743c40 tx=0x7f6f3c00f000 comp rx=0 tx=0).stop 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/800787564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc57512d0 msgr2=0x558cc57516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/800787564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc57512d0 0x558cc57516f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6f380e3660 tx=0x7f6f380de0b0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/800787564 shutdown_connections 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/800787564 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e20034650 0x7f6e20036b10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/800787564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc57512d0 0x558cc57516f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/800787564 >> 172.21.15.151:0/800787564 conn(0x558cc5746420 msgr2=0x558cc5748ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/800787564 shutdown_connections 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/800787564 wait complete. 2024-09-10T14:28:54.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x558cc5740cc0 msgr2=0x558cc57430b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x558cc5740cc0 0x558cc57430b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5738300 msgr2=0x558cc573a6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x558cc5738300 0x558cc573a6f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc573cdc0 msgr2=0x558cc573f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558cc573cdc0 0x558cc573f1b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e300346f0 msgr2=0x7f6e30036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6e300346f0 0x7f6e30036bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c001e50 tx=0x7f6f3c0013b0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563ef80 msgr2=0x558cc55b5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.547+0000 7f6f49f6b980 1 --2- 172.21.15.151:0/951890579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558cc563ef80 0x558cc55b5490 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6f380199f0 tx=0x7f6f380180e0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.551+0000 7f6f4827c640 1 -- 172.21.15.151:0/951890579 reap_dead start 2024-09-10T14:28:54.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.551+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 shutdown_connections 2024-09-10T14:28:54.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.551+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 >> 172.21.15.151:0/951890579 conn(0x558cc563a150 msgr2=0x558cc57241e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.551+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 shutdown_connections 2024-09-10T14:28:54.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.551+0000 7f6f49f6b980 1 -- 172.21.15.151:0/951890579 wait complete. 2024-09-10T14:28:54.565 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T14:28:54.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T14:28:54.566 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T14:28:54.644 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:54.645 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:54.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df4a2c980 1 Processor -- start 2024-09-10T14:28:54.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df4a2c980 1 -- start start 2024-09-10T14:28:54.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df4a2c980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56303f930290 0x56303f9be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df4a2c980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56303f843ae0 con 0x56303f9be8e0 2024-09-10T14:28:54.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df4a2c980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56303f867e30 con 0x56303f930290 2024-09-10T14:28:54.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df253c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56303f930290 0x56303f9be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df253c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56303f930290 0x56303f9be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49552/0 (socket says 172.21.15.151:49552) 2024-09-10T14:28:54.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df253c640 1 -- 172.21.15.151:0/600134833 learned_addr learned my addr 172.21.15.151:0/600134833 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df253c640 1 -- 172.21.15.151:0/600134833 >> v1:172.21.15.52:6789/0 conn(0x56303f9be8e0 legacy=0x56303f9c0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df253c640 1 -- 172.21.15.151:0/600134833 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303f930820 con 0x56303f930290 2024-09-10T14:28:54.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.643+0000 7f9df253c640 1 --2- 172.21.15.151:0/600134833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303f9be3a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00a5c0 tx=0x7f9dec01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17029d98fd91828 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df153a640 1 -- 172.21.15.151:0/600134833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0a6070 con 0x56303f930290 2024-09-10T14:28:54.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df153a640 1 -- 172.21.15.151:0/600134833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec0af070 con 0x56303f930290 2024-09-10T14:28:54.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df153a640 1 -- 172.21.15.151:0/600134833 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0aa5c0 con 0x56303f930290 2024-09-10T14:28:54.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df4a2c980 1 -- 172.21.15.151:0/600134833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 msgr2=0x56303f9be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/600134833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303f9be3a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00a5c0 tx=0x7f9dec01b340 comp rx=0 tx=0).stop 2024-09-10T14:28:54.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df4a2c980 1 -- 172.21.15.151:0/600134833 shutdown_connections 2024-09-10T14:28:54.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/600134833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303f9be3a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df4a2c980 1 -- 172.21.15.151:0/600134833 >> 172.21.15.151:0/600134833 conn(0x56303f9b6090 msgr2=0x56303f9b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df4a2c980 1 -- 172.21.15.151:0/600134833 shutdown_connections 2024-09-10T14:28:54.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.647+0000 7f9df4a2c980 1 -- 172.21.15.151:0/600134833 wait complete. 2024-09-10T14:28:54.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 Processor -- start 2024-09-10T14:28:54.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- start start 2024-09-10T14:28:54.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faa6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56303f869200 con 0x56303f930290 2024-09-10T14:28:54.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faa6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faa6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49560/0 (socket says 172.21.15.151:49560) 2024-09-10T14:28:54.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df253c640 1 -- 172.21.15.151:0/201481507 learned_addr learned my addr 172.21.15.151:0/201481507 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df253c640 1 -- 172.21.15.151:0/201481507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303faa6fd0 con 0x56303f930290 2024-09-10T14:28:54.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df253c640 1 --2- 172.21.15.151:0/201481507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faa6a00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0199f0 tx=0x7f9dec003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd182628049df39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9ce0608640 1 -- 172.21.15.151:0/201481507 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0aaa00 con 0x56303f930290 2024-09-10T14:28:54.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9ce0608640 1 -- 172.21.15.151:0/201481507 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec0aaba0 con 0x56303f930290 2024-09-10T14:28:54.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9ce0608640 1 -- 172.21.15.151:0/201481507 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0bd3f0 con 0x56303f930290 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- 172.21.15.151:0/201481507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 msgr2=0x56303faa6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/201481507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faa6a00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0199f0 tx=0x7f9dec003030 comp rx=0 tx=0).stop 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- 172.21.15.151:0/201481507 shutdown_connections 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/201481507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faa6a00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- 172.21.15.151:0/201481507 >> 172.21.15.151:0/201481507 conn(0x56303f9b6090 msgr2=0x56303faa2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- 172.21.15.151:0/201481507 shutdown_connections 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- 172.21.15.151:0/201481507 wait complete. 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 Processor -- start 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- start start 2024-09-10T14:28:54.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faadc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df4a2c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56303f9c2f00 con 0x56303f930290 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faadc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faadc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49566/0 (socket says 172.21.15.151:49566) 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.663+0000 7f9df253c640 1 -- 172.21.15.151:0/1736232293 learned_addr learned my addr 172.21.15.151:0/1736232293 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df253c640 1 -- 172.21.15.151:0/1736232293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303faae150 con 0x56303f930290 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df253c640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faadc10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0199f0 tx=0x7f9dec0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9cdee05640 1 -- 172.21.15.151:0/1736232293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0bd7c0 con 0x56303f930290 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56303faae3e0 con 0x56303f930290 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9cdee05640 1 -- 172.21.15.151:0/1736232293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec0bd960 con 0x56303f930290 2024-09-10T14:28:54.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56303fab10c0 con 0x56303f930290 2024-09-10T14:28:54.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9cdee05640 1 -- 172.21.15.151:0/1736232293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0bdc40 con 0x56303f930290 2024-09-10T14:28:54.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9cdee05640 1 -- 172.21.15.151:0/1736232293 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9dec0ce020 con 0x56303f930290 2024-09-10T14:28:54.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9cdee05640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cd8034650 0x7f9cd8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9cdee05640 1 -- 172.21.15.151:0/1736232293 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9dec0cc020 con 0x56303f930290 2024-09-10T14:28:54.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cd8034650 0x7f9cd8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303f9be8e0 0x56303fab4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303fab5240 con 0x56303f9be8e0 2024-09-10T14:28:54.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df2d3d640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303f9be8e0 0x56303fab4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cd8034650 0x7f9cd8036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9de8001e20 tx=0x7f9de80013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df2d3d640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303f9be8e0 0x56303fab4c00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1736232293 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303f9be8e0 2024-09-10T14:28:54.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303fab22e0 con 0x56303f9be8e0 2024-09-10T14:28:54.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1736232293 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303f9be8e0 2024-09-10T14:28:54.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303fab7590 0x56303fab9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faba050 con 0x56303fab7590 2024-09-10T14:28:54.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.667+0000 7f9df253c640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303fab7590 0x56303fab9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df253c640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303fab7590 0x56303fab9980 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df253c640 1 -- 172.21.15.151:0/1736232293 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9dec0e5050 con 0x56303fab7590 2024-09-10T14:28:54.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303fab6430 con 0x56303f9be8e0 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1736232293 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303f9be8e0 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56303fabb490 0x56303fabd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303fabe010 con 0x56303fabb490 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56303fabb490 0x56303fabd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56303fabb490 0x56303fabd880 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1736232293 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9de800d040 con 0x56303fabb490 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df4a2c980 1 Processor -- start 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df4a2c980 1 -- start start 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df4a2c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303facbaa0 0x56303facbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df4a2c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56303f8c2800 con 0x56303facbaa0 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303facbaa0 0x56303facbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303facbaa0 0x56303facbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49570/0 (socket says 172.21.15.151:49570) 2024-09-10T14:28:54.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.671+0000 7f9df253c640 1 -- 172.21.15.151:0/1816830844 learned_addr learned my addr 172.21.15.151:0/1816830844 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df253c640 1 -- 172.21.15.151:0/1816830844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303facc400 con 0x56303facbaa0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df253c640 1 --2- 172.21.15.151:0/1816830844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303facbaa0 0x56303facbec0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9dec000c10 tx=0x7f9dec0b36e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9cd7fff640 1 -- 172.21.15.151:0/1816830844 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0e31d0 con 0x56303facbaa0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1816830844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56303facc690 con 0x56303facbaa0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9cd7fff640 1 -- 172.21.15.151:0/1816830844 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec0e3370 con 0x56303facbaa0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9cd7fff640 1 -- 172.21.15.151:0/1816830844 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0bc9a0 con 0x56303facbaa0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1816830844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56303facf310 con 0x56303facbaa0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9cd7fff640 1 -- 172.21.15.151:0/1816830844 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9dec0bcb40 con 0x56303facbaa0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9cd7fff640 1 --2- 172.21.15.151:0/1816830844 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ccc034650 0x7f9ccc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9cd7fff640 1 -- 172.21.15.151:0/1816830844 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9dec0eec50 con 0x56303facbaa0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1816830844 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ccc034650 0x7f9ccc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df4a2c980 1 Processor -- start 2024-09-10T14:28:54.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df4a2c980 1 -- start start 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1816830844 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ccc034650 0x7f9ccc036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x56303fabe410 tx=0x7f9de8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df4a2c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fad87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df4a2c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56303faa7290 con 0x56303fad83e0 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fad87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fad87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49586/0 (socket says 172.21.15.151:49586) 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df253c640 1 -- 172.21.15.151:0/1596189177 learned_addr learned my addr 172.21.15.151:0/1596189177 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.675+0000 7f9df253c640 1 -- 172.21.15.151:0/1596189177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303fad8d90 con 0x56303fad83e0 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df253c640 1 --2- 172.21.15.151:0/1596189177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fad87c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0e7fd0 tx=0x7f9dec0a8700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5c2c12e935326e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9cd5ffb640 1 -- 172.21.15.151:0/1596189177 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0e5e30 con 0x56303fad83e0 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9cd5ffb640 1 -- 172.21.15.151:0/1596189177 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec0bce30 con 0x56303fad83e0 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9cd5ffb640 1 -- 172.21.15.151:0/1596189177 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0c6480 con 0x56303fad83e0 2024-09-10T14:28:54.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1596189177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 msgr2=0x56303fad87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1596189177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fad87c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0e7fd0 tx=0x7f9dec0a8700 comp rx=0 tx=0).stop 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1596189177 shutdown_connections 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1596189177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fad87c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1596189177 >> 172.21.15.151:0/1596189177 conn(0x56303fad47c0 msgr2=0x56303fad28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1596189177 shutdown_connections 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1596189177 wait complete. 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 Processor -- start 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- start start 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fadf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56303fad9230 con 0x56303fad83e0 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fadf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df253c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fadf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49588/0 (socket says 172.21.15.151:49588) 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 learned_addr learned my addr 172.21.15.151:0/1847049145 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303fadfac0 con 0x56303fad83e0 2024-09-10T14:28:54.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df253c640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fadf580 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0e7fd0 tx=0x7f9dec0f3f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9cc3fff640 1 -- 172.21.15.151:0/1847049145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0c7590 con 0x56303fad83e0 2024-09-10T14:28:54.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56303fadfac0 con 0x56303fad83e0 2024-09-10T14:28:54.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9cc3fff640 1 -- 172.21.15.151:0/1847049145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec10b070 con 0x56303fad83e0 2024-09-10T14:28:54.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9cc3fff640 1 -- 172.21.15.151:0/1847049145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0b9cb0 con 0x56303fad83e0 2024-09-10T14:28:54.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.679+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56303fadfac0 con 0x56303fad83e0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9cc3fff640 1 -- 172.21.15.151:0/1847049145 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9dec0e5530 con 0x56303fad83e0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9cc3fff640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cbc034650 0x7f9cbc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9cc3fff640 1 -- 172.21.15.151:0/1847049145 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9dec111cd0 con 0x56303fad83e0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cbc034650 0x7f9cbc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303faea4b0 0x56303faec970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faed0c0 con 0x56303faea4b0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df2d3d640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303faea4b0 0x56303faec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cbc034650 0x7f9cbc036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9de80207d0 tx=0x7f9de8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df2d3d640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303faea4b0 0x56303faec970 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 realm 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faed4d0 con 0x56303faea4b0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faedd70 con 0x56303faea4b0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303faeee70 0x56303faf1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faf18b0 con 0x56303faeee70 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df253c640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303faeee70 0x56303faf1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df253c640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303faeee70 0x56303faf1260 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 20 searching for the correct realm 2024-09-10T14:28:54.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faf3110 con 0x56303faeee70 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df253c640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9dec009040 0x7f9dec0b9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faf3110 con 0x7f9dec009040 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.683+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9dec009040 0x7f9dec0b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9dec009040 0x7f9dec0b9200 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df1d3b640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9de800f3d0 0x7f9de800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faf3110 con 0x7f9de800f3d0 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9de800f3d0 0x7f9de800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9de800f3d0 0x7f9de800f7f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9de800f3d0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9de800f3d0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.687+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9dec009040 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faeee70 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9de800f3d0 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9dec009040 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faeee70 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faeee70 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9de800f3d0 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faeee70 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faeee70 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.691+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9de800f3d0 2024-09-10T14:28:54.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faeee70 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9dec009040 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9de800f3d0 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faeee70 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9de800f3d0 2024-09-10T14:28:54.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9dec009040 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faeee70 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.695+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9de800f3d0 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x56303faea4b0 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56303faee110 con 0x7f9dec009040 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faf2230 con 0x56303faea4b0 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faf2a80 con 0x56303faea4b0 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faf1e90 con 0x7f9de800f3d0 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 zone default found 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 4 Realm: () 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 zonegroup default 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faf2fe0 con 0x7f9de800f3d0 2024-09-10T14:28:54.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faf4f20 con 0x56303faeee70 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303faf53e0 con 0x56303faeee70 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 started sync module instance, tier type = 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.699+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf43c0 con 0x7f9dec009040 2024-09-10T14:28:54.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.703+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.703+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94765226870704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf5cf0 con 0x7f9dec009040 2024-09-10T14:28:54.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.703+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf6540 con 0x56303faea4b0 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.703+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94765226870704] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.703+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.703+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94765226874944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf6540 con 0x56303faea4b0 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.703+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf7060 con 0x56303faeee70 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.707+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.707+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94765226874944] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.707+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94765226879792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf7900 con 0x56303faeee70 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.707+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf6090 con 0x7f9dec009040 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.707+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.707+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94765226884624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf86e0 con 0x7f9dec009040 2024-09-10T14:28:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.707+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf90e0 con 0x56303faea4b0 2024-09-10T14:28:54.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.707+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94765226884624] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.711+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94765226879792] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.711+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.711+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94765226882128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf8230 con 0x56303faea4b0 2024-09-10T14:28:54.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.711+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf9980 con 0x7f9de800f3d0 2024-09-10T14:28:54.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.711+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94765226882128] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.711+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.711+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94765226888176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf8230 con 0x7f9de800f3d0 2024-09-10T14:28:54.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.711+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf9e50 con 0x7f9de800f3d0 2024-09-10T14:28:54.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.715+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94765226888176] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.715+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.715+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94765226891584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf9e10 con 0x7f9de800f3d0 2024-09-10T14:28:54.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.715+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fafa830 con 0x7f9de800f3d0 2024-09-10T14:28:54.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94765226894112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fafaca0 con 0x7f9de800f3d0 2024-09-10T14:28:54.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 add_watcher() i=0 2024-09-10T14:28:54.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 add_watcher() i=1 2024-09-10T14:28:54.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 add_watcher() i=2 2024-09-10T14:28:54.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 add_watcher() i=3 2024-09-10T14:28:54.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 add_watcher() i=4 2024-09-10T14:28:54.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 add_watcher() i=5 2024-09-10T14:28:54.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94765226891584] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 add_watcher() i=6 2024-09-10T14:28:54.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94765226894112] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 add_watcher() i=7 2024-09-10T14:28:54.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:54.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303fafaca0 con 0x56303faea4b0 2024-09-10T14:28:54.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94765226895344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fafac10 con 0x56303faea4b0 2024-09-10T14:28:54.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94765226895344] v33'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9ca8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:54.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:54.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.719+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb06540 con 0x56303faea4b0 2024-09-10T14:28:54.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.723+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.723+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb06b90 con 0x7f9de800f3d0 2024-09-10T14:28:54.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.727+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.727+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb06fd0 con 0x56303faeee70 2024-09-10T14:28:54.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.727+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.727+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb06fc0 con 0x56303faea4b0 2024-09-10T14:28:54.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.727+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'114 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.727+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb07470 con 0x7f9dec009040 2024-09-10T14:28:54.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.727+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.727+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb079e0 con 0x56303faeee70 2024-09-10T14:28:54.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.731+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.731+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb079e0 con 0x56303faea4b0 2024-09-10T14:28:54.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.731+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.731+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb079e0 con 0x7f9de800f3d0 2024-09-10T14:28:54.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.735+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.735+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb07a70 con 0x7f9dec009040 2024-09-10T14:28:54.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.735+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.735+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08020 con 0x56303faeee70 2024-09-10T14:28:54.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.735+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.735+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08020 con 0x7f9dec009040 2024-09-10T14:28:54.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.739+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.739+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08590 con 0x7f9de800f3d0 2024-09-10T14:28:54.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.739+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.739+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x7f9dec009040 2024-09-10T14:28:54.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.743+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.743+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x7f9de800f3d0 2024-09-10T14:28:54.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.743+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.743+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faea4b0 2024-09-10T14:28:54.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.743+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.743+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.747+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.747+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x7f9dec009040 2024-09-10T14:28:54.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.747+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.747+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.747+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.747+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faea4b0 2024-09-10T14:28:54.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.751+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.751+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faea4b0 2024-09-10T14:28:54.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.751+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'116 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.751+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.755+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.755+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x7f9dec009040 2024-09-10T14:28:54.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.755+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.755+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.755+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.755+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.759+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.759+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.759+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.759+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.759+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.759+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x7f9de800f3d0 2024-09-10T14:28:54.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.763+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.763+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.763+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.763+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x7f9de800f3d0 2024-09-10T14:28:54.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.767+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.767+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x56303faeee70 2024-09-10T14:28:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.767+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.767+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x7f9de800f3d0 2024-09-10T14:28:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb08990 con 0x7f9dec009040 2024-09-10T14:28:54.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9c237fe640 20 reqs_thread_entry: start 2024-09-10T14:28:54.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9df4a2c980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:54.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9df4a2c980 20 Filter name: none 2024-09-10T14:28:54.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9c217fa640 20 reqs_thread_entry: start 2024-09-10T14:28:54.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9df4a2c980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:28:54.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9df4a2c980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.771+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303fb048b0 con 0x7f9de800f3d0 2024-09-10T14:28:54.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df4a2c980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:28:54.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df4a2c980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T14:28:54.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df4a2c980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:54.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df4a2c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:54.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56303fb04410 con 0x7f9de800f3d0 2024-09-10T14:28:54.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.779 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T14:28:54.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9ca8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94765226895344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fb00190 con 0x56303faea4b0 2024-09-10T14:28:54.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94765226895344] v33'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.775+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94765226870704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fafa7f0 con 0x7f9dec009040 2024-09-10T14:28:54.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.779+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94765226870704] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.779+0000 7f9df4a2c980 20 remove_watcher() i=0 2024-09-10T14:28:54.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.779+0000 7f9df4a2c980 2 removed watcher, disabling cache 2024-09-10T14:28:54.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.779+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94765226874944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fafa7f0 con 0x56303faea4b0 2024-09-10T14:28:54.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.779+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94765226874944] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.779+0000 7f9df4a2c980 20 remove_watcher() i=1 2024-09-10T14:28:54.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.779+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94765226879792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fafa7f0 con 0x56303faeee70 2024-09-10T14:28:54.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.783+0000 7f9df253c640 1 -- 172.21.15.151:0/1847049145 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94765226879792] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0f4070 con 0x56303faeee70 2024-09-10T14:28:54.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.783+0000 7f9df4a2c980 20 remove_watcher() i=2 2024-09-10T14:28:54.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.783+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94765226884624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf6b30 con 0x7f9dec009040 2024-09-10T14:28:54.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.783+0000 7f9df1d3b640 1 -- 172.21.15.151:0/1847049145 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94765226884624] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de8036040 con 0x7f9dec009040 2024-09-10T14:28:54.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.783+0000 7f9df4a2c980 20 remove_watcher() i=3 2024-09-10T14:28:54.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.783+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94765226882128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fafa7f0 con 0x56303faea4b0 2024-09-10T14:28:54.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.787+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94765226882128] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x56303faea4b0 2024-09-10T14:28:54.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.787+0000 7f9df4a2c980 20 remove_watcher() i=4 2024-09-10T14:28:54.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.787+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94765226888176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf7e10 con 0x7f9de800f3d0 2024-09-10T14:28:54.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.787+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94765226888176] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.787+0000 7f9df4a2c980 20 remove_watcher() i=5 2024-09-10T14:28:54.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.787+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94765226891584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303faf6b30 con 0x7f9de800f3d0 2024-09-10T14:28:54.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94765226891584] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 20 remove_watcher() i=6 2024-09-10T14:28:54.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94765226894112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56303fafa7f0 con 0x7f9de800f3d0 2024-09-10T14:28:54.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94765226894112] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de400a4d0 con 0x7f9de800f3d0 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 20 remove_watcher() i=7 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9de800f3d0 msgr2=0x7f9de800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9de800f3d0 0x7f9de800f7f0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303faea4b0 msgr2=0x56303faec970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303faea4b0 0x56303faec970 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9dec009040 msgr2=0x7f9dec0b9200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9dec009040 0x7f9dec0b9200 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303faeee70 msgr2=0x56303faf1260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303faeee70 0x56303faf1260 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cbc034650 msgr2=0x7f9cbc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cbc034650 0x7f9cbc036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9de80207d0 tx=0x7f9de8011000 comp rx=0 tx=0).stop 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1847049145 reap_dead start 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 msgr2=0x56303fadf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fadf580 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0e7fd0 tx=0x7f9dec0f3f60 comp rx=0 tx=0).stop 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 shutdown_connections 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1847049145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303fad83e0 0x56303fadf580 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 >> 172.21.15.151:0/1847049145 conn(0x56303fad47c0 msgr2=0x56303fad2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 shutdown_connections 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.791+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1847049145 wait complete. 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1816830844 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ccc034650 msgr2=0x7f9ccc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1816830844 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ccc034650 0x7f9ccc036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x56303fabe410 tx=0x7f9de8006000 comp rx=0 tx=0).stop 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1816830844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303facbaa0 msgr2=0x56303facbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1816830844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303facbaa0 0x56303facbec0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9dec000c10 tx=0x7f9dec0b36e0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1816830844 shutdown_connections 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1816830844 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ccc034650 0x7f9ccc036b10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1816830844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303facbaa0 0x56303facbec0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1816830844 >> 172.21.15.151:0/1816830844 conn(0x56303fac0bf0 msgr2=0x56303fac3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1816830844 shutdown_connections 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1816830844 wait complete. 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56303fabb490 msgr2=0x56303fabd880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56303fabb490 0x56303fabd880 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303f9be8e0 msgr2=0x56303fab4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56303f9be8e0 0x56303fab4c00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303fab7590 msgr2=0x56303fab9980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56303fab7590 0x56303fab9980 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cd8034650 msgr2=0x7f9cd8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9cd8034650 0x7f9cd8036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9de8001e20 tx=0x7f9de80013a0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 msgr2=0x56303faadc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 --2- 172.21.15.151:0/1736232293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56303f930290 0x56303faadc10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0199f0 tx=0x7f9dec0180e0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df2d3d640 1 -- 172.21.15.151:0/1736232293 reap_dead start 2024-09-10T14:28:54.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 shutdown_connections 2024-09-10T14:28:54.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 >> 172.21.15.151:0/1736232293 conn(0x56303f9b6090 msgr2=0x56303faa11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 shutdown_connections 2024-09-10T14:28:54.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.795+0000 7f9df4a2c980 1 -- 172.21.15.151:0/1736232293 wait complete. 2024-09-10T14:28:54.808 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T14:28:54.808 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T14:28:54.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T14:28:54.809 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-10T14:28:54.885 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:54.885 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:54.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7606a67980 1 Processor -- start 2024-09-10T14:28:54.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7606a67980 1 -- start start 2024-09-10T14:28:54.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7606a67980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557702958480 0x55770295fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7606a67980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577027e1ae0 con 0x5577029578a0 2024-09-10T14:28:54.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7606a67980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x557702805e30 con 0x557702958480 2024-09-10T14:28:54.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7603d76640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557702958480 0x55770295fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7603d76640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557702958480 0x55770295fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49590/0 (socket says 172.21.15.151:49590) 2024-09-10T14:28:54.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7603d76640 1 -- 172.21.15.151:0/3122700469 learned_addr learned my addr 172.21.15.151:0/3122700469 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7604577640 1 --1- 172.21.15.151:0/3122700469 >> v1:172.21.15.52:6789/0 conn(0x5577029578a0 0x557702957c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44690/0 (socket says 172.21.15.151:44690) 2024-09-10T14:28:54.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7603d76640 1 -- 172.21.15.151:0/3122700469 >> v1:172.21.15.52:6789/0 conn(0x5577029578a0 legacy=0x557702957c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.883+0000 7f7603d76640 1 -- 172.21.15.151:0/3122700469 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557702961260 con 0x557702958480 2024-09-10T14:28:54.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7603d76640 1 --2- 172.21.15.151:0/3122700469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702958480 0x55770295fbf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00a5c0 tx=0x7f75ec01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c0cc82306501fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7603575640 1 -- 172.21.15.151:0/3122700469 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75ec0a6070 con 0x557702958480 2024-09-10T14:28:54.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7603575640 1 -- 172.21.15.151:0/3122700469 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec0af070 con 0x557702958480 2024-09-10T14:28:54.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7603575640 1 -- 172.21.15.151:0/3122700469 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75ec0aa5c0 con 0x557702958480 2024-09-10T14:28:54.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7606a67980 1 -- 172.21.15.151:0/3122700469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702958480 msgr2=0x55770295fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7606a67980 1 --2- 172.21.15.151:0/3122700469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702958480 0x55770295fbf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00a5c0 tx=0x7f75ec01b340 comp rx=0 tx=0).stop 2024-09-10T14:28:54.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7606a67980 1 -- 172.21.15.151:0/3122700469 shutdown_connections 2024-09-10T14:28:54.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7606a67980 1 --2- 172.21.15.151:0/3122700469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702958480 0x55770295fbf0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7606a67980 1 -- 172.21.15.151:0/3122700469 >> 172.21.15.151:0/3122700469 conn(0x5577029537b0 msgr2=0x557702955bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7606a67980 1 -- 172.21.15.151:0/3122700469 shutdown_connections 2024-09-10T14:28:54.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.887+0000 7f7606a67980 1 -- 172.21.15.151:0/3122700469 wait complete. 2024-09-10T14:28:54.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.899+0000 7f7606a67980 1 Processor -- start 2024-09-10T14:28:54.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.899+0000 7f7606a67980 1 -- start start 2024-09-10T14:28:54.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.899+0000 7f7606a67980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a44a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.899+0000 7f7606a67980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557702807200 con 0x5577029578a0 2024-09-10T14:28:54.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a44a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a44a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49606/0 (socket says 172.21.15.151:49606) 2024-09-10T14:28:54.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 -- 172.21.15.151:0/3571794742 learned_addr learned my addr 172.21.15.151:0/3571794742 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 -- 172.21.15.151:0/3571794742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557702a45000 con 0x5577029578a0 2024-09-10T14:28:54.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 --2- 172.21.15.151:0/3571794742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a44a30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0015f0 tx=0x7f75fc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d558a104060ba03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f74f260c640 1 -- 172.21.15.151:0/3571794742 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc013420 con 0x5577029578a0 2024-09-10T14:28:54.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f74f260c640 1 -- 172.21.15.151:0/3571794742 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc0135e0 con 0x5577029578a0 2024-09-10T14:28:54.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f74f260c640 1 -- 172.21.15.151:0/3571794742 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc013940 con 0x5577029578a0 2024-09-10T14:28:54.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 -- 172.21.15.151:0/3571794742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 msgr2=0x557702a44a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 --2- 172.21.15.151:0/3571794742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a44a30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0015f0 tx=0x7f75fc001ab0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 -- 172.21.15.151:0/3571794742 shutdown_connections 2024-09-10T14:28:54.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 --2- 172.21.15.151:0/3571794742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a44a30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 -- 172.21.15.151:0/3571794742 >> 172.21.15.151:0/3571794742 conn(0x5577029537b0 msgr2=0x557702a40660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 -- 172.21.15.151:0/3571794742 shutdown_connections 2024-09-10T14:28:54.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 -- 172.21.15.151:0/3571794742 wait complete. 2024-09-10T14:28:54.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 Processor -- start 2024-09-10T14:28:54.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 -- start start 2024-09-10T14:28:54.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a4be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7606a67980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557702960d30 con 0x5577029578a0 2024-09-10T14:28:54.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a4be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a4be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49622/0 (socket says 172.21.15.151:49622) 2024-09-10T14:28:54.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 -- 172.21.15.151:0/3337615497 learned_addr learned my addr 172.21.15.151:0/3337615497 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.903+0000 7f7604577640 1 -- 172.21.15.151:0/3337615497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557702a4c340 con 0x5577029578a0 2024-09-10T14:28:54.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7604577640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a4be00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f75fc006640 tx=0x7f75fc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f74f0e09640 1 -- 172.21.15.151:0/3337615497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc022020 con 0x5577029578a0 2024-09-10T14:28:54.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557702a4c5d0 con 0x5577029578a0 2024-09-10T14:28:54.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f74f0e09640 1 -- 172.21.15.151:0/3337615497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc006320 con 0x5577029578a0 2024-09-10T14:28:54.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f74f0e09640 1 -- 172.21.15.151:0/3337615497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc004ab0 con 0x5577029578a0 2024-09-10T14:28:54.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557702a4f2b0 con 0x5577029578a0 2024-09-10T14:28:54.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f74f0e09640 1 -- 172.21.15.151:0/3337615497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f75fc025020 con 0x5577029578a0 2024-09-10T14:28:54.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f74f0e09640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74ec034650 0x7f74ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f74f0e09640 1 -- 172.21.15.151:0/3337615497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f75fc018030 con 0x5577029578a0 2024-09-10T14:28:54.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7603d76640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74ec034650 0x7f74ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7606a67980 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702958480 0x557702a52e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a53480 con 0x557702958480 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7604d78640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702958480 0x557702a52e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7603d76640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74ec034650 0x7f74ec036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0ae000 tx=0x7f75ec0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7604d78640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702958480 0x557702a52e10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7604d78640 1 -- 172.21.15.151:0/3337615497 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702958480 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a504d0 con 0x557702958480 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7604d78640 1 -- 172.21.15.151:0/3337615497 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75f40083f0 con 0x557702958480 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7606a67980 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a557d0 0x557702a57bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a582b0 con 0x557702a557d0 2024-09-10T14:28:54.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7604577640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a557d0 0x557702a57bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7604577640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a557d0 0x557702a57bc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7604577640 1 -- 172.21.15.151:0/3337615497 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f75fc01b070 con 0x557702a557d0 2024-09-10T14:28:54.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.907+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a54670 con 0x557702958480 2024-09-10T14:28:54.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7604d78640 1 -- 172.21.15.151:0/3337615497 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75f40083f0 con 0x557702958480 2024-09-10T14:28:54.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7606a67980 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557702a59710 0x557702a5bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a5c240 con 0x557702a59710 2024-09-10T14:28:54.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7603d76640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557702a59710 0x557702a5bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7603d76640 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557702a59710 0x557702a5bb00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7603d76640 1 -- 172.21.15.151:0/3337615497 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f75ec0aaae0 con 0x557702a59710 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7606a67980 1 Processor -- start 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7606a67980 1 -- start start 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7606a67980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a69d10 0x557702a6a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7606a67980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557702860800 con 0x557702a69d10 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a69d10 0x557702a6a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a69d10 0x557702a6a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49638/0 (socket says 172.21.15.151:49638) 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7604577640 1 -- 172.21.15.151:0/1946816530 learned_addr learned my addr 172.21.15.151:0/1946816530 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7604577640 1 -- 172.21.15.151:0/1946816530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557702a6a670 con 0x557702a69d10 2024-09-10T14:28:54.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.911+0000 7f7604577640 1 --2- 172.21.15.151:0/1946816530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a69d10 0x557702a6a130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0069a0 tx=0x7f75fc010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f74e9ffb640 1 -- 172.21.15.151:0/1946816530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc01d580 con 0x557702a69d10 2024-09-10T14:28:54.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f74e9ffb640 1 -- 172.21.15.151:0/1946816530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc01d720 con 0x557702a69d10 2024-09-10T14:28:54.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f74e9ffb640 1 -- 172.21.15.151:0/1946816530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc01da40 con 0x557702a69d10 2024-09-10T14:28:54.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f7606a67980 1 -- 172.21.15.151:0/1946816530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557702a6a900 con 0x557702a69d10 2024-09-10T14:28:54.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f7606a67980 1 -- 172.21.15.151:0/1946816530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557702a6d580 con 0x557702a69d10 2024-09-10T14:28:54.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f74e9ffb640 1 -- 172.21.15.151:0/1946816530 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f75fc010070 con 0x557702a69d10 2024-09-10T14:28:54.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f74e9ffb640 1 --2- 172.21.15.151:0/1946816530 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74dc0346a0 0x7f74dc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f74e9ffb640 1 -- 172.21.15.151:0/1946816530 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f75fc005550 con 0x557702a69d10 2024-09-10T14:28:54.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.915+0000 7f7603d76640 1 --2- 172.21.15.151:0/1946816530 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74dc0346a0 0x7f74dc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 Processor -- start 2024-09-10T14:28:54.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- start start 2024-09-10T14:28:54.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7603d76640 1 --2- 172.21.15.151:0/1946816530 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74dc0346a0 0x7f74dc036b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x557702a53950 tx=0x7f75ec005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a76aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557702a45380 con 0x557702a766a0 2024-09-10T14:28:54.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a76aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a76aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49654/0 (socket says 172.21.15.151:49654) 2024-09-10T14:28:54.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7604577640 1 -- 172.21.15.151:0/1871821136 learned_addr learned my addr 172.21.15.151:0/1871821136 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7604577640 1 -- 172.21.15.151:0/1871821136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557702a77070 con 0x557702a766a0 2024-09-10T14:28:54.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7604577640 1 --2- 172.21.15.151:0/1871821136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a76aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f75fc01efd0 tx=0x7f75fc027d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d00ce08ebbfa0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f74db7fe640 1 -- 172.21.15.151:0/1871821136 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc0412c0 con 0x557702a766a0 2024-09-10T14:28:54.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f74db7fe640 1 -- 172.21.15.151:0/1871821136 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc049aa0 con 0x557702a766a0 2024-09-10T14:28:54.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f74db7fe640 1 -- 172.21.15.151:0/1871821136 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc0265d0 con 0x557702a766a0 2024-09-10T14:28:54.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- 172.21.15.151:0/1871821136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 msgr2=0x557702a76aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 --2- 172.21.15.151:0/1871821136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a76aa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f75fc01efd0 tx=0x7f75fc027d50 comp rx=0 tx=0).stop 2024-09-10T14:28:54.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- 172.21.15.151:0/1871821136 shutdown_connections 2024-09-10T14:28:54.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 --2- 172.21.15.151:0/1871821136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a76aa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- 172.21.15.151:0/1871821136 >> 172.21.15.151:0/1871821136 conn(0x557702a72a30 msgr2=0x557702a70b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- 172.21.15.151:0/1871821136 shutdown_connections 2024-09-10T14:28:54.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- 172.21.15.151:0/1871821136 wait complete. 2024-09-10T14:28:54.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 Processor -- start 2024-09-10T14:28:54.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- start start 2024-09-10T14:28:54.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a7d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7606a67980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557702a775c0 con 0x557702a766a0 2024-09-10T14:28:54.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a7d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7604577640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a7d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49656/0 (socket says 172.21.15.151:49656) 2024-09-10T14:28:54.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.919+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 learned_addr learned my addr 172.21.15.151:0/1466765151 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:54.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557702a7dd10 con 0x557702a766a0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7604577640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a7d7d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f75fc01ed60 tx=0x7f75fc0051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f74d9ffb640 1 -- 172.21.15.151:0/1466765151 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc06a020 con 0x557702a766a0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f74d9ffb640 1 -- 172.21.15.151:0/1466765151 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc061040 con 0x557702a766a0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557702a7dd10 con 0x557702a766a0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f74d9ffb640 1 -- 172.21.15.151:0/1466765151 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc0265d0 con 0x557702a766a0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557702a7dd10 con 0x557702a766a0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f74d9ffb640 1 -- 172.21.15.151:0/1466765151 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f75fc027780 con 0x557702a766a0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f74d9ffb640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74cc034650 0x7f74cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f74d9ffb640 1 -- 172.21.15.151:0/1466765151 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f75fc06ba20 con 0x557702a766a0 2024-09-10T14:28:54.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7603d76640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74cc034650 0x7f74cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702a88780 0x557702a8ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a8b370 con 0x557702a88780 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7604d78640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702a88780 0x557702a8ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7603d76640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74cc034650 0x7f74cc036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c10 tx=0x7f75ec0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7604d78640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702a88780 0x557702a8ac20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 20 realm 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a8b780 con 0x557702a88780 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.923+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c020 con 0x557702a88780 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a8d120 0x557702a8f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a8fb60 con 0x557702a8d120 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604577640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a8d120 0x557702a8f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604577640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a8d120 0x557702a8f510 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 20 searching for the correct realm 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a913c0 con 0x557702a8d120 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604577640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f75fc027020 0x7f75fc021390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a913c0 con 0x7f75fc027020 2024-09-10T14:28:54.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7603d76640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f75fc027020 0x7f75fc021390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7603d76640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f75fc027020 0x7f75fc021390 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7603d76640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f75ec0e0040 0x7f75ec0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:54.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a913c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604d78640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f75ec0e0040 0x7f75ec0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.927+0000 7f7604d78640 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f75ec0e0040 0x7f75ec0e0420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75fc027020 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a8d120 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75fc027020 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.931+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a8d120 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a8d120 2024-09-10T14:28:54.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a8d120 2024-09-10T14:28:54.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a8d120 2024-09-10T14:28:54.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a8d120 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75fc027020 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.935+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a8d120 2024-09-10T14:28:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75fc027020 2024-09-10T14:28:54.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a8d120 2024-09-10T14:28:54.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75ec0e0040 2024-09-10T14:28:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x557702a88780 2024-09-10T14:28:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557702a8c3c0 con 0x7f75fc027020 2024-09-10T14:28:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a904e0 con 0x557702a88780 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a90d30 con 0x557702a88780 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.939+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a90880 con 0x7f75ec0e0040 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 zone default found 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 4 Realm: () 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 zonegroup default 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a90cb0 con 0x7f75ec0e0040 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a931d0 con 0x557702a8d120 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a93570 con 0x557702a8d120 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 started sync module instance, tier type = 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a92670 con 0x7f75fc027020 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969634107840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a93910 con 0x7f75fc027020 2024-09-10T14:28:54.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.943+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a941e0 con 0x557702a88780 2024-09-10T14:28:54.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.947+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93969634107840] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.947+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.947+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969634114736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a945d0 con 0x557702a88780 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.947+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a94f90 con 0x557702a8d120 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.947+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.947+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969634118368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a957e0 con 0x557702a8d120 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.947+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a961e0 con 0x7f75fc027020 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93969634114736] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969634110096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a96ab0 con 0x7f75fc027020 2024-09-10T14:28:54.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a97300 con 0x557702a88780 2024-09-10T14:28:54.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93969634118368] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93969634110096] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969634120496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a97300 con 0x557702a88780 2024-09-10T14:28:54.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.951+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a97ba0 con 0x7f75ec0e0040 2024-09-10T14:28:54.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.955+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93969634120496] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.955+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.955+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969634127712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a978d0 con 0x7f75ec0e0040 2024-09-10T14:28:54.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.955+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a983f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.955+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93969634127712] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.955+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.955+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969634131648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a983b0 con 0x7f75ec0e0040 2024-09-10T14:28:54.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.955+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a98e00 con 0x7f75ec0e0040 2024-09-10T14:28:54.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93969634131648] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969634128768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a98e00 con 0x7f75ec0e0040 2024-09-10T14:28:54.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 20 add_watcher() i=0 2024-09-10T14:28:54.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 20 add_watcher() i=1 2024-09-10T14:28:54.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 20 add_watcher() i=2 2024-09-10T14:28:54.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 20 add_watcher() i=3 2024-09-10T14:28:54.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 20 add_watcher() i=4 2024-09-10T14:28:54.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 20 add_watcher() i=5 2024-09-10T14:28:54.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 20 add_watcher() i=6 2024-09-10T14:28:54.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93969634128768] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 20 add_watcher() i=7 2024-09-10T14:28:54.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:54.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702a9c270 con 0x557702a88780 2024-09-10T14:28:54.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.959+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969634134976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a99610 con 0x557702a88780 2024-09-10T14:28:54.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93969634134976] v33'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f74ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:54.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:54.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 5 note: GC not initialized 2024-09-10T14:28:54.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f74b97e2640 20 reqs_thread_entry: start 2024-09-10T14:28:54.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:54.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 Filter name: none 2024-09-10T14:28:54.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7432ffd640 20 reqs_thread_entry: start 2024-09-10T14:28:54.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:28:54.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702abf860 con 0x7f75ec0e0040 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702ac1940 con 0x7f75fc027020 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:54.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702ac31c0 con 0x557702a88780 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(64 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T14:28:54.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.963+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702ac46e0 con 0x7f75ec0e0040 2024-09-10T14:28:54.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(65 fud.buckets [call] v33'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7606a67980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T14:28:54.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7606a67980 20 rados->read ofs=0 len=0 2024-09-10T14:28:54.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702ac4ae0 con 0x7f75fc027020 2024-09-10T14:28:54.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7606a67980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:54.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7606a67980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T14:28:54.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7606a67980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:54.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7606a67980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:54.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.967+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702aca6d0 con 0x7f75fc027020 2024-09-10T14:28:54.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7606a67980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T14:28:54.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7606a67980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:54.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7606a67980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T14:28:54.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93969634320864 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557702ac7c40 con 0x7f75ec0e0040 2024-09-10T14:28:54.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== watch-notify(notify (1) cookie 93969634131648 notify 141733920772 ret 0) ==== 380+0+0 (crc 0 0 0) 0x557702ac35b0 con 0x7f75ec0e0040 2024-09-10T14:28:54.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f74db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 93969634131648 notifier 4512 bl.length()=338 2024-09-10T14:28:54.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f74db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T14:28:54.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f74db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:54.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(68 notify.6 [notify cookie 93969634320864 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f74db7fe640 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f74c8003eb0 con 0x7f75ec0e0040 2024-09-10T14:28:54.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== watch-notify(notify_complete (2) cookie 93969634320864 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557702ac2730 con 0x7f75ec0e0040 2024-09-10T14:28:54.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f74ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:54.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.971+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969634134976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702abd690 con 0x557702a88780 2024-09-10T14:28:54.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93969634134976] v33'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969634107840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702abd690 con 0x7f75fc027020 2024-09-10T14:28:54.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93969634107840] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7606a67980 20 remove_watcher() i=0 2024-09-10T14:28:54.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7606a67980 2 removed watcher, disabling cache 2024-09-10T14:28:54.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969634114736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a921c0 con 0x557702a88780 2024-09-10T14:28:54.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93969634114736] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7606a67980 20 remove_watcher() i=1 2024-09-10T14:28:54.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.975+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969634118368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702abd690 con 0x557702a8d120 2024-09-10T14:28:54.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.979+0000 7f7604577640 1 -- 172.21.15.151:0/1466765151 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93969634118368] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc059070 con 0x557702a8d120 2024-09-10T14:28:54.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.979+0000 7f7606a67980 20 remove_watcher() i=2 2024-09-10T14:28:54.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.979+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969634110096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a93cb0 con 0x7f75fc027020 2024-09-10T14:28:54.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.979+0000 7f7603d76640 1 -- 172.21.15.151:0/1466765151 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93969634110096] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75ec0aaae0 con 0x7f75fc027020 2024-09-10T14:28:54.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.979+0000 7f7606a67980 20 remove_watcher() i=3 2024-09-10T14:28:54.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.979+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969634120496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702abd690 con 0x557702a88780 2024-09-10T14:28:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.983+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93969634120496] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x557702a88780 2024-09-10T14:28:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.983+0000 7f7606a67980 20 remove_watcher() i=4 2024-09-10T14:28:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.983+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969634127712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a92a90 con 0x7f75ec0e0040 2024-09-10T14:28:54.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.983+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93969634127712] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.983+0000 7f7606a67980 20 remove_watcher() i=5 2024-09-10T14:28:54.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.983+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969634131648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702a93cb0 con 0x7f75ec0e0040 2024-09-10T14:28:54.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.983+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93969634131648] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 20 remove_watcher() i=6 2024-09-10T14:28:54.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969634128768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557702abd690 con 0x7f75ec0e0040 2024-09-10T14:28:54.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93969634128768] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40083f0 con 0x7f75ec0e0040 2024-09-10T14:28:54.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 20 remove_watcher() i=7 2024-09-10T14:28:54.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f75ec0e0040 msgr2=0x7f75ec0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f75ec0e0040 0x7f75ec0e0420 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702a88780 msgr2=0x557702a8ac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702a88780 0x557702a8ac20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f75fc027020 msgr2=0x7f75fc021390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f75fc027020 0x7f75fc021390 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a8d120 msgr2=0x557702a8f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a8d120 0x557702a8f510 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74cc034650 msgr2=0x7f74cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74cc034650 0x7f74cc036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c10 tx=0x7f75ec0c1040 comp rx=0 tx=0).stop 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 msgr2=0x557702a7d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7604d78640 1 -- 172.21.15.151:0/1466765151 reap_dead start 2024-09-10T14:28:54.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a7d7d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f75fc01ed60 tx=0x7f75fc0051c0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 shutdown_connections 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1466765151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a766a0 0x557702a7d7d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 >> 172.21.15.151:0/1466765151 conn(0x557702a72a30 msgr2=0x557702a70b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 shutdown_connections 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1466765151 wait complete. 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1946816530 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74dc0346a0 msgr2=0x7f74dc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1946816530 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74dc0346a0 0x7f74dc036b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x557702a53950 tx=0x7f75ec005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1946816530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a69d10 msgr2=0x557702a6a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1946816530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a69d10 0x557702a6a130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0069a0 tx=0x7f75fc010ab0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1946816530 shutdown_connections 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1946816530 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74dc0346a0 0x7f74dc036b60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/1946816530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557702a69d10 0x557702a6a130 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1946816530 >> 172.21.15.151:0/1946816530 conn(0x557702a5ee60 msgr2=0x557702a618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1946816530 shutdown_connections 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/1946816530 wait complete. 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557702a59710 msgr2=0x557702a5bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557702a59710 0x557702a5bb00 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702958480 msgr2=0x557702a52e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557702958480 0x557702a52e10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a557d0 msgr2=0x557702a57bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557702a557d0 0x557702a57bc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74ec034650 msgr2=0x7f74ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74ec034650 0x7f74ec036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0ae000 tx=0x7f75ec0a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 msgr2=0x557702a4be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:54.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 --2- 172.21.15.151:0/3337615497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577029578a0 0x557702a4be00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f75fc006640 tx=0x7f75fc000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:54.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7604d78640 1 -- 172.21.15.151:0/3337615497 reap_dead start 2024-09-10T14:28:54.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 shutdown_connections 2024-09-10T14:28:54.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 >> 172.21.15.151:0/3337615497 conn(0x5577029537b0 msgr2=0x557702a3f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:54.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 shutdown_connections 2024-09-10T14:28:54.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:54.987+0000 7f7606a67980 1 -- 172.21.15.151:0/3337615497 wait complete. 2024-09-10T14:28:55.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1'] 2024-09-10T14:28:55.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1'] 2024-09-10T14:28:55.002 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:55.083 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:55.083 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:55.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f814061d980 1 Processor -- start 2024-09-10T14:28:55.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f814061d980 1 -- start start 2024-09-10T14:28:55.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f814061d980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55f74f9cbff0 0x55f74f9ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f814061d980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f74f851ae0 con 0x55f74f9c7c20 2024-09-10T14:28:55.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f814061d980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55f74f875e30 con 0x55f74f9cbff0 2024-09-10T14:28:55.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f813d92c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55f74f9cbff0 0x55f74f9ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f813e12d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55f74f9c7c20 0x55f74f9c8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44692/0 (socket says 172.21.15.151:44692) 2024-09-10T14:28:55.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f813e12d640 1 -- 172.21.15.151:0/989140010 learned_addr learned my addr 172.21.15.151:0/989140010 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:55.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f813d12b640 1 -- 172.21.15.151:0/989140010 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175327220 0 0) 0x55f74f851ae0 con 0x55f74f9c7c20 2024-09-10T14:28:55.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f813d12b640 1 -- 172.21.15.151:0/989140010 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8128001e20 con 0x55f74f9c7c20 2024-09-10T14:28:55.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f813d92c640 1 -- 172.21.15.151:0/989140010 >> v1:172.21.15.52:6789/0 conn(0x55f74f9c7c20 legacy=0x55f74f9c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.079+0000 7f813d92c640 1 -- 172.21.15.151:0/989140010 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74f9cf930 con 0x55f74f9cbff0 2024-09-10T14:28:55.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f813d92c640 1 --2- 172.21.15.151:0/989140010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9cbff0 0x55f74f9ce3e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f813000b5d0 tx=0x7f813001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8a47fab6ceb0f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f813d12b640 1 -- 172.21.15.151:0/989140010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81300af070 con 0x55f74f9cbff0 2024-09-10T14:28:55.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f813d12b640 1 -- 172.21.15.151:0/989140010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81300aa3f0 con 0x55f74f9cbff0 2024-09-10T14:28:55.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f813d12b640 1 -- 172.21.15.151:0/989140010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81300a7070 con 0x55f74f9cbff0 2024-09-10T14:28:55.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f814061d980 1 -- 172.21.15.151:0/989140010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9cbff0 msgr2=0x55f74f9ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f814061d980 1 --2- 172.21.15.151:0/989140010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9cbff0 0x55f74f9ce3e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f813000b5d0 tx=0x7f813001c3c0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f814061d980 1 -- 172.21.15.151:0/989140010 shutdown_connections 2024-09-10T14:28:55.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f814061d980 1 --2- 172.21.15.151:0/989140010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9cbff0 0x55f74f9ce3e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f814061d980 1 -- 172.21.15.151:0/989140010 >> 172.21.15.151:0/989140010 conn(0x55f74f9c3740 msgr2=0x55f74f9c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f814061d980 1 -- 172.21.15.151:0/989140010 shutdown_connections 2024-09-10T14:28:55.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.083+0000 7f814061d980 1 -- 172.21.15.151:0/989140010 wait complete. 2024-09-10T14:28:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 Processor -- start 2024-09-10T14:28:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 -- start start 2024-09-10T14:28:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fab2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f74f877200 con 0x55f74f9c7c20 2024-09-10T14:28:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fab2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fab2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49674/0 (socket says 172.21.15.151:49674) 2024-09-10T14:28:55.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f813e12d640 1 -- 172.21.15.151:0/3094175500 learned_addr learned my addr 172.21.15.151:0/3094175500 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f813e12d640 1 -- 172.21.15.151:0/3094175500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74fab3540 con 0x55f74f9c7c20 2024-09-10T14:28:55.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f813e12d640 1 --2- 172.21.15.151:0/3094175500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fab2f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8134001e40 tx=0x7f813400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1090b6c2d784397 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f802c608640 1 -- 172.21.15.151:0/3094175500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8134012020 con 0x55f74f9c7c20 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f802c608640 1 -- 172.21.15.151:0/3094175500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813400e7c0 con 0x55f74f9c7c20 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f802c608640 1 -- 172.21.15.151:0/3094175500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f813400eb00 con 0x55f74f9c7c20 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 -- 172.21.15.151:0/3094175500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 msgr2=0x55f74fab2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 --2- 172.21.15.151:0/3094175500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fab2f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8134001e40 tx=0x7f813400b790 comp rx=0 tx=0).stop 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 -- 172.21.15.151:0/3094175500 shutdown_connections 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 --2- 172.21.15.151:0/3094175500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fab2f70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 -- 172.21.15.151:0/3094175500 >> 172.21.15.151:0/3094175500 conn(0x55f74f9c3740 msgr2=0x55f74faaeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 -- 172.21.15.151:0/3094175500 shutdown_connections 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.099+0000 7f814061d980 1 -- 172.21.15.151:0/3094175500 wait complete. 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f814061d980 1 Processor -- start 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f814061d980 1 -- start start 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f814061d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fabe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f814061d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f74f9cf430 con 0x55f74f9c7c20 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fabe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fabe7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49676/0 (socket says 172.21.15.151:49676) 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f813e12d640 1 -- 172.21.15.151:0/2826605552 learned_addr learned my addr 172.21.15.151:0/2826605552 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f813e12d640 1 -- 172.21.15.151:0/2826605552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74fabed10 con 0x55f74f9c7c20 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f813e12d640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fabe7d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f813400b7d0 tx=0x7f8134000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f802ae05640 1 -- 172.21.15.151:0/2826605552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8134012030 con 0x55f74f9c7c20 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f74fabefa0 con 0x55f74f9c7c20 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f802ae05640 1 -- 172.21.15.151:0/2826605552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81340014a0 con 0x55f74f9c7c20 2024-09-10T14:28:55.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f802ae05640 1 -- 172.21.15.151:0/2826605552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f813401aaf0 con 0x55f74f9c7c20 2024-09-10T14:28:55.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f74fac1c80 con 0x55f74f9c7c20 2024-09-10T14:28:55.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f802ae05640 1 -- 172.21.15.151:0/2826605552 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8134015020 con 0x55f74f9c7c20 2024-09-10T14:28:55.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f802ae05640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 0x7f8024036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f802ae05640 1 -- 172.21.15.151:0/2826605552 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8134020030 con 0x55f74f9c7c20 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.103+0000 7f813d92c640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 0x7f8024036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f814061d980 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74f9cbff0 0x55f74fac57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fac5e10 con 0x55f74f9cbff0 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813e92e640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74f9cbff0 0x55f74fac57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813d92c640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 0x7f8024036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55f74f9c7830 tx=0x7f81300a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813e92e640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74f9cbff0 0x55f74fac57a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813e92e640 1 -- 172.21.15.151:0/2826605552 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74f9cbff0 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fac2ea0 con 0x55f74f9cbff0 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813e92e640 1 -- 172.21.15.151:0/2826605552 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81380083f0 con 0x55f74f9cbff0 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f814061d980 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74fac8160 0x55f74faca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74facac40 con 0x55f74fac8160 2024-09-10T14:28:55.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813e12d640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74fac8160 0x55f74faca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813e12d640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74fac8160 0x55f74faca550 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813e12d640 1 -- 172.21.15.151:0/2826605552 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8134008030 con 0x55f74fac8160 2024-09-10T14:28:55.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fac7000 con 0x55f74f9cbff0 2024-09-10T14:28:55.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813e92e640 1 -- 172.21.15.151:0/2826605552 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81380083f0 con 0x55f74f9cbff0 2024-09-10T14:28:55.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f814061d980 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f74facc0a0 0x55f74face490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74facebd0 con 0x55f74facc0a0 2024-09-10T14:28:55.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813d92c640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f74facc0a0 0x55f74face490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.107+0000 7f813d92c640 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f74facc0a0 0x55f74face490 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f813d92c640 1 -- 172.21.15.151:0/2826605552 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81300ab890 con 0x55f74facc0a0 2024-09-10T14:28:55.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f814061d980 1 Processor -- start 2024-09-10T14:28:55.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f814061d980 1 -- start start 2024-09-10T14:28:55.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f814061d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fadc680 0x55f74fadcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f814061d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f74f8d0800 con 0x55f74fadc680 2024-09-10T14:28:55.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fadc680 0x55f74fadcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fadc680 0x55f74fadcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49688/0 (socket says 172.21.15.151:49688) 2024-09-10T14:28:55.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f813e12d640 1 -- 172.21.15.151:0/651971347 learned_addr learned my addr 172.21.15.151:0/651971347 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f813e12d640 1 -- 172.21.15.151:0/651971347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74fadcfe0 con 0x55f74fadc680 2024-09-10T14:28:55.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f813e12d640 1 --2- 172.21.15.151:0/651971347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fadc680 0x55f74fadcaa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8134048460 tx=0x7f813400d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f8023fff640 1 -- 172.21.15.151:0/651971347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8134017e60 con 0x55f74fadc680 2024-09-10T14:28:55.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f814061d980 1 -- 172.21.15.151:0/651971347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f74fadd270 con 0x55f74fadc680 2024-09-10T14:28:55.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f8023fff640 1 -- 172.21.15.151:0/651971347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8134041350 con 0x55f74fadc680 2024-09-10T14:28:55.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f8023fff640 1 -- 172.21.15.151:0/651971347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8134041630 con 0x55f74fadc680 2024-09-10T14:28:55.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f814061d980 1 -- 172.21.15.151:0/651971347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f74fadfef0 con 0x55f74fadc680 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f8023fff640 1 -- 172.21.15.151:0/651971347 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8134009070 con 0x55f74fadc680 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f8023fff640 1 --2- 172.21.15.151:0/651971347 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8018034650 0x7f8018036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f8023fff640 1 -- 172.21.15.151:0/651971347 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8134005050 con 0x55f74fadc680 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.111+0000 7f813d92c640 1 --2- 172.21.15.151:0/651971347 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8018034650 0x7f8018036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 Processor -- start 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- start start 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74fae91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f74fab38c0 con 0x55f74fae8db0 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813d92c640 1 --2- 172.21.15.151:0/651971347 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8018034650 0x7f8018036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55f74fac62e0 tx=0x7f8130005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74fae91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74fae91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49692/0 (socket says 172.21.15.151:49692) 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 -- 172.21.15.151:0/907585764 learned_addr learned my addr 172.21.15.151:0/907585764 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 -- 172.21.15.151:0/907585764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74fae9780 con 0x55f74fae8db0 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 --2- 172.21.15.151:0/907585764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74fae91b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8134036010 tx=0x7f813403a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949402bbb031624b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f8021ffb640 1 -- 172.21.15.151:0/907585764 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8134060020 con 0x55f74fae8db0 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f8021ffb640 1 -- 172.21.15.151:0/907585764 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8134024420 con 0x55f74fae8db0 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f8021ffb640 1 -- 172.21.15.151:0/907585764 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81340417d0 con 0x55f74fae8db0 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- 172.21.15.151:0/907585764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 msgr2=0x55f74fae91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 --2- 172.21.15.151:0/907585764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74fae91b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8134036010 tx=0x7f813403a4f0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- 172.21.15.151:0/907585764 shutdown_connections 2024-09-10T14:28:55.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 --2- 172.21.15.151:0/907585764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74fae91b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- 172.21.15.151:0/907585764 >> 172.21.15.151:0/907585764 conn(0x55f74fae5190 msgr2=0x55f74fae3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- 172.21.15.151:0/907585764 shutdown_connections 2024-09-10T14:28:55.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- 172.21.15.151:0/907585764 wait complete. 2024-09-10T14:28:55.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 Processor -- start 2024-09-10T14:28:55.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- start start 2024-09-10T14:28:55.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74faefff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f814061d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f74fae9c00 con 0x55f74fae8db0 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74faefff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74faefff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49698/0 (socket says 172.21.15.151:49698) 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 learned_addr learned my addr 172.21.15.151:0/2395807375 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74faf0530 con 0x55f74fae8db0 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.115+0000 7f813e12d640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74faefff0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f813402dea0 tx=0x7f813405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f800ffff640 1 -- 172.21.15.151:0/2395807375 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8134074070 con 0x55f74fae8db0 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f74faf0530 con 0x55f74fae8db0 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f800ffff640 1 -- 172.21.15.151:0/2395807375 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81340165e0 con 0x55f74fae8db0 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f800ffff640 1 -- 172.21.15.151:0/2395807375 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f813403ae60 con 0x55f74fae8db0 2024-09-10T14:28:55.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f74faf0530 con 0x55f74fae8db0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f800ffff640 1 -- 172.21.15.151:0/2395807375 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8134077070 con 0x55f74fae8db0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f800ffff640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8008034650 0x7f8008036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f800ffff640 1 -- 172.21.15.151:0/2395807375 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f813406c050 con 0x55f74fae8db0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813d92c640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8008034650 0x7f8008036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74fafb0c0 0x55f74fafd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafdcd0 con 0x55f74fafb0c0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813e92e640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74fafb0c0 0x55f74fafd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813d92c640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8008034650 0x7f8008036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8130018fd0 tx=0x7f81300a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813e92e640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74fafb0c0 0x55f74fafd580 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 realm 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafe0e0 con 0x55f74fafb0c0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafe980 con 0x55f74fafb0c0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74faffa80 0x55f74fb01e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb024c0 con 0x55f74faffa80 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.119+0000 7f813e12d640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74faffa80 0x55f74fb01e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e12d640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74faffa80 0x55f74fb01e70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f814061d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:55.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f814061d980 20 searching for the correct realm 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb03d20 con 0x55f74faffa80 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e12d640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8134079060 0x7f8134004310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb03d20 con 0x7f8134079060 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813d92c640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8134079060 0x7f8134004310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813d92c640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8134079060 0x7f8134004310 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813d92c640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f81300db040 0x7f81300dc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb03d20 con 0x7f81300db040 2024-09-10T14:28:55.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e92e640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f81300db040 0x7f81300dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e92e640 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f81300db040 0x7f81300dc430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.123+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f81300db040 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f81300db040 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f8134079060 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74faffa80 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f81300db040 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f8134079060 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74faffa80 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74faffa80 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.127+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f81300db040 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74faffa80 2024-09-10T14:28:55.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74faffa80 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f81300db040 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74faffa80 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f8134079060 2024-09-10T14:28:55.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f81300db040 2024-09-10T14:28:55.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74faffa80 2024-09-10T14:28:55.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.131+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f81300db040 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f8134079060 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74faffa80 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f81300db040 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x55f74fafb0c0 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f74fafed20 con 0x7f8134079060 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:55.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:55.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:55.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:55.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:55.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:55.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb02e10 con 0x55f74fafb0c0 2024-09-10T14:28:55.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb03660 con 0x55f74fafb0c0 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.135+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb02a20 con 0x7f81300db040 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 zone default found 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 4 Realm: () 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:55.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 zonegroup default 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb03b50 con 0x7f81300db040 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb03b20 con 0x55f74faffa80 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb05c20 con 0x55f74faffa80 2024-09-10T14:28:55.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 started sync module instance, tier type = 2024-09-10T14:28:55.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:55.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb05000 con 0x7f8134079060 2024-09-10T14:28:55.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94520682239008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb04c60 con 0x7f8134079060 2024-09-10T14:28:55.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb06b50 con 0x55f74fafb0c0 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.139+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94520682239008] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.143+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.143+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94520682243744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb06f70 con 0x55f74fafb0c0 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.143+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb07840 con 0x55f74faffa80 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.143+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.143+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94520682246304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb080e0 con 0x55f74faffa80 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.143+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb08ae0 con 0x7f8134079060 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.143+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94520682243744] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.147+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.147+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94520682244800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb08f00 con 0x7f8134079060 2024-09-10T14:28:55.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.147+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb098c0 con 0x55f74fafb0c0 2024-09-10T14:28:55.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.147+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94520682246304] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.147+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94520682244800] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.147+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.147+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94520682249264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb08700 con 0x55f74fafb0c0 2024-09-10T14:28:55.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.147+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb098c0 con 0x7f81300db040 2024-09-10T14:28:55.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.151+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94520682249264] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.151+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.151+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94520682258032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb098c0 con 0x7f81300db040 2024-09-10T14:28:55.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.151+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb0aa30 con 0x7f81300db040 2024-09-10T14:28:55.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.151+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.151+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94520682259840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb0ae50 con 0x7f81300db040 2024-09-10T14:28:55.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.151+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb0b880 con 0x7f81300db040 2024-09-10T14:28:55.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.151+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94520682258032] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94520682255376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb0b840 con 0x7f81300db040 2024-09-10T14:28:55.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 20 add_watcher() i=0 2024-09-10T14:28:55.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 20 add_watcher() i=1 2024-09-10T14:28:55.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 20 add_watcher() i=2 2024-09-10T14:28:55.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 20 add_watcher() i=3 2024-09-10T14:28:55.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 20 add_watcher() i=4 2024-09-10T14:28:55.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 20 add_watcher() i=5 2024-09-10T14:28:55.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94520682259840] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 20 add_watcher() i=6 2024-09-10T14:28:55.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94520682255376] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 20 add_watcher() i=7 2024-09-10T14:28:55.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:55.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb0a9a0 con 0x55f74fafb0c0 2024-09-10T14:28:55.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.155+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94520682260896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb0bce0 con 0x55f74fafb0c0 2024-09-10T14:28:55.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94520682260896] v33'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f7ff4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:55.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:55.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:55.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 5 note: GC not initialized 2024-09-10T14:28:55.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f7f6f7fe640 20 reqs_thread_entry: start 2024-09-10T14:28:55.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:55.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 Filter name: none 2024-09-10T14:28:55.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f7f6d7fa640 20 reqs_thread_entry: start 2024-09-10T14:28:55.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb31e40 con 0x55f74fafb0c0 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb33f20 con 0x7f8134079060 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:55.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb35bb0 con 0x55f74fafb0c0 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T14:28:55.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.159+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb3a200 con 0x7f81300db040 2024-09-10T14:28:55.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.163+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(65 fud.buckets [call] v33'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.163+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb40100 con 0x55f74fafb0c0 2024-09-10T14:28:55.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.163+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.163+0000 7f814061d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.163+0000 7f814061d980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.163+0000 7f814061d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.163+0000 7f814061d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1, ofs0, ns] 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.163+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94520682435680 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb3a630 con 0x7f8134079060 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== watch-notify(notify (1) cookie 94520682239008 notify 141733920788 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f81300e5060 con 0x7f8134079060 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f8021ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 94520682239008 notifier 4519 bl.length()=752 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f8021ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f8021ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f8021ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(67 notify.0 [notify cookie 94520682435680 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f8021ffb640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8004003eb0 con 0x7f8134079060 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== watch-notify(notify_complete (2) cookie 94520682435680 notify 141733920788 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f74f9cf930 con 0x7f8134079060 2024-09-10T14:28:55.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f814061d980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_sources= new_sources= 2024-09-10T14:28:55.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f814061d980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential sources added=[] removed=[] 2024-09-10T14:28:55.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f814061d980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_dests= new_dests= 2024-09-10T14:28:55.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f814061d980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential dests added=[] removed=[] 2024-09-10T14:28:55.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb35460 con 0x7f8134079060 2024-09-10T14:28:55.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(69 foo.buckets [call] v33'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.167+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb3f930 con 0x7f8134079060 2024-09-10T14:28:55.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f814061d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T14:28:55.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f814061d980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:55.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f814061d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T14:28:55.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94520682435680 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb3edd0 con 0x7f81300db040 2024-09-10T14:28:55.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== watch-notify(notify (1) cookie 94520682259840 notify 141733920773 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55f74fb33d20 con 0x7f81300db040 2024-09-10T14:28:55.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f8021ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94520682259840 notifier 4519 bl.length()=314 2024-09-10T14:28:55.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f8021ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T14:28:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f8021ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.6 [notify cookie 94520682435680 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f8021ffb640 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8004003eb0 con 0x7f81300db040 2024-09-10T14:28:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== watch-notify(notify_complete (2) cookie 94520682435680 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8138010040 con 0x7f81300db040 2024-09-10T14:28:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f7ff4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:55.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.171+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94520682260896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb2fc70 con 0x55f74fafb0c0 2024-09-10T14:28:55.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.175+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94520682260896] v33'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.175+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94520682239008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb2fc70 con 0x7f8134079060 2024-09-10T14:28:55.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.175+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94520682239008] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.175+0000 7f814061d980 20 remove_watcher() i=0 2024-09-10T14:28:55.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.175+0000 7f814061d980 2 removed watcher, disabling cache 2024-09-10T14:28:55.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.175+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94520682243744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb2fc70 con 0x55f74fafb0c0 2024-09-10T14:28:55.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94520682243744] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f814061d980 20 remove_watcher() i=1 2024-09-10T14:28:55.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94520682246304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb2fc70 con 0x55f74faffa80 2024-09-10T14:28:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f813e12d640 1 -- 172.21.15.151:0/2395807375 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94520682246304] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8134076030 con 0x55f74faffa80 2024-09-10T14:28:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f814061d980 20 remove_watcher() i=2 2024-09-10T14:28:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94520682244800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb2fc70 con 0x7f8134079060 2024-09-10T14:28:55.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f813d92c640 1 -- 172.21.15.151:0/2395807375 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94520682244800] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81300c8030 con 0x7f8134079060 2024-09-10T14:28:55.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f814061d980 20 remove_watcher() i=3 2024-09-10T14:28:55.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.179+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94520682249264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb2fc70 con 0x55f74fafb0c0 2024-09-10T14:28:55.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.183+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94520682249264] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x55f74fafb0c0 2024-09-10T14:28:55.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.183+0000 7f814061d980 20 remove_watcher() i=4 2024-09-10T14:28:55.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.183+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94520682258032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb2fc70 con 0x7f81300db040 2024-09-10T14:28:55.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.183+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94520682258032] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.183+0000 7f814061d980 20 remove_watcher() i=5 2024-09-10T14:28:55.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.183+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94520682259840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb09e70 con 0x7f81300db040 2024-09-10T14:28:55.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94520682259840] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 20 remove_watcher() i=6 2024-09-10T14:28:55.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94520682255376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f74fb2fc70 con 0x7f81300db040 2024-09-10T14:28:55.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94520682255376] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81380083f0 con 0x7f81300db040 2024-09-10T14:28:55.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 20 remove_watcher() i=7 2024-09-10T14:28:55.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f81300db040 msgr2=0x7f81300dc430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f81300db040 0x7f81300dc430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74fafb0c0 msgr2=0x55f74fafd580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74fafb0c0 0x55f74fafd580 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8134079060 msgr2=0x7f8134004310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8134079060 0x7f8134004310 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74faffa80 msgr2=0x55f74fb01e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74faffa80 0x55f74fb01e70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8008034650 msgr2=0x7f8008036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8008034650 0x7f8008036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8130018fd0 tx=0x7f81300a8000 comp rx=0 tx=0).stop 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 msgr2=0x55f74faefff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f813e92e640 1 -- 172.21.15.151:0/2395807375 reap_dead start 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74faefff0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f813402dea0 tx=0x7f813405b000 comp rx=0 tx=0).stop 2024-09-10T14:28:55.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 shutdown_connections 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 --2- 172.21.15.151:0/2395807375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fae8db0 0x55f74faefff0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 >> 172.21.15.151:0/2395807375 conn(0x55f74fae5190 msgr2=0x55f74fae3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 shutdown_connections 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.187+0000 7f814061d980 1 -- 172.21.15.151:0/2395807375 wait complete. 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/651971347 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8018034650 msgr2=0x7f8018036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/651971347 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8018034650 0x7f8018036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55f74fac62e0 tx=0x7f8130005d90 comp rx=0 tx=0).stop 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/651971347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fadc680 msgr2=0x55f74fadcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/651971347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fadc680 0x55f74fadcaa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8134048460 tx=0x7f813400d6b0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/651971347 shutdown_connections 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/651971347 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8018034650 0x7f8018036b10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/651971347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74fadc680 0x55f74fadcaa0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/651971347 >> 172.21.15.151:0/651971347 conn(0x55f74fad17d0 msgr2=0x55f74fad4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/651971347 shutdown_connections 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/651971347 wait complete. 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f74facc0a0 msgr2=0x55f74face490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f74facc0a0 0x55f74face490 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74f9cbff0 msgr2=0x55f74fac57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f74f9cbff0 0x55f74fac57a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74fac8160 msgr2=0x55f74faca550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f74fac8160 0x55f74faca550 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 msgr2=0x7f8024036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 0x7f8024036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55f74f9c7830 tx=0x7f81300a7000 comp rx=0 tx=0).stop 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 msgr2=0x55f74fabe7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 --2- 172.21.15.151:0/2826605552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f74f9c7c20 0x55f74fabe7d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f813400b7d0 tx=0x7f8134000ee0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f813e92e640 1 -- 172.21.15.151:0/2826605552 reap_dead start 2024-09-10T14:28:55.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 shutdown_connections 2024-09-10T14:28:55.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 >> 172.21.15.151:0/2826605552 conn(0x55f74f9c3740 msgr2=0x55f74faad720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 shutdown_connections 2024-09-10T14:28:55.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.191+0000 7f814061d980 1 -- 172.21.15.151:0/2826605552 wait complete. 2024-09-10T14:28:55.205 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T14:28:55.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T14:28:55.205 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T14:28:55.284 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:55.284 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:55.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.279+0000 7f8c8f07d980 1 Processor -- start 2024-09-10T14:28:55.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.279+0000 7f8c8f07d980 1 -- start start 2024-09-10T14:28:55.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8f07d980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5587a99d8c60 0x5587a99db050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8f07d980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5587a985aae0 con 0x5587a99d48e0 2024-09-10T14:28:55.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8f07d980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5587a987ee30 con 0x5587a99d8c60 2024-09-10T14:28:55.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8c38c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5587a99d8c60 0x5587a99db050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8c38c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5587a99d8c60 0x5587a99db050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49704/0 (socket says 172.21.15.151:49704) 2024-09-10T14:28:55.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8c38c640 1 -- 172.21.15.151:0/2866477947 learned_addr learned my addr 172.21.15.151:0/2866477947 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8c38c640 1 -- 172.21.15.151:0/2866477947 >> v1:172.21.15.52:6789/0 conn(0x5587a99d48e0 legacy=0x5587a99d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8c38c640 1 -- 172.21.15.151:0/2866477947 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a99dc5a0 con 0x5587a99d8c60 2024-09-10T14:28:55.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/2866477947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d8c60 0x5587a99db050 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000a5c0 tx=0x7f8c8001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feaa8dcce3e0bb9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8bb8b640 1 -- 172.21.15.151:0/2866477947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c800a6070 con 0x5587a99d8c60 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8bb8b640 1 -- 172.21.15.151:0/2866477947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c800af070 con 0x5587a99d8c60 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.283+0000 7f8c8bb8b640 1 -- 172.21.15.151:0/2866477947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c800aa5c0 con 0x5587a99d8c60 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.287+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2866477947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d8c60 msgr2=0x5587a99db050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.287+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2866477947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d8c60 0x5587a99db050 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000a5c0 tx=0x7f8c8001b340 comp rx=0 tx=0).stop 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.287+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2866477947 shutdown_connections 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.287+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2866477947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d8c60 0x5587a99db050 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.287+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2866477947 >> 172.21.15.151:0/2866477947 conn(0x5587a9948230 msgr2=0x5587a9948640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.287+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2866477947 shutdown_connections 2024-09-10T14:28:55.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.287+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2866477947 wait complete. 2024-09-10T14:28:55.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.299+0000 7f8c8f07d980 1 Processor -- start 2024-09-10T14:28:55.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.299+0000 7f8c8f07d980 1 -- start start 2024-09-10T14:28:55.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9abfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5587a9880200 con 0x5587a99d48e0 2024-09-10T14:28:55.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9abfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9abfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49712/0 (socket says 172.21.15.151:49712) 2024-09-10T14:28:55.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3046538693 learned_addr learned my addr 172.21.15.151:0/3046538693 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3046538693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a9ac0200 con 0x5587a99d48e0 2024-09-10T14:28:55.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/3046538693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9abfc30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0015f0 tx=0x7f8c7c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947668d981e3ff33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8b7ae0d640 1 -- 172.21.15.151:0/3046538693 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c016070 con 0x5587a99d48e0 2024-09-10T14:28:55.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8b7ae0d640 1 -- 172.21.15.151:0/3046538693 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c00f640 con 0x5587a99d48e0 2024-09-10T14:28:55.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8b7ae0d640 1 -- 172.21.15.151:0/3046538693 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c00f960 con 0x5587a99d48e0 2024-09-10T14:28:55.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3046538693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 msgr2=0x5587a9abfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3046538693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9abfc30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0015f0 tx=0x7f8c7c001ab0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3046538693 shutdown_connections 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3046538693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9abfc30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3046538693 >> 172.21.15.151:0/3046538693 conn(0x5587a9948230 msgr2=0x5587a9abb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3046538693 shutdown_connections 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3046538693 wait complete. 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 Processor -- start 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 -- start start 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9ac7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8f07d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5587a99dc0a0 con 0x5587a99d48e0 2024-09-10T14:28:55.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9ac7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9ac7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49726/0 (socket says 172.21.15.151:49726) 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.303+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/2941667318 learned_addr learned my addr 172.21.15.151:0/2941667318 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/2941667318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a9ac7570 con 0x5587a99d48e0 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9ac7030 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00f610 tx=0x7f8c7c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8b7960a640 1 -- 172.21.15.151:0/2941667318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c021020 con 0x5587a99d48e0 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587a9ac7800 con 0x5587a99d48e0 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8b7960a640 1 -- 172.21.15.151:0/2941667318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c011670 con 0x5587a99d48e0 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8b7960a640 1 -- 172.21.15.151:0/2941667318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c016040 con 0x5587a99d48e0 2024-09-10T14:28:55.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a9aca4e0 con 0x5587a99d48e0 2024-09-10T14:28:55.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8b7960a640 1 -- 172.21.15.151:0/2941667318 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8c7c024020 con 0x5587a99d48e0 2024-09-10T14:28:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8b7960a640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b74034650 0x7f8b74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8b7960a640 1 -- 172.21.15.151:0/2941667318 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8c7c0496f0 con 0x5587a99d48e0 2024-09-10T14:28:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b74034650 0x7f8b74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a99d8c60 0x5587a9ace000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9ace670 con 0x5587a99d8c60 2024-09-10T14:28:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8d38e640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a99d8c60 0x5587a9ace000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b74034650 0x7f8b74036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c800ae000 tx=0x7f8c800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.307+0000 7f8c8d38e640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a99d8c60 0x5587a9ace000 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8d38e640 1 -- 172.21.15.151:0/2941667318 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a99d8c60 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9acb6e0 con 0x5587a99d8c60 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8d38e640 1 -- 172.21.15.151:0/2941667318 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a99d8c60 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9ad09a0 0x5587a9ad2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9ad3460 con 0x5587a9ad09a0 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9ad09a0 0x5587a9ad2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9ad09a0 0x5587a9ad2d90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/2941667318 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c7c00f070 con 0x5587a9ad09a0 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9acf840 con 0x5587a99d8c60 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8d38e640 1 -- 172.21.15.151:0/2941667318 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a99d8c60 2024-09-10T14:28:55.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5587a9ad48c0 0x5587a9ad6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9ad73b0 con 0x5587a9ad48c0 2024-09-10T14:28:55.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5587a9ad48c0 0x5587a9ad6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5587a9ad48c0 0x5587a9ad6cb0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8c38c640 1 -- 172.21.15.151:0/2941667318 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c800aab60 con 0x5587a9ad48c0 2024-09-10T14:28:55.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8f07d980 1 Processor -- start 2024-09-10T14:28:55.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.311+0000 7f8c8f07d980 1 -- start start 2024-09-10T14:28:55.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8f07d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9ae4e80 0x5587a9ae52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8f07d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5587a98d9800 con 0x5587a9ae4e80 2024-09-10T14:28:55.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9ae4e80 0x5587a9ae52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9ae4e80 0x5587a9ae52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49730/0 (socket says 172.21.15.151:49730) 2024-09-10T14:28:55.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/2259015460 learned_addr learned my addr 172.21.15.151:0/2259015460 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/2259015460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a9ae57e0 con 0x5587a9ae4e80 2024-09-10T14:28:55.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/2259015460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9ae4e80 0x5587a9ae52a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c047ae0 tx=0x7f8c7c0493a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8b727fc640 1 -- 172.21.15.151:0/2259015460 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c025de0 con 0x5587a9ae4e80 2024-09-10T14:28:55.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8b727fc640 1 -- 172.21.15.151:0/2259015460 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c02db90 con 0x5587a9ae4e80 2024-09-10T14:28:55.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8b727fc640 1 -- 172.21.15.151:0/2259015460 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c018500 con 0x5587a9ae4e80 2024-09-10T14:28:55.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2259015460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587a9ae5a70 con 0x5587a9ae4e80 2024-09-10T14:28:55.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2259015460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a9ae86f0 con 0x5587a9ae4e80 2024-09-10T14:28:55.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8b727fc640 1 -- 172.21.15.151:0/2259015460 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8c7c0186a0 con 0x5587a9ae4e80 2024-09-10T14:28:55.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8b727fc640 1 --2- 172.21.15.151:0/2259015460 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b64034650 0x7f8b64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8b727fc640 1 -- 172.21.15.151:0/2259015460 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8c7c035070 con 0x5587a9ae4e80 2024-09-10T14:28:55.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/2259015460 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b64034650 0x7f8b64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.315+0000 7f8c8f07d980 1 Processor -- start 2024-09-10T14:28:55.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- start start 2024-09-10T14:28:55.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/2259015460 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b64034650 0x7f8b64036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5587a9acef50 tx=0x7f8c80005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5587a9ac0580 con 0x5587a9af17b0 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49732/0 (socket says 172.21.15.151:49732) 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/2593352673 learned_addr learned my addr 172.21.15.151:0/2593352673 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/2593352673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a9af2160 con 0x5587a9af17b0 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/2593352673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af1b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c039000 tx=0x7f8c7c041230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929b984d7fec10d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8b63fff640 1 -- 172.21.15.151:0/2593352673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c057020 con 0x5587a9af17b0 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8b63fff640 1 -- 172.21.15.151:0/2593352673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c026cd0 con 0x5587a9af17b0 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8b63fff640 1 -- 172.21.15.151:0/2593352673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c031070 con 0x5587a9af17b0 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2593352673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 msgr2=0x5587a9af1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2593352673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af1b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c039000 tx=0x7f8c7c041230 comp rx=0 tx=0).stop 2024-09-10T14:28:55.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2593352673 shutdown_connections 2024-09-10T14:28:55.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2593352673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af1b90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2593352673 >> 172.21.15.151:0/2593352673 conn(0x5587a9aedb90 msgr2=0x5587a9aebc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2593352673 shutdown_connections 2024-09-10T14:28:55.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2593352673 wait complete. 2024-09-10T14:28:55.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 Processor -- start 2024-09-10T14:28:55.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- start start 2024-09-10T14:28:55.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8f07d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5587a9af2600 con 0x5587a9af17b0 2024-09-10T14:28:55.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49742/0 (socket says 172.21.15.151:49742) 2024-09-10T14:28:55.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 learned_addr learned my addr 172.21.15.151:0/3202891179 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.319+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a9af8ed0 con 0x5587a9af17b0 2024-09-10T14:28:55.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af8990 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c02dab0 tx=0x7f8c7c01ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8b627fc640 1 -- 172.21.15.151:0/3202891179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c06c070 con 0x5587a9af17b0 2024-09-10T14:28:55.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587a9af8ed0 con 0x5587a9af17b0 2024-09-10T14:28:55.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8b627fc640 1 -- 172.21.15.151:0/3202891179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c042e00 con 0x5587a9af17b0 2024-09-10T14:28:55.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8b627fc640 1 -- 172.21.15.151:0/3202891179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c01c490 con 0x5587a9af17b0 2024-09-10T14:28:55.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a9af8ed0 con 0x5587a9af17b0 2024-09-10T14:28:55.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8b627fc640 1 -- 172.21.15.151:0/3202891179 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8c7c06f070 con 0x5587a9af17b0 2024-09-10T14:28:55.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8b627fc640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b58034650 0x7f8b58036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8b627fc640 1 -- 172.21.15.151:0/3202891179 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8c7c072cc0 con 0x5587a9af17b0 2024-09-10T14:28:55.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b58034650 0x7f8b58036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a9b03a40 0x5587a9b05f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b06650 con 0x5587a9b03a40 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8d38e640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a9b03a40 0x5587a9b05f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b58034650 0x7f8b58036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c8001b380 tx=0x7f8c800c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8d38e640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a9b03a40 0x5587a9b05f00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 20 realm 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b06a60 con 0x5587a9b03a40 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b07330 con 0x5587a9b03a40 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.323+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8f07d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9b08430 0x5587a9b0a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0ae30 con 0x5587a9b08430 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9b08430 0x5587a9b0a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9b08430 0x5587a9b0a820 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8f07d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8f07d980 20 searching for the correct realm 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0c700 con 0x5587a9b08430 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8cb8d640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8c7c071060 0x7f8c7c07c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0c700 con 0x7f8c7c071060 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8c7c071060 0x7f8c7c07c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8c7c071060 0x7f8c7c07c650 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8c38c640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8c800e0040 0x7f8c800e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0c700 con 0x7f8c800e0040 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8d38e640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8c800e0040 0x7f8c800e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8d38e640 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8c800e0040 0x7f8c800e0930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.327+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c800e0040 2024-09-10T14:28:55.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c800e0040 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c7c071060 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b08430 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c800e0040 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c7c071060 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.331+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b08430 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b08430 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c800e0040 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b08430 2024-09-10T14:28:55.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b08430 2024-09-10T14:28:55.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c800e0040 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b08430 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c7c071060 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.335+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c800e0040 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b08430 2024-09-10T14:28:55.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c800e0040 2024-09-10T14:28:55.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c7c071060 2024-09-10T14:28:55.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b08430 2024-09-10T14:28:55.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c800e0040 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x5587a9b03a40 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b076d0 con 0x7f8c7c071060 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:55.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0b7f0 con 0x5587a9b03a40 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.339+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0b430 con 0x5587a9b03a40 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0c110 con 0x7f8c800e0040 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 zone default found 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 4 Realm: () 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 zonegroup default 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0c540 con 0x7f8c800e0040 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0c540 con 0x5587a9b08430 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0e510 con 0x5587a9b08430 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 started sync module instance, tier type = 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0d9b0 con 0x7f8c7c071060 2024-09-10T14:28:55.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94041155886496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0d610 con 0x7f8c7c071060 2024-09-10T14:28:55.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.343+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0f410 con 0x5587a9b03a40 2024-09-10T14:28:55.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.347+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94041155886496] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.347+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.347+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94041155891040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0f830 con 0x5587a9b03a40 2024-09-10T14:28:55.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.347+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b101f0 con 0x5587a9b08430 2024-09-10T14:28:55.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.347+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.347+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94041155894592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b10a40 con 0x5587a9b08430 2024-09-10T14:28:55.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.347+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b11400 con 0x7f8c7c071060 2024-09-10T14:28:55.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94041155891040] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94041155892096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b11ca0 con 0x7f8c7c071060 2024-09-10T14:28:55.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b12530 con 0x5587a9b03a40 2024-09-10T14:28:55.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94041155894592] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94041155892096] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94041155901424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b12040 con 0x5587a9b03a40 2024-09-10T14:28:55.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.351+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b12dd0 con 0x7f8c800e0040 2024-09-10T14:28:55.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.355+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.355+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94041155905648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b13140 con 0x7f8c800e0040 2024-09-10T14:28:55.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.355+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b13b80 con 0x7f8c800e0040 2024-09-10T14:28:55.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.355+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94041155901424] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.355+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94041155905648] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.355+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.355+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94041155909200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b12c90 con 0x7f8c800e0040 2024-09-10T14:28:55.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.355+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b14210 con 0x7f8c800e0040 2024-09-10T14:28:55.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94041155909200] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94041155896720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b14210 con 0x7f8c800e0040 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 20 add_watcher() i=0 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 20 add_watcher() i=1 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 20 add_watcher() i=2 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 20 add_watcher() i=3 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 20 add_watcher() i=4 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 20 add_watcher() i=5 2024-09-10T14:28:55.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 20 add_watcher() i=6 2024-09-10T14:28:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94041155896720] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 20 add_watcher() i=7 2024-09-10T14:28:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.359+0000 7f8c8f07d980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b173a0 con 0x5587a9b03a40 2024-09-10T14:28:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94041155911008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b14630 con 0x5587a9b03a40 2024-09-10T14:28:55.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94041155911008] v33'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8b42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:55.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8f07d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:55.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8f07d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:55.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b16b90 con 0x5587a9b03a40 2024-09-10T14:28:55.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.363+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b20460 con 0x7f8c800e0040 2024-09-10T14:28:55.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.367+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.367+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b20460 con 0x5587a9b08430 2024-09-10T14:28:55.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.367+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.367+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b20910 con 0x5587a9b03a40 2024-09-10T14:28:55.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.371+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'123 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.371+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b20d90 con 0x7f8c7c071060 2024-09-10T14:28:55.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.371+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.371+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b21300 con 0x5587a9b08430 2024-09-10T14:28:55.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.371+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.371+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b21300 con 0x5587a9b03a40 2024-09-10T14:28:55.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.375+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.375+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b217b0 con 0x7f8c800e0040 2024-09-10T14:28:55.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.379+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.379+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b217b0 con 0x7f8c7c071060 2024-09-10T14:28:55.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.379+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.379+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b21d20 con 0x5587a9b08430 2024-09-10T14:28:55.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.379+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.379+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b21d20 con 0x7f8c7c071060 2024-09-10T14:28:55.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.383+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.383+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b221d0 con 0x7f8c800e0040 2024-09-10T14:28:55.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.383+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.383+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b221d0 con 0x7f8c7c071060 2024-09-10T14:28:55.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.387+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.387+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b221d0 con 0x7f8c800e0040 2024-09-10T14:28:55.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.387+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.387+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b221d0 con 0x5587a9b03a40 2024-09-10T14:28:55.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.391+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.391+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b221d0 con 0x5587a9b08430 2024-09-10T14:28:55.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.391+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.391+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b221d0 con 0x7f8c7c071060 2024-09-10T14:28:55.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.395+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.395+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22260 con 0x5587a9b08430 2024-09-10T14:28:55.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.395+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.395+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b03a40 2024-09-10T14:28:55.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.395+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.395+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b03a40 2024-09-10T14:28:55.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.399+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'125 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.399+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b08430 2024-09-10T14:28:55.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.399+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.399+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x7f8c7c071060 2024-09-10T14:28:55.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.403+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.403+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b08430 2024-09-10T14:28:55.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.403+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.403+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b08430 2024-09-10T14:28:55.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.403+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.403+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b08430 2024-09-10T14:28:55.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.407+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.407+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b08430 2024-09-10T14:28:55.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.407+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.407+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x7f8c800e0040 2024-09-10T14:28:55.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.407+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.407+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b08430 2024-09-10T14:28:55.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.411+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.411+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x7f8c800e0040 2024-09-10T14:28:55.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.411+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.411+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x5587a9b08430 2024-09-10T14:28:55.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.415+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.415+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x7f8c800e0040 2024-09-10T14:28:55.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b22310 con 0x7f8c7c071060 2024-09-10T14:28:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8b41fe3640 20 reqs_thread_entry: start 2024-09-10T14:28:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8c8f07d980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8c8f07d980 20 Filter name: none 2024-09-10T14:28:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8ab37fe640 20 reqs_thread_entry: start 2024-09-10T14:28:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8c8f07d980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:28:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8c8f07d980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.419+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b1f070 con 0x7f8c800e0040 2024-09-10T14:28:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:28:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T14:28:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:28:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b1eb10 con 0x7f8c800e0040 2024-09-10T14:28:55.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T14:28:55.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b1eb10 con 0x7f8c800e0040 2024-09-10T14:28:55.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T14:28:55.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94041156082688 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b3f640 con 0x5587a9b08430 2024-09-10T14:28:55.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== watch-notify(notify (1) cookie 94041155894592 notify 141733920771 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5587a9b21300 con 0x5587a9b08430 2024-09-10T14:28:55.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8b63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94041155894592 notifier 4526 bl.length()=170 2024-09-10T14:28:55.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.423+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(97 notify.2 [notify cookie 94041156082688 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8b63fff640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8b50003d70 con 0x5587a9b08430 2024-09-10T14:28:55.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== watch-notify(notify_complete (2) cookie 94041156082688 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5587a9ae57e0 con 0x5587a9b08430 2024-09-10T14:28:55.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8f07d980 10 removing email index: 2024-09-10T14:28:55.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8f07d980 10 removing user buckets index 2024-09-10T14:28:55.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b3dc00 con 0x7f8c800e0040 2024-09-10T14:28:55.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(99 fud.buckets [delete] v33'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8f07d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T14:28:55.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94041156082688 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b3f640 con 0x7f8c800e0040 2024-09-10T14:28:55.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== watch-notify(notify (1) cookie 94041155909200 notify 141733920774 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5587a9b214d0 con 0x7f8c800e0040 2024-09-10T14:28:55.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8b637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94041155909200 notifier 4526 bl.length()=160 2024-09-10T14:28:55.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8b637fe640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8ac00032d0 con 0x7f8c800e0040 2024-09-10T14:28:55.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.427+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(100 notify.6 [notify cookie 94041156082688 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== watch-notify(notify_complete (2) cookie 94041156082688 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5587a9b16d00 con 0x7f8c800e0040 2024-09-10T14:28:55.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8f07d980 10 removing user index: fud 2024-09-10T14:28:55.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b3f5f0 con 0x7f8c800e0040 2024-09-10T14:28:55.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(102 fud [call,call,delete] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8f07d980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T14:28:55.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8f07d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T14:28:55.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94041156084016 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b3f560 con 0x7f8c800e0040 2024-09-10T14:28:55.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== watch-notify(notify (1) cookie 94041155905648 notify 141733920775 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5587a9b16d00 con 0x7f8c800e0040 2024-09-10T14:28:55.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8b63fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94041155905648 notifier 4526 bl.length()=152 2024-09-10T14:28:55.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8b63fff640 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8b50003d70 con 0x7f8c800e0040 2024-09-10T14:28:55.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.431+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== osd_op_reply(103 notify.5 [notify cookie 94041156084016 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.435+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.435+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== watch-notify(notify_complete (2) cookie 94041156084016 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5587a9ae5a70 con 0x7f8c800e0040 2024-09-10T14:28:55.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.435+0000 7f8b42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:55.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.435+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94041155911008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b1d870 con 0x5587a9b03a40 2024-09-10T14:28:55.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.435+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94041155911008] v33'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.435+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94041155886496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b13d60 con 0x7f8c7c071060 2024-09-10T14:28:55.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.439+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94041155886496] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.439+0000 7f8c8f07d980 20 remove_watcher() i=0 2024-09-10T14:28:55.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.439+0000 7f8c8f07d980 2 removed watcher, disabling cache 2024-09-10T14:28:55.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.439+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94041155891040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b13d60 con 0x5587a9b03a40 2024-09-10T14:28:55.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.439+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94041155891040] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.439+0000 7f8c8f07d980 20 remove_watcher() i=1 2024-09-10T14:28:55.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.439+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94041155894592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0ef60 con 0x5587a9b08430 2024-09-10T14:28:55.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.443+0000 7f8c8cb8d640 1 -- 172.21.15.151:0/3202891179 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94041155894592] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c06e030 con 0x5587a9b08430 2024-09-10T14:28:55.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.443+0000 7f8c8f07d980 20 remove_watcher() i=2 2024-09-10T14:28:55.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.443+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94041155892096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b13d60 con 0x7f8c7c071060 2024-09-10T14:28:55.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.443+0000 7f8c8c38c640 1 -- 172.21.15.151:0/3202891179 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94041155892096] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c800aab60 con 0x7f8c7c071060 2024-09-10T14:28:55.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.443+0000 7f8c8f07d980 20 remove_watcher() i=3 2024-09-10T14:28:55.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.443+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94041155901424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0fd40 con 0x5587a9b03a40 2024-09-10T14:28:55.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.447+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94041155901424] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x5587a9b03a40 2024-09-10T14:28:55.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.447+0000 7f8c8f07d980 20 remove_watcher() i=4 2024-09-10T14:28:55.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.447+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94041155905648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b117f0 con 0x7f8c800e0040 2024-09-10T14:28:55.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.447+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94041155905648] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.447+0000 7f8c8f07d980 20 remove_watcher() i=5 2024-09-10T14:28:55.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.447+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94041155909200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b0fd40 con 0x7f8c800e0040 2024-09-10T14:28:55.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94041155909200] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 20 remove_watcher() i=6 2024-09-10T14:28:55.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94041155896720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5587a9b117f0 con 0x7f8c800e0040 2024-09-10T14:28:55.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94041155896720] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c840083f0 con 0x7f8c800e0040 2024-09-10T14:28:55.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 20 remove_watcher() i=7 2024-09-10T14:28:55.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8c800e0040 msgr2=0x7f8c800e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8c800e0040 0x7f8c800e0930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a9b03a40 msgr2=0x5587a9b05f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a9b03a40 0x5587a9b05f00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8c7c071060 msgr2=0x7f8c7c07c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f8c7c071060 0x7f8c7c07c650 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9b08430 msgr2=0x5587a9b0a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9b08430 0x5587a9b0a820 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b58034650 msgr2=0x7f8b58036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b58034650 0x7f8b58036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c8001b380 tx=0x7f8c800c1040 comp rx=0 tx=0).stop 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 msgr2=0x5587a9af8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8d38e640 1 -- 172.21.15.151:0/3202891179 reap_dead start 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af8990 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c02dab0 tx=0x7f8c7c01ff50 comp rx=0 tx=0).stop 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 shutdown_connections 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/3202891179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9af17b0 0x5587a9af8990 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 >> 172.21.15.151:0/3202891179 conn(0x5587a9aedb90 msgr2=0x5587a9aebc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 shutdown_connections 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.451+0000 7f8c8f07d980 1 -- 172.21.15.151:0/3202891179 wait complete. 2024-09-10T14:28:55.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2259015460 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b64034650 msgr2=0x7f8b64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2259015460 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b64034650 0x7f8b64036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5587a9acef50 tx=0x7f8c80005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2259015460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9ae4e80 msgr2=0x5587a9ae52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2259015460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9ae4e80 0x5587a9ae52a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c047ae0 tx=0x7f8c7c0493a0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2259015460 shutdown_connections 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2259015460 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b64034650 0x7f8b64036b10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2259015460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a9ae4e80 0x5587a9ae52a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2259015460 >> 172.21.15.151:0/2259015460 conn(0x5587a9ad9fd0 msgr2=0x5587a9adca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2259015460 shutdown_connections 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2259015460 wait complete. 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5587a9ad48c0 msgr2=0x5587a9ad6cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5587a9ad48c0 0x5587a9ad6cb0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a99d8c60 msgr2=0x5587a9ace000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5587a99d8c60 0x5587a9ace000 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9ad09a0 msgr2=0x5587a9ad2d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5587a9ad09a0 0x5587a9ad2d90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b74034650 msgr2=0x7f8b74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8b74034650 0x7f8b74036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c800ae000 tx=0x7f8c800a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 msgr2=0x5587a9ac7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 --2- 172.21.15.151:0/2941667318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5587a99d48e0 0x5587a9ac7030 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00f610 tx=0x7f8c7c000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8d38e640 1 -- 172.21.15.151:0/2941667318 reap_dead start 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 shutdown_connections 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 >> 172.21.15.151:0/2941667318 conn(0x5587a9948230 msgr2=0x5587a9aba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 shutdown_connections 2024-09-10T14:28:55.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.455+0000 7f8c8f07d980 1 -- 172.21.15.151:0/2941667318 wait complete. 2024-09-10T14:28:55.470 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T14:28:55.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T14:28:55.470 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T14:28:55.561 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:55.561 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:55.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f583c5f7980 1 Processor -- start 2024-09-10T14:28:55.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f583c5f7980 1 -- start start 2024-09-10T14:28:55.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f583c5f7980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b1ebda8a60 0x55b1ebe39710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f583c5f7980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1ebcbcae0 con 0x55b1ebe39c50 2024-09-10T14:28:55.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f583c5f7980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55b1ebce0e30 con 0x55b1ebda8a60 2024-09-10T14:28:55.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f583a107640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b1ebda8a60 0x55b1ebe39710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f5839906640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55b1ebe39c50 0x55b1ebe3c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44712/0 (socket says 172.21.15.151:44712) 2024-09-10T14:28:55.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f5839906640 1 -- 172.21.15.151:0/1359484665 learned_addr learned my addr 172.21.15.151:0/1359484665 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:55.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f583a107640 1 -- 172.21.15.151:0/1359484665 >> v1:172.21.15.52:6789/0 conn(0x55b1ebe39c50 legacy=0x55b1ebe3c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.559+0000 7f583a107640 1 -- 172.21.15.151:0/1359484665 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ebda8e40 con 0x55b1ebda8a60 2024-09-10T14:28:55.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f583a107640 1 --2- 172.21.15.151:0/1359484665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebe39710 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f582c00a420 tx=0x7f582c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573f4acd1b93e659 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f5839105640 1 -- 172.21.15.151:0/1359484665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0af070 con 0x55b1ebda8a60 2024-09-10T14:28:55.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f5839105640 1 -- 172.21.15.151:0/1359484665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c0aa530 con 0x55b1ebda8a60 2024-09-10T14:28:55.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f5839105640 1 -- 172.21.15.151:0/1359484665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0aa850 con 0x55b1ebda8a60 2024-09-10T14:28:55.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f583c5f7980 1 -- 172.21.15.151:0/1359484665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 msgr2=0x55b1ebe39710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1359484665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebe39710 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f582c00a420 tx=0x7f582c01afd0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f583c5f7980 1 -- 172.21.15.151:0/1359484665 shutdown_connections 2024-09-10T14:28:55.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1359484665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebe39710 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f583c5f7980 1 -- 172.21.15.151:0/1359484665 >> 172.21.15.151:0/1359484665 conn(0x55b1ebe2f000 msgr2=0x55b1ebe31420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f583c5f7980 1 -- 172.21.15.151:0/1359484665 shutdown_connections 2024-09-10T14:28:55.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.563+0000 7f583c5f7980 1 -- 172.21.15.151:0/1359484665 wait complete. 2024-09-10T14:28:55.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583c5f7980 1 Processor -- start 2024-09-10T14:28:55.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583c5f7980 1 -- start start 2024-09-10T14:28:55.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583c5f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf21cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583c5f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1ebce2200 con 0x55b1ebda8a60 2024-09-10T14:28:55.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf21cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf21cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49768/0 (socket says 172.21.15.151:49768) 2024-09-10T14:28:55.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583a107640 1 -- 172.21.15.151:0/3780598998 learned_addr learned my addr 172.21.15.151:0/3780598998 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583a107640 1 -- 172.21.15.151:0/3780598998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ebf222c0 con 0x55b1ebda8a60 2024-09-10T14:28:55.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f583a107640 1 --2- 172.21.15.151:0/3780598998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf21cf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f582c0aa500 tx=0x7f582c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5521abbb569df49f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f5728608640 1 -- 172.21.15.151:0/3780598998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0af070 con 0x55b1ebda8a60 2024-09-10T14:28:55.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f5728608640 1 -- 172.21.15.151:0/3780598998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c0b0040 con 0x55b1ebda8a60 2024-09-10T14:28:55.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.579+0000 7f5728608640 1 -- 172.21.15.151:0/3780598998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0aace0 con 0x55b1ebda8a60 2024-09-10T14:28:55.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- 172.21.15.151:0/3780598998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 msgr2=0x55b1ebf21cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 --2- 172.21.15.151:0/3780598998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf21cf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f582c0aa500 tx=0x7f582c0033b0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- 172.21.15.151:0/3780598998 shutdown_connections 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 --2- 172.21.15.151:0/3780598998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf21cf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- 172.21.15.151:0/3780598998 >> 172.21.15.151:0/3780598998 conn(0x55b1ebe2f000 msgr2=0x55b1ebf1d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- 172.21.15.151:0/3780598998 shutdown_connections 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- 172.21.15.151:0/3780598998 wait complete. 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 Processor -- start 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- start start 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf28ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1ebe401f0 con 0x55b1ebda8a60 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf28ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf28ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49784/0 (socket says 172.21.15.151:49784) 2024-09-10T14:28:55.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583a107640 1 -- 172.21.15.151:0/1899072675 learned_addr learned my addr 172.21.15.151:0/1899072675 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583a107640 1 -- 172.21.15.151:0/1899072675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ebf29430 con 0x55b1ebda8a60 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583a107640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf28ef0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f582c0aa500 tx=0x7f582c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f5726e05640 1 -- 172.21.15.151:0/1899072675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0b6940 con 0x55b1ebda8a60 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1ebf296c0 con 0x55b1ebda8a60 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f5726e05640 1 -- 172.21.15.151:0/1899072675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c0c6070 con 0x55b1ebda8a60 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f5726e05640 1 -- 172.21.15.151:0/1899072675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0b6c50 con 0x55b1ebda8a60 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ebf2c3a0 con 0x55b1ebda8a60 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.583+0000 7f5726e05640 1 -- 172.21.15.151:0/1899072675 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f582c0c0440 con 0x55b1ebda8a60 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f5726e05640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5720034650 0x7f5720036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f5726e05640 1 -- 172.21.15.151:0/1899072675 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f582c0bb070 con 0x55b1ebda8a60 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f5839906640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5720034650 0x7f5720036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebe39c50 0x55b1ebf2fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf30530 con 0x55b1ebe39c50 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583a908640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebe39c50 0x55b1ebf2fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f5839906640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5720034650 0x7f5720036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5824000f70 tx=0x7f58240012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583a908640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebe39c50 0x55b1ebf2fff0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583a908640 1 -- 172.21.15.151:0/1899072675 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebe39c50 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf2d5c0 con 0x55b1ebe39c50 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583a908640 1 -- 172.21.15.151:0/1899072675 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebe39c50 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf32870 0x55b1ebf34c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf35330 con 0x55b1ebf32870 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583a107640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf32870 0x55b1ebf34c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583a107640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf32870 0x55b1ebf34c60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583a107640 1 -- 172.21.15.151:0/1899072675 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f582c0d2070 con 0x55b1ebf32870 2024-09-10T14:28:55.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf31710 con 0x55b1ebe39c50 2024-09-10T14:28:55.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583a908640 1 -- 172.21.15.151:0/1899072675 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebe39c50 2024-09-10T14:28:55.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b1ebf36790 0x55b1ebf38b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf39280 con 0x55b1ebf36790 2024-09-10T14:28:55.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.587+0000 7f5839906640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b1ebf36790 0x55b1ebf38b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f5839906640 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b1ebf36790 0x55b1ebf38b80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f5839906640 1 -- 172.21.15.151:0/1899072675 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f582400e620 con 0x55b1ebf36790 2024-09-10T14:28:55.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583c5f7980 1 Processor -- start 2024-09-10T14:28:55.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583c5f7980 1 -- start start 2024-09-10T14:28:55.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583c5f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf46d50 0x55b1ebf47170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583c5f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1ebd3b800 con 0x55b1ebf46d50 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf46d50 0x55b1ebf47170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf46d50 0x55b1ebf47170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49790/0 (socket says 172.21.15.151:49790) 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583a107640 1 -- 172.21.15.151:0/2000438338 learned_addr learned my addr 172.21.15.151:0/2000438338 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583a107640 1 -- 172.21.15.151:0/2000438338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ebf476b0 con 0x55b1ebf46d50 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583a107640 1 --2- 172.21.15.151:0/2000438338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf46d50 0x55b1ebf47170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f582c0bff70 tx=0x7f582c0a9d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f571ffff640 1 -- 172.21.15.151:0/2000438338 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0a9a40 con 0x55b1ebf46d50 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f571ffff640 1 -- 172.21.15.151:0/2000438338 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c0b4a60 con 0x55b1ebf46d50 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583c5f7980 1 -- 172.21.15.151:0/2000438338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1ebf47940 con 0x55b1ebf46d50 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f571ffff640 1 -- 172.21.15.151:0/2000438338 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0b4d40 con 0x55b1ebf46d50 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.591+0000 7f583c5f7980 1 -- 172.21.15.151:0/2000438338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ebf47940 con 0x55b1ebf46d50 2024-09-10T14:28:55.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f571ffff640 1 -- 172.21.15.151:0/2000438338 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f582c0e0070 con 0x55b1ebf46d50 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f571ffff640 1 --2- 172.21.15.151:0/2000438338 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5714034650 0x7f5714036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f571ffff640 1 -- 172.21.15.151:0/2000438338 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f582c0eace0 con 0x55b1ebf46d50 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f5839906640 1 --2- 172.21.15.151:0/2000438338 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5714034650 0x7f5714036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 Processor -- start 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- start start 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f5839906640 1 --2- 172.21.15.151:0/2000438338 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5714034650 0x7f5714036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f582400bf60 tx=0x7f582400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf53960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1ebf22580 con 0x55b1ebf53560 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf53960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf53960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49796/0 (socket says 172.21.15.151:49796) 2024-09-10T14:28:55.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583a107640 1 -- 172.21.15.151:0/2968154939 learned_addr learned my addr 172.21.15.151:0/2968154939 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583a107640 1 -- 172.21.15.151:0/2968154939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ebf53f30 con 0x55b1ebf53560 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583a107640 1 --2- 172.21.15.151:0/2968154939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf53960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f582c0c2fa0 tx=0x7f582c0f24b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62882dccaace8fed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f571dffb640 1 -- 172.21.15.151:0/2968154939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0cbdc0 con 0x55b1ebf53560 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f571dffb640 1 -- 172.21.15.151:0/2968154939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c0cb620 con 0x55b1ebf53560 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f571dffb640 1 -- 172.21.15.151:0/2968154939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0cb900 con 0x55b1ebf53560 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- 172.21.15.151:0/2968154939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 msgr2=0x55b1ebf53960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 --2- 172.21.15.151:0/2968154939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf53960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f582c0c2fa0 tx=0x7f582c0f24b0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- 172.21.15.151:0/2968154939 shutdown_connections 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 --2- 172.21.15.151:0/2968154939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf53960 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- 172.21.15.151:0/2968154939 >> 172.21.15.151:0/2968154939 conn(0x55b1ebf4f8f0 msgr2=0x55b1ebf4d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- 172.21.15.151:0/2968154939 shutdown_connections 2024-09-10T14:28:55.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- 172.21.15.151:0/2968154939 wait complete. 2024-09-10T14:28:55.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 Processor -- start 2024-09-10T14:28:55.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- start start 2024-09-10T14:28:55.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf5a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583c5f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1ebf54480 con 0x55b1ebf53560 2024-09-10T14:28:55.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.595+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf5a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583a107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf5a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49812/0 (socket says 172.21.15.151:49812) 2024-09-10T14:28:55.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 learned_addr learned my addr 172.21.15.151:0/1859102855 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ebf5abd0 con 0x55b1ebf53560 2024-09-10T14:28:55.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583a107640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf5a690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f582c0adff0 tx=0x7f582c0cd180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f570bfff640 1 -- 172.21.15.151:0/1859102855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c110070 con 0x55b1ebf53560 2024-09-10T14:28:55.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1ebf5abd0 con 0x55b1ebf53560 2024-09-10T14:28:55.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f570bfff640 1 -- 172.21.15.151:0/1859102855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c0c0730 con 0x55b1ebf53560 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f570bfff640 1 -- 172.21.15.151:0/1859102855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c0c0a10 con 0x55b1ebf53560 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ebf5b0a0 con 0x55b1ebf53560 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f570bfff640 1 -- 172.21.15.151:0/1859102855 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f582c113070 con 0x55b1ebf53560 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f570bfff640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5704034650 0x7f5704036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f570bfff640 1 -- 172.21.15.151:0/1859102855 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f582c106030 con 0x55b1ebf53560 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f5839906640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5704034650 0x7f5704036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebf657e0 0x55b1ebf67ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf683f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583a908640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebf657e0 0x55b1ebf67ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f5839906640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5704034650 0x7f5704036b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55b1ebf30e20 tx=0x7f5824010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583a908640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebf657e0 0x55b1ebf67ca0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 20 realm 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.599+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf68800 con 0x55b1ebf657e0 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:55.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf690a0 con 0x55b1ebf657e0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf6a1a0 0x55b1ebf6c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6cbe0 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a107640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf6a1a0 0x55b1ebf6c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a107640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf6a1a0 0x55b1ebf6c590 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 20 searching for the correct realm 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6e4b0 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a107640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f582c115060 0x7f582c0e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6e4b0 con 0x7f582c115060 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f5839906640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f582c115060 0x7f582c0e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f5839906640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f582c115060 0x7f582c0e6550 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f5839906640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5824037040 0x7f5824036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6e4b0 con 0x7f5824037040 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a908640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5824037040 0x7f5824036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.603+0000 7f583a908640 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5824037040 0x7f5824036410 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f5824037040 2024-09-10T14:28:55.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f5824037040 2024-09-10T14:28:55.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f582c115060 2024-09-10T14:28:55.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.607+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f5824037040 2024-09-10T14:28:55.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f582c115060 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f5824037040 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.611+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f5824037040 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f582c115060 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f5824037040 2024-09-10T14:28:55.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f5824037040 2024-09-10T14:28:55.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f582c115060 2024-09-10T14:28:55.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.615+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f5824037040 2024-09-10T14:28:55.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x55b1ebf657e0 2024-09-10T14:28:55.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf69440 con 0x7f582c115060 2024-09-10T14:28:55.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6d5d0 con 0x55b1ebf657e0 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6de20 con 0x55b1ebf657e0 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6d210 con 0x7f5824037040 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 zone default found 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 4 Realm: () 2024-09-10T14:28:55.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 zonegroup default 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6de20 con 0x7f5824037040 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6de20 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf70380 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 started sync module instance, tier type = 2024-09-10T14:28:55.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:55.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.619+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf6f760 con 0x7f582c115060 2024-09-10T14:28:55.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.623+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.623+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94222656404304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf70c90 con 0x7f582c115060 2024-09-10T14:28:55.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.623+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf714e0 con 0x55b1ebf657e0 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.623+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94222656404304] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.623+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.623+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94222656407520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf714e0 con 0x55b1ebf657e0 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.623+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf71f80 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94222656412240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf72820 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf73240 con 0x7f582c115060 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94222656407520] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94222656417072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf73630 con 0x7f582c115060 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf73ff0 con 0x55b1ebf657e0 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94222656412240] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.627+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94222656417072] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.631+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.631+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94222656414576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf73ff0 con 0x55b1ebf657e0 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.631+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf74840 con 0x7f5824037040 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.631+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.631+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94222656422144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf74b10 con 0x7f5824037040 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.631+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf75610 con 0x7f5824037040 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.631+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94222656414576] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94222656422144] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94222656426240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf74560 con 0x7f5824037040 2024-09-10T14:28:55.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf75ac0 con 0x7f5824037040 2024-09-10T14:28:55.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94222656427472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf75ee0 con 0x7f5824037040 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 20 add_watcher() i=0 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 20 add_watcher() i=1 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 20 add_watcher() i=2 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 20 add_watcher() i=3 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 20 add_watcher() i=4 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 20 add_watcher() i=5 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94222656426240] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.635+0000 7f583c5f7980 20 add_watcher() i=6 2024-09-10T14:28:55.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94222656427472] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 20 add_watcher() i=7 2024-09-10T14:28:55.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:55.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf73b40 con 0x55b1ebf657e0 2024-09-10T14:28:55.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94222656420672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf763c0 con 0x55b1ebf657e0 2024-09-10T14:28:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94222656420672] v33'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f56f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 5 note: GC not initialized 2024-09-10T14:28:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f566b7fe640 20 reqs_thread_entry: start 2024-09-10T14:28:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f583c5f7980 20 Filter name: none 2024-09-10T14:28:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.639+0000 7f56697fa640 20 reqs_thread_entry: start 2024-09-10T14:28:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T14:28:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9c760 con 0x7f5824037040 2024-09-10T14:28:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-10T14:28:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T14:28:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T14:28:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9ae50 con 0x7f5824037040 2024-09-10T14:28:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T14:28:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T14:28:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T14:28:55.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9f470 con 0x7f5824037040 2024-09-10T14:28:55.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v33'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T14:28:55.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T14:28:55.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.643+0000 7f583c5f7980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T14:28:55.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94222656597552 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9ffc0 con 0x7f582c115060 2024-09-10T14:28:55.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== watch-notify(notify (1) cookie 94222656417072 notify 141733920789 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f5824041060 con 0x7f582c115060 2024-09-10T14:28:55.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f571dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94222656417072 notifier 4533 bl.length()=610 2024-09-10T14:28:55.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f571dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T14:28:55.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f571dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T14:28:55.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(65 notify.3 [notify cookie 94222656597552 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f571dffb640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5700003eb0 con 0x7f582c115060 2024-09-10T14:28:55.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== watch-notify(notify_complete (2) cookie 94222656597552 notify 141733920789 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b1ebcbcae0 con 0x7f582c115060 2024-09-10T14:28:55.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9ee70 con 0x7f5824037040 2024-09-10T14:28:55.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v33'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583c5f7980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T14:28:55.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583c5f7980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:55.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583c5f7980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T14:28:55.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94222656593040 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9ee70 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== watch-notify(notify (1) cookie 94222656412240 notify 141733920772 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55b1ebf476b0 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f571d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94222656412240 notifier 4533 bl.length()=192 2024-09-10T14:28:55.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f571d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T14:28:55.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f571d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:28:55.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(68 notify.2 [notify cookie 94222656593040 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.647+0000 7f571d7fa640 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5670003410 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== watch-notify(notify_complete (2) cookie 94222656593040 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f582c0dc040 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.657 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T14:28:55.648833Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:55.648814Z","tags":[],"group_ids":[]} 2024-09-10T14:28:55.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f56f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:55.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94222656420672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9a360 con 0x55b1ebf657e0 2024-09-10T14:28:55.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94222656420672] v33'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94222656404304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9a360 con 0x7f582c115060 2024-09-10T14:28:55.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94222656404304] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f583c5f7980 20 remove_watcher() i=0 2024-09-10T14:28:55.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f583c5f7980 2 removed watcher, disabling cache 2024-09-10T14:28:55.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.651+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94222656407520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf9a360 con 0x55b1ebf657e0 2024-09-10T14:28:55.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.655+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94222656407520] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.655+0000 7f583c5f7980 20 remove_watcher() i=1 2024-09-10T14:28:55.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.655+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94222656412240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf707e0 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f583a107640 1 -- 172.21.15.151:0/1859102855 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94222656412240] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582c112030 con 0x55b1ebf6a1a0 2024-09-10T14:28:55.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f583c5f7980 20 remove_watcher() i=2 2024-09-10T14:28:55.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94222656417072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf71a50 con 0x7f582c115060 2024-09-10T14:28:55.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f5839906640 1 -- 172.21.15.151:0/1859102855 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94222656417072] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582400e620 con 0x7f582c115060 2024-09-10T14:28:55.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f583c5f7980 20 remove_watcher() i=3 2024-09-10T14:28:55.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94222656414576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf707e0 con 0x55b1ebf657e0 2024-09-10T14:28:55.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94222656414576] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x55b1ebf657e0 2024-09-10T14:28:55.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f583c5f7980 20 remove_watcher() i=4 2024-09-10T14:28:55.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.659+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94222656422144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf72d30 con 0x7f5824037040 2024-09-10T14:28:55.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.663+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94222656422144] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.663+0000 7f583c5f7980 20 remove_watcher() i=5 2024-09-10T14:28:55.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.663+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94222656426240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf71a50 con 0x7f5824037040 2024-09-10T14:28:55.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.663+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94222656426240] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.663+0000 7f583c5f7980 20 remove_watcher() i=6 2024-09-10T14:28:55.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.663+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94222656427472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b1ebf707e0 con 0x7f5824037040 2024-09-10T14:28:55.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94222656427472] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58340083f0 con 0x7f5824037040 2024-09-10T14:28:55.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 20 remove_watcher() i=7 2024-09-10T14:28:55.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5824037040 msgr2=0x7f5824036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f5824037040 0x7f5824036410 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebf657e0 msgr2=0x55b1ebf67ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebf657e0 0x55b1ebf67ca0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f582c115060 msgr2=0x7f582c0e6550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f582c115060 0x7f582c0e6550 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf6a1a0 msgr2=0x55b1ebf6c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf6a1a0 0x55b1ebf6c590 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5704034650 msgr2=0x7f5704036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5704034650 0x7f5704036b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55b1ebf30e20 tx=0x7f5824010000 comp rx=0 tx=0).stop 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 msgr2=0x55b1ebf5a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583a908640 1 -- 172.21.15.151:0/1859102855 reap_dead start 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf5a690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f582c0adff0 tx=0x7f582c0cd180 comp rx=0 tx=0).stop 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 shutdown_connections 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1859102855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf53560 0x55b1ebf5a690 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 >> 172.21.15.151:0/1859102855 conn(0x55b1ebf4f8f0 msgr2=0x55b1ebf4d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 shutdown_connections 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1859102855 wait complete. 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/2000438338 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5714034650 msgr2=0x7f5714036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/2000438338 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5714034650 0x7f5714036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f582400bf60 tx=0x7f582400f000 comp rx=0 tx=0).stop 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/2000438338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf46d50 msgr2=0x55b1ebf47170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/2000438338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf46d50 0x55b1ebf47170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f582c0bff70 tx=0x7f582c0a9d50 comp rx=0 tx=0).stop 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/2000438338 shutdown_connections 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/2000438338 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5714034650 0x7f5714036b10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/2000438338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebf46d50 0x55b1ebf47170 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/2000438338 >> 172.21.15.151:0/2000438338 conn(0x55b1ebf3bea0 msgr2=0x55b1ebf3e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/2000438338 shutdown_connections 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/2000438338 wait complete. 2024-09-10T14:28:55.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b1ebf36790 msgr2=0x55b1ebf38b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b1ebf36790 0x55b1ebf38b80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebe39c50 msgr2=0x55b1ebf2fff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b1ebe39c50 0x55b1ebf2fff0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf32870 msgr2=0x55b1ebf34c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b1ebf32870 0x55b1ebf34c60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5720034650 msgr2=0x7f5720036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5720034650 0x7f5720036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5824000f70 tx=0x7f58240012c0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 msgr2=0x55b1ebf28ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 --2- 172.21.15.151:0/1899072675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1ebda8a60 0x55b1ebf28ef0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f582c0aa500 tx=0x7f582c017d70 comp rx=0 tx=0).stop 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583a908640 1 -- 172.21.15.151:0/1899072675 reap_dead start 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 shutdown_connections 2024-09-10T14:28:55.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 >> 172.21.15.151:0/1899072675 conn(0x55b1ebe2f000 msgr2=0x55b1ebf1c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 shutdown_connections 2024-09-10T14:28:55.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.667+0000 7f583c5f7980 1 -- 172.21.15.151:0/1899072675 wait complete. 2024-09-10T14:28:55.684 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T14:28:55.648833Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:55.648814Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:55.684 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T14:28:55.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T14:28:55.685 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-10T14:28:55.719 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:55.719 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:55.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.715+0000 7f1d49747980 1 Processor -- start 2024-09-10T14:28:55.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.715+0000 7f1d49747980 1 -- start start 2024-09-10T14:28:55.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.715+0000 7f1d49747980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c3465d59b0 0x55c3465d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.715+0000 7f1d49747980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c346459ae0 con 0x55c3465d1630 2024-09-10T14:28:55.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.715+0000 7f1d49747980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55c34647de30 con 0x55c3465d59b0 2024-09-10T14:28:55.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.715+0000 7f1d46a56640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c3465d59b0 0x55c3465d7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.715+0000 7f1d47257640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55c3465d1630 0x55c3465d1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44718/0 (socket says 172.21.15.151:44718) 2024-09-10T14:28:55.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.715+0000 7f1d47257640 1 -- 172.21.15.151:0/231325583 learned_addr learned my addr 172.21.15.151:0/231325583 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:55.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d46a56640 1 -- 172.21.15.151:0/231325583 >> v1:172.21.15.52:6789/0 conn(0x55c3465d1630 legacy=0x55c3465d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d46a56640 1 -- 172.21.15.151:0/231325583 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3465d92f0 con 0x55c3465d59b0 2024-09-10T14:28:55.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d46a56640 1 --2- 172.21.15.151:0/231325583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 0x55c3465d7da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00a480 tx=0x7f1d3c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894fd5ce0b7e8ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d46255640 1 -- 172.21.15.151:0/231325583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d3c0b0070 con 0x55c3465d59b0 2024-09-10T14:28:55.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d46255640 1 -- 172.21.15.151:0/231325583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0ab540 con 0x55c3465d59b0 2024-09-10T14:28:55.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d46255640 1 -- 172.21.15.151:0/231325583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d3c0ab840 con 0x55c3465d59b0 2024-09-10T14:28:55.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d49747980 1 -- 172.21.15.151:0/231325583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 msgr2=0x55c3465d7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d49747980 1 --2- 172.21.15.151:0/231325583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 0x55c3465d7da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00a480 tx=0x7f1d3c01b280 comp rx=0 tx=0).stop 2024-09-10T14:28:55.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d49747980 1 -- 172.21.15.151:0/231325583 shutdown_connections 2024-09-10T14:28:55.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d49747980 1 --2- 172.21.15.151:0/231325583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 0x55c3465d7da0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d49747980 1 -- 172.21.15.151:0/231325583 >> 172.21.15.151:0/231325583 conn(0x55c3465cd150 msgr2=0x55c3465cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d49747980 1 -- 172.21.15.151:0/231325583 shutdown_connections 2024-09-10T14:28:55.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.719+0000 7f1d49747980 1 -- 172.21.15.151:0/231325583 wait complete. 2024-09-10T14:28:55.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d49747980 1 Processor -- start 2024-09-10T14:28:55.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d49747980 1 -- start start 2024-09-10T14:28:55.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d49747980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d1630 0x55c3466bca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d49747980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c34647f200 con 0x55c3465d1630 2024-09-10T14:28:55.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d1630 0x55c3466bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d1630 0x55c3466bca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49830/0 (socket says 172.21.15.151:49830) 2024-09-10T14:28:55.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d47257640 1 -- 172.21.15.151:0/2402208888 learned_addr learned my addr 172.21.15.151:0/2402208888 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d47257640 1 -- 172.21.15.151:0/2402208888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3466bcff0 con 0x55c3465d1630 2024-09-10T14:28:55.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.735+0000 7f1d47257640 1 --2- 172.21.15.151:0/2402208888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d1630 0x55c3466bca20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1d400017b0 tx=0x7f1d40001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857f06bc172c7ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1c3560a640 1 -- 172.21.15.151:0/2402208888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40016070 con 0x55c3465d1630 2024-09-10T14:28:55.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1c3560a640 1 -- 172.21.15.151:0/2402208888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40004530 con 0x55c3465d1630 2024-09-10T14:28:55.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1c3560a640 1 -- 172.21.15.151:0/2402208888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40004870 con 0x55c3465d1630 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- 172.21.15.151:0/2402208888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d1630 msgr2=0x55c3466bca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 --2- 172.21.15.151:0/2402208888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d1630 0x55c3466bca20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1d400017b0 tx=0x7f1d40001c70 comp rx=0 tx=0).stop 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- 172.21.15.151:0/2402208888 shutdown_connections 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 --2- 172.21.15.151:0/2402208888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d1630 0x55c3466bca20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- 172.21.15.151:0/2402208888 >> 172.21.15.151:0/2402208888 conn(0x55c3465cd150 msgr2=0x55c3466b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- 172.21.15.151:0/2402208888 shutdown_connections 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- 172.21.15.151:0/2402208888 wait complete. 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 Processor -- start 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- start start 2024-09-10T14:28:55.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 0x55c3466c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c3465d8df0 con 0x55c3465d59b0 2024-09-10T14:28:55.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 0x55c3466c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 0x55c3466c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49832/0 (socket says 172.21.15.151:49832) 2024-09-10T14:28:55.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d47257640 1 -- 172.21.15.151:0/2664939741 learned_addr learned my addr 172.21.15.151:0/2664939741 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d47257640 1 -- 172.21.15.151:0/2664939741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3466c4570 con 0x55c3465d59b0 2024-09-10T14:28:55.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d47257640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 0x55c3466c4030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1d40000f90 tx=0x7f1d40001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1c33e07640 1 -- 172.21.15.151:0/2664939741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40020020 con 0x55c3465d59b0 2024-09-10T14:28:55.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3466c4800 con 0x55c3465d59b0 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1c33e07640 1 -- 172.21.15.151:0/2664939741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40017040 con 0x55c3465d59b0 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1c33e07640 1 -- 172.21.15.151:0/2664939741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40016070 con 0x55c3465d59b0 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.739+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3466c74e0 con 0x55c3465d59b0 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1c33e07640 1 -- 172.21.15.151:0/2664939741 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d40023020 con 0x55c3465d59b0 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1c33e07640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c2c034650 0x7f1c2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1c33e07640 1 -- 172.21.15.151:0/2664939741 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1d40048f40 con 0x55c3465d59b0 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c2c034650 0x7f1c2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d49747980 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c3466c9120 0x55c3466cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3466cba50 con 0x55c3466c9120 2024-09-10T14:28:55.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d47a58640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c3466c9120 0x55c3466cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c2c034650 0x7f1c2c036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0ad000 tx=0x7f1d3c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d47a58640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c3466c9120 0x55c3466cb510 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d47a58640 1 -- 172.21.15.151:0/2664939741 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c3466c9120 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3466cbe50 con 0x55c3466c9120 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d47a58640 1 -- 172.21.15.151:0/2664939741 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d380083f0 con 0x55c3466c9120 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d49747980 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c3466cdc60 0x55c3466d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3466d0720 con 0x55c3466cdc60 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d47257640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c3466cdc60 0x55c3466d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d47257640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c3466cdc60 0x55c3466d0050 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d47257640 1 -- 172.21.15.151:0/2664939741 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d4000f070 con 0x55c3466cdc60 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3466ccad0 con 0x55c3466c9120 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d47a58640 1 -- 172.21.15.151:0/2664939741 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d380083f0 con 0x55c3466c9120 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d49747980 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c3466d1b80 0x55c3466d3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3466d4660 con 0x55c3466d1b80 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.743+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c3466d1b80 0x55c3466d3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c3466d1b80 0x55c3466d3f70 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d46a56640 1 -- 172.21.15.151:0/2664939741 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d3c0b3040 con 0x55c3466d1b80 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d49747980 1 Processor -- start 2024-09-10T14:28:55.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d49747980 1 -- start start 2024-09-10T14:28:55.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d49747980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3466e2110 0x55c3466e2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d49747980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c3464d8800 con 0x55c3466e2110 2024-09-10T14:28:55.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3466e2110 0x55c3466e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3466e2110 0x55c3466e2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49848/0 (socket says 172.21.15.151:49848) 2024-09-10T14:28:55.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d47257640 1 -- 172.21.15.151:0/680741275 learned_addr learned my addr 172.21.15.151:0/680741275 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d47257640 1 -- 172.21.15.151:0/680741275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3466e2a70 con 0x55c3466e2110 2024-09-10T14:28:55.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d47257640 1 --2- 172.21.15.151:0/680741275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3466e2110 0x55c3466e2530 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1d400472a0 tx=0x7f1d4001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1c31602640 1 -- 172.21.15.151:0/680741275 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4003e070 con 0x55c3466e2110 2024-09-10T14:28:55.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d49747980 1 -- 172.21.15.151:0/680741275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3466e2d00 con 0x55c3466e2110 2024-09-10T14:28:55.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1c31602640 1 -- 172.21.15.151:0/680741275 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4002c790 con 0x55c3466e2110 2024-09-10T14:28:55.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1c31602640 1 -- 172.21.15.151:0/680741275 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4001ba60 con 0x55c3466e2110 2024-09-10T14:28:55.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.747+0000 7f1d49747980 1 -- 172.21.15.151:0/680741275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3466e5980 con 0x55c3466e2110 2024-09-10T14:28:55.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1c31602640 1 -- 172.21.15.151:0/680741275 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d400402c0 con 0x55c3466e2110 2024-09-10T14:28:55.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1c31602640 1 --2- 172.21.15.151:0/680741275 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c20034650 0x7f1c20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1c31602640 1 -- 172.21.15.151:0/680741275 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1d4004dc90 con 0x55c3466e2110 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d46a56640 1 --2- 172.21.15.151:0/680741275 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c20034650 0x7f1c20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 Processor -- start 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 -- start start 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d46a56640 1 --2- 172.21.15.151:0/680741275 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c20034650 0x7f1c20036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55c3466cc210 tx=0x7f1d3c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c346546f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c3466bd370 con 0x55c346546b70 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c346546f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c346546f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49850/0 (socket says 172.21.15.151:49850) 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d47257640 1 -- 172.21.15.151:0/1920281565 learned_addr learned my addr 172.21.15.151:0/1920281565 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d47257640 1 -- 172.21.15.151:0/1920281565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c346547540 con 0x55c346546b70 2024-09-10T14:28:55.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d47257640 1 --2- 172.21.15.151:0/1920281565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c346546f70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1d4001b750 tx=0x7f1d4002e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81db3107337511c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1c2affd640 1 -- 172.21.15.151:0/1920281565 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40060070 con 0x55c346546b70 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1c2affd640 1 -- 172.21.15.151:0/1920281565 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4001be10 con 0x55c346546b70 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1c2affd640 1 -- 172.21.15.151:0/1920281565 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40057040 con 0x55c346546b70 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 -- 172.21.15.151:0/1920281565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 msgr2=0x55c346546f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 --2- 172.21.15.151:0/1920281565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c346546f70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1d4001b750 tx=0x7f1d4002e6f0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 -- 172.21.15.151:0/1920281565 shutdown_connections 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 --2- 172.21.15.151:0/1920281565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c346546f70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 -- 172.21.15.151:0/1920281565 >> 172.21.15.151:0/1920281565 conn(0x55c3466eae20 msgr2=0x55c3466e8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 -- 172.21.15.151:0/1920281565 shutdown_connections 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 -- 172.21.15.151:0/1920281565 wait complete. 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.751+0000 7f1d49747980 1 Processor -- start 2024-09-10T14:28:55.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d49747980 1 -- start start 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d49747980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c3466f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d49747980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c346547b70 con 0x55c346546b70 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c3466f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d47257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c3466f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49860/0 (socket says 172.21.15.151:49860) 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 learned_addr learned my addr 172.21.15.151:0/2920989380 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3466f8410 con 0x55c346546b70 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d47257640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c3466f7ed0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1d4001b750 tx=0x7f1d40030f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1c297fa640 1 -- 172.21.15.151:0/2920989380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40068020 con 0x55c346546b70 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3466f8410 con 0x55c346546b70 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1c297fa640 1 -- 172.21.15.151:0/2920989380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40040c80 con 0x55c346546b70 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1c297fa640 1 -- 172.21.15.151:0/2920989380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40060040 con 0x55c346546b70 2024-09-10T14:28:55.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3466f8880 con 0x55c346546b70 2024-09-10T14:28:55.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1c297fa640 1 -- 172.21.15.151:0/2920989380 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d4006b020 con 0x55c346546b70 2024-09-10T14:28:55.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1c297fa640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c100345b0 0x7f1c10036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1c297fa640 1 -- 172.21.15.151:0/2920989380 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1d4006ec60 con 0x55c346546b70 2024-09-10T14:28:55.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c100345b0 0x7f1c10036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d49747980 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c346702e90 0x55c346705350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c346705aa0 con 0x55c346702e90 2024-09-10T14:28:55.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d47a58640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c346702e90 0x55c346705350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c100345b0 0x7f1c10036a70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c000c10 tx=0x7f1d3c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.755+0000 7f1d47a58640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c346702e90 0x55c346705350 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 realm 2024-09-10T14:28:55.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c346705eb0 con 0x55c346702e90 2024-09-10T14:28:55.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:55.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c346706780 con 0x55c346702e90 2024-09-10T14:28:55.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c346707880 0x55c346709c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34670a2c0 con 0x55c346707880 2024-09-10T14:28:55.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47257640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c346707880 0x55c346709c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47257640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c346707880 0x55c346709c70 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:55.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 20 searching for the correct realm 2024-09-10T14:28:55.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c34670bb20 con 0x55c346707880 2024-09-10T14:28:55.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47257640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d40078040 0x7f1d40064430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c34670bb20 con 0x7f1d40078040 2024-09-10T14:28:55.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d40078040 0x7f1d40064430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d40078040 0x7f1d40064430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d46a56640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d3c0dc040 0x7f1d3c0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c34670bb20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.759+0000 7f1d47a58640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d3c0dc040 0x7f1d3c0dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d3c0dc040 0x7f1d3c0dd430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d40078040 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346707880 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.763+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d40078040 2024-09-10T14:28:55.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346707880 2024-09-10T14:28:55.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346707880 2024-09-10T14:28:55.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346707880 2024-09-10T14:28:55.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346707880 2024-09-10T14:28:55.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.767+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346707880 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d40078040 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346707880 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d40078040 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346707880 2024-09-10T14:28:55.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x55c346702e90 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.771+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c346706b20 con 0x7f1d40078040 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:55.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34670ac10 con 0x55c346702e90 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34670b460 con 0x55c346702e90 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34670afb0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 zone default found 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 4 Realm: () 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 zonegroup default 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34670b3e0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34670b3e0 con 0x55c346707880 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34670da60 con 0x55c346707880 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 started sync module instance, tier type = 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:55.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.775+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c34670cdd0 con 0x7f1d40078040 2024-09-10T14:28:55.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.779+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.779+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94297188782528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c34670ca30 con 0x7f1d40078040 2024-09-10T14:28:55.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.779+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c34670e8a0 con 0x55c346702e90 2024-09-10T14:28:55.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.779+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94297188782528] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.779+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.779+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94297188785856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c34670ec90 con 0x55c346702e90 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.779+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c34670f650 con 0x55c346707880 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94297188790688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c34670fef0 con 0x55c346707880 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3467108f0 con 0x7f1d40078040 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94297188785856] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94297188786912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346711190 con 0x7f1d40078040 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346711a20 con 0x55c346702e90 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94297188790688] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94297188786912] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94297188797664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346711530 con 0x55c346702e90 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.783+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3467122c0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.787+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.787+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94297188801872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346712620 con 0x7f1d3c0dc040 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.787+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346713070 con 0x7f1d3c0dc040 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.787+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94297188797664] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94297188801872] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94297188805472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346712170 con 0x7f1d3c0dc040 2024-09-10T14:28:55.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346713700 con 0x7f1d3c0dc040 2024-09-10T14:28:55.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94297188805472] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94297188792896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346713700 con 0x7f1d3c0dc040 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 20 add_watcher() i=0 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 20 add_watcher() i=1 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 20 add_watcher() i=2 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 20 add_watcher() i=3 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 20 add_watcher() i=4 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 20 add_watcher() i=5 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.791+0000 7f1d49747980 20 add_watcher() i=6 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94297188792896] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 20 add_watcher() i=7 2024-09-10T14:28:55.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:55.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3467168a0 con 0x55c346702e90 2024-09-10T14:28:55.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94297188807248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346713b20 con 0x55c346702e90 2024-09-10T14:28:55.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94297188807248] v33'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1bfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 5 note: GC not initialized 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1bfcfe1640 20 reqs_thread_entry: start 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 20 Filter name: none 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1b767fc640 20 reqs_thread_entry: start 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.795+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34673a120 con 0x7f1d3c0dc040 2024-09-10T14:28:55.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T14:28:55.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T14:28:55.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T14:28:55.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:55.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:28:55.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c346739b70 con 0x7f1d40078040 2024-09-10T14:28:55.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:55.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:28:55.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:55.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:55.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c34673d950 con 0x55c346702e90 2024-09-10T14:28:55.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(64 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:55.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:55.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:55.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:55.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:55.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:55.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-10T14:28:55.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346741e80 con 0x7f1d40078040 2024-09-10T14:28:55.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(65 foo.buckets [call] v33'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.799+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.5 8:a2ff50d5:root::.bucket.meta.testx%3amyfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346745790 con 0x55c346702e90 2024-09-10T14:28:55.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [create,call,writefull 0~412,setxattr (203)] v33'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x7 2024-09-10T14:28:55.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:55.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T14:28:55.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1, ofs0, ns] 2024-09-10T14:28:55.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94297189004736 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c346745260 con 0x7f1d3c0dc040 2024-09-10T14:28:55.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== watch-notify(notify (1) cookie 94297188792896 notify 141733920776 ret 0) ==== 889+0+0 (crc 0 0 0) 0x55c346745b30 con 0x7f1d3c0dc040 2024-09-10T14:28:55.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1c2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94297188792896 notifier 4540 bl.length()=847 2024-09-10T14:28:55.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1c2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x7 2024-09-10T14:28:55.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1c2affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:55.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1c2affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T14:28:55.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(67 notify.7 [notify cookie 94297189004736 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1c2affd640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1c0c003eb0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== watch-notify(notify_complete (2) cookie 94297189004736 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c346741d20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 20 handle_bi_update(): bucket=testx:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_sources= new_sources= 2024-09-10T14:28:55.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 20 handle_bi_update(): bucket=testx:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential sources added=[] removed=[] 2024-09-10T14:28:55.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 20 handle_bi_update(): bucket=testx:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_dests= new_dests= 2024-09-10T14:28:55.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 20 handle_bi_update(): bucket=testx:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential dests added=[] removed=[] 2024-09-10T14:28:55.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.803+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3467452e0 con 0x55c346702e90 2024-09-10T14:28:55.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v33'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3467452e0 con 0x55c346702e90 2024-09-10T14:28:55.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v33'2 uv2 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d49747980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T14:28:55.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d49747980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T14:28:55.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d49747980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T14:28:55.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94297189010992 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c346745250 con 0x55c346702e90 2024-09-10T14:28:55.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== watch-notify(notify (1) cookie 94297188797664 notify 141733920779 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55c346745680 con 0x55c346702e90 2024-09-10T14:28:55.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1c2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 94297188797664 notifier 4540 bl.length()=348 2024-09-10T14:28:55.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1c2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T14:28:55.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1c2affd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T14:28:55.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1c2affd640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1c0c003eb0 con 0x55c346702e90 2024-09-10T14:28:55.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(71 notify.4 [notify cookie 94297189010992 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== watch-notify(notify_complete (2) cookie 94297189010992 notify 141733920779 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c3467445d0 con 0x55c346702e90 2024-09-10T14:28:55.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.807+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3467452e0 con 0x7f1d40078040 2024-09-10T14:28:55.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(73 myfoo [call,delete] v33'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d49747980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T14:28:55.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d49747980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T14:28:55.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94297189010992 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c346745250 con 0x7f1d3c0dc040 2024-09-10T14:28:55.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== watch-notify(notify (1) cookie 94297188805472 notify 141733920777 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55c3467445d0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1c2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94297188805472 notifier 4540 bl.length()=149 2024-09-10T14:28:55.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1c2a7fc640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1b7c0032d0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(74 notify.6 [notify cookie 94297189010992 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== watch-notify(notify_complete (2) cookie 94297189010992 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c346741d20 con 0x7f1d3c0dc040 2024-09-10T14:28:55.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.811+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3467452e0 con 0x55c346702e90 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(76 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call,delete] v33'5 uv5 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d49747980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 from cache 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d49747980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1, ofs0, ns] 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94297188979232 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3467452e0 con 0x7f1d40078040 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== watch-notify(notify (1) cookie 94297188782528 notify 141733920790 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f1d3c0e6060 con 0x7f1d40078040 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1c2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 94297188782528 notifier 4540 bl.length()=206 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1c2affd640 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1c0c003eb0 con 0x7f1d40078040 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(77 notify.0 [notify cookie 94297188979232 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== watch-notify(notify_complete (2) cookie 94297188979232 notify 141733920790 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c3465d92f0 con 0x7f1d40078040 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1bfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.815+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94297188807248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346737db0 con 0x55c346702e90 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.819+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94297188807248] v33'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.819+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94297188782528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346737db0 con 0x7f1d40078040 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.819+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94297188782528] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.819+0000 7f1d49747980 20 remove_watcher() i=0 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.819+0000 7f1d49747980 2 removed watcher, disabling cache 2024-09-10T14:28:55.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.819+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94297188785856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346737db0 con 0x55c346702e90 2024-09-10T14:28:55.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94297188785856] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d49747980 20 remove_watcher() i=1 2024-09-10T14:28:55.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94297188790688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c34670dec0 con 0x55c346707880 2024-09-10T14:28:55.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d47257640 1 -- 172.21.15.151:0/2920989380 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94297188790688] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d40040030 con 0x55c346707880 2024-09-10T14:28:55.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d49747980 20 remove_watcher() i=2 2024-09-10T14:28:55.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94297188786912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346737db0 con 0x7f1d40078040 2024-09-10T14:28:55.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d46a56640 1 -- 172.21.15.151:0/2920989380 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94297188786912] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d3c0c9030 con 0x7f1d40078040 2024-09-10T14:28:55.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d49747980 20 remove_watcher() i=3 2024-09-10T14:28:55.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.823+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94297188797664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346737db0 con 0x55c346702e90 2024-09-10T14:28:55.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.827+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94297188797664] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x55c346702e90 2024-09-10T14:28:55.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.827+0000 7f1d49747980 20 remove_watcher() i=4 2024-09-10T14:28:55.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.827+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94297188801872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346710ce0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.827+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94297188801872] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.827+0000 7f1d49747980 20 remove_watcher() i=5 2024-09-10T14:28:55.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.827+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94297188805472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346737db0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94297188805472] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 20 remove_watcher() i=6 2024-09-10T14:28:55.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94297188792896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c346710ce0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94297188792896] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d380083f0 con 0x7f1d3c0dc040 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 20 remove_watcher() i=7 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d3c0dc040 msgr2=0x7f1d3c0dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d3c0dc040 0x7f1d3c0dd430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c346702e90 msgr2=0x55c346705350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c346702e90 0x55c346705350 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d40078040 msgr2=0x7f1d40064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d40078040 0x7f1d40064430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c346707880 msgr2=0x55c346709c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c346707880 0x55c346709c70 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c100345b0 msgr2=0x7f1c10036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c100345b0 0x7f1c10036a70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c000c10 tx=0x7f1d3c0b9040 comp rx=0 tx=0).stop 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 msgr2=0x55c3466f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 --2- 172.21.15.151:0/2920989380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c346546b70 0x55c3466f7ed0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1d4001b750 tx=0x7f1d40030f30 comp rx=0 tx=0).stop 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 reap_dead start 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d47a58640 1 -- 172.21.15.151:0/2920989380 reap_dead start 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 shutdown_connections 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 >> 172.21.15.151:0/2920989380 conn(0x55c3466eae20 msgr2=0x55c3466e8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.831+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 shutdown_connections 2024-09-10T14:28:55.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2920989380 wait complete. 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/680741275 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c20034650 msgr2=0x7f1c20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/680741275 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c20034650 0x7f1c20036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55c3466cc210 tx=0x7f1d3c005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/680741275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3466e2110 msgr2=0x55c3466e2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/680741275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3466e2110 0x55c3466e2530 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1d400472a0 tx=0x7f1d4001ca70 comp rx=0 tx=0).stop 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/680741275 shutdown_connections 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/680741275 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c20034650 0x7f1c20036b10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/680741275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3466e2110 0x55c3466e2530 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/680741275 >> 172.21.15.151:0/680741275 conn(0x55c3466d7260 msgr2=0x55c3466d9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/680741275 shutdown_connections 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/680741275 wait complete. 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c3466d1b80 msgr2=0x55c3466d3f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c3466d1b80 0x55c3466d3f70 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c3466c9120 msgr2=0x55c3466cb510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c3466c9120 0x55c3466cb510 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c3466cdc60 msgr2=0x55c3466d0050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c3466cdc60 0x55c3466d0050 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c2c034650 msgr2=0x7f1c2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c2c034650 0x7f1c2c036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0ad000 tx=0x7f1d3c0a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 msgr2=0x55c3466c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 --2- 172.21.15.151:0/2664939741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c3465d59b0 0x55c3466c4030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1d40000f90 tx=0x7f1d40001260 comp rx=0 tx=0).stop 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d47a58640 1 -- 172.21.15.151:0/2664939741 reap_dead start 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 shutdown_connections 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 >> 172.21.15.151:0/2664939741 conn(0x55c3465cd150 msgr2=0x55c3466b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 shutdown_connections 2024-09-10T14:28:55.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.835+0000 7f1d49747980 1 -- 172.21.15.151:0/2664939741 wait complete. 2024-09-10T14:28:55.849 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T14:28:55.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T14:28:55.849 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-10T14:28:55.927 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:55.927 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:55.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.923+0000 7f717fba7980 1 Processor -- start 2024-09-10T14:28:55.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.923+0000 7f717fba7980 1 -- start start 2024-09-10T14:28:55.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.923+0000 7f717fba7980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5633d3707c60 0x5633d370a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.923+0000 7f717fba7980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5633d3589ae0 con 0x5633d37038e0 2024-09-10T14:28:55.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.923+0000 7f717fba7980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5633d35ade30 con 0x5633d3707c60 2024-09-10T14:28:55.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.923+0000 7f717ceb6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5633d3707c60 0x5633d370a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.923+0000 7f717d6b7640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5633d37038e0 0x5633d3703cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44730/0 (socket says 172.21.15.151:44730) 2024-09-10T14:28:55.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.923+0000 7f717d6b7640 1 -- 172.21.15.151:0/358896800 learned_addr learned my addr 172.21.15.151:0/358896800 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:55.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717ceb6640 1 -- 172.21.15.151:0/358896800 >> v1:172.21.15.52:6789/0 conn(0x5633d37038e0 legacy=0x5633d3703cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717ceb6640 1 -- 172.21.15.151:0/358896800 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d370b5a0 con 0x5633d3707c60 2024-09-10T14:28:55.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717ceb6640 1 --2- 172.21.15.151:0/358896800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3707c60 0x5633d370a050 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f717400a480 tx=0x7f717401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f5d111630c24cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f716ffff640 1 -- 172.21.15.151:0/358896800 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71740b0070 con 0x5633d3707c60 2024-09-10T14:28:55.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f716ffff640 1 -- 172.21.15.151:0/358896800 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71740ab540 con 0x5633d3707c60 2024-09-10T14:28:55.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f716ffff640 1 -- 172.21.15.151:0/358896800 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71740ab840 con 0x5633d3707c60 2024-09-10T14:28:55.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717fba7980 1 -- 172.21.15.151:0/358896800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3707c60 msgr2=0x5633d370a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717fba7980 1 --2- 172.21.15.151:0/358896800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3707c60 0x5633d370a050 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f717400a480 tx=0x7f717401b280 comp rx=0 tx=0).stop 2024-09-10T14:28:55.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717fba7980 1 -- 172.21.15.151:0/358896800 shutdown_connections 2024-09-10T14:28:55.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717fba7980 1 --2- 172.21.15.151:0/358896800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3707c60 0x5633d370a050 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717fba7980 1 -- 172.21.15.151:0/358896800 >> 172.21.15.151:0/358896800 conn(0x5633d3677230 msgr2=0x5633d3677640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717fba7980 1 -- 172.21.15.151:0/358896800 shutdown_connections 2024-09-10T14:28:55.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.927+0000 7f717fba7980 1 -- 172.21.15.151:0/358896800 wait complete. 2024-09-10T14:28:55.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.943+0000 7f717fba7980 1 Processor -- start 2024-09-10T14:28:55.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.943+0000 7f717fba7980 1 -- start start 2024-09-10T14:28:55.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.943+0000 7f717fba7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.943+0000 7f717fba7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5633d35af200 con 0x5633d37038e0 2024-09-10T14:28:55.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.943+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49876/0 (socket says 172.21.15.151:49876) 2024-09-10T14:28:55.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 -- 172.21.15.151:0/1428365395 learned_addr learned my addr 172.21.15.151:0/1428365395 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 -- 172.21.15.151:0/1428365395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d37ef270 con 0x5633d37038e0 2024-09-10T14:28:55.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 --2- 172.21.15.151:0/1428365395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37eeca0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f71780017b0 tx=0x7f7178001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c565814203b7b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f706b606640 1 -- 172.21.15.151:0/1428365395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7178016070 con 0x5633d37038e0 2024-09-10T14:28:55.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f706b606640 1 -- 172.21.15.151:0/1428365395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7178004530 con 0x5633d37038e0 2024-09-10T14:28:55.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f706b606640 1 -- 172.21.15.151:0/1428365395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7178004870 con 0x5633d37038e0 2024-09-10T14:28:55.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 -- 172.21.15.151:0/1428365395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 msgr2=0x5633d37eeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 --2- 172.21.15.151:0/1428365395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37eeca0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f71780017b0 tx=0x7f7178001c70 comp rx=0 tx=0).stop 2024-09-10T14:28:55.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 -- 172.21.15.151:0/1428365395 shutdown_connections 2024-09-10T14:28:55.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 --2- 172.21.15.151:0/1428365395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37eeca0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 -- 172.21.15.151:0/1428365395 >> 172.21.15.151:0/1428365395 conn(0x5633d3677230 msgr2=0x5633d37ea8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 -- 172.21.15.151:0/1428365395 shutdown_connections 2024-09-10T14:28:55.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 -- 172.21.15.151:0/1428365395 wait complete. 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 Processor -- start 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 -- start start 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717fba7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5633d370b0a0 con 0x5633d37038e0 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49888/0 (socket says 172.21.15.151:49888) 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 -- 172.21.15.151:0/4273493028 learned_addr learned my addr 172.21.15.151:0/4273493028 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 -- 172.21.15.151:0/4273493028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d37f65b0 con 0x5633d37038e0 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.947+0000 7f717d6b7640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37f6070 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7178000f90 tx=0x7f7178001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f7069e03640 1 -- 172.21.15.151:0/4273493028 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7178020070 con 0x5633d37038e0 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633d37f6840 con 0x5633d37038e0 2024-09-10T14:28:55.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f7069e03640 1 -- 172.21.15.151:0/4273493028 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7178011400 con 0x5633d37038e0 2024-09-10T14:28:55.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f7069e03640 1 -- 172.21.15.151:0/4273493028 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7178016040 con 0x5633d37038e0 2024-09-10T14:28:55.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633d37f9520 con 0x5633d37038e0 2024-09-10T14:28:55.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f7069e03640 1 -- 172.21.15.151:0/4273493028 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7178023070 con 0x5633d37038e0 2024-09-10T14:28:55.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f7069e03640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7064034650 0x7f7064036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f7069e03640 1 -- 172.21.15.151:0/4273493028 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7178049230 con 0x5633d37038e0 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717ceb6640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7064034650 0x7f7064036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717fba7980 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d3707c60 0x5633d37fd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d37fd6b0 con 0x5633d3707c60 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717deb8640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d3707c60 0x5633d37fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717ceb6640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7064034650 0x7f7064036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71740ad000 tx=0x7f71740a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717deb8640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d3707c60 0x5633d37fd170 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717deb8640 1 -- 172.21.15.151:0/4273493028 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d3707c60 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d37fa720 con 0x5633d3707c60 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717deb8640 1 -- 172.21.15.151:0/4273493028 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71700083f0 con 0x5633d3707c60 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717fba7980 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d37ff9d0 0x5633d3801dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d3802490 con 0x5633d37ff9d0 2024-09-10T14:28:55.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717d6b7640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d37ff9d0 0x5633d3801dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717d6b7640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d37ff9d0 0x5633d3801dc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.951+0000 7f717d6b7640 1 -- 172.21.15.151:0/4273493028 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f717802c070 con 0x5633d37ff9d0 2024-09-10T14:28:55.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d37fe840 con 0x5633d3707c60 2024-09-10T14:28:55.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717deb8640 1 -- 172.21.15.151:0/4273493028 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71700083f0 con 0x5633d3707c60 2024-09-10T14:28:55.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717fba7980 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5633d38038f0 0x5633d3805ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d38063d0 con 0x5633d38038f0 2024-09-10T14:28:55.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717ceb6640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5633d38038f0 0x5633d3805ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717ceb6640 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5633d38038f0 0x5633d3805ce0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717ceb6640 1 -- 172.21.15.151:0/4273493028 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f71740b3040 con 0x5633d38038f0 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717fba7980 1 Processor -- start 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717fba7980 1 -- start start 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717fba7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3813e20 0x5633d3814240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717fba7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5633d3608800 con 0x5633d3813e20 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3813e20 0x5633d3814240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3813e20 0x5633d3814240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49902/0 (socket says 172.21.15.151:49902) 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717d6b7640 1 -- 172.21.15.151:0/2642442126 learned_addr learned my addr 172.21.15.151:0/2642442126 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717d6b7640 1 -- 172.21.15.151:0/2642442126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d3814780 con 0x5633d3813e20 2024-09-10T14:28:55.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.955+0000 7f717d6b7640 1 --2- 172.21.15.151:0/2642442126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3813e20 0x5633d3814240 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f71780475c0 tx=0x7f7178023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7062ffd640 1 -- 172.21.15.151:0/2642442126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f717802a040 con 0x5633d3813e20 2024-09-10T14:28:55.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7062ffd640 1 -- 172.21.15.151:0/2642442126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7178023db0 con 0x5633d3813e20 2024-09-10T14:28:55.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717fba7980 1 -- 172.21.15.151:0/2642442126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633d3814a10 con 0x5633d3813e20 2024-09-10T14:28:55.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7062ffd640 1 -- 172.21.15.151:0/2642442126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f717802a420 con 0x5633d3813e20 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717fba7980 1 -- 172.21.15.151:0/2642442126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633d3817690 con 0x5633d3813e20 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7062ffd640 1 -- 172.21.15.151:0/2642442126 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7178011850 con 0x5633d3813e20 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7062ffd640 1 --2- 172.21.15.151:0/2642442126 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7054034650 0x7f7054036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7062ffd640 1 -- 172.21.15.151:0/2642442126 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7178036070 con 0x5633d3813e20 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717ceb6640 1 --2- 172.21.15.151:0/2642442126 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7054034650 0x7f7054036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717fba7980 1 Processor -- start 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717fba7980 1 -- start start 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717fba7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3820b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717ceb6640 1 --2- 172.21.15.151:0/2642442126 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7054034650 0x7f7054036b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5633d37fdf80 tx=0x7f7174005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717fba7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5633d37ef5f0 con 0x5633d3820750 2024-09-10T14:28:55.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3820b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3820b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49914/0 (socket says 172.21.15.151:49914) 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717d6b7640 1 -- 172.21.15.151:0/3621301769 learned_addr learned my addr 172.21.15.151:0/3621301769 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717d6b7640 1 -- 172.21.15.151:0/3621301769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d3821100 con 0x5633d3820750 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f717d6b7640 1 --2- 172.21.15.151:0/3621301769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3820b30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7178006830 tx=0x7f71780257b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d454760c18d5adc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7060ff9640 1 -- 172.21.15.151:0/3621301769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7178040670 con 0x5633d3820750 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7060ff9640 1 -- 172.21.15.151:0/3621301769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7178040930 con 0x5633d3820750 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.959+0000 7f7060ff9640 1 -- 172.21.15.151:0/3621301769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7178040bf0 con 0x5633d3820750 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- 172.21.15.151:0/3621301769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 msgr2=0x5633d3820b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 --2- 172.21.15.151:0/3621301769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3820b30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7178006830 tx=0x7f71780257b0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- 172.21.15.151:0/3621301769 shutdown_connections 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 --2- 172.21.15.151:0/3621301769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3820b30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:55.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- 172.21.15.151:0/3621301769 >> 172.21.15.151:0/3621301769 conn(0x5633d381cb30 msgr2=0x5633d381ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- 172.21.15.151:0/3621301769 shutdown_connections 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- 172.21.15.151:0/3621301769 wait complete. 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 Processor -- start 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- start start 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3827840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5633d38215a0 con 0x5633d3820750 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3827840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717d6b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3827840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49930/0 (socket says 172.21.15.151:49930) 2024-09-10T14:28:55.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 learned_addr learned my addr 172.21.15.151:0/900822465 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:55.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d3827d80 con 0x5633d3820750 2024-09-10T14:28:55.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717d6b7640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3827840 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f717802b000 tx=0x7f7178052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f7052ffd640 1 -- 172.21.15.151:0/900822465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7178040bf0 con 0x5633d3820750 2024-09-10T14:28:55.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633d3827d80 con 0x5633d3820750 2024-09-10T14:28:55.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f7052ffd640 1 -- 172.21.15.151:0/900822465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7178063070 con 0x5633d3820750 2024-09-10T14:28:55.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f7052ffd640 1 -- 172.21.15.151:0/900822465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f717802d690 con 0x5633d3820750 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633d3828250 con 0x5633d3820750 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.963+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f7052ffd640 1 -- 172.21.15.151:0/900822465 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f717805a040 con 0x5633d3820750 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f7052ffd640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7048034650 0x7f7048036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f7052ffd640 1 -- 172.21.15.151:0/900822465 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7178058020 con 0x5633d3820750 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717ceb6640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7048034650 0x7f7048036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d38329c0 0x5633d3834e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d38355b0 con 0x5633d38329c0 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717deb8640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d38329c0 0x5633d3834e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717ceb6640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7048034650 0x7f7048036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7174000c10 tx=0x7f71740b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717deb8640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d38329c0 0x5633d3834e60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 realm 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d38359c0 con 0x5633d38329c0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836260 con 0x5633d38329c0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d3837360 0x5633d3839750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d3839cd0 con 0x5633d3837360 2024-09-10T14:28:55.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717d6b7640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d3837360 0x5633d3839750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717d6b7640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d3837360 0x5633d3839750 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:55.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 20 searching for the correct realm 2024-09-10T14:28:55.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d383b550 con 0x5633d3837360 2024-09-10T14:28:55.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717d6b7640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7178053070 0x7f7178049770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d383b550 con 0x7f7178053070 2024-09-10T14:28:55.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.967+0000 7f717ceb6640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7178053070 0x7f7178049770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717ceb6640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7178053070 0x7f7178049770 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:55.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717ceb6640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f71740dc040 0x7f71740dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:55.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d383b550 con 0x7f71740dc040 2024-09-10T14:28:55.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f71740dc040 0x7f71740dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:55.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f71740dc040 0x7f71740dd430 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:55.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f71740dc040 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f71740dc040 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.971+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f7178053070 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:55.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d3837360 2024-09-10T14:28:55.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f71740dc040 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f7178053070 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d3837360 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d3837360 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f71740dc040 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d3837360 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.975+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d3837360 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f71740dc040 2024-09-10T14:28:55.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d3837360 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f7178053070 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f71740dc040 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d3837360 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.979+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f71740dc040 2024-09-10T14:28:55.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f7178053070 2024-09-10T14:28:55.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:55.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d3837360 2024-09-10T14:28:55.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f71740dc040 2024-09-10T14:28:55.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x5633d38329c0 2024-09-10T14:28:55.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5633d3836600 con 0x7f7178053070 2024-09-10T14:28:55.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:55.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d383a520 con 0x5633d38329c0 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d383a910 con 0x5633d38329c0 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d383a910 con 0x7f71740dc040 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 zone default found 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 4 Realm: () 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:55.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:55.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:55.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 zonegroup default 2024-09-10T14:28:55.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.983+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d383ad30 con 0x7f71740dc040 2024-09-10T14:28:55.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:55.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d383b150 con 0x5633d3837360 2024-09-10T14:28:55.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:55.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d383d400 con 0x5633d3837360 2024-09-10T14:28:55.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:55.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:55.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 20 started sync module instance, tier type = 2024-09-10T14:28:55.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:55.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d383c8a0 con 0x7f7178053070 2024-09-10T14:28:55.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:55.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94780591951040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d383c500 con 0x7f7178053070 2024-09-10T14:28:55.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d383e100 con 0x5633d38329c0 2024-09-10T14:28:55.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.987+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94780591951040] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:55.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94780591954096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d383e4f0 con 0x5633d38329c0 2024-09-10T14:28:56.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d383eeb0 con 0x5633d3837360 2024-09-10T14:28:56.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94780591954096] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:56.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94780591958528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d383f2a0 con 0x5633d3837360 2024-09-10T14:28:56.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d383fc60 con 0x7f7178053070 2024-09-10T14:28:56.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:56.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.991+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94780591964240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3840920 con 0x7f7178053070 2024-09-10T14:28:56.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.995+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d38412e0 con 0x5633d38329c0 2024-09-10T14:28:56.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.995+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94780591958528] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:56.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.995+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94780591964240] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:56.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.995+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.995+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94780591955248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3840580 con 0x5633d38329c0 2024-09-10T14:28:56.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.995+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d38412e0 con 0x7f71740dc040 2024-09-10T14:28:56.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.995+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.999+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94780591970544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d38412e0 con 0x7f71740dc040 2024-09-10T14:28:56.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.999+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3842940 con 0x7f71740dc040 2024-09-10T14:28:56.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.999+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94780591955248] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.999+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94780591970544] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.999+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.999+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94780591967792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3841250 con 0x7f71740dc040 2024-09-10T14:28:56.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:55.999+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3842df0 con 0x7f71740dc040 2024-09-10T14:28:56.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(58 notify.7 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94780591974720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3843210 con 0x7f71740dc040 2024-09-10T14:28:56.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 20 add_watcher() i=0 2024-09-10T14:28:56.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 20 add_watcher() i=1 2024-09-10T14:28:56.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 20 add_watcher() i=2 2024-09-10T14:28:56.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 20 add_watcher() i=3 2024-09-10T14:28:56.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 20 add_watcher() i=4 2024-09-10T14:28:56.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 20 add_watcher() i=5 2024-09-10T14:28:56.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94780591967792] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 20 add_watcher() i=6 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94780591974720] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 20 add_watcher() i=7 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d3842490 con 0x5633d38329c0 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.003+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94780591973520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3843730 con 0x5633d38329c0 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94780591973520] v33'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f7033fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 5 note: GC not initialized 2024-09-10T14:28:56.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f7032fe5640 20 reqs_thread_entry: start 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 20 Filter name: none 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f7030fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5633d38692e0 con 0x5633d38329c0 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f7033fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.007+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94780591973520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x5633d38329c0 2024-09-10T14:28:56.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94780591973520] v33'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94780591951040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x7f7178053070 2024-09-10T14:28:56.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94780591951040] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:56.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717fba7980 20 remove_watcher() i=0 2024-09-10T14:28:56.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717fba7980 2 removed watcher, disabling cache 2024-09-10T14:28:56.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94780591954096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x5633d38329c0 2024-09-10T14:28:56.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94780591954096] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717fba7980 20 remove_watcher() i=1 2024-09-10T14:28:56.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.011+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94780591958528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x5633d3837360 2024-09-10T14:28:56.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.015+0000 7f717d6b7640 1 -- 172.21.15.151:0/900822465 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94780591958528] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f717802c070 con 0x5633d3837360 2024-09-10T14:28:56.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.015+0000 7f717fba7980 20 remove_watcher() i=2 2024-09-10T14:28:56.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.015+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94780591964240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x7f7178053070 2024-09-10T14:28:56.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.015+0000 7f717ceb6640 1 -- 172.21.15.151:0/900822465 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94780591964240] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71740c9030 con 0x7f7178053070 2024-09-10T14:28:56.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.015+0000 7f717fba7980 20 remove_watcher() i=3 2024-09-10T14:28:56.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.015+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94780591955248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x5633d38329c0 2024-09-10T14:28:56.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.019+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94780591955248] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x5633d38329c0 2024-09-10T14:28:56.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.019+0000 7f717fba7980 20 remove_watcher() i=4 2024-09-10T14:28:56.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.019+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94780591970544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x7f71740dc040 2024-09-10T14:28:56.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.019+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94780591970544] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.019+0000 7f717fba7980 20 remove_watcher() i=5 2024-09-10T14:28:56.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.019+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94780591967792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x7f71740dc040 2024-09-10T14:28:56.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94780591967792] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 20 remove_watcher() i=6 2024-09-10T14:28:56.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94780591974720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5633d3867230 con 0x7f71740dc040 2024-09-10T14:28:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94780591974720] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71700083f0 con 0x7f71740dc040 2024-09-10T14:28:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 20 remove_watcher() i=7 2024-09-10T14:28:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f71740dc040 msgr2=0x7f71740dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f71740dc040 0x7f71740dd430 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d38329c0 msgr2=0x5633d3834e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d38329c0 0x5633d3834e60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7178053070 msgr2=0x7f7178049770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7178053070 0x7f7178049770 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d3837360 msgr2=0x5633d3839750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d3837360 0x5633d3839750 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7048034650 msgr2=0x7f7048036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7048034650 0x7f7048036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7174000c10 tx=0x7f71740b9040 comp rx=0 tx=0).stop 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 msgr2=0x5633d3827840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717deb8640 1 -- 172.21.15.151:0/900822465 reap_dead start 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.023+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3827840 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f717802b000 tx=0x7f7178052000 comp rx=0 tx=0).stop 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 shutdown_connections 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/900822465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3820750 0x5633d3827840 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 >> 172.21.15.151:0/900822465 conn(0x5633d381cb30 msgr2=0x5633d381ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 shutdown_connections 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/900822465 wait complete. 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/2642442126 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7054034650 msgr2=0x7f7054036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/2642442126 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7054034650 0x7f7054036b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5633d37fdf80 tx=0x7f7174005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/2642442126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3813e20 msgr2=0x5633d3814240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/2642442126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3813e20 0x5633d3814240 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f71780475c0 tx=0x7f7178023ac0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/2642442126 shutdown_connections 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/2642442126 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7054034650 0x7f7054036b10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/2642442126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d3813e20 0x5633d3814240 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/2642442126 >> 172.21.15.151:0/2642442126 conn(0x5633d3808f70 msgr2=0x5633d380b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/2642442126 shutdown_connections 2024-09-10T14:28:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/2642442126 wait complete. 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5633d38038f0 msgr2=0x5633d3805ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5633d38038f0 0x5633d3805ce0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d3707c60 msgr2=0x5633d37fd170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5633d3707c60 0x5633d37fd170 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d37ff9d0 msgr2=0x5633d3801dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5633d37ff9d0 0x5633d3801dc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7064034650 msgr2=0x7f7064036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7064034650 0x7f7064036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71740ad000 tx=0x7f71740a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 msgr2=0x5633d37f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 --2- 172.21.15.151:0/4273493028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633d37038e0 0x5633d37f6070 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7178000f90 tx=0x7f7178001260 comp rx=0 tx=0).stop 2024-09-10T14:28:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717deb8640 1 -- 172.21.15.151:0/4273493028 reap_dead start 2024-09-10T14:28:56.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 shutdown_connections 2024-09-10T14:28:56.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 >> 172.21.15.151:0/4273493028 conn(0x5633d3677230 msgr2=0x5633d37e9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 shutdown_connections 2024-09-10T14:28:56.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.027+0000 7f717fba7980 1 -- 172.21.15.151:0/4273493028 wait complete. 2024-09-10T14:28:56.041 INFO:teuthology.orchestra.run.smithi151.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"vOjOCeJXmnZkrttTTITqecoJ","ver":2},"mtime":"2024-09-10T14:28:55.811562Z","data":{"bucket":{"name":"myfoo","marker":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","bucket_id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-10T14:28:52.346429Z","linked":true,"has_bucket_info":false}} 2024-09-10T14:28:56.041 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'vOjOCeJXmnZkrttTTITqecoJ', 'ver': 2}, 'mtime': '2024-09-10T14:28:55.811562Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'bucket_id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-10T14:28:52.346429Z', 'linked': True, 'has_bucket_info': False}} 2024-09-10T14:28:56.042 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T14:28:56.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T14:28:56.042 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-10T14:28:56.122 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:56.122 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:56.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a6996980 1 Processor -- start 2024-09-10T14:28:56.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a6996980 1 -- start start 2024-09-10T14:28:56.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a6996980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5637796012a0 0x56377968f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a6996980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563779514ae0 con 0x56377968f8f0 2024-09-10T14:28:56.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a6996980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x563779538e30 con 0x5637796012a0 2024-09-10T14:28:56.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a44a6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5637796012a0 0x56377968f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a44a6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5637796012a0 0x56377968f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49938/0 (socket says 172.21.15.151:49938) 2024-09-10T14:28:56.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1661273579 learned_addr learned my addr 172.21.15.151:0/1661273579 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a3ca5640 1 --1- 172.21.15.151:0/1661273579 >> v1:172.21.15.52:6789/0 conn(0x56377968f8f0 0x563779691ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44738/0 (socket says 172.21.15.151:44738) 2024-09-10T14:28:56.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1661273579 >> v1:172.21.15.52:6789/0 conn(0x56377968f8f0 legacy=0x563779691ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.119+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1661273579 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563779601830 con 0x5637796012a0 2024-09-10T14:28:56.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/1661273579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968f3b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd59400a4e0 tx=0x7fd59401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0f96904a903701 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a34a4640 1 -- 172.21.15.151:0/1661273579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940aa540 con 0x5637796012a0 2024-09-10T14:28:56.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a34a4640 1 -- 172.21.15.151:0/1661273579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940aa6e0 con 0x5637796012a0 2024-09-10T14:28:56.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a34a4640 1 -- 172.21.15.151:0/1661273579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940aaa40 con 0x5637796012a0 2024-09-10T14:28:56.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a6996980 1 -- 172.21.15.151:0/1661273579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 msgr2=0x56377968f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1661273579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968f3b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd59400a4e0 tx=0x7fd59401b090 comp rx=0 tx=0).stop 2024-09-10T14:28:56.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a6996980 1 -- 172.21.15.151:0/1661273579 shutdown_connections 2024-09-10T14:28:56.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1661273579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968f3b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a6996980 1 -- 172.21.15.151:0/1661273579 >> 172.21.15.151:0/1661273579 conn(0x5637796870a0 msgr2=0x5637796894c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a6996980 1 -- 172.21.15.151:0/1661273579 shutdown_connections 2024-09-10T14:28:56.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.123+0000 7fd5a6996980 1 -- 172.21.15.151:0/1661273579 wait complete. 2024-09-10T14:28:56.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a6996980 1 Processor -- start 2024-09-10T14:28:56.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a6996980 1 -- start start 2024-09-10T14:28:56.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a6996980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a6996980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56377953a200 con 0x5637796012a0 2024-09-10T14:28:56.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49950/0 (socket says 172.21.15.151:49950) 2024-09-10T14:28:56.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a44a6640 1 -- 172.21.15.151:0/2022896710 learned_addr learned my addr 172.21.15.151:0/2022896710 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a44a6640 1 -- 172.21.15.151:0/2022896710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56377968d0e0 con 0x5637796012a0 2024-09-10T14:28:56.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/2022896710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968cb10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd594018cc0 tx=0x7fd5940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edffd42b35891bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd49260c640 1 -- 172.21.15.151:0/2022896710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940b9070 con 0x5637796012a0 2024-09-10T14:28:56.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd49260c640 1 -- 172.21.15.151:0/2022896710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940aab50 con 0x5637796012a0 2024-09-10T14:28:56.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.139+0000 7fd49260c640 1 -- 172.21.15.151:0/2022896710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940aae50 con 0x5637796012a0 2024-09-10T14:28:56.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- 172.21.15.151:0/2022896710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 msgr2=0x56377968cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 --2- 172.21.15.151:0/2022896710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968cb10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd594018cc0 tx=0x7fd5940033b0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- 172.21.15.151:0/2022896710 shutdown_connections 2024-09-10T14:28:56.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 --2- 172.21.15.151:0/2022896710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x56377968cb10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- 172.21.15.151:0/2022896710 >> 172.21.15.151:0/2022896710 conn(0x5637796870a0 msgr2=0x563779773670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- 172.21.15.151:0/2022896710 shutdown_connections 2024-09-10T14:28:56.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- 172.21.15.151:0/2022896710 wait complete. 2024-09-10T14:28:56.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 Processor -- start 2024-09-10T14:28:56.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- start start 2024-09-10T14:28:56.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x563779780e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563779693f10 con 0x5637796012a0 2024-09-10T14:28:56.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x563779780e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x563779780e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49964/0 (socket says 172.21.15.151:49964) 2024-09-10T14:28:56.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a44a6640 1 -- 172.21.15.151:0/128863475 learned_addr learned my addr 172.21.15.151:0/128863475 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a44a6640 1 -- 172.21.15.151:0/128863475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637797813d0 con 0x5637796012a0 2024-09-10T14:28:56.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x563779780e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd594017ca0 tx=0x7fd594017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd490e09640 1 -- 172.21.15.151:0/128863475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940b9070 con 0x5637796012a0 2024-09-10T14:28:56.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563779781660 con 0x5637796012a0 2024-09-10T14:28:56.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd490e09640 1 -- 172.21.15.151:0/128863475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940b5e40 con 0x5637796012a0 2024-09-10T14:28:56.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd490e09640 1 -- 172.21.15.151:0/128863475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940c7580 con 0x5637796012a0 2024-09-10T14:28:56.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.143+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563779784340 con 0x5637796012a0 2024-09-10T14:28:56.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd490e09640 1 -- 172.21.15.151:0/128863475 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5940b3040 con 0x5637796012a0 2024-09-10T14:28:56.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd490e09640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd48c034650 0x7fd48c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd490e09640 1 -- 172.21.15.151:0/128863475 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd5940c4070 con 0x5637796012a0 2024-09-10T14:28:56.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd48c034650 0x7fd48c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a6996980 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56377968f8f0 0x563779787f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797884d0 con 0x56377968f8f0 2024-09-10T14:28:56.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a4ca7640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56377968f8f0 0x563779787f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd48c034650 0x7fd48c036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd58c001e50 tx=0x7fd58c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a4ca7640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56377968f8f0 0x563779787f90 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/128863475 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x56377968f8f0 2024-09-10T14:28:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563779785540 con 0x56377968f8f0 2024-09-10T14:28:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/128863475 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd59c0083f0 con 0x56377968f8f0 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a6996980 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56377978a800 0x56377978cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56377978d2c0 con 0x56377978a800 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56377978a800 0x56377978cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56377978a800 0x56377978cbf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a44a6640 1 -- 172.21.15.151:0/128863475 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd5940cd060 con 0x56377978a800 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563779789670 con 0x56377968f8f0 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/128863475 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd59c0083f0 con 0x56377968f8f0 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a6996980 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56377978e700 0x563779790af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563779791260 con 0x56377978e700 2024-09-10T14:28:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.147+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56377978e700 0x563779790af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56377978e700 0x563779790af0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/128863475 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd58c00f700 con 0x56377978e700 2024-09-10T14:28:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a6996980 1 Processor -- start 2024-09-10T14:28:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a6996980 1 -- start start 2024-09-10T14:28:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a6996980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56377979ecd0 0x56377979f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a6996980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563779593800 con 0x56377979ecd0 2024-09-10T14:28:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56377979ecd0 0x56377979f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56377979ecd0 0x56377979f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49972/0 (socket says 172.21.15.151:49972) 2024-09-10T14:28:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a44a6640 1 -- 172.21.15.151:0/2127068354 learned_addr learned my addr 172.21.15.151:0/2127068354 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a44a6640 1 -- 172.21.15.151:0/2127068354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56377979f630 con 0x56377979ecd0 2024-09-10T14:28:56.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/2127068354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56377979ecd0 0x56377979f0f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd5940ce910 tx=0x7fd5940cf850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd489ffb640 1 -- 172.21.15.151:0/2127068354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940d7280 con 0x56377979ecd0 2024-09-10T14:28:56.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd489ffb640 1 -- 172.21.15.151:0/2127068354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940c6370 con 0x56377979ecd0 2024-09-10T14:28:56.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a6996980 1 -- 172.21.15.151:0/2127068354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56377979f860 con 0x56377979ecd0 2024-09-10T14:28:56.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd489ffb640 1 -- 172.21.15.151:0/2127068354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940d0960 con 0x56377979ecd0 2024-09-10T14:28:56.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.151+0000 7fd5a6996980 1 -- 172.21.15.151:0/2127068354 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56377979f860 con 0x56377979ecd0 2024-09-10T14:28:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd489ffb640 1 -- 172.21.15.151:0/2127068354 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5940eb060 con 0x56377979ecd0 2024-09-10T14:28:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd489ffb640 1 --2- 172.21.15.151:0/2127068354 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd47c034650 0x7fd47c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd489ffb640 1 -- 172.21.15.151:0/2127068354 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd5940de070 con 0x56377979ecd0 2024-09-10T14:28:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/2127068354 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd47c034650 0x7fd47c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 Processor -- start 2024-09-10T14:28:56.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 -- start start 2024-09-10T14:28:56.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/2127068354 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd47c034650 0x7fd47c036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x563779791640 tx=0x7fd58c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56377968b240 con 0x5637797ab360 2024-09-10T14:28:56.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49984/0 (socket says 172.21.15.151:49984) 2024-09-10T14:28:56.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a44a6640 1 -- 172.21.15.151:0/953092649 learned_addr learned my addr 172.21.15.151:0/953092649 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a44a6640 1 -- 172.21.15.151:0/953092649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637797abd30 con 0x5637797ab360 2024-09-10T14:28:56.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/953092649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797ab760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd5940b4b00 tx=0x7fd5940e04c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450f37a33fdfcb8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd4837fe640 1 -- 172.21.15.151:0/953092649 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940fb020 con 0x5637797ab360 2024-09-10T14:28:56.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd4837fe640 1 -- 172.21.15.151:0/953092649 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940d9070 con 0x5637797ab360 2024-09-10T14:28:56.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd4837fe640 1 -- 172.21.15.151:0/953092649 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940c6750 con 0x5637797ab360 2024-09-10T14:28:56.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 -- 172.21.15.151:0/953092649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 msgr2=0x5637797ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 --2- 172.21.15.151:0/953092649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797ab760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd5940b4b00 tx=0x7fd5940e04c0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 -- 172.21.15.151:0/953092649 shutdown_connections 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 --2- 172.21.15.151:0/953092649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797ab760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 -- 172.21.15.151:0/953092649 >> 172.21.15.151:0/953092649 conn(0x5637797a7790 msgr2=0x5637797a5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 -- 172.21.15.151:0/953092649 shutdown_connections 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.155+0000 7fd5a6996980 1 -- 172.21.15.151:0/953092649 wait complete. 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a6996980 1 Processor -- start 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a6996980 1 -- start start 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a6996980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a6996980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5637797ac200 con 0x5637797ab360 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a44a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797b25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:49986/0 (socket says 172.21.15.151:49986) 2024-09-10T14:28:56.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 learned_addr learned my addr 172.21.15.151:0/1327471462 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637797b2b20 con 0x5637797ab360 2024-09-10T14:28:56.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797b25e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd5940d7a70 tx=0x7fd5940ce800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd481ffb640 1 -- 172.21.15.151:0/1327471462 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59410f070 con 0x5637797ab360 2024-09-10T14:28:56.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637797b2b20 con 0x5637797ab360 2024-09-10T14:28:56.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd481ffb640 1 -- 172.21.15.151:0/1327471462 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940d7ae0 con 0x5637797ab360 2024-09-10T14:28:56.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd481ffb640 1 -- 172.21.15.151:0/1327471462 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940d7e00 con 0x5637797ab360 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637797b2f90 con 0x5637797ab360 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd481ffb640 1 -- 172.21.15.151:0/1327471462 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd594112070 con 0x5637797ab360 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd481ffb640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd474034650 0x7fd474036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd481ffb640 1 -- 172.21.15.151:0/1327471462 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fd594107050 con 0x5637797ab360 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.159+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd474034650 0x7fd474036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5637797bd6f0 0x5637797bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c0300 con 0x5637797bd6f0 2024-09-10T14:28:56.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a4ca7640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5637797bd6f0 0x5637797bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd474034650 0x7fd474036b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00baa0 tx=0x7fd58c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a4ca7640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5637797bd6f0 0x5637797bfbb0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 realm 2024-09-10T14:28:56.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c0710 con 0x5637797bd6f0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c0fe0 con 0x5637797bd6f0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5637797c20e0 0x5637797c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c4a90 con 0x5637797c20e0 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5637797c20e0 0x5637797c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5637797c20e0 0x5637797c44d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 20 searching for the correct realm 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c6360 con 0x5637797c20e0 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a44a6640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd594114060 0x7fd5941007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c6360 con 0x7fd594114060 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd594114060 0x7fd5941007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd594114060 0x7fd5941007b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a3ca5640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd58c03a3c0 0x7fd58c03a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.163+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c6360 con 0x7fd58c03a3c0 2024-09-10T14:28:56.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd58c03a3c0 0x7fd58c03a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd58c03a3c0 0x7fd58c03a800 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd594114060 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.167+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797c20e0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd594114060 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797c20e0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797c20e0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797c20e0 2024-09-10T14:28:56.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797c20e0 2024-09-10T14:28:56.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.171+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd59c0083f0 con 0x5637797bd6f0 2024-09-10T14:28:56.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797c20e0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd594114060 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797c20e0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.175+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd594114060 2024-09-10T14:28:56.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797c20e0 2024-09-10T14:28:56.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x5637797bd6f0 2024-09-10T14:28:56.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5637797c1380 con 0x7fd594114060 2024-09-10T14:28:56.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:56.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c5410 con 0x5637797bd6f0 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c5cb0 con 0x5637797bd6f0 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c5800 con 0x7fd58c03a3c0 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 zone default found 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 4 Realm: () 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 zonegroup default 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c5c30 con 0x7fd58c03a3c0 2024-09-10T14:28:56.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.179+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c8170 con 0x5637797c20e0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797c8510 con 0x5637797c20e0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 20 started sync module instance, tier type = 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797c7610 con 0x7fd594114060 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94796261390848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797c7270 con 0x7fd594114060 2024-09-10T14:28:56.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797c9250 con 0x5637797bd6f0 2024-09-10T14:28:56.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94796261390848] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.183+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94796261394608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797c9640 con 0x5637797bd6f0 2024-09-10T14:28:56.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.187+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797ca040 con 0x5637797c20e0 2024-09-10T14:28:56.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.187+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94796261394608] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.187+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.187+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94796261395664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797ca430 con 0x5637797c20e0 2024-09-10T14:28:56.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.187+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cadf0 con 0x7fd594114060 2024-09-10T14:28:56.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.187+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.187+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94796261402944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cb640 con 0x7fd594114060 2024-09-10T14:28:56.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.187+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cc040 con 0x5637797bd6f0 2024-09-10T14:28:56.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.191+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94796261395664] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.191+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94796261402944] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.191+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.191+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94796261405072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cbb50 con 0x5637797bd6f0 2024-09-10T14:28:56.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.191+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cc8e0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.191+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94796261405072] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.195+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.195+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94796261399376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cc830 con 0x7fd58c03a3c0 2024-09-10T14:28:56.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.195+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cd120 con 0x7fd58c03a3c0 2024-09-10T14:28:56.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.195+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94796261399376] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.195+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.195+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94796261409664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cd300 con 0x7fd58c03a3c0 2024-09-10T14:28:56.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.195+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cdb50 con 0x7fd58c03a3c0 2024-09-10T14:28:56.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94796261409664] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94796261413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cdbd0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 20 add_watcher() i=0 2024-09-10T14:28:56.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 20 add_watcher() i=1 2024-09-10T14:28:56.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 20 add_watcher() i=2 2024-09-10T14:28:56.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 20 add_watcher() i=3 2024-09-10T14:28:56.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 20 add_watcher() i=4 2024-09-10T14:28:56.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 20 add_watcher() i=5 2024-09-10T14:28:56.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 20 add_watcher() i=6 2024-09-10T14:28:56.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94796261413632] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 20 add_watcher() i=7 2024-09-10T14:28:56.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:56.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797d0e90 con 0x5637797bd6f0 2024-09-10T14:28:56.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.199+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94796261415056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797ce160 con 0x5637797bd6f0 2024-09-10T14:28:56.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94796261415056] v33'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd45a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 5 note: GC not initialized 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd4597e2640 20 reqs_thread_entry: start 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 Filter name: none 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd3caffd640 20 reqs_thread_entry: start 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797f4540 con 0x5637797bd6f0 2024-09-10T14:28:56.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:56.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:56.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:56.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797f4090 con 0x5637797bd6f0 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv2 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 8.5 8:a2ff50d5:root::.bucket.meta.testx%3amyfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797f81d0 con 0x5637797bd6f0 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 20 rados_obj.operate() r=0 bl.length=412 2024-09-10T14:28:56.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:56.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:56.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:56.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T14:28:56.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:56.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T14:28:56.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.203+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797fc880 con 0x5637797bd6f0 2024-09-10T14:28:56.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v33'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563779800190 con 0x5637797bd6f0 2024-09-10T14:28:56.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [create,call,writefull 0~379,setxattr (123)] v33'6 uv6 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x7 2024-09-10T14:28:56.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:56.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:56.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1, ofs0, ns] 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94796261613360 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797ffb90 con 0x7fd594114060 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== watch-notify(notify (1) cookie 94796261390848 notify 141733920791 ret 0) ==== 770+0+0 (crc 0 0 0) 0x7fd58c018040 con 0x7fd594114060 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd4837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94796261390848 notifier 4554 bl.length()=728 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd4837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x7 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd4837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd4837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(67 notify.0 [notify cookie 94796261613360 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd4837fe640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd468003eb0 con 0x7fd594114060 2024-09-10T14:28:56.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== watch-notify(notify_complete (2) cookie 94796261613360 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563779514ae0 con 0x7fd594114060 2024-09-10T14:28:56.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_sources= new_sources= 2024-09-10T14:28:56.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential sources added=[] removed=[] 2024-09-10T14:28:56.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_dests= new_dests= 2024-09-10T14:28:56.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential dests added=[] removed=[] 2024-09-10T14:28:56.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.207+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797ffc90 con 0x7fd594114060 2024-09-10T14:28:56.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.211+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(69 foo.buckets [call] v33'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.211+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797ffc90 con 0x7fd594114060 2024-09-10T14:28:56.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T14:28:56.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:56.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T14:28:56.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94796261619680 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797ffc00 con 0x7fd58c03a3c0 2024-09-10T14:28:56.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== watch-notify(notify (1) cookie 94796261409664 notify 141733920778 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5637797fc2b0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd4837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94796261409664 notifier 4554 bl.length()=314 2024-09-10T14:28:56.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd4837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T14:28:56.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd4837fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:56.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd4837fe640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd468003eb0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(71 notify.6 [notify cookie 94796261619680 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== watch-notify(notify_complete (2) cookie 94796261619680 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5637797f85c0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797ffc90 con 0x5637797bd6f0 2024-09-10T14:28:56.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(73 testx/myfoo [call,delete] v33'3 uv3 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-10T14:28:56.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T14:28:56.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94796261619680 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797ffc00 con 0x5637797bd6f0 2024-09-10T14:28:56.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== watch-notify(notify (1) cookie 94796261405072 notify 141733920780 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5637797f85c0 con 0x5637797bd6f0 2024-09-10T14:28:56.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd482ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94796261405072 notifier 4554 bl.length()=155 2024-09-10T14:28:56.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(74 notify.4 [notify cookie 94796261619680 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd482ffd640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd3d80032d0 con 0x5637797bd6f0 2024-09-10T14:28:56.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== watch-notify(notify_complete (2) cookie 94796261619680 notify 141733920780 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5637797f7830 con 0x5637797bd6f0 2024-09-10T14:28:56.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.215+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 8.5 8:a2ff50d5:root::.bucket.meta.testx%3amyfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797ffc90 con 0x5637797bd6f0 2024-09-10T14:28:56.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call,delete] v33'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd5a6996980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 from cache 2024-09-10T14:28:56.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd5a6996980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1, ofs0, ns] 2024-09-10T14:28:56.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94796261587616 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5637797ffc90 con 0x7fd58c03a3c0 2024-09-10T14:28:56.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== watch-notify(notify (1) cookie 94796261413632 notify 141733920779 ret 0) ==== 254+0+0 (crc 0 0 0) 0x5637797f7830 con 0x7fd58c03a3c0 2024-09-10T14:28:56.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd4837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 94796261413632 notifier 4554 bl.length()=212 2024-09-10T14:28:56.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(77 notify.7 [notify cookie 94796261587616 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd4837fe640 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd468003eb0 con 0x7fd58c03a3c0 2024-09-10T14:28:56.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== watch-notify(notify_complete (2) cookie 94796261587616 notify 141733920779 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd59c010040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.219+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.223+0000 7fd45a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.223+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94796261415056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797f2370 con 0x5637797bd6f0 2024-09-10T14:28:56.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.223+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94796261415056] v33'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.223+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94796261390848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797f2370 con 0x7fd594114060 2024-09-10T14:28:56.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.223+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94796261390848] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.223+0000 7fd5a6996980 20 remove_watcher() i=0 2024-09-10T14:28:56.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.223+0000 7fd5a6996980 2 removed watcher, disabling cache 2024-09-10T14:28:56.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.223+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94796261394608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797f2370 con 0x5637797bd6f0 2024-09-10T14:28:56.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94796261394608] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a6996980 20 remove_watcher() i=1 2024-09-10T14:28:56.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94796261395664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797f2370 con 0x5637797c20e0 2024-09-10T14:28:56.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a44a6640 1 -- 172.21.15.151:0/1327471462 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94796261395664] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd594111030 con 0x5637797c20e0 2024-09-10T14:28:56.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a6996980 20 remove_watcher() i=2 2024-09-10T14:28:56.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94796261402944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797f2370 con 0x7fd594114060 2024-09-10T14:28:56.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a3ca5640 1 -- 172.21.15.151:0/1327471462 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94796261402944] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c037040 con 0x7fd594114060 2024-09-10T14:28:56.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a6996980 20 remove_watcher() i=3 2024-09-10T14:28:56.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.227+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94796261405072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797f2370 con 0x5637797bd6f0 2024-09-10T14:28:56.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.231+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94796261405072] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x5637797bd6f0 2024-09-10T14:28:56.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.231+0000 7fd5a6996980 20 remove_watcher() i=4 2024-09-10T14:28:56.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.231+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94796261399376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797f2370 con 0x7fd58c03a3c0 2024-09-10T14:28:56.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.235+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94796261399376] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.235+0000 7fd5a6996980 20 remove_watcher() i=5 2024-09-10T14:28:56.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.235+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94796261409664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797f2370 con 0x7fd58c03a3c0 2024-09-10T14:28:56.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.235+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94796261409664] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.235+0000 7fd5a6996980 20 remove_watcher() i=6 2024-09-10T14:28:56.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.235+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94796261413632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5637797cc380 con 0x7fd58c03a3c0 2024-09-10T14:28:56.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.235+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94796261413632] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c030040 con 0x7fd58c03a3c0 2024-09-10T14:28:56.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.235+0000 7fd5a6996980 20 remove_watcher() i=7 2024-09-10T14:28:56.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd58c03a3c0 msgr2=0x7fd58c03a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd58c03a3c0 0x7fd58c03a800 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5637797bd6f0 msgr2=0x5637797bfbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5637797bd6f0 0x5637797bfbb0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd594114060 msgr2=0x7fd5941007b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd594114060 0x7fd5941007b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5637797c20e0 msgr2=0x5637797c44d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5637797c20e0 0x5637797c44d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd474034650 msgr2=0x7fd474036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd474034650 0x7fd474036b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00baa0 tx=0x7fd58c010000 comp rx=0 tx=0).stop 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 msgr2=0x5637797b25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/1327471462 reap_dead start 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797b25e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd5940d7a70 tx=0x7fd5940ce800 comp rx=0 tx=0).stop 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 shutdown_connections 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/1327471462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637797ab360 0x5637797b25e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 >> 172.21.15.151:0/1327471462 conn(0x5637797a7790 msgr2=0x5637797a5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 shutdown_connections 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/1327471462 wait complete. 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/2127068354 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd47c034650 msgr2=0x7fd47c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/2127068354 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd47c034650 0x7fd47c036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x563779791640 tx=0x7fd58c00f000 comp rx=0 tx=0).stop 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/2127068354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56377979ecd0 msgr2=0x56377979f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/2127068354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56377979ecd0 0x56377979f0f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd5940ce910 tx=0x7fd5940cf850 comp rx=0 tx=0).stop 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/2127068354 shutdown_connections 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/2127068354 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd47c034650 0x7fd47c036b10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/2127068354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56377979ecd0 0x56377979f0f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/2127068354 >> 172.21.15.151:0/2127068354 conn(0x563779793e20 msgr2=0x5637797968a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/2127068354 shutdown_connections 2024-09-10T14:28:56.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/2127068354 wait complete. 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56377978e700 msgr2=0x563779790af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56377978e700 0x563779790af0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56377968f8f0 msgr2=0x563779787f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56377968f8f0 0x563779787f90 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56377978a800 msgr2=0x56377978cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56377978a800 0x56377978cbf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd48c034650 msgr2=0x7fd48c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd48c034650 0x7fd48c036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd58c001e50 tx=0x7fd58c0013b0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 msgr2=0x563779780e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 --2- 172.21.15.151:0/128863475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637796012a0 0x563779780e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd594017ca0 tx=0x7fd594017e30 comp rx=0 tx=0).stop 2024-09-10T14:28:56.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a4ca7640 1 -- 172.21.15.151:0/128863475 reap_dead start 2024-09-10T14:28:56.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 shutdown_connections 2024-09-10T14:28:56.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 >> 172.21.15.151:0/128863475 conn(0x5637796870a0 msgr2=0x56377968b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 shutdown_connections 2024-09-10T14:28:56.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.239+0000 7fd5a6996980 1 -- 172.21.15.151:0/128863475 wait complete. 2024-09-10T14:28:56.254 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T14:28:56.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T14:28:56.254 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-10T14:28:56.335 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:56.335 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:56.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.331+0000 7f1d40ec1980 1 Processor -- start 2024-09-10T14:28:56.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.331+0000 7f1d40ec1980 1 -- start start 2024-09-10T14:28:56.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.331+0000 7f1d40ec1980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56476e2137d0 0x56476e212290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.331+0000 7f1d40ec1980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56476e124ae0 con 0x56476e2133c0 2024-09-10T14:28:56.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.331+0000 7f1d40ec1980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56476e148e30 con 0x56476e2137d0 2024-09-10T14:28:56.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.331+0000 7f1d3e1d0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56476e2137d0 0x56476e212290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.331+0000 7f1d3e9d1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x56476e2133c0 0x56476e211b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44742/0 (socket says 172.21.15.151:44742) 2024-09-10T14:28:56.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.331+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/2898510783 learned_addr learned my addr 172.21.15.151:0/2898510783 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:56.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/2898510783 >> v1:172.21.15.52:6789/0 conn(0x56476e2133c0 legacy=0x56476e211b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/2898510783 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56476e2128f0 con 0x56476e2137d0 2024-09-10T14:28:56.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/2898510783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2137d0 0x56476e212290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400a480 tx=0x7f1d3401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fa15194b199e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d3d9cf640 1 -- 172.21.15.151:0/2898510783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d340b0070 con 0x56476e2137d0 2024-09-10T14:28:56.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d3d9cf640 1 -- 172.21.15.151:0/2898510783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d340ab540 con 0x56476e2137d0 2024-09-10T14:28:56.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d3d9cf640 1 -- 172.21.15.151:0/2898510783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d340ab840 con 0x56476e2137d0 2024-09-10T14:28:56.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2898510783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2137d0 msgr2=0x56476e212290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2898510783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2137d0 0x56476e212290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400a480 tx=0x7f1d3401b280 comp rx=0 tx=0).stop 2024-09-10T14:28:56.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2898510783 shutdown_connections 2024-09-10T14:28:56.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2898510783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2137d0 0x56476e212290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2898510783 >> 172.21.15.151:0/2898510783 conn(0x56476e2981c0 msgr2=0x56476e29a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2898510783 shutdown_connections 2024-09-10T14:28:56.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.335+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2898510783 wait complete. 2024-09-10T14:28:56.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.351+0000 7f1d40ec1980 1 Processor -- start 2024-09-10T14:28:56.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.351+0000 7f1d40ec1980 1 -- start start 2024-09-10T14:28:56.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.351+0000 7f1d40ec1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e389c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.351+0000 7f1d40ec1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56476e14a200 con 0x56476e2133c0 2024-09-10T14:28:56.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.351+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e389c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.351+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e389c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50004/0 (socket says 172.21.15.151:50004) 2024-09-10T14:28:56.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.351+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/1161490391 learned_addr learned my addr 172.21.15.151:0/1161490391 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.351+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/1161490391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56476e38a1f0 con 0x56476e2133c0 2024-09-10T14:28:56.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/1161490391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e389c20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1d380015f0 tx=0x7f1d38001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856558d4ebc300f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1c2ce09640 1 -- 172.21.15.151:0/1161490391 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d38004530 con 0x56476e2133c0 2024-09-10T14:28:56.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1c2ce09640 1 -- 172.21.15.151:0/1161490391 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d380046f0 con 0x56476e2133c0 2024-09-10T14:28:56.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1c2ce09640 1 -- 172.21.15.151:0/1161490391 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d38004a90 con 0x56476e2133c0 2024-09-10T14:28:56.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- 172.21.15.151:0/1161490391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 msgr2=0x56476e389c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/1161490391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e389c20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1d380015f0 tx=0x7f1d38001ab0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- 172.21.15.151:0/1161490391 shutdown_connections 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/1161490391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e389c20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- 172.21.15.151:0/1161490391 >> 172.21.15.151:0/1161490391 conn(0x56476e2981c0 msgr2=0x56476e385850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- 172.21.15.151:0/1161490391 shutdown_connections 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- 172.21.15.151:0/1161490391 wait complete. 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 Processor -- start 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- start start 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e390f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56476e2a8210 con 0x56476e2133c0 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e390f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e390f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50020/0 (socket says 172.21.15.151:50020) 2024-09-10T14:28:56.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/2781251034 learned_addr learned my addr 172.21.15.151:0/2781251034 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/2781251034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56476e3914b0 con 0x56476e2133c0 2024-09-10T14:28:56.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e390f70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x56476e38ae00 tx=0x7f1d38000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1c2b606640 1 -- 172.21.15.151:0/2781251034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d38013760 con 0x56476e2133c0 2024-09-10T14:28:56.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1c2b606640 1 -- 172.21.15.151:0/2781251034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d38013900 con 0x56476e2133c0 2024-09-10T14:28:56.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56476e391740 con 0x56476e2133c0 2024-09-10T14:28:56.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1c2b606640 1 -- 172.21.15.151:0/2781251034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d38013be0 con 0x56476e2133c0 2024-09-10T14:28:56.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.355+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56476e394420 con 0x56476e2133c0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1c2b606640 1 -- 172.21.15.151:0/2781251034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d38010070 con 0x56476e2133c0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1c2b606640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c24034650 0x7f1c24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1c2b606640 1 -- 172.21.15.151:0/2781251034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1d38018070 con 0x56476e2133c0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c24034650 0x7f1c24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e2137d0 0x56476e397f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3985d0 con 0x56476e2137d0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3f1d2640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e2137d0 0x56476e397f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c24034650 0x7f1c24036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d340ad000 tx=0x7f1d340a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3f1d2640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e2137d0 0x56476e397f60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/2781251034 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e2137d0 2024-09-10T14:28:56.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e395620 con 0x56476e2137d0 2024-09-10T14:28:56.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/2781251034 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e2137d0 2024-09-10T14:28:56.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e39a900 0x56476e39ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e39d3e0 con 0x56476e39a900 2024-09-10T14:28:56.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e39a900 0x56476e39ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e39a900 0x56476e39ccf0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/2781251034 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d3801b030 con 0x56476e39a900 2024-09-10T14:28:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3997a0 con 0x56476e2137d0 2024-09-10T14:28:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/2781251034 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e2137d0 2024-09-10T14:28:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56476e39e840 0x56476e3a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.359+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3a1370 con 0x56476e39e840 2024-09-10T14:28:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56476e39e840 0x56476e3a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56476e39e840 0x56476e3a0c30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/2781251034 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d340abcf0 con 0x56476e39e840 2024-09-10T14:28:56.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d40ec1980 1 Processor -- start 2024-09-10T14:28:56.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d40ec1980 1 -- start start 2024-09-10T14:28:56.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d40ec1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3aee40 0x56476e3af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d40ec1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56476e1a3800 con 0x56476e3aee40 2024-09-10T14:28:56.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3aee40 0x56476e3af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3aee40 0x56476e3af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50034/0 (socket says 172.21.15.151:50034) 2024-09-10T14:28:56.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/2351035229 learned_addr learned my addr 172.21.15.151:0/2351035229 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/2351035229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56476e3af7a0 con 0x56476e3aee40 2024-09-10T14:28:56.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/2351035229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3aee40 0x56476e3af260 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d380483b0 tx=0x7f1d38029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1c28e01640 1 -- 172.21.15.151:0/2351035229 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d38043040 con 0x56476e3aee40 2024-09-10T14:28:56.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.363+0000 7f1c28e01640 1 -- 172.21.15.151:0/2351035229 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d38010d10 con 0x56476e3aee40 2024-09-10T14:28:56.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2351035229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56476e3afa30 con 0x56476e3aee40 2024-09-10T14:28:56.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1c28e01640 1 -- 172.21.15.151:0/2351035229 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d38041a10 con 0x56476e3aee40 2024-09-10T14:28:56.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2351035229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56476e3b26b0 con 0x56476e3aee40 2024-09-10T14:28:56.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1c28e01640 1 -- 172.21.15.151:0/2351035229 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d38041bb0 con 0x56476e3aee40 2024-09-10T14:28:56.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1c28e01640 1 --2- 172.21.15.151:0/2351035229 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c180346a0 0x7f1c18036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1c28e01640 1 -- 172.21.15.151:0/2351035229 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1d3803c030 con 0x56476e3aee40 2024-09-10T14:28:56.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/2351035229 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c180346a0 0x7f1c18036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d40ec1980 1 Processor -- start 2024-09-10T14:28:56.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d40ec1980 1 -- start start 2024-09-10T14:28:56.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/2351035229 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c180346a0 0x7f1c18036b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56476e398aa0 tx=0x7f1d34005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d40ec1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d40ec1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56476e38a570 con 0x56476e3bb7b0 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3bbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50036/0 (socket says 172.21.15.151:50036) 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/406321266 learned_addr learned my addr 172.21.15.151:0/406321266 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/406321266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56476e3bc180 con 0x56476e3bb7b0 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/406321266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3bbbb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d38035180 tx=0x7f1d38008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab991f22f56b872 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1c227fc640 1 -- 172.21.15.151:0/406321266 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d3805b040 con 0x56476e3bb7b0 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1c227fc640 1 -- 172.21.15.151:0/406321266 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d38028d10 con 0x56476e3bb7b0 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.367+0000 7f1c227fc640 1 -- 172.21.15.151:0/406321266 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d380287f0 con 0x56476e3bb7b0 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- 172.21.15.151:0/406321266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 msgr2=0x56476e3bbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/406321266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3bbbb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d38035180 tx=0x7f1d38008f90 comp rx=0 tx=0).stop 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- 172.21.15.151:0/406321266 shutdown_connections 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/406321266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3bbbb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- 172.21.15.151:0/406321266 >> 172.21.15.151:0/406321266 conn(0x56476e3b7b90 msgr2=0x56476e3b5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- 172.21.15.151:0/406321266 shutdown_connections 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- 172.21.15.151:0/406321266 wait complete. 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 Processor -- start 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- start start 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56476e3bc600 con 0x56476e3bb7b0 2024-09-10T14:28:56.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d3e9d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50052/0 (socket says 172.21.15.151:50052) 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 learned_addr learned my addr 172.21.15.151:0/3703977607 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56476e3c2e50 con 0x56476e3bb7b0 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3c2910 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d38008fd0 tx=0x7f1d3803aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1c20ff9640 1 -- 172.21.15.151:0/3703977607 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d38041530 con 0x56476e3bb7b0 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1c20ff9640 1 -- 172.21.15.151:0/3703977607 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3806f030 con 0x56476e3bb7b0 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56476e3c2e50 con 0x56476e3bb7b0 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1c20ff9640 1 -- 172.21.15.151:0/3703977607 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d38041820 con 0x56476e3bb7b0 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56476e3c2e50 con 0x56476e3bb7b0 2024-09-10T14:28:56.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1c20ff9640 1 -- 172.21.15.151:0/3703977607 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1d38034660 con 0x56476e3bb7b0 2024-09-10T14:28:56.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1c20ff9640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c080347a0 0x7f1c08036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1c20ff9640 1 -- 172.21.15.151:0/3703977607 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f1d38075c80 con 0x56476e3bb7b0 2024-09-10T14:28:56.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.371+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c080347a0 0x7f1c08036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e3cda10 0x56476e3cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d0620 con 0x56476e3cda10 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3f1d2640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e3cda10 0x56476e3cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c080347a0 0x7f1c08036c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x56476e3a1770 tx=0x7f1d340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3f1d2640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e3cda10 0x56476e3cfed0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 realm 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d0a30 con 0x56476e3cda10 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d1300 con 0x56476e3cda10 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x56476e3cda10 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e3d2400 0x56476e3d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d4dc0 con 0x56476e3d2400 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e3d2400 0x56476e3d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e3d2400 0x56476e3d47f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d3807b070 con 0x56476e3d2400 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 20 searching for the correct realm 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d6690 con 0x56476e3d2400 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3807b070 con 0x56476e3d2400 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e9d1640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d3806a050 0x7f1d38034950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d6690 con 0x7f1d3806a050 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d3806a050 0x7f1d38034950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d3806a050 0x7f1d38034950 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e1d0640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d340ce040 0x7f1d340c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.375+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d6690 con 0x7f1d340ce040 2024-09-10T14:28:56.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d340ce040 0x7f1d340c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d340ce040 0x7f1d340c03c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x56476e3cda10 2024-09-10T14:28:56.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x56476e3cda10 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x7f1d340ce040 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x7f1d340ce040 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x7f1d3806a050 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x56476e3d2400 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3807b070 con 0x56476e3d2400 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.379+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x56476e3cda10 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x7f1d340ce040 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x56476e3cda10 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d16a0 con 0x7f1d3806a050 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3d2400 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d3807b070 con 0x56476e3d2400 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3d2400 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3807b070 con 0x56476e3d2400 2024-09-10T14:28:56.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x7f1d340ce040 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3d2400 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3807b070 con 0x56476e3d2400 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3d2400 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d3807b070 con 0x56476e3d2400 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3cda10 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3cda10 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.383+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x7f1d340ce040 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3d2400 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x7f1d3806a050 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3cda10 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x7f1d340ce040 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3d2400 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x7f1d340ce040 2024-09-10T14:28:56.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x7f1d3806a050 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3d2400 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.387+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x7f1d340ce040 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x56476e3cda10 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f1d340e8060 con 0x7f1d3806a050 2024-09-10T14:28:56.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d57b0 con 0x56476e3cda10 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d6050 con 0x56476e3cda10 2024-09-10T14:28:56.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d53f0 con 0x7f1d340ce040 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 zone default found 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 4 Realm: () 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 zonegroup default 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d6050 con 0x7f1d340ce040 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d6080 con 0x56476e3d2400 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d85c0 con 0x56476e3d2400 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 started sync module instance, tier type = 2024-09-10T14:28:56.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:56.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.391+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d7940 con 0x7f1d3806a050 2024-09-10T14:28:56.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.395+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.395+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864792190304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d8ed0 con 0x7f1d3806a050 2024-09-10T14:28:56.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.395+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d9720 con 0x56476e3cda10 2024-09-10T14:28:56.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.395+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864792190304] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.395+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.395+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864792193568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d9720 con 0x56476e3cda10 2024-09-10T14:28:56.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.395+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3da180 con 0x56476e3d2400 2024-09-10T14:28:56.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864792193568] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864792195696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d9690 con 0x56476e3d2400 2024-09-10T14:28:56.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3daed0 con 0x7f1d3806a050 2024-09-10T14:28:56.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864792201760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3db770 con 0x7f1d3806a050 2024-09-10T14:28:56.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dc1b0 con 0x56476e3cda10 2024-09-10T14:28:56.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864792195696] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.399+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864792201760] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.403+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.403+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864792203968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3da570 con 0x56476e3cda10 2024-09-10T14:28:56.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.403+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dca50 con 0x7f1d340ce040 2024-09-10T14:28:56.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.403+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.403+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864792208688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dce00 con 0x7f1d340ce040 2024-09-10T14:28:56.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.403+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dd840 con 0x7f1d340ce040 2024-09-10T14:28:56.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.403+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864792203968] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864792208688] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864792212240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dc990 con 0x7f1d340ce040 2024-09-10T14:28:56.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dded0 con 0x7f1d340ce040 2024-09-10T14:28:56.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864792212240] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864792206464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dded0 con 0x7f1d340ce040 2024-09-10T14:28:56.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 20 add_watcher() i=0 2024-09-10T14:28:56.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 20 add_watcher() i=1 2024-09-10T14:28:56.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 20 add_watcher() i=2 2024-09-10T14:28:56.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 20 add_watcher() i=3 2024-09-10T14:28:56.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 20 add_watcher() i=4 2024-09-10T14:28:56.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 20 add_watcher() i=5 2024-09-10T14:28:56.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.407+0000 7f1d40ec1980 20 add_watcher() i=6 2024-09-10T14:28:56.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864792206464] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d40ec1980 20 add_watcher() i=7 2024-09-10T14:28:56.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d40ec1980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:56.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e3e1080 con 0x56476e3cda10 2024-09-10T14:28:56.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864792214048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3de2f0 con 0x56476e3cda10 2024-09-10T14:28:56.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864792214048] v33'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1bf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d40ec1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:56.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d40ec1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:56.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.411+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3e0850 con 0x56476e3cda10 2024-09-10T14:28:56.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.415+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.415+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3ea140 con 0x7f1d340ce040 2024-09-10T14:28:56.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.415+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.415+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3ea140 con 0x56476e3d2400 2024-09-10T14:28:56.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.419+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.419+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3ea5f0 con 0x56476e3cda10 2024-09-10T14:28:56.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.419+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'136 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.419+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eab60 con 0x7f1d3806a050 2024-09-10T14:28:56.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.419+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.419+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eaf80 con 0x56476e3d2400 2024-09-10T14:28:56.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.419+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.419+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eaf80 con 0x56476e3cda10 2024-09-10T14:28:56.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.423+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.423+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eafd0 con 0x7f1d340ce040 2024-09-10T14:28:56.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.423+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.423+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb0e0 con 0x7f1d3806a050 2024-09-10T14:28:56.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.427+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.427+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb7f0 con 0x56476e3d2400 2024-09-10T14:28:56.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.427+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.427+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb880 con 0x7f1d3806a050 2024-09-10T14:28:56.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.427+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.427+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x7f1d340ce040 2024-09-10T14:28:56.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.431+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.431+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x7f1d3806a050 2024-09-10T14:28:56.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.431+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.431+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb9a0 con 0x7f1d340ce040 2024-09-10T14:28:56.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.435+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.435+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb9a0 con 0x56476e3cda10 2024-09-10T14:28:56.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.435+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'137 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.435+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb9a0 con 0x56476e3d2400 2024-09-10T14:28:56.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.435+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.435+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb9a0 con 0x7f1d3806a050 2024-09-10T14:28:56.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.439+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.439+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb9a0 con 0x56476e3d2400 2024-09-10T14:28:56.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.439+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.439+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb9a0 con 0x56476e3cda10 2024-09-10T14:28:56.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.439+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.443+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x56476e3cda10 2024-09-10T14:28:56.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.443+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'138 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.443+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x56476e3d2400 2024-09-10T14:28:56.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.443+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.443+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x7f1d3806a050 2024-09-10T14:28:56.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.443+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.443+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x56476e3d2400 2024-09-10T14:28:56.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.447+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.447+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x56476e3d2400 2024-09-10T14:28:56.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.447+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.447+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x56476e3d2400 2024-09-10T14:28:56.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.447+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.447+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x56476e3d2400 2024-09-10T14:28:56.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.447+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.447+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x7f1d340ce040 2024-09-10T14:28:56.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.451+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.451+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x56476e3d2400 2024-09-10T14:28:56.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.451+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.451+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x7f1d340ce040 2024-09-10T14:28:56.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.455+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.455+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x56476e3d2400 2024-09-10T14:28:56.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.455+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.455+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x7f1d340ce040 2024-09-10T14:28:56.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.459+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.459+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3eb910 con 0x7f1d3806a050 2024-09-10T14:28:56.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.459+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.459+0000 7f1bf4fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:56.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.459+0000 7f1d40ec1980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:56.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.459+0000 7f1d40ec1980 20 Filter name: none 2024-09-10T14:28:56.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1bedffb640 20 reqs_thread_entry: start 2024-09-10T14:28:56.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T14:28:56.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e4071a0 con 0x7f1d340ce040 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e409a60 con 0x56476e3cda10 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T14:28:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e407a40 con 0x7f1d340ce040 2024-09-10T14:28:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v33'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T14:28:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94864792388912 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e409e50 con 0x56476e3d2400 2024-09-10T14:28:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== watch-notify(notify (1) cookie 94864792195696 notify 141733920773 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56476e3ea990 con 0x56476e3d2400 2024-09-10T14:28:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1c227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94864792195696 notifier 4561 bl.length()=170 2024-09-10T14:28:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(97 notify.2 [notify cookie 94864792388912 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.463+0000 7f1c227fc640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1c04003d70 con 0x56476e3d2400 2024-09-10T14:28:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== watch-notify(notify_complete (2) cookie 94864792388912 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56476e3af7a0 con 0x56476e3d2400 2024-09-10T14:28:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 10 removing email index: 2024-09-10T14:28:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 10 removing user buckets index 2024-09-10T14:28:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e4079d0 con 0x56476e3cda10 2024-09-10T14:28:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v33'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-10T14:28:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94864792384800 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e409df0 con 0x56476e3cda10 2024-09-10T14:28:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== watch-notify(notify (1) cookie 94864792203968 notify 141733920781 ret 0) ==== 217+0+0 (crc 0 0 0) 0x56476e3eabb0 con 0x56476e3cda10 2024-09-10T14:28:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1c227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94864792203968 notifier 4561 bl.length()=175 2024-09-10T14:28:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(100 notify.4 [notify cookie 94864792384800 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1c227fc640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1c04003d70 con 0x56476e3cda10 2024-09-10T14:28:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== watch-notify(notify_complete (2) cookie 94864792384800 notify 141733920781 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56476e3afa30 con 0x56476e3cda10 2024-09-10T14:28:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 10 removing user index: testx$tenanteduser 2024-09-10T14:28:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e4079d0 con 0x7f1d340ce040 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v33'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.467+0000 7f1d40ec1980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94864792384800 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56476e407940 con 0x7f1d3806a050 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== watch-notify(notify (1) cookie 94864792201760 notify 141733920792 ret 0) ==== 209+0+0 (crc 0 0 0) 0x56476e3eb0e0 con 0x7f1d3806a050 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1c21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94864792201760 notifier 4561 bl.length()=167 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1c21ffb640 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1b680032d0 con 0x7f1d3806a050 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(103 notify.3 [notify cookie 94864792384800 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== watch-notify(notify_complete (2) cookie 94864792384800 notify 141733920792 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56476e3eb620 con 0x7f1d3806a050 2024-09-10T14:28:56.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1bf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864792214048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e407520 con 0x56476e3cda10 2024-09-10T14:28:56.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94864792214048] v33'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864792190304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dda20 con 0x7f1d3806a050 2024-09-10T14:28:56.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94864792190304] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d40ec1980 20 remove_watcher() i=0 2024-09-10T14:28:56.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d40ec1980 2 removed watcher, disabling cache 2024-09-10T14:28:56.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.471+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864792193568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dda20 con 0x56476e3cda10 2024-09-10T14:28:56.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.475+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94864792193568] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.475+0000 7f1d40ec1980 20 remove_watcher() i=1 2024-09-10T14:28:56.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.475+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864792195696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d8a20 con 0x56476e3d2400 2024-09-10T14:28:56.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.475+0000 7f1d3e9d1640 1 -- 172.21.15.151:0/3703977607 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94864792195696] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d38093040 con 0x56476e3d2400 2024-09-10T14:28:56.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.475+0000 7f1d40ec1980 20 remove_watcher() i=2 2024-09-10T14:28:56.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.475+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864792201760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dda20 con 0x7f1d3806a050 2024-09-10T14:28:56.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.479+0000 7f1d3e1d0640 1 -- 172.21.15.151:0/3703977607 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94864792201760] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d340d9070 con 0x7f1d3806a050 2024-09-10T14:28:56.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.479+0000 7f1d40ec1980 20 remove_watcher() i=3 2024-09-10T14:28:56.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.479+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864792203968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d9270 con 0x56476e3cda10 2024-09-10T14:28:56.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.479+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94864792203968] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x56476e3cda10 2024-09-10T14:28:56.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.479+0000 7f1d40ec1980 20 remove_watcher() i=4 2024-09-10T14:28:56.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.479+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864792208688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3d8a20 con 0x7f1d340ce040 2024-09-10T14:28:56.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.483+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94864792208688] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.483+0000 7f1d40ec1980 20 remove_watcher() i=5 2024-09-10T14:28:56.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.483+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864792212240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3dda20 con 0x7f1d340ce040 2024-09-10T14:28:56.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.483+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94864792212240] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.483+0000 7f1d40ec1980 20 remove_watcher() i=6 2024-09-10T14:28:56.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.483+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864792206464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56476e3db2c0 con 0x7f1d340ce040 2024-09-10T14:28:56.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94864792206464] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d300083f0 con 0x7f1d340ce040 2024-09-10T14:28:56.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 20 remove_watcher() i=7 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d340ce040 msgr2=0x7f1d340c03c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f1d340ce040 0x7f1d340c03c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e3cda10 msgr2=0x56476e3cfed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e3cda10 0x56476e3cfed0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d3806a050 msgr2=0x7f1d38034950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f1d3806a050 0x7f1d38034950 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e3d2400 msgr2=0x56476e3d47f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e3d2400 0x56476e3d47f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c080347a0 msgr2=0x7f1c08036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c080347a0 0x7f1c08036c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x56476e3a1770 tx=0x7f1d340a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 msgr2=0x56476e3c2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3c2910 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d38008fd0 tx=0x7f1d3803aeb0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/3703977607 reap_dead start 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 shutdown_connections 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/3703977607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3bb7b0 0x56476e3c2910 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 >> 172.21.15.151:0/3703977607 conn(0x56476e3b7b90 msgr2=0x56476e3b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 shutdown_connections 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/3703977607 wait complete. 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2351035229 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c180346a0 msgr2=0x7f1c18036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2351035229 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c180346a0 0x7f1c18036b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56476e398aa0 tx=0x7f1d34005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2351035229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3aee40 msgr2=0x56476e3af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2351035229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3aee40 0x56476e3af260 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d380483b0 tx=0x7f1d38029840 comp rx=0 tx=0).stop 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2351035229 shutdown_connections 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2351035229 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c180346a0 0x7f1c18036b60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2351035229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e3aee40 0x56476e3af260 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2351035229 >> 172.21.15.151:0/2351035229 conn(0x56476e3a3f90 msgr2=0x56476e3a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2351035229 shutdown_connections 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2351035229 wait complete. 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56476e39e840 msgr2=0x56476e3a0c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56476e39e840 0x56476e3a0c30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e2137d0 msgr2=0x56476e397f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56476e2137d0 0x56476e397f60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e39a900 msgr2=0x56476e39ccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56476e39a900 0x56476e39ccf0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c24034650 msgr2=0x7f1c24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1c24034650 0x7f1c24036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d340ad000 tx=0x7f1d340a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 msgr2=0x56476e390f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 --2- 172.21.15.151:0/2781251034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56476e2133c0 0x56476e390f70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x56476e38ae00 tx=0x7f1d38000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:56.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d3f1d2640 1 -- 172.21.15.151:0/2781251034 reap_dead start 2024-09-10T14:28:56.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 shutdown_connections 2024-09-10T14:28:56.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 >> 172.21.15.151:0/2781251034 conn(0x56476e2981c0 msgr2=0x56476e3843d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 shutdown_connections 2024-09-10T14:28:56.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.487+0000 7f1d40ec1980 1 -- 172.21.15.151:0/2781251034 wait complete. 2024-09-10T14:28:56.509 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T14:28:56.514 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-10T14:28:56.561 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:28:56.562 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T14:28:56.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T14:28:56.562 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-10T14:28:56.599 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:56.600 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:56.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.595+0000 7f4d218cd980 1 Processor -- start 2024-09-10T14:28:56.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.595+0000 7f4d218cd980 1 -- start start 2024-09-10T14:28:56.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.595+0000 7f4d218cd980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55da92ab3a00 0x55da92ab3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.595+0000 7f4d218cd980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da929c1ae0 con 0x55da92ab0690 2024-09-10T14:28:56.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.595+0000 7f4d218cd980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55da929e5e30 con 0x55da92ab3a00 2024-09-10T14:28:56.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.595+0000 7f4d1ebdc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55da92ab3a00 0x55da92ab3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d1f3dd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55da92ab0690 0x55da92ab0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44750/0 (socket says 172.21.15.151:44750) 2024-09-10T14:28:56.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2796006258 learned_addr learned my addr 172.21.15.151:0/2796006258 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:56.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2796006258 >> v1:172.21.15.52:6789/0 conn(0x55da92ab0690 legacy=0x55da92ab0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2796006258 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da92ab4350 con 0x55da92ab3a00 2024-09-10T14:28:56.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/2796006258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab3a00 0x55da92ab3e10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800a480 tx=0x7f4d0801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7fedf3bdc1741a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d1e3db640 1 -- 172.21.15.151:0/2796006258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d080af070 con 0x55da92ab3a00 2024-09-10T14:28:56.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d1e3db640 1 -- 172.21.15.151:0/2796006258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d080aa530 con 0x55da92ab3a00 2024-09-10T14:28:56.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d1e3db640 1 -- 172.21.15.151:0/2796006258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d080aa830 con 0x55da92ab3a00 2024-09-10T14:28:56.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d218cd980 1 -- 172.21.15.151:0/2796006258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab3a00 msgr2=0x55da92ab3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2796006258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab3a00 0x55da92ab3e10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800a480 tx=0x7f4d0801b280 comp rx=0 tx=0).stop 2024-09-10T14:28:56.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d218cd980 1 -- 172.21.15.151:0/2796006258 shutdown_connections 2024-09-10T14:28:56.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2796006258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab3a00 0x55da92ab3e10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d218cd980 1 -- 172.21.15.151:0/2796006258 >> 172.21.15.151:0/2796006258 conn(0x55da92aaf240 msgr2=0x55da92aaf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d218cd980 1 -- 172.21.15.151:0/2796006258 shutdown_connections 2024-09-10T14:28:56.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.599+0000 7f4d218cd980 1 -- 172.21.15.151:0/2796006258 wait complete. 2024-09-10T14:28:56.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 Processor -- start 2024-09-10T14:28:56.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 -- start start 2024-09-10T14:28:56.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c2b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55da929e7200 con 0x55da92ab0690 2024-09-10T14:28:56.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c2b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c2b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50064/0 (socket says 172.21.15.151:50064) 2024-09-10T14:28:56.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/3716709914 learned_addr learned my addr 172.21.15.151:0/3716709914 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/3716709914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da92c2b9d0 con 0x55da92ab0690 2024-09-10T14:28:56.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/3716709914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c2b400 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4d100017b0 tx=0x7f4d10001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5277f712ba1d7faf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4c0d60a640 1 -- 172.21.15.151:0/3716709914 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d10016070 con 0x55da92ab0690 2024-09-10T14:28:56.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4c0d60a640 1 -- 172.21.15.151:0/3716709914 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d10004530 con 0x55da92ab0690 2024-09-10T14:28:56.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4c0d60a640 1 -- 172.21.15.151:0/3716709914 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d10004870 con 0x55da92ab0690 2024-09-10T14:28:56.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 -- 172.21.15.151:0/3716709914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 msgr2=0x55da92c2b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3716709914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c2b400 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4d100017b0 tx=0x7f4d10001c70 comp rx=0 tx=0).stop 2024-09-10T14:28:56.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 -- 172.21.15.151:0/3716709914 shutdown_connections 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3716709914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c2b400 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 -- 172.21.15.151:0/3716709914 >> 172.21.15.151:0/3716709914 conn(0x55da92aaf240 msgr2=0x55da92c27030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 -- 172.21.15.151:0/3716709914 shutdown_connections 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 -- 172.21.15.151:0/3716709914 wait complete. 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 Processor -- start 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.615+0000 7f4d218cd980 1 -- start start 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d218cd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c32730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d218cd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55da92b49930 con 0x55da92ab0690 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c32730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c32730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50070/0 (socket says 172.21.15.151:50070) 2024-09-10T14:28:56.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/3478762986 learned_addr learned my addr 172.21.15.151:0/3478762986 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/3478762986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da92c32c70 con 0x55da92ab0690 2024-09-10T14:28:56.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c32730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4d10000f90 tx=0x7f4d10001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4c0be07640 1 -- 172.21.15.151:0/3478762986 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d10020070 con 0x55da92ab0690 2024-09-10T14:28:56.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4c0be07640 1 -- 172.21.15.151:0/3478762986 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d10011400 con 0x55da92ab0690 2024-09-10T14:28:56.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4c0be07640 1 -- 172.21.15.151:0/3478762986 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d10016040 con 0x55da92ab0690 2024-09-10T14:28:56.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da92c32f00 con 0x55da92ab0690 2024-09-10T14:28:56.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da92c35be0 con 0x55da92ab0690 2024-09-10T14:28:56.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4c0be07640 1 -- 172.21.15.151:0/3478762986 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d10023070 con 0x55da92ab0690 2024-09-10T14:28:56.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4c0be07640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4c040346a0 0x7f4c04036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4c0be07640 1 -- 172.21.15.151:0/3478762986 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4d100491c0 con 0x55da92ab0690 2024-09-10T14:28:56.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4c040346a0 0x7f4c04036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92ab3a00 0x55da92c39830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c39d70 con 0x55da92ab3a00 2024-09-10T14:28:56.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d1fbde640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92ab3a00 0x55da92c39830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.619+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4c040346a0 0x7f4c04036b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d080ac000 tx=0x7f4d080a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1fbde640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92ab3a00 0x55da92c39830 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1fbde640 1 -- 172.21.15.151:0/3478762986 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92ab3a00 2024-09-10T14:28:56.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c3a1c0 con 0x55da92ab3a00 2024-09-10T14:28:56.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1fbde640 1 -- 172.21.15.151:0/3478762986 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92ab3a00 2024-09-10T14:28:56.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c3bfd0 0x55da92c3e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c3ea90 con 0x55da92c3bfd0 2024-09-10T14:28:56.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c3bfd0 0x55da92c3e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c3bfd0 0x55da92c3e3c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/3478762986 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d1002c070 con 0x55da92c3bfd0 2024-09-10T14:28:56.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c3ae40 con 0x55da92ab3a00 2024-09-10T14:28:56.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1fbde640 1 -- 172.21.15.151:0/3478762986 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92ab3a00 2024-09-10T14:28:56.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55da92c3fed0 0x55da92c422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c42a00 con 0x55da92c3fed0 2024-09-10T14:28:56.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55da92c3fed0 0x55da92c422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55da92c3fed0 0x55da92c422c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/3478762986 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d080b2040 con 0x55da92c3fed0 2024-09-10T14:28:56.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d218cd980 1 Processor -- start 2024-09-10T14:28:56.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.623+0000 7f4d218cd980 1 -- start start 2024-09-10T14:28:56.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d218cd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c50490 0x55da92c508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d218cd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55da92a40800 con 0x55da92c50490 2024-09-10T14:28:56.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c50490 0x55da92c508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c50490 0x55da92c508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50078/0 (socket says 172.21.15.151:50078) 2024-09-10T14:28:56.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/1261536294 learned_addr learned my addr 172.21.15.151:0/1261536294 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/1261536294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da92c50df0 con 0x55da92c50490 2024-09-10T14:28:56.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/1261536294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c50490 0x55da92c508b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4d10006830 tx=0x7f4d10023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4c09602640 1 -- 172.21.15.151:0/1261536294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d1003e070 con 0x55da92c50490 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d218cd980 1 -- 172.21.15.151:0/1261536294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da92c51080 con 0x55da92c50490 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4c09602640 1 -- 172.21.15.151:0/1261536294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d100116e0 con 0x55da92c50490 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4c09602640 1 -- 172.21.15.151:0/1261536294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d1002a040 con 0x55da92c50490 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d218cd980 1 -- 172.21.15.151:0/1261536294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da92c53d00 con 0x55da92c50490 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4c09602640 1 -- 172.21.15.151:0/1261536294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d100119c0 con 0x55da92c50490 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4c09602640 1 --2- 172.21.15.151:0/1261536294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bf8034650 0x7f4bf8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4c09602640 1 -- 172.21.15.151:0/1261536294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4d1004ea00 con 0x55da92c50490 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/1261536294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bf8034650 0x7f4bf8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d218cd980 1 Processor -- start 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d218cd980 1 -- start start 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/1261536294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bf8034650 0x7f4bf8036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d080aa500 tx=0x7f4d08005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d218cd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c5d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d218cd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55da92c2bd50 con 0x55da92c5ce40 2024-09-10T14:28:56.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c5d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c5d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50086/0 (socket says 172.21.15.151:50086) 2024-09-10T14:28:56.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.627+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2813469130 learned_addr learned my addr 172.21.15.151:0/2813469130 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2813469130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da92c5d810 con 0x55da92c5ce40 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/2813469130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c5d240 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4d10023c10 tx=0x7f4d10039b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdb0ce644ec1cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4c02ffd640 1 -- 172.21.15.151:0/2813469130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d1005b070 con 0x55da92c5ce40 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4c02ffd640 1 -- 172.21.15.151:0/2813469130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d10012030 con 0x55da92c5ce40 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4c02ffd640 1 -- 172.21.15.151:0/2813469130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d10026640 con 0x55da92c5ce40 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- 172.21.15.151:0/2813469130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 msgr2=0x55da92c5d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2813469130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c5d240 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4d10023c10 tx=0x7f4d10039b10 comp rx=0 tx=0).stop 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- 172.21.15.151:0/2813469130 shutdown_connections 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2813469130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c5d240 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- 172.21.15.151:0/2813469130 >> 172.21.15.151:0/2813469130 conn(0x55da92c59170 msgr2=0x55da92c57270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- 172.21.15.151:0/2813469130 shutdown_connections 2024-09-10T14:28:56.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- 172.21.15.151:0/2813469130 wait complete. 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 Processor -- start 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- start start 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c63f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55da92c5dd00 con 0x55da92c5ce40 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c63f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d1f3dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c63f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50092/0 (socket says 172.21.15.151:50092) 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 learned_addr learned my addr 172.21.15.151:0/2989653642 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da92c64450 con 0x55da92c5ce40 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c63f10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4d10039740 tx=0x7f4d10056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4c017fa640 1 -- 172.21.15.151:0/2989653642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d10049460 con 0x55da92c5ce40 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4c017fa640 1 -- 172.21.15.151:0/2989653642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d10025610 con 0x55da92c5ce40 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da92c64450 con 0x55da92c5ce40 2024-09-10T14:28:56.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4c017fa640 1 -- 172.21.15.151:0/2989653642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d100258f0 con 0x55da92c5ce40 2024-09-10T14:28:56.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.631+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da92c64450 con 0x55da92c5ce40 2024-09-10T14:28:56.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4c017fa640 1 -- 172.21.15.151:0/2989653642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4d1006d020 con 0x55da92c5ce40 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4c017fa640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4be8034650 0x7f4be8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4c017fa640 1 -- 172.21.15.151:0/2989653642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4d10070c70 con 0x55da92c5ce40 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4be8034650 0x7f4be8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92c6f0c0 0x55da92c71580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c71cd0 con 0x55da92c6f0c0 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1fbde640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92c6f0c0 0x55da92c71580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4be8034650 0x7f4be8036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d080aab30 tx=0x7f4d080b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1fbde640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92c6f0c0 0x55da92c71580 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 realm 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c720e0 con 0x55da92c6f0c0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72980 con 0x55da92c6f0c0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x55da92c6f0c0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:56.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c73a80 0x55da92c75e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c76510 con 0x55da92c73a80 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c73a80 0x55da92c75e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c73a80 0x55da92c75e70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 20 searching for the correct realm 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c77d70 con 0x55da92c73a80 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1f3dd640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4d10060070 0x7f4d100128e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c77d70 con 0x7f4d10060070 2024-09-10T14:28:56.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4d10060070 0x7f4d100128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.635+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4d10060070 0x7f4d100128e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1ebdc640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4d080cc040 0x7f4d080d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c77d70 con 0x7f4d080cc040 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4d080cc040 0x7f4d080d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4d080cc040 0x7f4d080d9410 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x55da92c6f0c0 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x55da92c6f0c0 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x7f4d080cc040 2024-09-10T14:28:56.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x7f4d080cc040 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x7f4d10060070 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.639+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x55da92c73a80 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x55da92c6f0c0 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x7f4d080cc040 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x55da92c6f0c0 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55da92c72d20 con 0x7f4d10060070 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c73a80 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c73a80 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x7f4d080cc040 2024-09-10T14:28:56.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c73a80 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c73a80 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c6f0c0 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c6f0c0 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.643+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x7f4d080cc040 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c73a80 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x7f4d10060070 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c6f0c0 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x7f4d080cc040 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c73a80 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x7f4d080cc040 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x7f4d10060070 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c73a80 2024-09-10T14:28:56.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.647+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x7f4d080cc040 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x55da92c6f0c0 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f4d080e6060 con 0x7f4d10060070 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:56.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c76e60 con 0x55da92c6f0c0 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c776b0 con 0x55da92c6f0c0 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c77200 con 0x7f4d080cc040 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:56.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 zone default found 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 4 Realm: () 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 zonegroup default 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c77630 con 0x7f4d080cc040 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c79b80 con 0x55da92c73a80 2024-09-10T14:28:56.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c79f20 con 0x55da92c73a80 2024-09-10T14:28:56.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 started sync module instance, tier type = 2024-09-10T14:28:56.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:56.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.651+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c79020 con 0x7f4d10060070 2024-09-10T14:28:56.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.655+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.655+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397253784640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7a770 con 0x7f4d10060070 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.655+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7afc0 con 0x55da92c6f0c0 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.655+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94397253784640] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.655+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.655+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94397253788352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7afc0 con 0x55da92c6f0c0 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.655+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7b980 con 0x55da92c73a80 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94397253788352] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94397253790480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7af30 con 0x55da92c73a80 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7c680 con 0x7f4d10060070 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94397253798512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7d340 con 0x7f4d10060070 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7dd00 con 0x55da92c6f0c0 2024-09-10T14:28:56.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94397253790480] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.659+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94397253798512] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.663+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.663+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397253802064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7d340 con 0x55da92c6f0c0 2024-09-10T14:28:56.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.663+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7dc70 con 0x7f4d080cc040 2024-09-10T14:28:56.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.663+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94397253802064] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.663+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.663+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94397253799568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7d2b0 con 0x7f4d080cc040 2024-09-10T14:28:56.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.663+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7ea00 con 0x7f4d080cc040 2024-09-10T14:28:56.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94397253799568] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94397253804128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7ea00 con 0x7f4d080cc040 2024-09-10T14:28:56.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7f3c0 con 0x7f4d080cc040 2024-09-10T14:28:56.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94397253804128] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94397253805184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7f3c0 con 0x7f4d080cc040 2024-09-10T14:28:56.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 20 add_watcher() i=0 2024-09-10T14:28:56.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 20 add_watcher() i=1 2024-09-10T14:28:56.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 20 add_watcher() i=2 2024-09-10T14:28:56.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 20 add_watcher() i=3 2024-09-10T14:28:56.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 20 add_watcher() i=4 2024-09-10T14:28:56.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 20 add_watcher() i=5 2024-09-10T14:28:56.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.667+0000 7f4d218cd980 20 add_watcher() i=6 2024-09-10T14:28:56.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94397253805184] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d218cd980 20 add_watcher() i=7 2024-09-10T14:28:56.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d218cd980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:56.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92c827f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94397253808352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c7fd10 con 0x55da92c6f0c0 2024-09-10T14:28:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94397253808352] v33'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4bd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d218cd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d218cd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8b120 con 0x55da92c6f0c0 2024-09-10T14:28:56.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.671+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8b7f0 con 0x7f4d080cc040 2024-09-10T14:28:56.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.675+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.675+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8bc10 con 0x55da92c73a80 2024-09-10T14:28:56.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.675+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.675+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8bbe0 con 0x55da92c6f0c0 2024-09-10T14:28:56.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.675+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'141 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.675+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8c150 con 0x7f4d10060070 2024-09-10T14:28:56.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.679+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.679+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8c6c0 con 0x55da92c73a80 2024-09-10T14:28:56.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.679+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.679+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8caa0 con 0x55da92c6f0c0 2024-09-10T14:28:56.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.679+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.679+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8caa0 con 0x7f4d080cc040 2024-09-10T14:28:56.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.683+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.683+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8caa0 con 0x7f4d10060070 2024-09-10T14:28:56.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.687+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.687+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8cf50 con 0x55da92c73a80 2024-09-10T14:28:56.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.687+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.687+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8cf50 con 0x7f4d10060070 2024-09-10T14:28:56.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.687+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.687+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8cf50 con 0x7f4d080cc040 2024-09-10T14:28:56.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.691+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.691+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x7f4d10060070 2024-09-10T14:28:56.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.691+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.691+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x7f4d080cc040 2024-09-10T14:28:56.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.695+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.695+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c6f0c0 2024-09-10T14:28:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.695+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.695+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.695+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.695+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x7f4d10060070 2024-09-10T14:28:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.699+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.699+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.699+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.699+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c6f0c0 2024-09-10T14:28:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.703+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.703+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c6f0c0 2024-09-10T14:28:56.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.703+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'143 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.703+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.703+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.703+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x7f4d10060070 2024-09-10T14:28:56.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.707+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.707+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.707+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.707+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.707+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.707+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.711+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.711+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.711+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.711+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x7f4d080cc040 2024-09-10T14:28:56.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.715+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.715+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.715+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.715+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x7f4d080cc040 2024-09-10T14:28:56.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.719+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.719+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x55da92c73a80 2024-09-10T14:28:56.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.719+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.719+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x7f4d080cc040 2024-09-10T14:28:56.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8d000 con 0x7f4d10060070 2024-09-10T14:28:56.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4bd4fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:56.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:56.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 20 Filter name: none 2024-09-10T14:28:56.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4b4e7fc640 20 reqs_thread_entry: start 2024-09-10T14:28:56.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:28:56.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92ca89b0 con 0x7f4d10060070 2024-09-10T14:28:56.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:56.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:28:56.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:56.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:56.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.723+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92caa0e0 con 0x55da92c6f0c0 2024-09-10T14:28:56.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(95 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:56.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:56.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:56.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:56.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:56.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:56.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 20 get_obj_state: octx=0x55da92c5d8d0 obj=myfoo:four state=0x55da92caae98 s->prefetch_data=0 2024-09-10T14:28:56.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:96 3.3fs0 3:ffa977b1:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55da92cabf30 con 0x7f4d10060070 2024-09-10T14:28:56.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(96 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1_four [getxattrs out=847b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+863 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 10 manifest: total_size = 4 2024-09-10T14:28:56.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 20 get_obj_state: setting s->obj_tag to 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.552815487303873011 2024-09-10T14:28:56.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 20 get_obj_state: octx=0x55da92c5d8d0 obj=myfoo:four state=0x55da92caae98 s->prefetch_data=0 2024-09-10T14:28:56.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 20 prepare_atomic_modification: state is not atomic. state=0x55da92caae98 2024-09-10T14:28:56.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6 2024-09-10T14:28:56.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:97 4.2d 4:b51c8fd0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92cb0960 con 0x7f4d080cc040 2024-09-10T14:28:56.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(97 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6 [stat,call,call] v33'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.727+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:98 3.3fs0 3:ffa977b1:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92cb0960 con 0x7f4d10060070 2024-09-10T14:28:56.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.731+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(98 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1_four [call] v33'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.731+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:99 4.2d 4:b51c8fd0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92cb13f0 con 0x7f4d080cc040 2024-09-10T14:28:56.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.731+0000 7f4bd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.731+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94397253808352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92cb13f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.731+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(99 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4c02ffd640 20 handle_completion(): completion ok for obj=four 2024-09-10T14:28:56.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94397253808352] v33'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94397253784640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8a160 con 0x7f4d10060070 2024-09-10T14:28:56.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94397253784640] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d218cd980 20 remove_watcher() i=0 2024-09-10T14:28:56.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d218cd980 2 removed watcher, disabling cache 2024-09-10T14:28:56.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94397253788352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8a160 con 0x55da92c6f0c0 2024-09-10T14:28:56.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94397253788352] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d218cd980 20 remove_watcher() i=1 2024-09-10T14:28:56.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.735+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94397253790480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8a160 con 0x55da92c73a80 2024-09-10T14:28:56.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.739+0000 7f4d1f3dd640 1 -- 172.21.15.151:0/2989653642 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94397253790480] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d1005d030 con 0x55da92c73a80 2024-09-10T14:28:56.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.739+0000 7f4d218cd980 20 remove_watcher() i=2 2024-09-10T14:28:56.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.739+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94397253798512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8a160 con 0x7f4d10060070 2024-09-10T14:28:56.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.739+0000 7f4d1ebdc640 1 -- 172.21.15.151:0/2989653642 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94397253798512] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d080d7070 con 0x7f4d10060070 2024-09-10T14:28:56.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.739+0000 7f4d218cd980 20 remove_watcher() i=3 2024-09-10T14:28:56.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.739+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94397253802064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8a160 con 0x55da92c6f0c0 2024-09-10T14:28:56.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.743+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94397253802064] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x55da92c6f0c0 2024-09-10T14:28:56.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.743+0000 7f4d218cd980 20 remove_watcher() i=4 2024-09-10T14:28:56.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.743+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94397253799568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8a160 con 0x7f4d080cc040 2024-09-10T14:28:56.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.743+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94397253799568] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.743+0000 7f4d218cd980 20 remove_watcher() i=5 2024-09-10T14:28:56.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.743+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94397253804128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8a160 con 0x7f4d080cc040 2024-09-10T14:28:56.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94397253804128] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 20 remove_watcher() i=6 2024-09-10T14:28:56.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94397253805184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55da92c8a160 con 0x7f4d080cc040 2024-09-10T14:28:56.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94397253805184] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d180083f0 con 0x7f4d080cc040 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 20 remove_watcher() i=7 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4d080cc040 msgr2=0x7f4d080d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f4d080cc040 0x7f4d080d9410 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92c6f0c0 msgr2=0x55da92c71580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92c6f0c0 0x55da92c71580 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4d10060070 msgr2=0x7f4d100128e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f4d10060070 0x7f4d100128e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c73a80 msgr2=0x55da92c75e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c73a80 0x55da92c75e70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4be8034650 msgr2=0x7f4be8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4be8034650 0x7f4be8036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d080aab30 tx=0x7f4d080b8040 comp rx=0 tx=0).stop 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 msgr2=0x55da92c63f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/2989653642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c5ce40 0x55da92c63f10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4d10039740 tx=0x7f4d10056000 comp rx=0 tx=0).stop 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d1fbde640 1 -- 172.21.15.151:0/2989653642 reap_dead start 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 shutdown_connections 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 >> 172.21.15.151:0/2989653642 conn(0x55da92c59170 msgr2=0x55da92c57240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 shutdown_connections 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/2989653642 wait complete. 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/1261536294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bf8034650 msgr2=0x7f4bf8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/1261536294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bf8034650 0x7f4bf8036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d080aa500 tx=0x7f4d08005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/1261536294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c50490 msgr2=0x55da92c508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/1261536294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c50490 0x55da92c508b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4d10006830 tx=0x7f4d10023ac0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/1261536294 shutdown_connections 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/1261536294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4bf8034650 0x7f4bf8036b10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/1261536294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92c50490 0x55da92c508b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/1261536294 >> 172.21.15.151:0/1261536294 conn(0x55da92c455e0 msgr2=0x55da92c48060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/1261536294 shutdown_connections 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/1261536294 wait complete. 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55da92c3fed0 msgr2=0x55da92c422c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55da92c3fed0 0x55da92c422c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92ab3a00 msgr2=0x55da92c39830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55da92ab3a00 0x55da92c39830 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c3bfd0 msgr2=0x55da92c3e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55da92c3bfd0 0x55da92c3e3c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4c040346a0 msgr2=0x7f4c04036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4c040346a0 0x7f4c04036b60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d080ac000 tx=0x7f4d080a5000 comp rx=0 tx=0).stop 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 msgr2=0x55da92c32730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 --2- 172.21.15.151:0/3478762986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da92ab0690 0x55da92c32730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4d10000f90 tx=0x7f4d10001260 comp rx=0 tx=0).stop 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d1fbde640 1 -- 172.21.15.151:0/3478762986 reap_dead start 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 shutdown_connections 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 >> 172.21.15.151:0/3478762986 conn(0x55da92aaf240 msgr2=0x55da92c25bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 shutdown_connections 2024-09-10T14:28:56.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.747+0000 7f4d218cd980 1 -- 172.21.15.151:0/3478762986 wait complete. 2024-09-10T14:28:56.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T14:28:56.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T14:28:56.763 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T14:28:56.838 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:56.838 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:56.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e315f3980 1 Processor -- start 2024-09-10T14:28:56.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e315f3980 1 -- start start 2024-09-10T14:28:56.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e315f3980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564565488680 0x564565488a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e315f3980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564565399ae0 con 0x564565488fd0 2024-09-10T14:28:56.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e315f3980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5645653bde30 con 0x564565488680 2024-09-10T14:28:56.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e2f103640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x564565488680 0x564565488a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e2e902640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564565488fd0 0x56456548b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44762/0 (socket says 172.21.15.151:44762) 2024-09-10T14:28:56.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e2e902640 1 -- 172.21.15.151:0/3056013807 learned_addr learned my addr 172.21.15.151:0/3056013807 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:56.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e2f103640 1 -- 172.21.15.151:0/3056013807 >> v1:172.21.15.52:6789/0 conn(0x564565488fd0 legacy=0x56456548b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.835+0000 7f3e2f103640 1 -- 172.21.15.151:0/3056013807 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456548c220 con 0x564565488680 2024-09-10T14:28:56.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e2f103640 1 --2- 172.21.15.151:0/3056013807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565488a60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000a480 tx=0x7f3e2001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470741623e8f5bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e2e101640 1 -- 172.21.15.151:0/3056013807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200b0070 con 0x564565488680 2024-09-10T14:28:56.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e2e101640 1 -- 172.21.15.151:0/3056013807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200ab410 con 0x564565488680 2024-09-10T14:28:56.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e2e101640 1 -- 172.21.15.151:0/3056013807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200ab710 con 0x564565488680 2024-09-10T14:28:56.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e315f3980 1 -- 172.21.15.151:0/3056013807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 msgr2=0x564565488a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3056013807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565488a60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000a480 tx=0x7f3e2001b280 comp rx=0 tx=0).stop 2024-09-10T14:28:56.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e315f3980 1 -- 172.21.15.151:0/3056013807 shutdown_connections 2024-09-10T14:28:56.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3056013807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565488a60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e315f3980 1 -- 172.21.15.151:0/3056013807 >> 172.21.15.151:0/3056013807 conn(0x564565487230 msgr2=0x564565487640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e315f3980 1 -- 172.21.15.151:0/3056013807 shutdown_connections 2024-09-10T14:28:56.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.839+0000 7f3e315f3980 1 -- 172.21.15.151:0/3056013807 wait complete. 2024-09-10T14:28:56.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 Processor -- start 2024-09-10T14:28:56.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- start start 2024-09-10T14:28:56.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565603260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645653bf200 con 0x564565488680 2024-09-10T14:28:56.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565603260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565603260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50112/0 (socket says 172.21.15.151:50112) 2024-09-10T14:28:56.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e2f103640 1 -- 172.21.15.151:0/2107686126 learned_addr learned my addr 172.21.15.151:0/2107686126 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e2f103640 1 -- 172.21.15.151:0/2107686126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564565603830 con 0x564565488680 2024-09-10T14:28:56.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e2f103640 1 --2- 172.21.15.151:0/2107686126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565603260 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ae040 tx=0x7f3e20003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412b5dab87791f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3d1d60a640 1 -- 172.21.15.151:0/2107686126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200b0040 con 0x564565488680 2024-09-10T14:28:56.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3d1d60a640 1 -- 172.21.15.151:0/2107686126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200aba10 con 0x564565488680 2024-09-10T14:28:56.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3d1d60a640 1 -- 172.21.15.151:0/2107686126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200abcf0 con 0x564565488680 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- 172.21.15.151:0/2107686126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 msgr2=0x564565603260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 --2- 172.21.15.151:0/2107686126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565603260 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ae040 tx=0x7f3e20003030 comp rx=0 tx=0).stop 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- 172.21.15.151:0/2107686126 shutdown_connections 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 --2- 172.21.15.151:0/2107686126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x564565603260 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- 172.21.15.151:0/2107686126 >> 172.21.15.151:0/2107686126 conn(0x564565487230 msgr2=0x5645655fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- 172.21.15.151:0/2107686126 shutdown_connections 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- 172.21.15.151:0/2107686126 wait complete. 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 Processor -- start 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- start start 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x56456560a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e315f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564565521920 con 0x564565488680 2024-09-10T14:28:56.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x56456560a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x56456560a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50122/0 (socket says 172.21.15.151:50122) 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.855+0000 7f3e2f103640 1 -- 172.21.15.151:0/119003748 learned_addr learned my addr 172.21.15.151:0/119003748 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2f103640 1 -- 172.21.15.151:0/119003748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456560a970 con 0x564565488680 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2f103640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x56456560a430 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000c10 tx=0x7f3e20018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3d1be07640 1 -- 172.21.15.151:0/119003748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200c3070 con 0x564565488680 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3d1be07640 1 -- 172.21.15.151:0/119003748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200b67b0 con 0x564565488680 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56456560ac00 con 0x564565488680 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3d1be07640 1 -- 172.21.15.151:0/119003748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200b0070 con 0x564565488680 2024-09-10T14:28:56.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456560d8e0 con 0x564565488680 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3d1be07640 1 -- 172.21.15.151:0/119003748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3e200c6070 con 0x564565488680 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3d1be07640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d14034650 0x7f3d14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3d1be07640 1 -- 172.21.15.151:0/119003748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3e200bc070 con 0x564565488680 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2e902640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d14034650 0x7f3d14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e315f3980 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565488fd0 0x5645656113e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565611a50 con 0x564565488fd0 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2f904640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565488fd0 0x5645656113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2e902640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d14034650 0x7f3d14036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e240012f0 tx=0x7f3e24006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2f904640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565488fd0 0x5645656113e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2f904640 1 -- 172.21.15.151:0/119003748 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565488fd0 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456560eae0 con 0x564565488fd0 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2f904640 1 -- 172.21.15.151:0/119003748 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e280083f0 con 0x564565488fd0 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e315f3980 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564565613d80 0x564565616170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565616840 con 0x564565613d80 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.859+0000 7f3e2f103640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564565613d80 0x564565616170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2f103640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564565613d80 0x564565616170 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2f103640 1 -- 172.21.15.151:0/119003748 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e200cf070 con 0x564565613d80 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565612bf0 con 0x564565488fd0 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2f904640 1 -- 172.21.15.151:0/119003748 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e280083f0 con 0x564565488fd0 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e315f3980 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564565617c80 0x56456561a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456561a7e0 con 0x564565617c80 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2e902640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564565617c80 0x56456561a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2e902640 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564565617c80 0x56456561a070 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2e902640 1 -- 172.21.15.151:0/119003748 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e2400f070 con 0x564565617c80 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e315f3980 1 Processor -- start 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e315f3980 1 -- start start 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e315f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645656282b0 0x5645656286d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e315f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564565418800 con 0x5645656282b0 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645656282b0 0x5645656286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645656282b0 0x5645656286d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50138/0 (socket says 172.21.15.151:50138) 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.863+0000 7f3e2f103640 1 -- 172.21.15.151:0/1131911484 learned_addr learned my addr 172.21.15.151:0/1131911484 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2f103640 1 -- 172.21.15.151:0/1131911484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564565628c10 con 0x5645656282b0 2024-09-10T14:28:56.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2f103640 1 --2- 172.21.15.151:0/1131911484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645656282b0 0x5645656286d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ab000 tx=0x7f3e200b8100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d19602640 1 -- 172.21.15.151:0/1131911484 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200e0020 con 0x5645656282b0 2024-09-10T14:28:56.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d19602640 1 -- 172.21.15.151:0/1131911484 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200e1260 con 0x5645656282b0 2024-09-10T14:28:56.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e315f3980 1 -- 172.21.15.151:0/1131911484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564565628ea0 con 0x5645656282b0 2024-09-10T14:28:56.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d19602640 1 -- 172.21.15.151:0/1131911484 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200e1540 con 0x5645656282b0 2024-09-10T14:28:56.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e315f3980 1 -- 172.21.15.151:0/1131911484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456562bb20 con 0x5645656282b0 2024-09-10T14:28:56.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d19602640 1 -- 172.21.15.151:0/1131911484 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3e200db070 con 0x5645656282b0 2024-09-10T14:28:56.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d19602640 1 --2- 172.21.15.151:0/1131911484 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d080346a0 0x7f3d08036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d19602640 1 -- 172.21.15.151:0/1131911484 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3e200a8070 con 0x5645656282b0 2024-09-10T14:28:56.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2e902640 1 --2- 172.21.15.151:0/1131911484 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d080346a0 0x7f3d08036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e315f3980 1 Processor -- start 2024-09-10T14:28:56.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e315f3980 1 -- start start 2024-09-10T14:28:56.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2e902640 1 --2- 172.21.15.151:0/1131911484 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d080346a0 0x7f3d08036b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3e240062e0 tx=0x7f3e2400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e315f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x564565635030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e315f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564565603af0 con 0x564565634c30 2024-09-10T14:28:56.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x564565635030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x564565635030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50144/0 (socket says 172.21.15.151:50144) 2024-09-10T14:28:56.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2f103640 1 -- 172.21.15.151:0/1861970252 learned_addr learned my addr 172.21.15.151:0/1861970252 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2f103640 1 -- 172.21.15.151:0/1861970252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564565635600 con 0x564565634c30 2024-09-10T14:28:56.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3e2f103640 1 --2- 172.21.15.151:0/1861970252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x564565635030 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ab9e0 tx=0x7f3e20001b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edee721fcb59725 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d12ffd640 1 -- 172.21.15.151:0/1861970252 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200dcd00 con 0x564565634c30 2024-09-10T14:28:56.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d12ffd640 1 -- 172.21.15.151:0/1861970252 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200b4370 con 0x564565634c30 2024-09-10T14:28:56.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.867+0000 7f3d12ffd640 1 -- 172.21.15.151:0/1861970252 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200aa3b0 con 0x564565634c30 2024-09-10T14:28:56.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- 172.21.15.151:0/1861970252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 msgr2=0x564565635030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 --2- 172.21.15.151:0/1861970252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x564565635030 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ab9e0 tx=0x7f3e20001b70 comp rx=0 tx=0).stop 2024-09-10T14:28:56.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- 172.21.15.151:0/1861970252 shutdown_connections 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 --2- 172.21.15.151:0/1861970252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x564565635030 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- 172.21.15.151:0/1861970252 >> 172.21.15.151:0/1861970252 conn(0x564565631010 msgr2=0x56456562f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- 172.21.15.151:0/1861970252 shutdown_connections 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- 172.21.15.151:0/1861970252 wait complete. 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 Processor -- start 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- start start 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x56456563bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564565635a80 con 0x564565634c30 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x56456563bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e2f103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x56456563bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50158/0 (socket says 172.21.15.151:50158) 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 learned_addr learned my addr 172.21.15.151:0/3439308248 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456563c330 con 0x564565634c30 2024-09-10T14:28:56.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e2f103640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x56456563bdf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3e200c6040 tx=0x7f3e200c0eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3d117fa640 1 -- 172.21.15.151:0/3439308248 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200a40a0 con 0x564565634c30 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56456563c330 con 0x564565634c30 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3d117fa640 1 -- 172.21.15.151:0/3439308248 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e200a4240 con 0x564565634c30 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456563c330 con 0x564565634c30 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3d117fa640 1 -- 172.21.15.151:0/3439308248 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e200a43f0 con 0x564565634c30 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.871+0000 7f3d117fa640 1 -- 172.21.15.151:0/3439308248 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3e200f6030 con 0x564565634c30 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3d117fa640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3cf80346a0 0x7f3cf8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3d117fa640 1 -- 172.21.15.151:0/3439308248 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3e20107070 con 0x564565634c30 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2e902640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3cf80346a0 0x7f3cf8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565646e60 0x564565649320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565649a70 con 0x564565646e60 2024-09-10T14:28:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f904640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565646e60 0x564565649320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2e902640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3cf80346a0 0x7f3cf8036b60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x564565611f70 tx=0x7f3e24010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f904640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565646e60 0x564565649320 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 realm 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565649e80 con 0x564565646e60 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456564a720 con 0x564565646e60 2024-09-10T14:28:56.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56456564b820 0x56456564dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456564e190 con 0x56456564b820 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f103640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56456564b820 0x56456564dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f103640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56456564b820 0x56456564dc10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:56.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 20 searching for the correct realm 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564f9f0 con 0x56456564b820 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f103640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3e200c8070 0x7f3e2010f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564f9f0 con 0x7f3e200c8070 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2e902640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3e200c8070 0x7f3e2010f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2e902640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3e200c8070 0x7f3e2010f880 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.875+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2400f070 con 0x7f3e200c8070 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2e902640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3e24024070 0x7f3e24031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564f9f0 con 0x7f3e24024070 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3e24024070 0x7f3e24031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3e24024070 0x7f3e24031460 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e24024070 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e24024070 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e200c8070 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2400f070 con 0x7f3e200c8070 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x56456564b820 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.879+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e24024070 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e200c8070 2024-09-10T14:28:56.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x56456564b820 2024-09-10T14:28:56.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x56456564b820 2024-09-10T14:28:56.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e24024070 2024-09-10T14:28:56.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x56456564b820 2024-09-10T14:28:56.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x56456564b820 2024-09-10T14:28:56.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.883+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e24024070 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x56456564b820 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e200c8070 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e24024070 2024-09-10T14:28:56.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x56456564b820 2024-09-10T14:28:56.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e24024070 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e200c8070 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x56456564b820 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e24024070 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x564565646e60 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.887+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56456564aac0 con 0x7f3e200c8070 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456564eae0 con 0x564565646e60 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456564f380 con 0x564565646e60 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456564e720 con 0x7f3e24024070 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 zone default found 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 4 Realm: () 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 zonegroup default 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456564eed0 con 0x7f3e24024070 2024-09-10T14:28:56.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456564f2f0 con 0x56456564b820 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565651880 con 0x56456564b820 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 started sync module instance, tier type = 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565650d20 con 0x7f3e200c8070 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94856053854480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645656520d0 con 0x7f3e200c8070 2024-09-10T14:28:56.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.891+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565652920 con 0x564565646e60 2024-09-10T14:28:56.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.895+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94856053854480] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.895+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.895+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94856053857312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565652920 con 0x564565646e60 2024-09-10T14:28:56.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.895+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645656533e0 con 0x56456564b820 2024-09-10T14:28:56.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.895+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.895+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94856053857312] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.895+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94856053862064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565653c80 con 0x56456564b820 2024-09-10T14:28:56.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565652490 con 0x7f3e200c8070 2024-09-10T14:28:56.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94856053866896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565654a60 con 0x7f3e200c8070 2024-09-10T14:28:56.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565655420 con 0x564565646e60 2024-09-10T14:28:56.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94856053862064] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94856053866896] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94856053864400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565655420 con 0x564565646e60 2024-09-10T14:28:56.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.899+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565655cc0 con 0x7f3e24024070 2024-09-10T14:28:56.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.903+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.903+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94856053871920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565655f80 con 0x7f3e24024070 2024-09-10T14:28:56.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.903+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565656aa0 con 0x7f3e24024070 2024-09-10T14:28:56.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.903+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94856053864400] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.903+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(56 notify.6 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.903+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94856053876080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565656a60 con 0x7f3e24024070 2024-09-10T14:28:56.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.903+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564565657480 con 0x7f3e24024070 2024-09-10T14:28:56.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.903+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94856053871920] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94856053876080] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94856053870448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645656559d0 con 0x7f3e24024070 2024-09-10T14:28:56.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 20 add_watcher() i=0 2024-09-10T14:28:56.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 20 add_watcher() i=1 2024-09-10T14:28:56.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 20 add_watcher() i=2 2024-09-10T14:28:56.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 20 add_watcher() i=3 2024-09-10T14:28:56.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 20 add_watcher() i=4 2024-09-10T14:28:56.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 20 add_watcher() i=5 2024-09-10T14:28:56.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 20 add_watcher() i=6 2024-09-10T14:28:56.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94856053870448] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 20 add_watcher() i=7 2024-09-10T14:28:56.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:56.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.907+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456565a470 con 0x564565646e60 2024-09-10T14:28:56.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94856053878640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5645656578f0 con 0x564565646e60 2024-09-10T14:28:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94856053878640] v33'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 5 note: GC not initialized 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3ce4fe1640 20 reqs_thread_entry: start 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 Filter name: none 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3c5e7fc640 20 reqs_thread_entry: start 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456567da40 con 0x7f3e200c8070 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456567e620 con 0x564565646e60 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(63 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:56.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456567e660 con 0x7f3e200c8070 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rados->read ofs=0 len=0 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456567fdd0 con 0x564565646e60 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:66 4.37 4:ec57f35b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456567f390 con 0x7f3e24024070 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 4.1c 4:380b0a52:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565684940 con 0x7f3e24024070 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 4.21 4:86275533:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565684940 con 0x7f3e24024070 2024-09-10T14:28:56.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 4.21 4:87e847a3:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565689700 con 0x7f3e24024070 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 4.32 4:4f67d3a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456568c020 con 0x564565646e60 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 4.b 4:d373810a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456568ea40 con 0x7f3e200c8070 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 4.2d 4:b51c8fd0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565691500 con 0x7f3e24024070 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 4.8 4:117e5d7e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565693f10 con 0x56456564b820 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 4.35 4:afbf09d9:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565696940 con 0x564565646e60 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 4.6 4:6014ede5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564565699800 con 0x56456564b820 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:76 4.1f 4:f8a1c4a6:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56456569c4f0 con 0x56456564b820 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(70 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(71 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.911+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(74 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(73 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(75 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(76 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(66 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(67 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(68 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(72 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(69 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3ce5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94856053878640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x564565646e60 2024-09-10T14:28:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94856053878640] v33'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94856053854480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x7f3e200c8070 2024-09-10T14:28:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94856053854480] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e24040040 con 0x7f3e200c8070 2024-09-10T14:28:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e315f3980 20 remove_watcher() i=0 2024-09-10T14:28:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e315f3980 2 removed watcher, disabling cache 2024-09-10T14:28:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.915+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94856053857312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x564565646e60 2024-09-10T14:28:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.919+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94856053857312] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.919+0000 7f3e315f3980 20 remove_watcher() i=1 2024-09-10T14:28:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.919+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94856053862064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x56456564b820 2024-09-10T14:28:56.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.919+0000 7f3e2f103640 1 -- 172.21.15.151:0/3439308248 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94856053862064] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e200eb070 con 0x56456564b820 2024-09-10T14:28:56.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.919+0000 7f3e315f3980 20 remove_watcher() i=2 2024-09-10T14:28:56.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.919+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94856053866896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x7f3e200c8070 2024-09-10T14:28:56.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.923+0000 7f3e2e902640 1 -- 172.21.15.151:0/3439308248 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94856053866896] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2404e040 con 0x7f3e200c8070 2024-09-10T14:28:56.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.923+0000 7f3e315f3980 20 remove_watcher() i=3 2024-09-10T14:28:56.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.923+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94856053864400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x564565646e60 2024-09-10T14:28:56.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.923+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94856053864400] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x564565646e60 2024-09-10T14:28:56.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.923+0000 7f3e315f3980 20 remove_watcher() i=4 2024-09-10T14:28:56.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.923+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94856053871920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x7f3e24024070 2024-09-10T14:28:56.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.927+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94856053871920] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.927+0000 7f3e315f3980 20 remove_watcher() i=5 2024-09-10T14:28:56.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.927+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94856053876080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x7f3e24024070 2024-09-10T14:28:56.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.927+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94856053876080] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.927+0000 7f3e315f3980 20 remove_watcher() i=6 2024-09-10T14:28:56.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.927+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94856053870448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56456566e1a0 con 0x7f3e24024070 2024-09-10T14:28:56.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94856053870448] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e280083f0 con 0x7f3e24024070 2024-09-10T14:28:56.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 20 remove_watcher() i=7 2024-09-10T14:28:56.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3e24024070 msgr2=0x7f3e24031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3e24024070 0x7f3e24031460 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565646e60 msgr2=0x564565649320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565646e60 0x564565649320 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3e200c8070 msgr2=0x7f3e2010f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3e200c8070 0x7f3e2010f880 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56456564b820 msgr2=0x56456564dc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56456564b820 0x56456564dc10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3cf80346a0 msgr2=0x7f3cf8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3cf80346a0 0x7f3cf8036b60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x564565611f70 tx=0x7f3e24010000 comp rx=0 tx=0).stop 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 msgr2=0x56456563bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e2f904640 1 -- 172.21.15.151:0/3439308248 reap_dead start 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x56456563bdf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3e200c6040 tx=0x7f3e200c0eb0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 shutdown_connections 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/3439308248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565634c30 0x56456563bdf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 >> 172.21.15.151:0/3439308248 conn(0x564565631010 msgr2=0x56456562f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 shutdown_connections 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/3439308248 wait complete. 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/1131911484 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d080346a0 msgr2=0x7f3d08036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/1131911484 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d080346a0 0x7f3d08036b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3e240062e0 tx=0x7f3e2400f000 comp rx=0 tx=0).stop 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/1131911484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645656282b0 msgr2=0x5645656286d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/1131911484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645656282b0 0x5645656286d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ab000 tx=0x7f3e200b8100 comp rx=0 tx=0).stop 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/1131911484 shutdown_connections 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/1131911484 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d080346a0 0x7f3d08036b60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/1131911484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645656282b0 0x5645656286d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/1131911484 >> 172.21.15.151:0/1131911484 conn(0x56456561d400 msgr2=0x56456561fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/1131911484 shutdown_connections 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/1131911484 wait complete. 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564565617c80 msgr2=0x56456561a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564565617c80 0x56456561a070 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565488fd0 msgr2=0x5645656113e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564565488fd0 0x5645656113e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564565613d80 msgr2=0x564565616170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564565613d80 0x564565616170 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d14034650 msgr2=0x7f3d14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3d14034650 0x7f3d14036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e240012f0 tx=0x7f3e24006700 comp rx=0 tx=0).stop 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 msgr2=0x56456560a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 --2- 172.21.15.151:0/119003748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564565488680 0x56456560a430 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000c10 tx=0x7f3e20018020 comp rx=0 tx=0).stop 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e2f904640 1 -- 172.21.15.151:0/119003748 reap_dead start 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 shutdown_connections 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 >> 172.21.15.151:0/119003748 conn(0x564565487230 msgr2=0x5645655fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 shutdown_connections 2024-09-10T14:28:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:56.931+0000 7f3e315f3980 1 -- 172.21.15.151:0/119003748 wait complete. 2024-09-10T14:28:56.944 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"58a4d2fa-bc9c-4537-a4ac-e71f7240f583","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","marker":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T14:28:56.211608Z","creation_time":"2024-09-10T14:28:52.346429Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-10T14:28:56.945 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T14:28:56.211608Z', 'creation_time': '2024-09-10T14:28:52.346429Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-10T14:28:56.945 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-10T14:28:56.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-10T14:28:56.945 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-10T14:28:57.015 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:57.015 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:57.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd08391980 1 Processor -- start 2024-09-10T14:28:57.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd08391980 1 -- start start 2024-09-10T14:28:57.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd08391980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55923f71b8e0 0x55923f71dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd08391980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55923f5a0ae0 con 0x55923f717560 2024-09-10T14:28:57.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd08391980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55923f5c4e30 con 0x55923f71b8e0 2024-09-10T14:28:57.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd056a0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55923f71b8e0 0x55923f71dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd056a0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55923f71b8e0 0x55923f71dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50166/0 (socket says 172.21.15.151:50166) 2024-09-10T14:28:57.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd056a0640 1 -- 172.21.15.151:0/2607515939 learned_addr learned my addr 172.21.15.151:0/2607515939 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd056a0640 1 -- 172.21.15.151:0/2607515939 >> v1:172.21.15.52:6789/0 conn(0x55923f717560 legacy=0x55923f717940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.011+0000 7fdd056a0640 1 -- 172.21.15.151:0/2607515939 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923f71f220 con 0x55923f71b8e0 2024-09-10T14:28:57.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2607515939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f71b8e0 0x55923f71dcd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00a5c0 tx=0x7fdcfc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4e005402b9500 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd04e9f640 1 -- 172.21.15.151:0/2607515939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc0a6070 con 0x55923f71b8e0 2024-09-10T14:28:57.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd04e9f640 1 -- 172.21.15.151:0/2607515939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcfc0af070 con 0x55923f71b8e0 2024-09-10T14:28:57.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd04e9f640 1 -- 172.21.15.151:0/2607515939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc0aa5c0 con 0x55923f71b8e0 2024-09-10T14:28:57.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd08391980 1 -- 172.21.15.151:0/2607515939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f71b8e0 msgr2=0x55923f71dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd08391980 1 --2- 172.21.15.151:0/2607515939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f71b8e0 0x55923f71dcd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00a5c0 tx=0x7fdcfc01b340 comp rx=0 tx=0).stop 2024-09-10T14:28:57.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd08391980 1 -- 172.21.15.151:0/2607515939 shutdown_connections 2024-09-10T14:28:57.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd08391980 1 --2- 172.21.15.151:0/2607515939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f71b8e0 0x55923f71dcd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd08391980 1 -- 172.21.15.151:0/2607515939 >> 172.21.15.151:0/2607515939 conn(0x55923f713080 msgr2=0x55923f7154a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd08391980 1 -- 172.21.15.151:0/2607515939 shutdown_connections 2024-09-10T14:28:57.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.015+0000 7fdd08391980 1 -- 172.21.15.151:0/2607515939 wait complete. 2024-09-10T14:28:57.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 Processor -- start 2024-09-10T14:28:57.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- start start 2024-09-10T14:28:57.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f802a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55923f5c6200 con 0x55923f717560 2024-09-10T14:28:57.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f802a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f802a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50174/0 (socket says 172.21.15.151:50174) 2024-09-10T14:28:57.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 -- 172.21.15.151:0/4016840322 learned_addr learned my addr 172.21.15.151:0/4016840322 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 -- 172.21.15.151:0/4016840322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923f803040 con 0x55923f717560 2024-09-10T14:28:57.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/4016840322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f802a70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000d5f0 tx=0x7fdd0000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26310704a0c3ff46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdbf3e07640 1 -- 172.21.15.151:0/4016840322 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd00006030 con 0x55923f717560 2024-09-10T14:28:57.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdbf3e07640 1 -- 172.21.15.151:0/4016840322 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd000061f0 con 0x55923f717560 2024-09-10T14:28:57.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdbf3e07640 1 -- 172.21.15.151:0/4016840322 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0000f810 con 0x55923f717560 2024-09-10T14:28:57.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- 172.21.15.151:0/4016840322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 msgr2=0x55923f802a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 --2- 172.21.15.151:0/4016840322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f802a70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000d5f0 tx=0x7fdd0000dab0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- 172.21.15.151:0/4016840322 shutdown_connections 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 --2- 172.21.15.151:0/4016840322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f802a70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- 172.21.15.151:0/4016840322 >> 172.21.15.151:0/4016840322 conn(0x55923f713080 msgr2=0x55923f7fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- 172.21.15.151:0/4016840322 shutdown_connections 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- 172.21.15.151:0/4016840322 wait complete. 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 Processor -- start 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- start start 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f80d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd08391980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55923f71ed20 con 0x55923f717560 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f80d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f80d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50182/0 (socket says 172.21.15.151:50182) 2024-09-10T14:28:57.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2479823479 learned_addr learned my addr 172.21.15.151:0/2479823479 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.031+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2479823479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923f80d610 con 0x55923f717560 2024-09-10T14:28:57.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f80d0d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000daf0 tx=0x7fdd00000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdbf2604640 1 -- 172.21.15.151:0/2479823479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd000014b0 con 0x55923f717560 2024-09-10T14:28:57.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55923f80d8a0 con 0x55923f717560 2024-09-10T14:28:57.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdbf2604640 1 -- 172.21.15.151:0/2479823479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd00001650 con 0x55923f717560 2024-09-10T14:28:57.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923f810580 con 0x55923f717560 2024-09-10T14:28:57.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdbf2604640 1 -- 172.21.15.151:0/2479823479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd00001930 con 0x55923f717560 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdbf2604640 1 -- 172.21.15.151:0/2479823479 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdd00001ad0 con 0x55923f717560 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdbf2604640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbec034650 0x7fdbec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdbf2604640 1 -- 172.21.15.151:0/2479823479 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdd0001e070 con 0x55923f717560 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbec034650 0x7fdbec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd08391980 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f812050 0x55923f814480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f814af0 con 0x55923f812050 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd066a2640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f812050 0x55923f814480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbec034650 0x7fdbec036b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0ae000 tx=0x7fdcfc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd066a2640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f812050 0x55923f814480 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd066a2640 1 -- 172.21.15.151:0/2479823479 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f812050 2024-09-10T14:28:57.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f8117a0 con 0x55923f812050 2024-09-10T14:28:57.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd066a2640 1 -- 172.21.15.151:0/2479823479 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f812050 2024-09-10T14:28:57.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd08391980 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f816e40 0x55923f819230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f819900 con 0x55923f816e40 2024-09-10T14:28:57.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f816e40 0x55923f819230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f816e40 0x55923f819230 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2479823479 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd00028020 con 0x55923f816e40 2024-09-10T14:28:57.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f815ce0 con 0x55923f812050 2024-09-10T14:28:57.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.035+0000 7fdd066a2640 1 -- 172.21.15.151:0/2479823479 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f812050 2024-09-10T14:28:57.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd08391980 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55923f81ad40 0x55923f81d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f81d870 con 0x55923f81ad40 2024-09-10T14:28:57.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55923f81ad40 0x55923f81d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55923f81ad40 0x55923f81d130 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd056a0640 1 -- 172.21.15.151:0/2479823479 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x55923f81ad40 2024-09-10T14:28:57.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd08391980 1 Processor -- start 2024-09-10T14:28:57.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd08391980 1 -- start start 2024-09-10T14:28:57.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd08391980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f82b300 0x55923f82b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd08391980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55923f61f800 con 0x55923f82b300 2024-09-10T14:28:57.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f82b300 0x55923f82b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f82b300 0x55923f82b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50184/0 (socket says 172.21.15.151:50184) 2024-09-10T14:28:57.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd05ea1640 1 -- 172.21.15.151:0/698775228 learned_addr learned my addr 172.21.15.151:0/698775228 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd05ea1640 1 -- 172.21.15.151:0/698775228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923f82bc60 con 0x55923f82b300 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/698775228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f82b300 0x55923f82b720 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd00049010 tx=0x7fdd00010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdbeb7fe640 1 -- 172.21.15.151:0/698775228 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd000107b0 con 0x55923f82b300 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdbeb7fe640 1 -- 172.21.15.151:0/698775228 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd00018420 con 0x55923f82b300 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdd08391980 1 -- 172.21.15.151:0/698775228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55923f82bef0 con 0x55923f82b300 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.039+0000 7fdbeb7fe640 1 -- 172.21.15.151:0/698775228 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd00018700 con 0x55923f82b300 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 -- 172.21.15.151:0/698775228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923f82eb70 con 0x55923f82b300 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdbeb7fe640 1 -- 172.21.15.151:0/698775228 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdd00049930 con 0x55923f82b300 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdbeb7fe640 1 --2- 172.21.15.151:0/698775228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbe0034650 0x7fdbe0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdbeb7fe640 1 -- 172.21.15.151:0/698775228 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdd00038070 con 0x55923f82b300 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd056a0640 1 --2- 172.21.15.151:0/698775228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbe0034650 0x7fdbe0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 Processor -- start 2024-09-10T14:28:57.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 -- start start 2024-09-10T14:28:57.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd056a0640 1 --2- 172.21.15.151:0/698775228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbe0034650 0x7fdbe0036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc018f70 tx=0x7fdcfc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f838110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55923f8033c0 con 0x55923f837d10 2024-09-10T14:28:57.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f838110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f838110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50192/0 (socket says 172.21.15.151:50192) 2024-09-10T14:28:57.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd05ea1640 1 -- 172.21.15.151:0/1634698648 learned_addr learned my addr 172.21.15.151:0/1634698648 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd05ea1640 1 -- 172.21.15.151:0/1634698648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923f8386e0 con 0x55923f837d10 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/1634698648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f838110 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdd00020650 tx=0x7fdd00022c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35edea8ad5cba7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdbe97fa640 1 -- 172.21.15.151:0/1634698648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0002bc90 con 0x55923f837d10 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdbe97fa640 1 -- 172.21.15.151:0/1634698648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd00059030 con 0x55923f837d10 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdbe97fa640 1 -- 172.21.15.151:0/1634698648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd00046770 con 0x55923f837d10 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 -- 172.21.15.151:0/1634698648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 msgr2=0x55923f838110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 --2- 172.21.15.151:0/1634698648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f838110 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdd00020650 tx=0x7fdd00022c70 comp rx=0 tx=0).stop 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 -- 172.21.15.151:0/1634698648 shutdown_connections 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 --2- 172.21.15.151:0/1634698648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f838110 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 -- 172.21.15.151:0/1634698648 >> 172.21.15.151:0/1634698648 conn(0x55923f834090 msgr2=0x55923f832190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 -- 172.21.15.151:0/1634698648 shutdown_connections 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.043+0000 7fdd08391980 1 -- 172.21.15.151:0/1634698648 wait complete. 2024-09-10T14:28:57.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 1 Processor -- start 2024-09-10T14:28:57.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 1 -- start start 2024-09-10T14:28:57.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f83ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55923f838aa0 con 0x55923f837d10 2024-09-10T14:28:57.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f83ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd05ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f83ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50206/0 (socket says 172.21.15.151:50206) 2024-09-10T14:28:57.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 learned_addr learned my addr 172.21.15.151:0/2223398704 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923f83f370 con 0x55923f837d10 2024-09-10T14:28:57.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f83ee30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdd00046970 tx=0x7fdd00020e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdbd77fe640 1 -- 172.21.15.151:0/2223398704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0006e070 con 0x55923f837d10 2024-09-10T14:28:57.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55923f83f370 con 0x55923f837d10 2024-09-10T14:28:57.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdbd77fe640 1 -- 172.21.15.151:0/2223398704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd000495d0 con 0x55923f837d10 2024-09-10T14:28:57.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdbd77fe640 1 -- 172.21.15.151:0/2223398704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd00030cf0 con 0x55923f837d10 2024-09-10T14:28:57.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923f83f370 con 0x55923f837d10 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdbd77fe640 1 -- 172.21.15.151:0/2223398704 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdd00071070 con 0x55923f837d10 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdbd77fe640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbd0034650 0x7fdbd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdbd77fe640 1 -- 172.21.15.151:0/2223398704 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdd00066070 con 0x55923f837d10 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbd0034650 0x7fdbd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f849f40 0x55923f84c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f84cb30 con 0x55923f849f40 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd066a2640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f849f40 0x55923f84c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbd0034650 0x7fdbd0036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55923f81dc70 tx=0x7fdcfc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.047+0000 7fdd066a2640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f849f40 0x55923f84c3e0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 realm 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f84cf40 con 0x55923f849f40 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f84d7e0 con 0x55923f849f40 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f84e8e0 0x55923f850cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f851250 con 0x55923f84e8e0 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f84e8e0 0x55923f850cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f84e8e0 0x55923f850cd0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 20 searching for the correct realm 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f852af0 con 0x55923f84e8e0 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd05ea1640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdd00073060 0x7fdd0003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f852af0 con 0x7fdd00073060 2024-09-10T14:28:57.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdd00073060 0x7fdd0003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdd00073060 0x7fdd0003b9b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd056a0640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdcfc0e0040 0x7fdcfc0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f852af0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd066a2640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdcfc0e0040 0x7fdcfc0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.051+0000 7fdd066a2640 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdcfc0e0040 0x7fdcfc0e0420 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdcfc0e0040 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdcfc0e0040 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdd00073060 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f84e8e0 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdcfc0e0040 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdd00073060 2024-09-10T14:28:57.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.055+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f84e8e0 2024-09-10T14:28:57.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f84e8e0 2024-09-10T14:28:57.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdcfc0e0040 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f84e8e0 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f84e8e0 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdcfc0e0040 2024-09-10T14:28:57.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f84e8e0 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdd00073060 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.059+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdcfc0e0040 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f84e8e0 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdcfc0e0040 2024-09-10T14:28:57.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdd00073060 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f84e8e0 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdcfc0e0040 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x55923f849f40 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f84db80 con 0x7fdd00073060 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f851aa0 con 0x55923f849f40 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f851e90 con 0x55923f849f40 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.063+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f851e90 con 0x7fdcfc0e0040 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 zone default found 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 4 Realm: () 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 zonegroup default 2024-09-10T14:28:57.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f8522b0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f8526f0 con 0x55923f84e8e0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f8549a0 con 0x55923f84e8e0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 started sync module instance, tier type = 2024-09-10T14:28:57.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:57.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f853e40 con 0x7fdd00073060 2024-09-10T14:28:57.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94086619284064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f8551f0 con 0x7fdd00073060 2024-09-10T14:28:57.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.067+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f855a40 con 0x55923f849f40 2024-09-10T14:28:57.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.071+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94086619284064] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.071+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.071+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94086619286848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f855a40 con 0x55923f849f40 2024-09-10T14:28:57.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.071+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f856460 con 0x55923f84e8e0 2024-09-10T14:28:57.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.071+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94086619286848] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.071+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.071+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94086619291472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f855a40 con 0x55923f84e8e0 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.071+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f856ea0 con 0x7fdd00073060 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.075+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.075+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94086619294192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdd00073060 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.075+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f858110 con 0x55923f849f40 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.075+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94086619291472] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.075+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94086619294192] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.075+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.075+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94086619296320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f855590 con 0x55923f849f40 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.075+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f8589b0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.079+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94086619296320] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.079+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.079+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94086619298816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f858910 con 0x7fdcfc0e0040 2024-09-10T14:28:57.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.079+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f8592d0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.079+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94086619298816] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.079+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.079+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94086619300960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f8594b0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.079+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f859d00 con 0x7fdcfc0e0040 2024-09-10T14:28:57.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94086619300960] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94086619304416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f859b70 con 0x7fdcfc0e0040 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd08391980 20 add_watcher() i=0 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd08391980 20 add_watcher() i=1 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd08391980 20 add_watcher() i=2 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd08391980 20 add_watcher() i=3 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd08391980 20 add_watcher() i=4 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd08391980 20 add_watcher() i=5 2024-09-10T14:28:57.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.083+0000 7fdd08391980 20 add_watcher() i=6 2024-09-10T14:28:57.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94086619304416] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 20 add_watcher() i=7 2024-09-10T14:28:57.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:57.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55923f85d0e0 con 0x55923f849f40 2024-09-10T14:28:57.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94086619305472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f85a5a0 con 0x55923f849f40 2024-09-10T14:28:57.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94086619305472] v33'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdbb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:57.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:57.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:57.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 5 note: GC not initialized 2024-09-10T14:28:57.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdbb67fc640 20 reqs_thread_entry: start 2024-09-10T14:28:57.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:57.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 20 Filter name: none 2024-09-10T14:28:57.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdb27fff640 20 reqs_thread_entry: start 2024-09-10T14:28:57.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f87fdd0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(62 [pgnls start_epoch 33 out=254b] v33'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.087+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f851aa0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(63 [pgnls start_epoch 33 out=131b] v33'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f851aa0 con 0x55923f84e8e0 2024-09-10T14:28:57.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8549a0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(65 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8549a0 con 0x55923f849f40 2024-09-10T14:28:57.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(66 [pgnls start_epoch 33 out=335b] v33'147 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8549a0 con 0x7fdd00073060 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(67 [pgnls start_epoch 33 out=213b] v33'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(68 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(69 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(70 [pgnls start_epoch 33 out=213b] v33'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdd00073060 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(71 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdd00073060 2024-09-10T14:28:57.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(72 [pgnls start_epoch 33 out=336b] v33'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.091+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(73 [pgnls start_epoch 33 out=131b] v33'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(74 [pgnls start_epoch 33 out=254b] v33'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(75 [pgnls start_epoch 33 out=90b] v33'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdd00070030 con 0x55923f84e8e0 2024-09-10T14:28:57.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f849f40 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(76 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(77 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdd0009d110 con 0x55923f84e8e0 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f849f40 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(78 [pgnls start_epoch 33 out=254b] v33'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(79 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdd0009d110 con 0x55923f84e8e0 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(80 [pgnls start_epoch 33 out=172b] v33'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd0009d110 con 0x55923f84e8e0 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f849f40 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(81 [pgnls start_epoch 33 out=295b] v33'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdd00073060 2024-09-10T14:28:57.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(82 [pgnls start_epoch 33 out=276b] v33'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdd00073060 2024-09-10T14:28:57.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(83 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f849f40 2024-09-10T14:28:57.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(84 [pgnls start_epoch 33 out=295b] v33'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.095+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(85 [pgnls start_epoch 33 out=172b] v33'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdd00073060 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(86 [pgnls start_epoch 33 out=213b] v33'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(87 [pgnls start_epoch 33 out=172b] v33'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(88 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdd0009d110 con 0x55923f84e8e0 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(89 [pgnls start_epoch 33 out=90b] v33'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdd0009d110 con 0x55923f84e8e0 2024-09-10T14:28:57.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f84e8e0 2024-09-10T14:28:57.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(90 [pgnls start_epoch 33 out=90b] v33'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdd0009d110 con 0x55923f84e8e0 2024-09-10T14:28:57.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x55923f849f40 2024-09-10T14:28:57.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(91 [pgnls start_epoch 33 out=131b] v33'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdd00073060 2024-09-10T14:28:57.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(92 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55923f8576f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.099+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(93 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.106 INFO:teuthology.orchestra.run.smithi151.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-10T14:28:57.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.103+0000 7fdbb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:57.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.103+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94086619305472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f87fd90 con 0x55923f849f40 2024-09-10T14:28:57.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.103+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94086619305472] v33'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.103+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94086619284064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f851aa0 con 0x7fdd00073060 2024-09-10T14:28:57.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.103+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94086619284064] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.103+0000 7fdd08391980 20 remove_watcher() i=0 2024-09-10T14:28:57.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.103+0000 7fdd08391980 2 removed watcher, disabling cache 2024-09-10T14:28:57.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.103+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94086619286848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f87fd90 con 0x55923f849f40 2024-09-10T14:28:57.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.107+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94086619286848] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.107+0000 7fdd08391980 20 remove_watcher() i=1 2024-09-10T14:28:57.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.107+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94086619291472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f87fd90 con 0x55923f84e8e0 2024-09-10T14:28:57.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.107+0000 7fdd05ea1640 1 -- 172.21.15.151:0/2223398704 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94086619291472] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0009d110 con 0x55923f84e8e0 2024-09-10T14:28:57.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.107+0000 7fdd08391980 20 remove_watcher() i=2 2024-09-10T14:28:57.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.107+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94086619294192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f859600 con 0x7fdd00073060 2024-09-10T14:28:57.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.111+0000 7fdd056a0640 1 -- 172.21.15.151:0/2223398704 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94086619294192] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc0aaa90 con 0x7fdd00073060 2024-09-10T14:28:57.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.111+0000 7fdd08391980 20 remove_watcher() i=3 2024-09-10T14:28:57.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.111+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94086619296320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f854d40 con 0x55923f849f40 2024-09-10T14:28:57.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.111+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94086619296320] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x55923f849f40 2024-09-10T14:28:57.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.111+0000 7fdd08391980 20 remove_watcher() i=4 2024-09-10T14:28:57.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.111+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94086619298816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f855f50 con 0x7fdcfc0e0040 2024-09-10T14:28:57.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.115+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94086619298816] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.115+0000 7fdd08391980 20 remove_watcher() i=5 2024-09-10T14:28:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.115+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94086619300960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f859600 con 0x7fdcfc0e0040 2024-09-10T14:28:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.115+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94086619300960] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.115+0000 7fdd08391980 20 remove_watcher() i=6 2024-09-10T14:28:57.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.115+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94086619304416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55923f859600 con 0x7fdcfc0e0040 2024-09-10T14:28:57.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94086619304416] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf80083f0 con 0x7fdcfc0e0040 2024-09-10T14:28:57.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 20 remove_watcher() i=7 2024-09-10T14:28:57.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdcfc0e0040 msgr2=0x7fdcfc0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdcfc0e0040 0x7fdcfc0e0420 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f849f40 msgr2=0x55923f84c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f849f40 0x55923f84c3e0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdd00073060 msgr2=0x7fdd0003b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdd00073060 0x7fdd0003b9b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f84e8e0 msgr2=0x55923f850cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f84e8e0 0x55923f850cd0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbd0034650 msgr2=0x7fdbd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbd0034650 0x7fdbd0036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55923f81dc70 tx=0x7fdcfc0c1040 comp rx=0 tx=0).stop 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd066a2640 1 -- 172.21.15.151:0/2223398704 reap_dead start 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 msgr2=0x55923f83ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f83ee30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdd00046970 tx=0x7fdd00020e50 comp rx=0 tx=0).stop 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 shutdown_connections 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2223398704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f837d10 0x55923f83ee30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 >> 172.21.15.151:0/2223398704 conn(0x55923f834090 msgr2=0x55923f832160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 shutdown_connections 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2223398704 wait complete. 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/698775228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbe0034650 msgr2=0x7fdbe0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/698775228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbe0034650 0x7fdbe0036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc018f70 tx=0x7fdcfc005ad0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/698775228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f82b300 msgr2=0x55923f82b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/698775228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f82b300 0x55923f82b720 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd00049010 tx=0x7fdd00010d80 comp rx=0 tx=0).stop 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/698775228 shutdown_connections 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/698775228 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbe0034650 0x7fdbe0036b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/698775228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f82b300 0x55923f82b720 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/698775228 >> 172.21.15.151:0/698775228 conn(0x55923f820450 msgr2=0x55923f822ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/698775228 shutdown_connections 2024-09-10T14:28:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/698775228 wait complete. 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55923f81ad40 msgr2=0x55923f81d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55923f81ad40 0x55923f81d130 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f812050 msgr2=0x55923f814480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55923f812050 0x55923f814480 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f816e40 msgr2=0x55923f819230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55923f816e40 0x55923f819230 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbec034650 msgr2=0x7fdbec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fdbec034650 0x7fdbec036b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0ae000 tx=0x7fdcfc0a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 msgr2=0x55923f80d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 --2- 172.21.15.151:0/2479823479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55923f717560 0x55923f80d0d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000daf0 tx=0x7fdd00000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd066a2640 1 -- 172.21.15.151:0/2479823479 reap_dead start 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 shutdown_connections 2024-09-10T14:28:57.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 >> 172.21.15.151:0/2479823479 conn(0x55923f713080 msgr2=0x55923f7fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 shutdown_connections 2024-09-10T14:28:57.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.119+0000 7fdd08391980 1 -- 172.21.15.151:0/2479823479 wait complete. 2024-09-10T14:28:57.132 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-10T14:28:57.132 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T14:28:57.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T14:28:57.133 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T14:28:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:57.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f0374d1b980 1 Processor -- start 2024-09-10T14:28:57.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f0374d1b980 1 -- start start 2024-09-10T14:28:57.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f0374d1b980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5615804b8690 0x5615804b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f0374d1b980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561580340ae0 con 0x5615804b8fe0 2024-09-10T14:28:57.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f0374d1b980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x561580364e30 con 0x5615804b8690 2024-09-10T14:28:57.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f037282b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5615804b8690 0x5615804b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f037282b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5615804b8690 0x5615804b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50218/0 (socket says 172.21.15.151:50218) 2024-09-10T14:28:57.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f037282b640 1 -- 172.21.15.151:0/1303520589 learned_addr learned my addr 172.21.15.151:0/1303520589 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f037202a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5615804b8fe0 0x5615804bda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44788/0 (socket says 172.21.15.151:44788) 2024-09-10T14:28:57.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f037282b640 1 -- 172.21.15.151:0/1303520589 >> v1:172.21.15.52:6789/0 conn(0x5615804b8fe0 legacy=0x5615804bda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.199+0000 7f037282b640 1 -- 172.21.15.151:0/1303520589 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615804c0260 con 0x5615804b8690 2024-09-10T14:28:57.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f037282b640 1 --2- 172.21.15.151:0/1303520589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615804b8a70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f036c00a4e0 tx=0x7f036c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a5dcffce099a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0371829640 1 -- 172.21.15.151:0/1303520589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0aa540 con 0x5615804b8690 2024-09-10T14:28:57.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0371829640 1 -- 172.21.15.151:0/1303520589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c0aa6e0 con 0x5615804b8690 2024-09-10T14:28:57.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0371829640 1 -- 172.21.15.151:0/1303520589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0aaa40 con 0x5615804b8690 2024-09-10T14:28:57.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0374d1b980 1 -- 172.21.15.151:0/1303520589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 msgr2=0x5615804b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0374d1b980 1 --2- 172.21.15.151:0/1303520589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615804b8a70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f036c00a4e0 tx=0x7f036c01b090 comp rx=0 tx=0).stop 2024-09-10T14:28:57.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0374d1b980 1 -- 172.21.15.151:0/1303520589 shutdown_connections 2024-09-10T14:28:57.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0374d1b980 1 --2- 172.21.15.151:0/1303520589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615804b8a70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0374d1b980 1 -- 172.21.15.151:0/1303520589 >> 172.21.15.151:0/1303520589 conn(0x5615804b41b0 msgr2=0x5615804b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0374d1b980 1 -- 172.21.15.151:0/1303520589 shutdown_connections 2024-09-10T14:28:57.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.203+0000 7f0374d1b980 1 -- 172.21.15.151:0/1303520589 wait complete. 2024-09-10T14:28:57.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.215+0000 7f0374d1b980 1 Processor -- start 2024-09-10T14:28:57.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.215+0000 7f0374d1b980 1 -- start start 2024-09-10T14:28:57.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.215+0000 7f0374d1b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.215+0000 7f0374d1b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561580366200 con 0x5615804b8690 2024-09-10T14:28:57.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50220/0 (socket says 172.21.15.151:50220) 2024-09-10T14:28:57.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f037282b640 1 -- 172.21.15.151:0/178565979 learned_addr learned my addr 172.21.15.151:0/178565979 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f037282b640 1 -- 172.21.15.151:0/178565979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615805a3fa0 con 0x5615804b8690 2024-09-10T14:28:57.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f037282b640 1 --2- 172.21.15.151:0/178565979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805a39d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f036c017ca0 tx=0x7f036c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4b2b38f8dc8074 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0260e09640 1 -- 172.21.15.151:0/178565979 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0b9030 con 0x5615804b8690 2024-09-10T14:28:57.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0260e09640 1 -- 172.21.15.151:0/178565979 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c0aaac0 con 0x5615804b8690 2024-09-10T14:28:57.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0260e09640 1 -- 172.21.15.151:0/178565979 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0aada0 con 0x5615804b8690 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 -- 172.21.15.151:0/178565979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 msgr2=0x5615805a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 --2- 172.21.15.151:0/178565979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805a39d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f036c017ca0 tx=0x7f036c0033b0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 -- 172.21.15.151:0/178565979 shutdown_connections 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 --2- 172.21.15.151:0/178565979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805a39d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 -- 172.21.15.151:0/178565979 >> 172.21.15.151:0/178565979 conn(0x5615804b41b0 msgr2=0x56158059f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 -- 172.21.15.151:0/178565979 shutdown_connections 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 -- 172.21.15.151:0/178565979 wait complete. 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 Processor -- start 2024-09-10T14:28:57.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 -- start start 2024-09-10T14:28:57.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f0374d1b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5615804bfca0 con 0x5615804b8690 2024-09-10T14:28:57.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805aabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50222/0 (socket says 172.21.15.151:50222) 2024-09-10T14:28:57.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.219+0000 7f037282b640 1 -- 172.21.15.151:0/3854437209 learned_addr learned my addr 172.21.15.151:0/3854437209 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037282b640 1 -- 172.21.15.151:0/3854437209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615805ab120 con 0x5615804b8690 2024-09-10T14:28:57.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037282b640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805aabe0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f036c005cc0 tx=0x7f036c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f025f606640 1 -- 172.21.15.151:0/3854437209 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0b9030 con 0x5615804b8690 2024-09-10T14:28:57.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615805ab3b0 con 0x5615804b8690 2024-09-10T14:28:57.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f025f606640 1 -- 172.21.15.151:0/3854437209 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c0c3070 con 0x5615804b8690 2024-09-10T14:28:57.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f025f606640 1 -- 172.21.15.151:0/3854437209 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0bf750 con 0x5615804b8690 2024-09-10T14:28:57.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615805ae090 con 0x5615804b8690 2024-09-10T14:28:57.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f025f606640 1 -- 172.21.15.151:0/3854437209 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f036c0c5030 con 0x5615804b8690 2024-09-10T14:28:57.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f025f606640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0258034650 0x7f0258036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f025f606640 1 -- 172.21.15.151:0/3854437209 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f036c0ba070 con 0x5615804b8690 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037202a640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0258034650 0x7f0258036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615804b8fe0 0x5615805b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805b2190 con 0x5615804b8fe0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037302c640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615804b8fe0 0x5615805b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037202a640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0258034650 0x7f0258036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0368001e50 tx=0x7f03680013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037302c640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615804b8fe0 0x5615805b1b70 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037302c640 1 -- 172.21.15.151:0/3854437209 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615804b8fe0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805b2aa0 con 0x5615804b8fe0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037302c640 1 -- 172.21.15.151:0/3854437209 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03640083f0 con 0x5615804b8fe0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805b43b0 0x5615805b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805b6fe0 con 0x5615805b43b0 2024-09-10T14:28:57.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037282b640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805b43b0 0x5615805b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.223+0000 7f037282b640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805b43b0 0x5615805b6850 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037282b640 1 -- 172.21.15.151:0/3854437209 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805b43b0 2024-09-10T14:28:57.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805b32f0 con 0x5615804b8fe0 2024-09-10T14:28:57.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037302c640 1 -- 172.21.15.151:0/3854437209 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03640083f0 con 0x5615804b8fe0 2024-09-10T14:28:57.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5615805b8440 0x5615805ba830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805bafa0 con 0x5615805b8440 2024-09-10T14:28:57.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037202a640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5615805b8440 0x5615805ba830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037202a640 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5615805b8440 0x5615805ba830 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037202a640 1 -- 172.21.15.151:0/3854437209 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f036800f700 con 0x5615805b8440 2024-09-10T14:28:57.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f0374d1b980 1 Processor -- start 2024-09-10T14:28:57.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f0374d1b980 1 -- start start 2024-09-10T14:28:57.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f0374d1b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805c8a50 0x5615805c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f0374d1b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5615803bf800 con 0x5615805c8a50 2024-09-10T14:28:57.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805c8a50 0x5615805c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805c8a50 0x5615805c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50232/0 (socket says 172.21.15.151:50232) 2024-09-10T14:28:57.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037282b640 1 -- 172.21.15.151:0/208916823 learned_addr learned my addr 172.21.15.151:0/208916823 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037282b640 1 -- 172.21.15.151:0/208916823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615805c93b0 con 0x5615805c8a50 2024-09-10T14:28:57.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.227+0000 7f037282b640 1 --2- 172.21.15.151:0/208916823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805c8a50 0x5615805c8e70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f036c0bdad0 tx=0x7f036c0a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f025ce01640 1 -- 172.21.15.151:0/208916823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0c63c0 con 0x5615805c8a50 2024-09-10T14:28:57.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f0374d1b980 1 -- 172.21.15.151:0/208916823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615805c95e0 con 0x5615805c8a50 2024-09-10T14:28:57.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f025ce01640 1 -- 172.21.15.151:0/208916823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c0c6560 con 0x5615805c8a50 2024-09-10T14:28:57.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f025ce01640 1 -- 172.21.15.151:0/208916823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0b4a20 con 0x5615805c8a50 2024-09-10T14:28:57.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f0374d1b980 1 -- 172.21.15.151:0/208916823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615805cc260 con 0x5615805c8a50 2024-09-10T14:28:57.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f025ce01640 1 -- 172.21.15.151:0/208916823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f036c0b3040 con 0x5615805c8a50 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f025ce01640 1 --2- 172.21.15.151:0/208916823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f024c0346a0 0x7f024c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f025ce01640 1 -- 172.21.15.151:0/208916823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f036c0d7070 con 0x5615805c8a50 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f037202a640 1 --2- 172.21.15.151:0/208916823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f024c0346a0 0x7f024c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f0374d1b980 1 Processor -- start 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f0374d1b980 1 -- start start 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f0374d1b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805d5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f037202a640 1 --2- 172.21.15.151:0/208916823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f024c0346a0 0x7f024c036b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5615805b7380 tx=0x7f036800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f0374d1b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5615805a4260 con 0x5615805d5370 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805d5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805d5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50242/0 (socket says 172.21.15.151:50242) 2024-09-10T14:28:57.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f037282b640 1 -- 172.21.15.151:0/3677915898 learned_addr learned my addr 172.21.15.151:0/3677915898 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f037282b640 1 -- 172.21.15.151:0/3677915898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615805d5d20 con 0x5615805d5370 2024-09-10T14:28:57.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f037282b640 1 --2- 172.21.15.151:0/3677915898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805d5750 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f036c0b7010 tx=0x7f036c0da4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07394b48685120b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f02567fc640 1 -- 172.21.15.151:0/3677915898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0c91b0 con 0x5615805d5370 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f02567fc640 1 -- 172.21.15.151:0/3677915898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c0dcb50 con 0x5615805d5370 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.231+0000 7f02567fc640 1 -- 172.21.15.151:0/3677915898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0bf9c0 con 0x5615805d5370 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- 172.21.15.151:0/3677915898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 msgr2=0x5615805d5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3677915898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805d5750 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f036c0b7010 tx=0x7f036c0da4c0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- 172.21.15.151:0/3677915898 shutdown_connections 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3677915898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805d5750 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- 172.21.15.151:0/3677915898 >> 172.21.15.151:0/3677915898 conn(0x5615805d16b0 msgr2=0x5615805cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- 172.21.15.151:0/3677915898 shutdown_connections 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- 172.21.15.151:0/3677915898 wait complete. 2024-09-10T14:28:57.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 Processor -- start 2024-09-10T14:28:57.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- start start 2024-09-10T14:28:57.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805dc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5615805d5d20 con 0x5615805d5370 2024-09-10T14:28:57.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805dc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f037282b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805dc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50246/0 (socket says 172.21.15.151:50246) 2024-09-10T14:28:57.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 learned_addr learned my addr 172.21.15.151:0/2468789413 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615805dc8a0 con 0x5615805d5370 2024-09-10T14:28:57.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f037282b640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805dc360 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f036c0b7010 tx=0x7f036c0c90e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0254ff9640 1 -- 172.21.15.151:0/2468789413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c100040 con 0x5615805d5370 2024-09-10T14:28:57.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615805dc8a0 con 0x5615805d5370 2024-09-10T14:28:57.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0254ff9640 1 -- 172.21.15.151:0/2468789413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c10b070 con 0x5615805d5370 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0254ff9640 1 -- 172.21.15.151:0/2468789413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f036c0bfaf0 con 0x5615805d5370 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615805dcd10 con 0x5615805d5370 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0254ff9640 1 -- 172.21.15.151:0/2468789413 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f036c0b4bc0 con 0x5615805d5370 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0254ff9640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f023c034650 0x7f023c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0254ff9640 1 -- 172.21.15.151:0/2468789413 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f036c0d6660 con 0x5615805d5370 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f037202a640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f023c034650 0x7f023c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615805e72b0 0x5615805e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805e9ec0 con 0x5615805e72b0 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.235+0000 7f037302c640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615805e72b0 0x5615805e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037202a640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f023c034650 0x7f023c036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5615805bb380 tx=0x7f0368010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037302c640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615805e72b0 0x5615805e9770 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 realm 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805ea2d0 con 0x5615805e72b0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805eab70 con 0x5615805e72b0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805ebc70 0x5615805ee060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805ee6b0 con 0x5615805ebc70 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037282b640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805ebc70 0x5615805ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037282b640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805ebc70 0x5615805ee060 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:57.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 20 searching for the correct realm 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eff10 con 0x5615805ebc70 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037282b640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f036c0da020 0x7f036c110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eff10 con 0x7f036c0da020 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037202a640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f036c0da020 0x7f036c110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037202a640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f036c0da020 0x7f036c110660 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037202a640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f036801fbe0 0x7f036803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eff10 con 0x7f036801fbe0 2024-09-10T14:28:57.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037302c640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f036801fbe0 0x7f036803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.239+0000 7f037302c640 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f036801fbe0 0x7f036803a3c0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036801fbe0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036801fbe0 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036c0da020 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805ebc70 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036801fbe0 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.243+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036c0da020 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805ebc70 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805ebc70 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036801fbe0 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805ebc70 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805ebc70 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036801fbe0 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805ebc70 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036c0da020 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.247+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036801fbe0 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805ebc70 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036801fbe0 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036c0da020 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805ebc70 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036801fbe0 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x5615805e72b0 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5615805eaf10 con 0x7f036c0da020 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:57.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805ef030 con 0x5615805e72b0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805ef880 con 0x5615805e72b0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.251+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805ef3d0 con 0x7f036801fbe0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 zone default found 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 4 Realm: () 2024-09-10T14:28:57.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 zonegroup default 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805ef800 con 0x7f036801fbe0 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805f1d20 con 0x5615805ebc70 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805f20c0 con 0x5615805ebc70 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 started sync module instance, tier type = 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f11c0 con 0x7f036c0da020 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94650348014864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f2460 con 0x7f036c0da020 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f2e20 con 0x5615805e72b0 2024-09-10T14:28:57.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.255+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94650348014864] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.259+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.259+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94650348022128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f3240 con 0x5615805e72b0 2024-09-10T14:28:57.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.259+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f3ad0 con 0x5615805ebc70 2024-09-10T14:28:57.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.259+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.259+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94650348024688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f4370 con 0x5615805ebc70 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.259+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f4d90 con 0x7f036c0da020 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.259+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94650348022128] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.263+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.263+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94650348023184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f5630 con 0x7f036c0da020 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.263+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f5ec0 con 0x5615805e72b0 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.263+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94650348024688] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.263+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94650348023184] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.263+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.263+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94650348032384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f59d0 con 0x5615805e72b0 2024-09-10T14:28:57.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.263+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f6760 con 0x7f036801fbe0 2024-09-10T14:28:57.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.267+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94650348032384] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.267+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.267+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94650348027584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f66d0 con 0x7f036801fbe0 2024-09-10T14:28:57.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.267+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f6fc0 con 0x7f036801fbe0 2024-09-10T14:28:57.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.267+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94650348027584] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.267+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.267+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94650348036640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f71a0 con 0x7f036801fbe0 2024-09-10T14:28:57.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.267+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f79f0 con 0x7f036801fbe0 2024-09-10T14:28:57.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94650348036640] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94650348040608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f7a70 con 0x7f036801fbe0 2024-09-10T14:28:57.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 20 add_watcher() i=0 2024-09-10T14:28:57.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 20 add_watcher() i=1 2024-09-10T14:28:57.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 20 add_watcher() i=2 2024-09-10T14:28:57.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 20 add_watcher() i=3 2024-09-10T14:28:57.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 20 add_watcher() i=4 2024-09-10T14:28:57.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 20 add_watcher() i=5 2024-09-10T14:28:57.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 20 add_watcher() i=6 2024-09-10T14:28:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94650348040608] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 20 add_watcher() i=7 2024-09-10T14:28:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615805fad30 con 0x5615805e72b0 2024-09-10T14:28:57.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.271+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94650348042032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f8000 con 0x5615805e72b0 2024-09-10T14:28:57.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94650348042032] v33'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f02297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 5 note: GC not initialized 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f01a3fff640 20 reqs_thread_entry: start 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 Filter name: none 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f01a1ffb640 20 reqs_thread_entry: start 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56158061e450 con 0x5615805e72b0 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:57.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:57.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:57.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:57.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56158061df70 con 0x7f036c0da020 2024-09-10T14:28:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 disabling bucket name=myfoo 2024-09-10T14:28:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:28:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56158061eec0 con 0x7f036c0da020 2024-09-10T14:28:57.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5615806207a0 con 0x5615805e72b0 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:57.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:57.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.275+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615806292a0 con 0x5615805e72b0 2024-09-10T14:28:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1, ofs0, ns] 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94650348212096 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561580627f10 con 0x7f036c0da020 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== watch-notify(notify (1) cookie 94650348014864 notify 141733920793 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f0368018040 con 0x7f036c0da020 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f02567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94650348014864 notifier 4589 bl.length()=752 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f02567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f02567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f02567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [notify cookie 94650348212096 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f02567fc640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0238003eb0 con 0x7f036c0da020 2024-09-10T14:28:57.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== watch-notify(notify_complete (2) cookie 94650348212096 notify 141733920793 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561580340ae0 con 0x7f036c0da020 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_sources= new_sources= 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential sources added=[] removed=[] 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_dests= new_dests= 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential dests added=[] removed=[] 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561580628a70 con 0x5615805e72b0 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v33'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94650348212096 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561580627f10 con 0x5615805e72b0 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== watch-notify(notify (1) cookie 94650348032384 notify 141733920782 ret 0) ==== 609+0+0 (crc 0 0 0) 0x561580620b90 con 0x5615805e72b0 2024-09-10T14:28:57.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0255ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920782 cookie 94650348032384 notifier 4589 bl.length()=567 2024-09-10T14:28:57.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(70 notify.4 [notify cookie 94650348212096 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0255ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:57.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0255ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:57.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f0255ffb640 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f01a8003440 con 0x5615805e72b0 2024-09-10T14:28:57.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== watch-notify(notify_complete (2) cookie 94650348212096 notify 141733920782 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56158061ec50 con 0x5615805e72b0 2024-09-10T14:28:57.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.279+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.288 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:57.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.283+0000 7f02297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:57.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.283+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94650348042032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56158061c280 con 0x5615805e72b0 2024-09-10T14:28:57.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.283+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94650348042032] v33'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.283+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94650348014864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56158061c280 con 0x7f036c0da020 2024-09-10T14:28:57.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.283+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94650348014864] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.283+0000 7f0374d1b980 20 remove_watcher() i=0 2024-09-10T14:28:57.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.283+0000 7f0374d1b980 2 removed watcher, disabling cache 2024-09-10T14:28:57.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.283+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94650348022128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f0d10 con 0x5615805e72b0 2024-09-10T14:28:57.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94650348022128] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f0374d1b980 20 remove_watcher() i=1 2024-09-10T14:28:57.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94650348024688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56158061c280 con 0x5615805ebc70 2024-09-10T14:28:57.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f037282b640 1 -- 172.21.15.151:0/2468789413 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94650348024688] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f036c0ce070 con 0x5615805ebc70 2024-09-10T14:28:57.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f0374d1b980 20 remove_watcher() i=2 2024-09-10T14:28:57.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94650348023184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f2970 con 0x7f036c0da020 2024-09-10T14:28:57.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f037202a640 1 -- 172.21.15.151:0/2468789413 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94650348023184] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0368037040 con 0x7f036c0da020 2024-09-10T14:28:57.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f0374d1b980 20 remove_watcher() i=3 2024-09-10T14:28:57.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.287+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94650348032384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f0d10 con 0x5615805e72b0 2024-09-10T14:28:57.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.291+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94650348032384] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x5615805e72b0 2024-09-10T14:28:57.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.291+0000 7f0374d1b980 20 remove_watcher() i=4 2024-09-10T14:28:57.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.291+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94650348027584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f5180 con 0x7f036801fbe0 2024-09-10T14:28:57.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.291+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94650348027584] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.291+0000 7f0374d1b980 20 remove_watcher() i=5 2024-09-10T14:28:57.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.291+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94650348036640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f5180 con 0x7f036801fbe0 2024-09-10T14:28:57.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.295+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94650348036640] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.295+0000 7f0374d1b980 20 remove_watcher() i=6 2024-09-10T14:28:57.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.295+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94650348040608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5615805f5180 con 0x7f036801fbe0 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94650348040608] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03640083f0 con 0x7f036801fbe0 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 20 remove_watcher() i=7 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f036801fbe0 msgr2=0x7f036803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f036801fbe0 0x7f036803a3c0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615805e72b0 msgr2=0x5615805e9770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615805e72b0 0x5615805e9770 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f036c0da020 msgr2=0x7f036c110660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f036c0da020 0x7f036c110660 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805ebc70 msgr2=0x5615805ee060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805ebc70 0x5615805ee060 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f023c034650 msgr2=0x7f023c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f023c034650 0x7f023c036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5615805bb380 tx=0x7f0368010000 comp rx=0 tx=0).stop 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 msgr2=0x5615805dc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f037302c640 1 -- 172.21.15.151:0/2468789413 reap_dead start 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805dc360 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f036c0b7010 tx=0x7f036c0c90e0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 shutdown_connections 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/2468789413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805d5370 0x5615805dc360 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 >> 172.21.15.151:0/2468789413 conn(0x5615805d16b0 msgr2=0x5615805cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 shutdown_connections 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/2468789413 wait complete. 2024-09-10T14:28:57.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/208916823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f024c0346a0 msgr2=0x7f024c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/208916823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f024c0346a0 0x7f024c036b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5615805b7380 tx=0x7f036800f000 comp rx=0 tx=0).stop 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/208916823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805c8a50 msgr2=0x5615805c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/208916823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805c8a50 0x5615805c8e70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f036c0bdad0 tx=0x7f036c0a9f70 comp rx=0 tx=0).stop 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/208916823 shutdown_connections 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/208916823 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f024c0346a0 0x7f024c036b60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/208916823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615805c8a50 0x5615805c8e70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/208916823 >> 172.21.15.151:0/208916823 conn(0x5615805bdba0 msgr2=0x5615805c0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/208916823 shutdown_connections 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/208916823 wait complete. 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5615805b8440 msgr2=0x5615805ba830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5615805b8440 0x5615805ba830 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615804b8fe0 msgr2=0x5615805b1b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5615804b8fe0 0x5615805b1b70 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805b43b0 msgr2=0x5615805b6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5615805b43b0 0x5615805b6850 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0258034650 msgr2=0x7f0258036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0258034650 0x7f0258036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0368001e50 tx=0x7f03680013b0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 msgr2=0x5615805aabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 --2- 172.21.15.151:0/3854437209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5615804b8690 0x5615805aabe0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f036c005cc0 tx=0x7f036c017e30 comp rx=0 tx=0).stop 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f037302c640 1 -- 172.21.15.151:0/3854437209 reap_dead start 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 shutdown_connections 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 >> 172.21.15.151:0/3854437209 conn(0x5615804b41b0 msgr2=0x56158059e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 shutdown_connections 2024-09-10T14:28:57.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.299+0000 7f0374d1b980 1 -- 172.21.15.151:0/3854437209 wait complete. 2024-09-10T14:28:57.312 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:57.314 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T14:28:57.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T14:28:57.315 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T14:28:57.386 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:28:57.386 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:28:57.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9428b54980 1 Processor -- start 2024-09-10T14:28:57.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9428b54980 1 -- start start 2024-09-10T14:28:57.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9428b54980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5648925a6e90 0x5648925a9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9428b54980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564892428ae0 con 0x564892514ac0 2024-09-10T14:28:57.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9428b54980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56489244ce30 con 0x5648925a6e90 2024-09-10T14:28:57.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9425e63640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5648925a6e90 0x5648925a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9426664640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x564892514ac0 0x5648925a5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:44792/0 (socket says 172.21.15.151:44792) 2024-09-10T14:28:57.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9426664640 1 -- 172.21.15.151:0/577927687 learned_addr learned my addr 172.21.15.151:0/577927687 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:28:57.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9425662640 1 -- 172.21.15.151:0/577927687 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732303675 0 0) 0x564892428ae0 con 0x564892514ac0 2024-09-10T14:28:57.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9425662640 1 -- 172.21.15.151:0/577927687 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9410001e20 con 0x564892514ac0 2024-09-10T14:28:57.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9425e63640 1 -- 172.21.15.151:0/577927687 >> v1:172.21.15.52:6789/0 conn(0x564892514ac0 legacy=0x5648925a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.383+0000 7f9425e63640 1 -- 172.21.15.151:0/577927687 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564892514ea0 con 0x5648925a6e90 2024-09-10T14:28:57.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.387+0000 7f9425e63640 1 --2- 172.21.15.151:0/577927687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648925a6e90 0x5648925a9280 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f941c00a480 tx=0x7f941c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43aadb35fdc7a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.387+0000 7f9425662640 1 -- 172.21.15.151:0/577927687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f941c0b0070 con 0x5648925a6e90 2024-09-10T14:28:57.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.387+0000 7f9425662640 1 -- 172.21.15.151:0/577927687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941c0ab540 con 0x5648925a6e90 2024-09-10T14:28:57.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.387+0000 7f9425662640 1 -- 172.21.15.151:0/577927687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f941c0ab820 con 0x5648925a6e90 2024-09-10T14:28:57.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.391+0000 7f9428b54980 1 -- 172.21.15.151:0/577927687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648925a6e90 msgr2=0x5648925a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.391+0000 7f9428b54980 1 --2- 172.21.15.151:0/577927687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648925a6e90 0x5648925a9280 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f941c00a480 tx=0x7f941c01b280 comp rx=0 tx=0).stop 2024-09-10T14:28:57.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.391+0000 7f9428b54980 1 -- 172.21.15.151:0/577927687 shutdown_connections 2024-09-10T14:28:57.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.391+0000 7f9428b54980 1 --2- 172.21.15.151:0/577927687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648925a6e90 0x5648925a9280 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.391+0000 7f9428b54980 1 -- 172.21.15.151:0/577927687 >> 172.21.15.151:0/577927687 conn(0x56489259b060 msgr2=0x56489259d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.391+0000 7f9428b54980 1 -- 172.21.15.151:0/577927687 shutdown_connections 2024-09-10T14:28:57.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.391+0000 7f9428b54980 1 -- 172.21.15.151:0/577927687 wait complete. 2024-09-10T14:28:57.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 Processor -- start 2024-09-10T14:28:57.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 -- start start 2024-09-10T14:28:57.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x56489268dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56489244e200 con 0x564892514ac0 2024-09-10T14:28:57.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x56489268dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x56489268dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50260/0 (socket says 172.21.15.151:50260) 2024-09-10T14:28:57.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9426664640 1 -- 172.21.15.151:0/1256303915 learned_addr learned my addr 172.21.15.151:0/1256303915 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9426664640 1 -- 172.21.15.151:0/1256303915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489268e190 con 0x564892514ac0 2024-09-10T14:28:57.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9426664640 1 --2- 172.21.15.151:0/1256303915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x56489268dbc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9420006fc0 tx=0x7f9420001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61304231ca08731 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9314608640 1 -- 172.21.15.151:0/1256303915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420004530 con 0x564892514ac0 2024-09-10T14:28:57.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9314608640 1 -- 172.21.15.151:0/1256303915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94200046d0 con 0x564892514ac0 2024-09-10T14:28:57.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9314608640 1 -- 172.21.15.151:0/1256303915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420004a70 con 0x564892514ac0 2024-09-10T14:28:57.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 -- 172.21.15.151:0/1256303915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 msgr2=0x56489268dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 --2- 172.21.15.151:0/1256303915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x56489268dbc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9420006fc0 tx=0x7f9420001af0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 -- 172.21.15.151:0/1256303915 shutdown_connections 2024-09-10T14:28:57.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 --2- 172.21.15.151:0/1256303915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x56489268dbc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.403+0000 7f9428b54980 1 -- 172.21.15.151:0/1256303915 >> 172.21.15.151:0/1256303915 conn(0x56489259b060 msgr2=0x564892689750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 -- 172.21.15.151:0/1256303915 shutdown_connections 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 -- 172.21.15.151:0/1256303915 wait complete. 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 Processor -- start 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 -- start start 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x564892694f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648925ac250 con 0x564892514ac0 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x564892694f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x564892694f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50268/0 (socket says 172.21.15.151:50268) 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9426664640 1 -- 172.21.15.151:0/4106855072 learned_addr learned my addr 172.21.15.151:0/4106855072 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9426664640 1 -- 172.21.15.151:0/4106855072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648926954b0 con 0x564892514ac0 2024-09-10T14:28:57.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9426664640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x564892694f70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9420002260 tx=0x7f9420000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9312e05640 1 -- 172.21.15.151:0/4106855072 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420013760 con 0x564892514ac0 2024-09-10T14:28:57.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9312e05640 1 -- 172.21.15.151:0/4106855072 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420013900 con 0x564892514ac0 2024-09-10T14:28:57.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564892695740 con 0x564892514ac0 2024-09-10T14:28:57.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9312e05640 1 -- 172.21.15.151:0/4106855072 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420013c00 con 0x564892514ac0 2024-09-10T14:28:57.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564892698420 con 0x564892514ac0 2024-09-10T14:28:57.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9312e05640 1 -- 172.21.15.151:0/4106855072 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9420010070 con 0x564892514ac0 2024-09-10T14:28:57.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9312e05640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f930c034650 0x7f930c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9312e05640 1 -- 172.21.15.151:0/4106855072 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9420018070 con 0x564892514ac0 2024-09-10T14:28:57.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9425e63640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f930c034650 0x7f930c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564892699ef0 0x56489269c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56489269c930 con 0x564892699ef0 2024-09-10T14:28:57.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.407+0000 7f9426e65640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564892699ef0 0x56489269c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9425e63640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f930c034650 0x7f930c036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f941c0ad000 tx=0x7f941c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9426e65640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564892699ef0 0x56489269c2e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9426e65640 1 -- 172.21.15.151:0/4106855072 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x564892699ef0 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564892699640 con 0x564892699ef0 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9426e65640 1 -- 172.21.15.151:0/4106855072 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94180083f0 con 0x564892699ef0 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9428b54980 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56489269ec60 0x5648926a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926a1720 con 0x56489269ec60 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9426664640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56489269ec60 0x5648926a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9426664640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56489269ec60 0x5648926a1050 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9426664640 1 -- 172.21.15.151:0/4106855072 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f942001b030 con 0x56489269ec60 2024-09-10T14:28:57.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56489269db00 con 0x564892699ef0 2024-09-10T14:28:57.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9426e65640 1 -- 172.21.15.151:0/4106855072 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94180083f0 con 0x564892699ef0 2024-09-10T14:28:57.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9428b54980 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5648926a2b80 0x5648926a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926a5670 con 0x5648926a2b80 2024-09-10T14:28:57.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9425e63640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5648926a2b80 0x5648926a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9425e63640 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5648926a2b80 0x5648926a4f70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.411+0000 7f9425e63640 1 -- 172.21.15.151:0/4106855072 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f941c0b3040 con 0x5648926a2b80 2024-09-10T14:28:57.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 Processor -- start 2024-09-10T14:28:57.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 -- start start 2024-09-10T14:28:57.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926b3140 0x5648926b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648924a7800 con 0x5648926b3140 2024-09-10T14:28:57.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926b3140 0x5648926b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926b3140 0x5648926b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50280/0 (socket says 172.21.15.151:50280) 2024-09-10T14:28:57.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9426664640 1 -- 172.21.15.151:0/1760083011 learned_addr learned my addr 172.21.15.151:0/1760083011 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9426664640 1 -- 172.21.15.151:0/1760083011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648926b3aa0 con 0x5648926b3140 2024-09-10T14:28:57.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9426664640 1 --2- 172.21.15.151:0/1760083011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926b3140 0x5648926b3560 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9420048470 tx=0x7f9420010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f930bfff640 1 -- 172.21.15.151:0/1760083011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420037070 con 0x5648926b3140 2024-09-10T14:28:57.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 -- 172.21.15.151:0/1760083011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5648926b3d30 con 0x5648926b3140 2024-09-10T14:28:57.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f930bfff640 1 -- 172.21.15.151:0/1760083011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94200128d0 con 0x5648926b3140 2024-09-10T14:28:57.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f930bfff640 1 -- 172.21.15.151:0/1760083011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420041c00 con 0x5648926b3140 2024-09-10T14:28:57.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 -- 172.21.15.151:0/1760083011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648926b69b0 con 0x5648926b3140 2024-09-10T14:28:57.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f930bfff640 1 -- 172.21.15.151:0/1760083011 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9420029d10 con 0x5648926b3140 2024-09-10T14:28:57.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f930bfff640 1 --2- 172.21.15.151:0/1760083011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9300034650 0x7f9300036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f930bfff640 1 -- 172.21.15.151:0/1760083011 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f942003b020 con 0x5648926b3140 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9425e63640 1 --2- 172.21.15.151:0/1760083011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9300034650 0x7f9300036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 Processor -- start 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 -- start start 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9425e63640 1 --2- 172.21.15.151:0/1760083011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9300034650 0x7f9300036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x56489269d210 tx=0x7f941c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.415+0000 7f9428b54980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56489268e510 con 0x5648926bfb50 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926bff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50296/0 (socket says 172.21.15.151:50296) 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 -- 172.21.15.151:0/2802467600 learned_addr learned my addr 172.21.15.151:0/2802467600 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 -- 172.21.15.151:0/2802467600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648926c0500 con 0x5648926bfb50 2024-09-10T14:28:57.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 --2- 172.21.15.151:0/2802467600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926bff30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9420028d60 tx=0x7f9420042170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99e8b3429139acd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9309ffb640 1 -- 172.21.15.151:0/2802467600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420063070 con 0x5648926bfb50 2024-09-10T14:28:57.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9309ffb640 1 -- 172.21.15.151:0/2802467600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420028940 con 0x5648926bfb50 2024-09-10T14:28:57.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9309ffb640 1 -- 172.21.15.151:0/2802467600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420056070 con 0x5648926bfb50 2024-09-10T14:28:57.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 -- 172.21.15.151:0/2802467600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 msgr2=0x5648926bff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 --2- 172.21.15.151:0/2802467600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926bff30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9420028d60 tx=0x7f9420042170 comp rx=0 tx=0).stop 2024-09-10T14:28:57.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 -- 172.21.15.151:0/2802467600 shutdown_connections 2024-09-10T14:28:57.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 --2- 172.21.15.151:0/2802467600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926bff30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 -- 172.21.15.151:0/2802467600 >> 172.21.15.151:0/2802467600 conn(0x5648926bbe80 msgr2=0x5648926b9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 -- 172.21.15.151:0/2802467600 shutdown_connections 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 -- 172.21.15.151:0/2802467600 wait complete. 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 Processor -- start 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 -- start start 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9428b54980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648926c0890 con 0x5648926bfb50 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50302/0 (socket says 172.21.15.151:50302) 2024-09-10T14:28:57.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 learned_addr learned my addr 172.21.15.151:0/1180910386 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:28:57.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648926c7210 con 0x5648926bfb50 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f9426664640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926c6cd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9420032be0 tx=0x7f9420008f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.419+0000 7f92f7fff640 1 -- 172.21.15.151:0/1180910386 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420063030 con 0x5648926bfb50 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5648926c7210 con 0x5648926bfb50 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f92f7fff640 1 -- 172.21.15.151:0/1180910386 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420064040 con 0x5648926bfb50 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f92f7fff640 1 -- 172.21.15.151:0/1180910386 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9420059040 con 0x5648926bfb50 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648926c7680 con 0x5648926bfb50 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f92f7fff640 1 -- 172.21.15.151:0/1180910386 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9420011d10 con 0x5648926bfb50 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f92f7fff640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f92f0034650 0x7f92f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f92f7fff640 1 -- 172.21.15.151:0/1180910386 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f942006e930 con 0x5648926bfb50 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9425e63640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f92f0034650 0x7f92f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5648926d1d90 0x5648926d4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926d4980 con 0x5648926d1d90 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426e65640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5648926d1d90 0x5648926d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9425e63640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f92f0034650 0x7f92f0036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x5648926a5a70 tx=0x7f941c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426e65640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5648926d1d90 0x5648926d4230 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 realm 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926d4d90 con 0x5648926d1d90 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926d5630 con 0x5648926d1d90 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x5648926d1d90 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5648926d6730 0x5648926d8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926d9170 con 0x5648926d6730 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426664640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5648926d6730 0x5648926d8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426664640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5648926d6730 0x5648926d8b20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f942001b030 con 0x5648926d6730 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.423+0000 7f9428b54980 20 searching for the correct realm 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926da9d0 con 0x5648926d6730 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942001b030 con 0x5648926d6730 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426664640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9420048580 0x7f942002e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926da9d0 con 0x7f9420048580 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9425e63640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9420048580 0x7f942002e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9425e63640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9420048580 0x7f942002e960 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9425e63640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f941c0cd040 0x7f941c0da410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:28:57.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926da9d0 con 0x7f941c0cd040 2024-09-10T14:28:57.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f941c0cd040 0x7f941c0da410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:28:57.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f941c0cd040 0x7f941c0da410 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x5648926d1d90 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x5648926d1d90 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x7f941c0cd040 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x7f941c0cd040 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.427+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x7f9420048580 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x5648926d6730 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942001b030 con 0x5648926d6730 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x5648926d1d90 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x7f941c0cd040 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x5648926d1d90 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5648926d59d0 con 0x7f9420048580 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d6730 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f942001b030 con 0x5648926d6730 2024-09-10T14:28:57.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d6730 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942001b030 con 0x5648926d6730 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x7f941c0cd040 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d6730 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942001b030 con 0x5648926d6730 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d6730 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942001b030 con 0x5648926d6730 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d1d90 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d1d90 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.431+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x7f941c0cd040 2024-09-10T14:28:57.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d6730 2024-09-10T14:28:57.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f942001b030 con 0x5648926d6730 2024-09-10T14:28:57.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x7f9420048580 2024-09-10T14:28:57.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d1d90 2024-09-10T14:28:57.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x7f941c0cd040 2024-09-10T14:28:57.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d6730 2024-09-10T14:28:57.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9420090040 con 0x5648926d6730 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x7f941c0cd040 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x7f9420048580 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d6730 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9420090040 con 0x5648926d6730 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.435+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x7f941c0cd040 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x5648926d1d90 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f941c0e7060 con 0x7f9420048580 2024-09-10T14:28:57.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926d9ac0 con 0x5648926d1d90 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926da310 con 0x5648926d1d90 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926d9e60 con 0x7f941c0cd040 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 zone default found 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 4 Realm: () 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:28:57.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 zonegroup default 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926da290 con 0x7f941c0cd040 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926dc810 con 0x5648926d6730 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9420090040 con 0x5648926d6730 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926dcbb0 con 0x5648926d6730 2024-09-10T14:28:57.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9420090040 con 0x5648926d6730 2024-09-10T14:28:57.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:28:57.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 started sync module instance, tier type = 2024-09-10T14:28:57.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:28:57.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.439+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dbcb0 con 0x7f9420048580 2024-09-10T14:28:57.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.443+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(44 notify.0 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.443+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94869694298112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dcbb0 con 0x7f9420048580 2024-09-10T14:28:57.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.443+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dd400 con 0x5648926d1d90 2024-09-10T14:28:57.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.443+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94869694298112] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.443+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.443+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94869694304080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dd370 con 0x5648926d1d90 2024-09-10T14:28:57.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.443+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926de190 con 0x5648926d6730 2024-09-10T14:28:57.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.443+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94869694304080] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9420090040 con 0x5648926d6730 2024-09-10T14:28:57.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94869694306288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926de0c0 con 0x5648926d6730 2024-09-10T14:28:57.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926deb10 con 0x7f9420048580 2024-09-10T14:28:57.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(50 notify.3 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94869694309888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926df3e0 con 0x7f9420048580 2024-09-10T14:28:57.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dfde0 con 0x5648926d1d90 2024-09-10T14:28:57.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94869694306288] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9420090040 con 0x5648926d6730 2024-09-10T14:28:57.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94869694309888] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94869694312240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926df8f0 con 0x5648926d1d90 2024-09-10T14:28:57.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.447+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926e06b0 con 0x7f941c0cd040 2024-09-10T14:28:57.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.451+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94869694312240] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.451+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(54 notify.5 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.451+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94869694307344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926e0660 con 0x7f941c0cd040 2024-09-10T14:28:57.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.451+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926e1020 con 0x7f941c0cd040 2024-09-10T14:28:57.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94869694307344] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(56 notify.6 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94869694317456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926e1020 con 0x7f941c0cd040 2024-09-10T14:28:57.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926e19e0 con 0x7f941c0cd040 2024-09-10T14:28:57.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94869694317456] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(58 notify.7 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94869694319984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926e19e0 con 0x7f941c0cd040 2024-09-10T14:28:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 20 add_watcher() i=0 2024-09-10T14:28:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 20 add_watcher() i=1 2024-09-10T14:28:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 20 add_watcher() i=2 2024-09-10T14:28:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 20 add_watcher() i=3 2024-09-10T14:28:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 20 add_watcher() i=4 2024-09-10T14:28:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 20 add_watcher() i=5 2024-09-10T14:28:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.455+0000 7f9428b54980 20 add_watcher() i=6 2024-09-10T14:28:57.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94869694319984] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 add_watcher() i=7 2024-09-10T14:28:57.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 2 all 8 watchers are set, enabling cache 2024-09-10T14:28:57.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648926e4de0 con 0x5648926d1d90 2024-09-10T14:28:57.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94869694322432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926e2300 con 0x5648926d1d90 2024-09-10T14:28:57.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94869694322432] v33'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f92dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:57.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:28:57.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:28:57.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 5 note: GC not initialized 2024-09-10T14:28:57.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f92577fe640 20 reqs_thread_entry: start 2024-09-10T14:28:57.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 init_complete bucket index max shards: 11 2024-09-10T14:28:57.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 Filter name: none 2024-09-10T14:28:57.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f92557fa640 20 reqs_thread_entry: start 2024-09-10T14:28:57.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:28:57.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5648927084b0 con 0x5648926d1d90 2024-09-10T14:28:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:28:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:28:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564892707f90 con 0x7f9420048580 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 enabling bucket name=myfoo 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564892708f20 con 0x7f9420048580 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:28:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 : miss 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 rados->read ofs=0 len=0 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56489270a800 con 0x5648926d1d90 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 2024-09-10T14:28:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.459+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.3 8:c67e5820:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648927131c0 con 0x5648926d1d90 2024-09-10T14:28:57.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1, ofs0, ns] 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94869694492560 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564892711e50 con 0x7f9420048580 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== watch-notify(notify (1) cookie 94869694298112 notify 141733920794 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f941c0e1040 con 0x7f9420048580 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9309ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94869694298112 notifier 4596 bl.length()=752 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9309ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 info.flags=0x17 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9309ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1 to cache LRU end 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9309ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9309ffb640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f92ec003eb0 con 0x7f9420048580 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [notify cookie 94869694492560 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== watch-notify(notify_complete (2) cookie 94869694492560 notify 141733920794 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564892514ea0 con 0x7f9420048580 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_sources= new_sources= 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential sources added=[] removed=[] 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): orig_dests= new_dests= 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 20 handle_bi_update(): bucket=:myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1]): potential dests added=[] removed=[] 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.463+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56489270dfc0 con 0x5648926d1d90 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v33'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94869694519712 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56489270ea70 con 0x5648926d1d90 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== watch-notify(notify (1) cookie 94869694312240 notify 141733920783 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56489270abf0 con 0x5648926d1d90 2024-09-10T14:28:57.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f93097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94869694312240 notifier 4596 bl.length()=567 2024-09-10T14:28:57.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f93097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:28:57.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f93097fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:28:57.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(70 notify.4 [notify cookie 94869694519712 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f93097fa640 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f925c003440 con 0x5648926d1d90 2024-09-10T14:28:57.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== watch-notify(notify_complete (2) cookie 94869694519712 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564892708c70 con 0x5648926d1d90 2024-09-10T14:28:57.473 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:28:57.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f92dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:28:57.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94869694322432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648927062e0 con 0x5648926d1d90 2024-09-10T14:28:57.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94869694322432] v33'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94869694298112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648927062e0 con 0x7f9420048580 2024-09-10T14:28:57.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94869694298112] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 20 remove_watcher() i=0 2024-09-10T14:28:57.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 2 removed watcher, disabling cache 2024-09-10T14:28:57.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.467+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94869694304080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648927062e0 con 0x5648926d1d90 2024-09-10T14:28:57.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.471+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94869694304080] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.471+0000 7f9428b54980 20 remove_watcher() i=1 2024-09-10T14:28:57.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.471+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94869694306288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dcf50 con 0x5648926d6730 2024-09-10T14:28:57.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.471+0000 7f9426664640 1 -- 172.21.15.151:0/1180910386 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94869694306288] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9420090040 con 0x5648926d6730 2024-09-10T14:28:57.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.471+0000 7f9428b54980 20 remove_watcher() i=2 2024-09-10T14:28:57.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.471+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94869694309888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648927062e0 con 0x7f9420048580 2024-09-10T14:28:57.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.475+0000 7f9425e63640 1 -- 172.21.15.151:0/1180910386 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94869694309888] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c0d8070 con 0x7f9420048580 2024-09-10T14:28:57.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.475+0000 7f9428b54980 20 remove_watcher() i=3 2024-09-10T14:28:57.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.475+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94869694312240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dd7f0 con 0x5648926d1d90 2024-09-10T14:28:57.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.475+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94869694312240] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x5648926d1d90 2024-09-10T14:28:57.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.475+0000 7f9428b54980 20 remove_watcher() i=4 2024-09-10T14:28:57.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.475+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94869694307344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dcf50 con 0x7f941c0cd040 2024-09-10T14:28:57.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.479+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94869694307344] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.479+0000 7f9428b54980 20 remove_watcher() i=5 2024-09-10T14:28:57.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.479+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94869694317456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dcf50 con 0x7f941c0cd040 2024-09-10T14:28:57.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.479+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94869694317456] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.479+0000 7f9428b54980 20 remove_watcher() i=6 2024-09-10T14:28:57.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.479+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94869694319984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5648926dcf50 con 0x7f941c0cd040 2024-09-10T14:28:57.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94869694319984] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94180083f0 con 0x7f941c0cd040 2024-09-10T14:28:57.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 20 remove_watcher() i=7 2024-09-10T14:28:57.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f941c0cd040 msgr2=0x7f941c0da410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f941c0cd040 0x7f941c0da410 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5648926d1d90 msgr2=0x5648926d4230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5648926d1d90 0x5648926d4230 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9420048580 msgr2=0x7f942002e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9420048580 0x7f942002e960 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5648926d6730 msgr2=0x5648926d8b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5648926d6730 0x5648926d8b20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f92f0034650 msgr2=0x7f92f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f92f0034650 0x7f92f0036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x5648926a5a70 tx=0x7f941c0a6000 comp rx=0 tx=0).stop 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 msgr2=0x5648926c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9426e65640 1 -- 172.21.15.151:0/1180910386 reap_dead start 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926c6cd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9420032be0 tx=0x7f9420008f50 comp rx=0 tx=0).stop 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 shutdown_connections 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1180910386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926bfb50 0x5648926c6cd0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 >> 172.21.15.151:0/1180910386 conn(0x5648926bbe80 msgr2=0x5648926b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 shutdown_connections 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1180910386 wait complete. 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1760083011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9300034650 msgr2=0x7f9300036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1760083011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9300034650 0x7f9300036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x56489269d210 tx=0x7f941c005a10 comp rx=0 tx=0).stop 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1760083011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926b3140 msgr2=0x5648926b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1760083011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926b3140 0x5648926b3560 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9420048470 tx=0x7f9420010d50 comp rx=0 tx=0).stop 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1760083011 shutdown_connections 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1760083011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9300034650 0x7f9300036b10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/1760083011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648926b3140 0x5648926b3560 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1760083011 >> 172.21.15.151:0/1760083011 conn(0x5648926a8290 msgr2=0x5648926aad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1760083011 shutdown_connections 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/1760083011 wait complete. 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5648926a2b80 msgr2=0x5648926a4f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5648926a2b80 0x5648926a4f70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564892699ef0 msgr2=0x56489269c2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x564892699ef0 0x56489269c2e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56489269ec60 msgr2=0x5648926a1050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56489269ec60 0x5648926a1050 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f930c034650 msgr2=0x7f930c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f930c034650 0x7f930c036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f941c0ad000 tx=0x7f941c0a5040 comp rx=0 tx=0).stop 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 msgr2=0x564892694f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:28:57.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 --2- 172.21.15.151:0/4106855072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564892514ac0 0x564892694f70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9420002260 tx=0x7f9420000f50 comp rx=0 tx=0).stop 2024-09-10T14:28:57.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9426e65640 1 -- 172.21.15.151:0/4106855072 reap_dead start 2024-09-10T14:28:57.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 shutdown_connections 2024-09-10T14:28:57.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 >> 172.21.15.151:0/4106855072 conn(0x56489259b060 msgr2=0x5648926882d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:28:57.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 shutdown_connections 2024-09-10T14:28:57.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:28:57.483+0000 7f9428b54980 1 -- 172.21.15.151:0/4106855072 wait complete. 2024-09-10T14:28:57.497 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:28:57.505 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T14:28:57.857 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-10T14:28:57.874 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:12.875 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T14:29:12.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T14:29:12.876 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T14:29:12.913 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:12.913 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:12.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9bacfad980 1 Processor -- start 2024-09-10T14:29:12.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9bacfad980 1 -- start start 2024-09-10T14:29:12.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9bacfad980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5638c699f9f0 0x5638c699fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9bacfad980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5638c68adae0 con 0x5638c699c680 2024-09-10T14:29:12.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9bacfad980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5638c68d1e30 con 0x5638c699f9f0 2024-09-10T14:29:12.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9baa2bc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5638c699f9f0 0x5638c699fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9baa2bc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5638c699f9f0 0x5638c699fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:38948/0 (socket says 172.21.15.151:38948) 2024-09-10T14:29:12.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9baaabd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5638c699c680 0x5638c699ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51294/0 (socket says 172.21.15.151:51294) 2024-09-10T14:29:12.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9baa2bc640 1 -- 172.21.15.151:0/2896460552 learned_addr learned my addr 172.21.15.151:0/2896460552 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:12.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9baa2bc640 1 -- 172.21.15.151:0/2896460552 >> v1:172.21.15.52:6789/0 conn(0x5638c699c680 legacy=0x5638c699ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:12.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.911+0000 7f9baa2bc640 1 -- 172.21.15.151:0/2896460552 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c69a0340 con 0x5638c699f9f0 2024-09-10T14:29:12.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/2896460552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699f9f0 0x5638c699fe00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400a5c0 tx=0x7f9b9401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71f38d1691c6a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9ba9abb640 1 -- 172.21.15.151:0/2896460552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b940b1070 con 0x5638c699f9f0 2024-09-10T14:29:12.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9ba9abb640 1 -- 172.21.15.151:0/2896460552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b940a8070 con 0x5638c699f9f0 2024-09-10T14:29:12.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9ba9abb640 1 -- 172.21.15.151:0/2896460552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b940ac5b0 con 0x5638c699f9f0 2024-09-10T14:29:12.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9bacfad980 1 -- 172.21.15.151:0/2896460552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699f9f0 msgr2=0x5638c699fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:12.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9bacfad980 1 --2- 172.21.15.151:0/2896460552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699f9f0 0x5638c699fe00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400a5c0 tx=0x7f9b9401b340 comp rx=0 tx=0).stop 2024-09-10T14:29:12.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9bacfad980 1 -- 172.21.15.151:0/2896460552 shutdown_connections 2024-09-10T14:29:12.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9bacfad980 1 --2- 172.21.15.151:0/2896460552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699f9f0 0x5638c699fe00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:12.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9bacfad980 1 -- 172.21.15.151:0/2896460552 >> 172.21.15.151:0/2896460552 conn(0x5638c699b230 msgr2=0x5638c699b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:12.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9bacfad980 1 -- 172.21.15.151:0/2896460552 shutdown_connections 2024-09-10T14:29:12.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.915+0000 7f9bacfad980 1 -- 172.21.15.151:0/2896460552 wait complete. 2024-09-10T14:29:12.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9bacfad980 1 Processor -- start 2024-09-10T14:29:12.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9bacfad980 1 -- start start 2024-09-10T14:29:12.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9bacfad980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b173f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9bacfad980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5638c68d3200 con 0x5638c699c680 2024-09-10T14:29:12.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b173f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b173f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:38960/0 (socket says 172.21.15.151:38960) 2024-09-10T14:29:12.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9baaabd640 1 -- 172.21.15.151:0/2283012580 learned_addr learned my addr 172.21.15.151:0/2283012580 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:12.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9baaabd640 1 -- 172.21.15.151:0/2283012580 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c6b179c0 con 0x5638c699c680 2024-09-10T14:29:12.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.931+0000 7f9baaabd640 1 --2- 172.21.15.151:0/2283012580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b173f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0015f0 tx=0x7f9b9c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581d1d9f5e948f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9a98e09640 1 -- 172.21.15.151:0/2283012580 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c013420 con 0x5638c699c680 2024-09-10T14:29:12.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9a98e09640 1 -- 172.21.15.151:0/2283012580 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0135e0 con 0x5638c699c680 2024-09-10T14:29:12.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9a98e09640 1 -- 172.21.15.151:0/2283012580 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c013940 con 0x5638c699c680 2024-09-10T14:29:12.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- 172.21.15.151:0/2283012580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 msgr2=0x5638c6b173f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:12.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 --2- 172.21.15.151:0/2283012580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b173f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0015f0 tx=0x7f9b9c001ab0 comp rx=0 tx=0).stop 2024-09-10T14:29:12.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- 172.21.15.151:0/2283012580 shutdown_connections 2024-09-10T14:29:12.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 --2- 172.21.15.151:0/2283012580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b173f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:12.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- 172.21.15.151:0/2283012580 >> 172.21.15.151:0/2283012580 conn(0x5638c699b230 msgr2=0x5638c6b13020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:12.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- 172.21.15.151:0/2283012580 shutdown_connections 2024-09-10T14:29:12.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- 172.21.15.151:0/2283012580 wait complete. 2024-09-10T14:29:12.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 Processor -- start 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- start start 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b1e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5638c6a35920 con 0x5638c699c680 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b1e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b1e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:38974/0 (socket says 172.21.15.151:38974) 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9baaabd640 1 -- 172.21.15.151:0/3237846057 learned_addr learned my addr 172.21.15.151:0/3237846057 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9baaabd640 1 -- 172.21.15.151:0/3237846057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c6b1ec60 con 0x5638c699c680 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9baaabd640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b1e720 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c006640 tx=0x7f9b9c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9a97606640 1 -- 172.21.15.151:0/3237846057 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c022020 con 0x5638c699c680 2024-09-10T14:29:12.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638c6b1eef0 con 0x5638c699c680 2024-09-10T14:29:12.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9a97606640 1 -- 172.21.15.151:0/3237846057 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c006320 con 0x5638c699c680 2024-09-10T14:29:12.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9a97606640 1 -- 172.21.15.151:0/3237846057 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c004af0 con 0x5638c699c680 2024-09-10T14:29:12.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.935+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c6b21bd0 con 0x5638c699c680 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9a97606640 1 -- 172.21.15.151:0/3237846057 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9b9c025020 con 0x5638c699c680 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9a97606640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a90034650 0x7f9a90036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9a97606640 1 -- 172.21.15.151:0/3237846057 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9b9c018030 con 0x5638c699c680 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a90034650 0x7f9a90036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c699f9f0 0x5638c6b25820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b25d60 con 0x5638c699f9f0 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bab2be640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c699f9f0 0x5638c6b25820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a90034650 0x7f9a90036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b940ae000 tx=0x7f9b940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bab2be640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c699f9f0 0x5638c6b25820 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bab2be640 1 -- 172.21.15.151:0/3237846057 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c699f9f0 2024-09-10T14:29:12.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b22df0 con 0x5638c699f9f0 2024-09-10T14:29:12.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bab2be640 1 -- 172.21.15.151:0/3237846057 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c699f9f0 2024-09-10T14:29:12.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b28090 0x5638c6b2a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b2ab50 con 0x5638c6b28090 2024-09-10T14:29:12.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9baaabd640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b28090 0x5638c6b2a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9baaabd640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b28090 0x5638c6b2a480 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9baaabd640 1 -- 172.21.15.151:0/3237846057 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b9c01b070 con 0x5638c6b28090 2024-09-10T14:29:12.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b26f30 con 0x5638c699f9f0 2024-09-10T14:29:12.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bab2be640 1 -- 172.21.15.151:0/3237846057 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c699f9f0 2024-09-10T14:29:12.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5638c6b2bf90 0x5638c6b2e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.939+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b2eb10 con 0x5638c6b2bf90 2024-09-10T14:29:12.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5638c6b2bf90 0x5638c6b2e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5638c6b2bf90 0x5638c6b2e380 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9baa2bc640 1 -- 172.21.15.151:0/3237846057 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b940aca00 con 0x5638c6b2bf90 2024-09-10T14:29:12.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9bacfad980 1 Processor -- start 2024-09-10T14:29:12.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9bacfad980 1 -- start start 2024-09-10T14:29:12.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9bacfad980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b3c5a0 0x5638c6b3c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9bacfad980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5638c692c800 con 0x5638c6b3c5a0 2024-09-10T14:29:12.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b3c5a0 0x5638c6b3c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b3c5a0 0x5638c6b3c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:38980/0 (socket says 172.21.15.151:38980) 2024-09-10T14:29:12.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9baaabd640 1 -- 172.21.15.151:0/3925955880 learned_addr learned my addr 172.21.15.151:0/3925955880 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:12.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9baaabd640 1 -- 172.21.15.151:0/3925955880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c6b3cf00 con 0x5638c6b3c5a0 2024-09-10T14:29:12.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.943+0000 7f9baaabd640 1 --2- 172.21.15.151:0/3925955880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b3c5a0 0x5638c6b3c9c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0484a0 tx=0x7f9b9c005070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a94e01640 1 -- 172.21.15.151:0/3925955880 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c01db60 con 0x5638c6b3c5a0 2024-09-10T14:29:12.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a94e01640 1 -- 172.21.15.151:0/3925955880 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c01dd00 con 0x5638c6b3c5a0 2024-09-10T14:29:12.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9bacfad980 1 -- 172.21.15.151:0/3925955880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638c6b3d190 con 0x5638c6b3c5a0 2024-09-10T14:29:12.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a94e01640 1 -- 172.21.15.151:0/3925955880 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c01e3f0 con 0x5638c6b3c5a0 2024-09-10T14:29:12.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9bacfad980 1 -- 172.21.15.151:0/3925955880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c6b3fe10 con 0x5638c6b3c5a0 2024-09-10T14:29:12.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a94e01640 1 -- 172.21.15.151:0/3925955880 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9b9c046040 con 0x5638c6b3c5a0 2024-09-10T14:29:12.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a94e01640 1 --2- 172.21.15.151:0/3925955880 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a84034650 0x7f9a84036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a94e01640 1 -- 172.21.15.151:0/3925955880 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9b9c04ed20 con 0x5638c6b3c5a0 2024-09-10T14:29:12.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/3925955880 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a84034650 0x7f9a84036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9bacfad980 1 Processor -- start 2024-09-10T14:29:12.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9bacfad980 1 -- start start 2024-09-10T14:29:12.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/3925955880 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a84034650 0x7f9a84036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b94000c10 tx=0x7f9b94005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9bacfad980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b49330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9bacfad980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5638c6b17d40 con 0x5638c6b48f50 2024-09-10T14:29:12.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b49330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b49330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:38992/0 (socket says 172.21.15.151:38992) 2024-09-10T14:29:12.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9baaabd640 1 -- 172.21.15.151:0/3357851258 learned_addr learned my addr 172.21.15.151:0/3357851258 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:12.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9baaabd640 1 -- 172.21.15.151:0/3357851258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c6b49900 con 0x5638c6b48f50 2024-09-10T14:29:12.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9baaabd640 1 --2- 172.21.15.151:0/3357851258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b49330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c01d660 tx=0x7f9b9c0056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3b29e6e58f259c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a8e7fc640 1 -- 172.21.15.151:0/3357851258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c05d020 con 0x5638c6b48f50 2024-09-10T14:29:12.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a8e7fc640 1 -- 172.21.15.151:0/3357851258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c041ff0 con 0x5638c6b48f50 2024-09-10T14:29:12.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.947+0000 7f9a8e7fc640 1 -- 172.21.15.151:0/3357851258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c027400 con 0x5638c6b48f50 2024-09-10T14:29:12.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- 172.21.15.151:0/3357851258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 msgr2=0x5638c6b49330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:12.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3357851258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b49330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c01d660 tx=0x7f9b9c0056b0 comp rx=0 tx=0).stop 2024-09-10T14:29:12.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- 172.21.15.151:0/3357851258 shutdown_connections 2024-09-10T14:29:12.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3357851258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b49330 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:12.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- 172.21.15.151:0/3357851258 >> 172.21.15.151:0/3357851258 conn(0x5638c6b45280 msgr2=0x5638c6b43380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:12.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- 172.21.15.151:0/3357851258 shutdown_connections 2024-09-10T14:29:12.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- 172.21.15.151:0/3357851258 wait complete. 2024-09-10T14:29:12.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 Processor -- start 2024-09-10T14:29:12.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- start start 2024-09-10T14:29:12.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5638c6b49e10 con 0x5638c6b48f50 2024-09-10T14:29:12.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9baaabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:38998/0 (socket says 172.21.15.151:38998) 2024-09-10T14:29:12.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 learned_addr learned my addr 172.21.15.151:0/896084111 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:12.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c6b505e0 con 0x5638c6b48f50 2024-09-10T14:29:12.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9baaabd640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b500a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c01d660 tx=0x7f9b9c04ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9a8cff9640 1 -- 172.21.15.151:0/896084111 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c072070 con 0x5638c6b48f50 2024-09-10T14:29:12.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638c6b505e0 con 0x5638c6b48f50 2024-09-10T14:29:12.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9a8cff9640 1 -- 172.21.15.151:0/896084111 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c03d660 con 0x5638c6b48f50 2024-09-10T14:29:12.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9a8cff9640 1 -- 172.21.15.151:0/896084111 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b9c03d850 con 0x5638c6b48f50 2024-09-10T14:29:12.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.951+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c6b50a50 con 0x5638c6b48f50 2024-09-10T14:29:12.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9a8cff9640 1 -- 172.21.15.151:0/896084111 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9b9c075070 con 0x5638c6b48f50 2024-09-10T14:29:12.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9a8cff9640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a74034650 0x7f9a74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9a8cff9640 1 -- 172.21.15.151:0/896084111 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9b9c069030 con 0x5638c6b48f50 2024-09-10T14:29:12.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a74034650 0x7f9a74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c6b5b120 0x5638c6b5d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5dd10 con 0x5638c6b5b120 2024-09-10T14:29:12.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bab2be640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c6b5b120 0x5638c6b5d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bab2be640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c6b5b120 0x5638c6b5d5c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a74034650 0x7f9a74036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9b9401b380 tx=0x7f9b940a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:12.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 realm 2024-09-10T14:29:12.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5e120 con 0x5638c6b5b120 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5e9c0 con 0x5638c6b5b120 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b5fac0 0x5638c6b61eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b62430 con 0x5638c6b5fac0 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9baaabd640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b5fac0 0x5638c6b61eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9baaabd640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b5fac0 0x5638c6b61eb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 20 searching for the correct realm 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.955+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b63cd0 con 0x5638c6b5fac0 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9baaabd640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9b9c077060 0x7f9b9c025310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b63cd0 con 0x7f9b9c077060 2024-09-10T14:29:12.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9b9c077060 0x7f9b9c025310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9b9c077060 0x7f9b9c025310 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9baa2bc640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9b940de040 0x7f9b940df940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:12.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b63cd0 con 0x7f9b940de040 2024-09-10T14:29:12.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9b940de040 0x7f9b940df940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:12.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9b940de040 0x7f9b940df940 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:12.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b940de040 2024-09-10T14:29:12.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.959+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b940de040 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b9c077060 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5fac0 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b940de040 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b9c077060 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5fac0 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5fac0 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b9c077060 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.963+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5fac0 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5fac0 2024-09-10T14:29:12.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b940de040 2024-09-10T14:29:12.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5fac0 2024-09-10T14:29:12.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b9c077060 2024-09-10T14:29:12.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b9c077060 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5fac0 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.967+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b940de040 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b9c077060 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5fac0 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b940de040 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x5638c6b5b120 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b5ed60 con 0x7f9b9c077060 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:12.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b62c80 con 0x5638c6b5b120 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b63070 con 0x5638c6b5b120 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b63070 con 0x7f9b940de040 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 zone default found 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 4 Realm: () 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 zonegroup default 2024-09-10T14:29:12.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.971+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b63490 con 0x7f9b9c077060 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b65b80 con 0x5638c6b5fac0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 20 rados->read ofs=0 len=0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b65f20 con 0x5638c6b5fac0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 20 started sync module instance, tier type = 2024-09-10T14:29:12.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:12.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b65020 con 0x7f9b9c077060 2024-09-10T14:29:12.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801851995152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b66770 con 0x7f9b9c077060 2024-09-10T14:29:12.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b66fc0 con 0x5638c6b5b120 2024-09-10T14:29:12.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.975+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801851995152] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.979+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.979+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801851998912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b66fc0 con 0x5638c6b5b120 2024-09-10T14:29:12.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.979+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b67980 con 0x5638c6b5fac0 2024-09-10T14:29:12.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.979+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801851998912] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.979+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.979+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801852001040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b66f30 con 0x5638c6b5fac0 2024-09-10T14:29:12.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.979+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b68780 con 0x7f9b9c077060 2024-09-10T14:29:12.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.983+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.983+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801852006992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b69020 con 0x7f9b9c077060 2024-09-10T14:29:12.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.983+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b69a20 con 0x5638c6b5b120 2024-09-10T14:29:12.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.983+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801852001040] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:12.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.983+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801852006992] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:12.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.983+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.983+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801852009328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b69530 con 0x5638c6b5b120 2024-09-10T14:29:12.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.983+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6a2c0 con 0x7f9b940de040 2024-09-10T14:29:12.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.987+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801852009328] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.987+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.987+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801852005792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6a200 con 0x7f9b940de040 2024-09-10T14:29:12.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.987+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6abc0 con 0x7f9b940de040 2024-09-10T14:29:12.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.987+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801852005792] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.987+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.987+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801852014176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6abc0 con 0x7f9b940de040 2024-09-10T14:29:12.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.987+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6b580 con 0x7f9b940de040 2024-09-10T14:29:12.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801852014176] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801852016400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6b760 con 0x7f9b940de040 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bacfad980 20 add_watcher() i=0 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bacfad980 20 add_watcher() i=1 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bacfad980 20 add_watcher() i=2 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bacfad980 20 add_watcher() i=3 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bacfad980 20 add_watcher() i=4 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bacfad980 20 add_watcher() i=5 2024-09-10T14:29:12.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.991+0000 7f9bacfad980 20 add_watcher() i=6 2024-09-10T14:29:12.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801852016400] v36'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:12.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bacfad980 20 add_watcher() i=7 2024-09-10T14:29:12.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bacfad980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:12.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6e900 con 0x5638c6b5b120 2024-09-10T14:29:12.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801852031728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6b6d0 con 0x5638c6b5b120 2024-09-10T14:29:12.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801852031728] v36'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:12.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9a617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:12.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bacfad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:12.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bacfad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:13.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.995+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b77030 con 0x5638c6b5b120 2024-09-10T14:29:13.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.999+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.999+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b77680 con 0x7f9b940de040 2024-09-10T14:29:13.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.999+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:12.999+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b77bf0 con 0x5638c6b5fac0 2024-09-10T14:29:13.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.003+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.003+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b77bf0 con 0x5638c6b5b120 2024-09-10T14:29:13.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.003+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'154 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.003+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b77fb0 con 0x7f9b9c077060 2024-09-10T14:29:13.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.003+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.003+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78430 con 0x5638c6b5fac0 2024-09-10T14:29:13.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.007+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.007+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78560 con 0x5638c6b5b120 2024-09-10T14:29:13.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.007+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.007+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b789c0 con 0x7f9b940de040 2024-09-10T14:29:13.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.011+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.011+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b789c0 con 0x7f9b9c077060 2024-09-10T14:29:13.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.011+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.011+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.015+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.015+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x7f9b9c077060 2024-09-10T14:29:13.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.015+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.015+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b79260 con 0x7f9b940de040 2024-09-10T14:29:13.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.015+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.015+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b79260 con 0x7f9b9c077060 2024-09-10T14:29:13.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.019+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.019+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b79260 con 0x7f9b940de040 2024-09-10T14:29:13.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.019+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.019+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5b120 2024-09-10T14:29:13.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.023+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'155 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.023+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.023+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.023+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x7f9b9c077060 2024-09-10T14:29:13.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.027+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.027+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.027+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.027+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5b120 2024-09-10T14:29:13.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.031+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.031+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5b120 2024-09-10T14:29:13.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.031+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'156 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.031+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.035+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.035+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x7f9b9c077060 2024-09-10T14:29:13.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.035+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.035+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.035+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.035+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.039+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.039+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.039+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.039+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.043+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.043+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x7f9b940de040 2024-09-10T14:29:13.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.043+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.043+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.047+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.047+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x7f9b940de040 2024-09-10T14:29:13.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.047+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.047+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x5638c6b5fac0 2024-09-10T14:29:13.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.051+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.051+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x7f9b940de040 2024-09-10T14:29:13.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.055+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.055+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b78e70 con 0x7f9b9c077060 2024-09-10T14:29:13.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.055+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.055+0000 7f99dbfff640 20 reqs_thread_entry: start 2024-09-10T14:29:13.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.055+0000 7f9bacfad980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:13.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.055+0000 7f9bacfad980 20 Filter name: none 2024-09-10T14:29:13.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.055+0000 7f99d9ffb640 20 reqs_thread_entry: start 2024-09-10T14:29:13.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.055+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5b120 2024-09-10T14:29:13.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b746c0 con 0x5638c6b5b120 2024-09-10T14:29:13.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b940de040 2024-09-10T14:29:13.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b940de040 2024-09-10T14:29:13.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b940de040 2024-09-10T14:29:13.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.059+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5b120 2024-09-10T14:29:13.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5b120 2024-09-10T14:29:13.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b9c077060 2024-09-10T14:29:13.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.063+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5b120 2024-09-10T14:29:13.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5b120 2024-09-10T14:29:13.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b940de040 2024-09-10T14:29:13.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b940de040 2024-09-10T14:29:13.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.067+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b940de040 2024-09-10T14:29:13.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b9c077060 2024-09-10T14:29:13.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b9c077060 2024-09-10T14:29:13.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.071+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b940de040 2024-09-10T14:29:13.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b940de040 2024-09-10T14:29:13.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b940de040 2024-09-10T14:29:13.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b9c077060 2024-09-10T14:29:13.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.075+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b940de040 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b940de040 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b940de040 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5b120 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.079+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5b120 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b9c077060 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b9c077060 2024-09-10T14:29:13.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b9c077060 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.083+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x7f9b9c077060 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.087+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x7f9b9c077060 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b74b70 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94f40 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 50 ==== osd_op_reply(165 gc.23 [call out=1702b] v0'0 uv24 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b95aa0 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b94a90 con 0x5638c6b5fac0 2024-09-10T14:29:13.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b95aa0 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.091+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.095+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x5638c6b5fac0 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.099+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b940de040 2024-09-10T14:29:13.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b9c077060 2024-09-10T14:29:13.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b9c077060 2024-09-10T14:29:13.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b743b0 con 0x7f9b9c077060 2024-09-10T14:29:13.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.103+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.107+0000 7f9a617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:13.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.107+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801852031728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b73210 con 0x5638c6b5b120 2024-09-10T14:29:13.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.107+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94801852031728] v36'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.107+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801851995152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b6e2f0 con 0x7f9b9c077060 2024-09-10T14:29:13.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.107+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94801851995152] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.107+0000 7f9bacfad980 20 remove_watcher() i=0 2024-09-10T14:29:13.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.107+0000 7f9bacfad980 2 removed watcher, disabling cache 2024-09-10T14:29:13.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.107+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801851998912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b65410 con 0x5638c6b5b120 2024-09-10T14:29:13.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.111+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94801851998912] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.111+0000 7f9bacfad980 20 remove_watcher() i=1 2024-09-10T14:29:13.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.111+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801852001040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b65410 con 0x5638c6b5fac0 2024-09-10T14:29:13.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9baaabd640 1 -- 172.21.15.151:0/896084111 <== osd.3 v2:172.21.15.151:6803/3136276598 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94801852001040] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b9c074030 con 0x5638c6b5fac0 2024-09-10T14:29:13.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9bacfad980 20 remove_watcher() i=2 2024-09-10T14:29:13.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801852006992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b65410 con 0x7f9b9c077060 2024-09-10T14:29:13.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9baa2bc640 1 -- 172.21.15.151:0/896084111 <== osd.2 v2:172.21.15.151:6816/2885613778 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94801852006992] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b940cb030 con 0x7f9b9c077060 2024-09-10T14:29:13.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9bacfad980 20 remove_watcher() i=3 2024-09-10T14:29:13.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801852009328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b65410 con 0x5638c6b5b120 2024-09-10T14:29:13.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.1 v2:172.21.15.151:6800/103268966 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94801852009328] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x5638c6b5b120 2024-09-10T14:29:13.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9bacfad980 20 remove_watcher() i=4 2024-09-10T14:29:13.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.115+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801852005792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b68b70 con 0x7f9b940de040 2024-09-10T14:29:13.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.119+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94801852005792] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.119+0000 7f9bacfad980 20 remove_watcher() i=5 2024-09-10T14:29:13.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.119+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801852014176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b65410 con 0x7f9b940de040 2024-09-10T14:29:13.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94801852014176] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 20 remove_watcher() i=6 2024-09-10T14:29:13.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801852016400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5638c6b67da0 con 0x7f9b940de040 2024-09-10T14:29:13.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 <== osd.0 v2:172.21.15.52:6800/2968015226 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94801852016400] v36'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ba40083f0 con 0x7f9b940de040 2024-09-10T14:29:13.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 20 remove_watcher() i=7 2024-09-10T14:29:13.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9b940de040 msgr2=0x7f9b940df940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9b940de040 0x7f9b940df940 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c6b5b120 msgr2=0x5638c6b5d5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c6b5b120 0x5638c6b5d5c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9b9c077060 msgr2=0x7f9b9c025310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9b9c077060 0x7f9b9c025310 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b5fac0 msgr2=0x5638c6b61eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b5fac0 0x5638c6b61eb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a74034650 msgr2=0x7f9a74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a74034650 0x7f9a74036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9b9401b380 tx=0x7f9b940a8000 comp rx=0 tx=0).stop 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 msgr2=0x5638c6b500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/896084111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b48f50 0x5638c6b500a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c01d660 tx=0x7f9b9c04ff40 comp rx=0 tx=0).stop 2024-09-10T14:29:13.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 reap_dead start 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bab2be640 1 -- 172.21.15.151:0/896084111 reap_dead start 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 shutdown_connections 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 >> 172.21.15.151:0/896084111 conn(0x5638c6b45280 msgr2=0x5638c6b43350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 shutdown_connections 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/896084111 wait complete. 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3925955880 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a84034650 msgr2=0x7f9a84036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3925955880 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a84034650 0x7f9a84036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b94000c10 tx=0x7f9b94005ad0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3925955880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b3c5a0 msgr2=0x5638c6b3c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3925955880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b3c5a0 0x5638c6b3c9c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0484a0 tx=0x7f9b9c005070 comp rx=0 tx=0).stop 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3925955880 shutdown_connections 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3925955880 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a84034650 0x7f9a84036b10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3925955880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c6b3c5a0 0x5638c6b3c9c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3925955880 >> 172.21.15.151:0/3925955880 conn(0x5638c6b316f0 msgr2=0x5638c6b34170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3925955880 shutdown_connections 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3925955880 wait complete. 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5638c6b2bf90 msgr2=0x5638c6b2e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5638c6b2bf90 0x5638c6b2e380 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c699f9f0 msgr2=0x5638c6b25820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5638c699f9f0 0x5638c6b25820 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b28090 msgr2=0x5638c6b2a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5638c6b28090 0x5638c6b2a480 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.123+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a90034650 msgr2=0x7f9a90036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.127+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9a90034650 0x7f9a90036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b940ae000 tx=0x7f9b940a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.127+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 msgr2=0x5638c6b1e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.127+0000 7f9bacfad980 1 --2- 172.21.15.151:0/3237846057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638c699c680 0x5638c6b1e720 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c006640 tx=0x7f9b9c000f50 comp rx=0 tx=0).stop 2024-09-10T14:29:13.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.127+0000 7f9bab2be640 1 -- 172.21.15.151:0/3237846057 reap_dead start 2024-09-10T14:29:13.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.127+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 shutdown_connections 2024-09-10T14:29:13.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.127+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 >> 172.21.15.151:0/3237846057 conn(0x5638c699b230 msgr2=0x5638c6b11ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.127+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 shutdown_connections 2024-09-10T14:29:13.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.127+0000 7f9bacfad980 1 -- 172.21.15.151:0/3237846057 wait complete. 2024-09-10T14:29:13.140 INFO:teuthology.orchestra.run.smithi151.stdout:[{"tag":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.15311802062146496978\u0000","time":"2024-09-10T14:29:12.872229+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_7","key":"","instance":""}]}] 2024-09-10T14:29:13.140 DEBUG:tasks.util.rgw: json result: [{'tag': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.15311802062146496978\x00', 'time': '2024-09-10T14:29:12.872229+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_7', 'key': '', 'instance': ''}]}] 2024-09-10T14:29:13.141 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-10T14:29:13.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-10T14:29:13.141 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-10T14:29:13.219 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:13.219 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:13.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd92f8c3980 1 Processor -- start 2024-09-10T14:29:13.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd92f8c3980 1 -- start start 2024-09-10T14:29:13.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd92f8c3980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b6d1e85e80 0x55b6d1e88270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd92f8c3980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b6d1d07ae0 con 0x55b6d1df3ab0 2024-09-10T14:29:13.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd92f8c3980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55b6d1d2be30 con 0x55b6d1e85e80 2024-09-10T14:29:13.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd927fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55b6d1e85e80 0x55b6d1e88270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd92d3d3640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55b6d1df3ab0 0x55b6d1e84760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51306/0 (socket says 172.21.15.151:51306) 2024-09-10T14:29:13.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd92d3d3640 1 -- 172.21.15.151:0/156353670 learned_addr learned my addr 172.21.15.151:0/156353670 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:13.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd927fff640 1 -- 172.21.15.151:0/156353670 >> v1:172.21.15.52:6789/0 conn(0x55b6d1df3ab0 legacy=0x55b6d1e84760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.215+0000 7fd927fff640 1 -- 172.21.15.151:0/156353670 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1df3e90 con 0x55b6d1e85e80 2024-09-10T14:29:13.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd927fff640 1 --2- 172.21.15.151:0/156353670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1e85e80 0x55b6d1e88270 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd91800a480 tx=0x7fd91801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35a8a398cea15df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92cbd2640 1 -- 172.21.15.151:0/156353670 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9180b0070 con 0x55b6d1e85e80 2024-09-10T14:29:13.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92cbd2640 1 -- 172.21.15.151:0/156353670 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9180ab540 con 0x55b6d1e85e80 2024-09-10T14:29:13.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92cbd2640 1 -- 172.21.15.151:0/156353670 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9180ab840 con 0x55b6d1e85e80 2024-09-10T14:29:13.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92f8c3980 1 -- 172.21.15.151:0/156353670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1e85e80 msgr2=0x55b6d1e88270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/156353670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1e85e80 0x55b6d1e88270 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd91800a480 tx=0x7fd91801b280 comp rx=0 tx=0).stop 2024-09-10T14:29:13.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92f8c3980 1 -- 172.21.15.151:0/156353670 shutdown_connections 2024-09-10T14:29:13.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/156353670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1e85e80 0x55b6d1e88270 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92f8c3980 1 -- 172.21.15.151:0/156353670 >> 172.21.15.151:0/156353670 conn(0x55b6d1e7a050 msgr2=0x55b6d1e7c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92f8c3980 1 -- 172.21.15.151:0/156353670 shutdown_connections 2024-09-10T14:29:13.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.219+0000 7fd92f8c3980 1 -- 172.21.15.151:0/156353670 wait complete. 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.235+0000 7fd92f8c3980 1 Processor -- start 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- start start 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f6ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1d2d200 con 0x55b6d1df3ab0 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f6ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f6ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39024/0 (socket says 172.21.15.151:39024) 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92d3d3640 1 -- 172.21.15.151:0/899149887 learned_addr learned my addr 172.21.15.151:0/899149887 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92d3d3640 1 -- 172.21.15.151:0/899149887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1f6d280 con 0x55b6d1df3ab0 2024-09-10T14:29:13.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/899149887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f6ccb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd920001e20 tx=0x7fd92000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504a6301c62bfd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd81b606640 1 -- 172.21.15.151:0/899149887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd920012020 con 0x55b6d1df3ab0 2024-09-10T14:29:13.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd81b606640 1 -- 172.21.15.151:0/899149887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92000e7c0 con 0x55b6d1df3ab0 2024-09-10T14:29:13.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd81b606640 1 -- 172.21.15.151:0/899149887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92000eb00 con 0x55b6d1df3ab0 2024-09-10T14:29:13.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- 172.21.15.151:0/899149887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 msgr2=0x55b6d1f6ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/899149887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f6ccb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd920001e20 tx=0x7fd92000b790 comp rx=0 tx=0).stop 2024-09-10T14:29:13.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- 172.21.15.151:0/899149887 shutdown_connections 2024-09-10T14:29:13.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/899149887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f6ccb0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- 172.21.15.151:0/899149887 >> 172.21.15.151:0/899149887 conn(0x55b6d1e7a050 msgr2=0x55b6d1f688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- 172.21.15.151:0/899149887 shutdown_connections 2024-09-10T14:29:13.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- 172.21.15.151:0/899149887 wait complete. 2024-09-10T14:29:13.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 Processor -- start 2024-09-10T14:29:13.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- start start 2024-09-10T14:29:13.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f74020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92f8c3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1e8b240 con 0x55b6d1df3ab0 2024-09-10T14:29:13.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f74020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f74020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39038/0 (socket says 172.21.15.151:39038) 2024-09-10T14:29:13.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.239+0000 7fd92d3d3640 1 -- 172.21.15.151:0/575127949 learned_addr learned my addr 172.21.15.151:0/575127949 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92d3d3640 1 -- 172.21.15.151:0/575127949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1f74560 con 0x55b6d1df3ab0 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f74020 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd920001e20 tx=0x7fd920000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd819e03640 1 -- 172.21.15.151:0/575127949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd920012030 con 0x55b6d1df3ab0 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd819e03640 1 -- 172.21.15.151:0/575127949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd920001480 con 0x55b6d1df3ab0 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd819e03640 1 -- 172.21.15.151:0/575127949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92001a910 con 0x55b6d1df3ab0 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6d1f747f0 con 0x55b6d1df3ab0 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d1f774d0 con 0x55b6d1df3ab0 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd819e03640 1 -- 172.21.15.151:0/575127949 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd920015020 con 0x55b6d1df3ab0 2024-09-10T14:29:13.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd819e03640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd814034650 0x7fd814036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd819e03640 1 -- 172.21.15.151:0/575127949 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd920020030 con 0x55b6d1df3ab0 2024-09-10T14:29:13.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd927fff640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd814034650 0x7fd814036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1e85e80 0x55b6d1f7b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1f7b650 con 0x55b6d1e85e80 2024-09-10T14:29:13.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92dbd4640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1e85e80 0x55b6d1f7b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd927fff640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd814034650 0x7fd814036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9180ad000 tx=0x7fd9180a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92dbd4640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1e85e80 0x55b6d1f7b010 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92dbd4640 1 -- 172.21.15.151:0/575127949 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1e85e80 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.243+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1f786d0 con 0x55b6d1e85e80 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92dbd4640 1 -- 172.21.15.151:0/575127949 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1e85e80 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1f7d980 0x55b6d1f7fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1f80440 con 0x55b6d1f7d980 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1f7d980 0x55b6d1f7fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1f7d980 0x55b6d1f7fd70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92d3d3640 1 -- 172.21.15.151:0/575127949 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd920043040 con 0x55b6d1f7d980 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1f7c820 con 0x55b6d1e85e80 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92dbd4640 1 -- 172.21.15.151:0/575127949 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1e85e80 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b6d1f81880 0x55b6d1f83c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1f84400 con 0x55b6d1f81880 2024-09-10T14:29:13.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd927fff640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b6d1f81880 0x55b6d1f83c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd927fff640 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b6d1f81880 0x55b6d1f83c70 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd927fff640 1 -- 172.21.15.151:0/575127949 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd9180b3040 con 0x55b6d1f81880 2024-09-10T14:29:13.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.247+0000 7fd92f8c3980 1 Processor -- start 2024-09-10T14:29:13.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 -- start start 2024-09-10T14:29:13.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f91e90 0x55b6d1f922b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1d86800 con 0x55b6d1f91e90 2024-09-10T14:29:13.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f91e90 0x55b6d1f922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f91e90 0x55b6d1f922b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39052/0 (socket says 172.21.15.151:39052) 2024-09-10T14:29:13.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92d3d3640 1 -- 172.21.15.151:0/1447149956 learned_addr learned my addr 172.21.15.151:0/1447149956 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92d3d3640 1 -- 172.21.15.151:0/1447149956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1f927f0 con 0x55b6d1f91e90 2024-09-10T14:29:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/1447149956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f91e90 0x55b6d1f922b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b2d0 tx=0x7fd92000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd812ffd640 1 -- 172.21.15.151:0/1447149956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92003e020 con 0x55b6d1f91e90 2024-09-10T14:29:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 -- 172.21.15.151:0/1447149956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6d1f92a80 con 0x55b6d1f91e90 2024-09-10T14:29:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd812ffd640 1 -- 172.21.15.151:0/1447149956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd920017c50 con 0x55b6d1f91e90 2024-09-10T14:29:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 -- 172.21.15.151:0/1447149956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d1f92a80 con 0x55b6d1f91e90 2024-09-10T14:29:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd812ffd640 1 -- 172.21.15.151:0/1447149956 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd920041310 con 0x55b6d1f91e90 2024-09-10T14:29:13.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd812ffd640 1 -- 172.21.15.151:0/1447149956 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd920009070 con 0x55b6d1f91e90 2024-09-10T14:29:13.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd812ffd640 1 --2- 172.21.15.151:0/1447149956 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd808034650 0x7fd808036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd812ffd640 1 -- 172.21.15.151:0/1447149956 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd920005050 con 0x55b6d1f91e90 2024-09-10T14:29:13.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd927fff640 1 --2- 172.21.15.151:0/1447149956 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd808034650 0x7fd808036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 Processor -- start 2024-09-10T14:29:13.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 -- start start 2024-09-10T14:29:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd927fff640 1 --2- 172.21.15.151:0/1447149956 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd808034650 0x7fd808036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd91800a480 tx=0x7fd918005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1f9ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.251+0000 7fd92f8c3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1f6d600 con 0x55b6d1f9e670 2024-09-10T14:29:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1f9ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1f9ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39056/0 (socket says 172.21.15.151:39056) 2024-09-10T14:29:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92d3d3640 1 -- 172.21.15.151:0/3079122891 learned_addr learned my addr 172.21.15.151:0/3079122891 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92d3d3640 1 -- 172.21.15.151:0/3079122891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1f9f020 con 0x55b6d1f9e670 2024-09-10T14:29:13.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/3079122891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1f9ea50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd920027fd0 tx=0x7fd920010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd6714f91f9105c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd810ff9640 1 -- 172.21.15.151:0/3079122891 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92005c070 con 0x55b6d1f9e670 2024-09-10T14:29:13.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd810ff9640 1 -- 172.21.15.151:0/3079122891 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd920048770 con 0x55b6d1f9e670 2024-09-10T14:29:13.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd810ff9640 1 -- 172.21.15.151:0/3079122891 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd920019d70 con 0x55b6d1f9e670 2024-09-10T14:29:13.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 -- 172.21.15.151:0/3079122891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 msgr2=0x55b6d1f9ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/3079122891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1f9ea50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd920027fd0 tx=0x7fd920010f90 comp rx=0 tx=0).stop 2024-09-10T14:29:13.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 -- 172.21.15.151:0/3079122891 shutdown_connections 2024-09-10T14:29:13.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/3079122891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1f9ea50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 -- 172.21.15.151:0/3079122891 >> 172.21.15.151:0/3079122891 conn(0x55b6d1f9aa50 msgr2=0x55b6d1f98b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 -- 172.21.15.151:0/3079122891 shutdown_connections 2024-09-10T14:29:13.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 -- 172.21.15.151:0/3079122891 wait complete. 2024-09-10T14:29:13.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 Processor -- start 2024-09-10T14:29:13.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 -- start start 2024-09-10T14:29:13.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1fa5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92f8c3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b6d1f9f4c0 con 0x55b6d1f9e670 2024-09-10T14:29:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1fa5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92d3d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1fa5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39058/0 (socket says 172.21.15.151:39058) 2024-09-10T14:29:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.255+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 learned_addr learned my addr 172.21.15.151:0/2067961206 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d1fa5d90 con 0x55b6d1f9e670 2024-09-10T14:29:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1fa5850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd920050040 tx=0x7fd9200421b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd7feffd640 1 -- 172.21.15.151:0/2067961206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92003a460 con 0x55b6d1f9e670 2024-09-10T14:29:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd7feffd640 1 -- 172.21.15.151:0/2067961206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92003a600 con 0x55b6d1f9e670 2024-09-10T14:29:13.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6d1fa5d90 con 0x55b6d1f9e670 2024-09-10T14:29:13.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd7feffd640 1 -- 172.21.15.151:0/2067961206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92003a920 con 0x55b6d1f9e670 2024-09-10T14:29:13.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d1fa5d90 con 0x55b6d1f9e670 2024-09-10T14:29:13.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd7feffd640 1 -- 172.21.15.151:0/2067961206 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd92006e020 con 0x55b6d1f9e670 2024-09-10T14:29:13.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd7feffd640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7f80346a0 0x7fd7f8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd7feffd640 1 -- 172.21.15.151:0/2067961206 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd920071d30 con 0x55b6d1f9e670 2024-09-10T14:29:13.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd927fff640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7f80346a0 0x7fd7f8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1fb08d0 0x55b6d1fb2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb34e0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92dbd4640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1fb08d0 0x55b6d1fb2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd927fff640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7f80346a0 0x7fd7f8036b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd9180ae040 tx=0x7fd9180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92dbd4640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1fb08d0 0x55b6d1fb2d90 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 20 realm 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.259+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb38f0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb41c0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1fb52c0 0x55b6d1fb76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb7c80 con 0x55b6d1fb52c0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1fb52c0 0x55b6d1fb76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1fb52c0 0x55b6d1fb76b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:13.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 20 searching for the correct realm 2024-09-10T14:29:13.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb9550 con 0x55b6d1fb52c0 2024-09-10T14:29:13.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92d3d3640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd920061070 0x7fd920079850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb9550 con 0x7fd920061070 2024-09-10T14:29:13.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd927fff640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd920061070 0x7fd920079850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd927fff640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd920061070 0x7fd920079850 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd927fff640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd9180dc040 0x7fd9180dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb9550 con 0x7fd9180dc040 2024-09-10T14:29:13.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.263+0000 7fd92dbd4640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd9180dc040 0x7fd9180dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd9180dc040 0x7fd9180dd430 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd9180dc040 2024-09-10T14:29:13.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd9180dc040 2024-09-10T14:29:13.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd920061070 2024-09-10T14:29:13.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb52c0 2024-09-10T14:29:13.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.267+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd9180dc040 2024-09-10T14:29:13.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd920061070 2024-09-10T14:29:13.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb52c0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb52c0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd920061070 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb52c0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb52c0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.271+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd9180dc040 2024-09-10T14:29:13.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb52c0 2024-09-10T14:29:13.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd920061070 2024-09-10T14:29:13.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd920061070 2024-09-10T14:29:13.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb52c0 2024-09-10T14:29:13.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd9180dc040 2024-09-10T14:29:13.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd920061070 2024-09-10T14:29:13.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb52c0 2024-09-10T14:29:13.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.275+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd9180dc040 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x55b6d1fb08d0 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb4560 con 0x7fd920061070 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:13.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb8640 con 0x55b6d1fb08d0 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb8ee0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb8a30 con 0x7fd9180dc040 2024-09-10T14:29:13.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 zone default found 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 4 Realm: () 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 zonegroup default 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fb8e60 con 0x7fd920061070 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbb360 con 0x55b6d1fb52c0 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbb7b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 started sync module instance, tier type = 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.279+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fba800 con 0x7fd920061070 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.283+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.283+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94243695340448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbafc0 con 0x7fd920061070 2024-09-10T14:29:13.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.283+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbc6e0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.283+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94243695340448] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.283+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.283+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94243695346224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbcb00 con 0x55b6d1fb08d0 2024-09-10T14:29:13.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.283+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbd4c0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.287+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.287+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94243695349776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbdd10 con 0x55b6d1fb52c0 2024-09-10T14:29:13.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.287+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbe710 con 0x7fd920061070 2024-09-10T14:29:13.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.287+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94243695346224] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.287+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.287+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94243695347280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbeb00 con 0x7fd920061070 2024-09-10T14:29:13.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.287+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbf4c0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94243695349776] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94243695347280] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94243695351904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbf4c0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbfd10 con 0x7fd9180dc040 2024-09-10T14:29:13.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94243695351904] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94243695358240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbfa50 con 0x7fd9180dc040 2024-09-10T14:29:13.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.291+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fc0570 con 0x7fd9180dc040 2024-09-10T14:29:13.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.295+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94243695358240] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.295+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.295+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94243695362112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fc0530 con 0x7fd9180dc040 2024-09-10T14:29:13.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.295+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fc0f70 con 0x7fd9180dc040 2024-09-10T14:29:13.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94243695362112] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94243695364672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fc0f30 con 0x7fd9180dc040 2024-09-10T14:29:13.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 20 add_watcher() i=0 2024-09-10T14:29:13.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 20 add_watcher() i=1 2024-09-10T14:29:13.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 20 add_watcher() i=2 2024-09-10T14:29:13.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 20 add_watcher() i=3 2024-09-10T14:29:13.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 20 add_watcher() i=4 2024-09-10T14:29:13.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 20 add_watcher() i=5 2024-09-10T14:29:13.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 20 add_watcher() i=6 2024-09-10T14:29:13.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94243695364672] v36'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 20 add_watcher() i=7 2024-09-10T14:29:13.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:13.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fc4390 con 0x55b6d1fb08d0 2024-09-10T14:29:13.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.299+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94243695359296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fc18b0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.303+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94243695359296] v36'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.303+0000 7fd7e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:13.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.303+0000 7fd92f8c3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:13.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.303+0000 7fd92f8c3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:13.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.303+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fc4070 con 0x55b6d1fb08d0 2024-09-10T14:29:13.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.303+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.303+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcd400 con 0x7fd9180dc040 2024-09-10T14:29:13.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.307+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.307+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcd400 con 0x55b6d1fb52c0 2024-09-10T14:29:13.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.307+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.307+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcd400 con 0x55b6d1fb08d0 2024-09-10T14:29:13.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.311+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'159 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.311+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcde20 con 0x7fd920061070 2024-09-10T14:29:13.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.311+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.311+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcca70 con 0x55b6d1fb52c0 2024-09-10T14:29:13.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.311+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.311+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcca70 con 0x55b6d1fb08d0 2024-09-10T14:29:13.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.315+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.315+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcca70 con 0x7fd9180dc040 2024-09-10T14:29:13.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.315+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.315+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcca70 con 0x7fd920061070 2024-09-10T14:29:13.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.319+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.319+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fce980 con 0x55b6d1fb52c0 2024-09-10T14:29:13.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.319+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.319+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fced40 con 0x7fd920061070 2024-09-10T14:29:13.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.323+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.323+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcebe0 con 0x7fd9180dc040 2024-09-10T14:29:13.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.323+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.323+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcebe0 con 0x7fd920061070 2024-09-10T14:29:13.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.323+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.323+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcebe0 con 0x7fd9180dc040 2024-09-10T14:29:13.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.327+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.327+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcebe0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.327+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.327+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcebe0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.331+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.331+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcebe0 con 0x7fd920061070 2024-09-10T14:29:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.331+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.331+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcebe0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.335+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.335+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.335+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.335+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.335+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'161 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.335+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.339+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.339+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x7fd920061070 2024-09-10T14:29:13.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.339+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.339+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.343+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.343+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.343+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.343+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.347+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.347+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.347+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'33 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.347+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcf1b0 con 0x7fd9180dc040 2024-09-10T14:29:13.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.351+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.351+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcc740 con 0x55b6d1fb52c0 2024-09-10T14:29:13.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.351+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.351+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcc740 con 0x7fd9180dc040 2024-09-10T14:29:13.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.355+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.355+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcc740 con 0x55b6d1fb52c0 2024-09-10T14:29:13.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.355+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.355+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcc740 con 0x7fd9180dc040 2024-09-10T14:29:13.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.359+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.359+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fcc740 con 0x7fd920061070 2024-09-10T14:29:13.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.363+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.363+0000 7fd7e27e4640 20 reqs_thread_entry: start 2024-09-10T14:29:13.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.363+0000 7fd92f8c3980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:13.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.363+0000 7fd92f8c3980 20 Filter name: none 2024-09-10T14:29:13.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.363+0000 7fd753fff640 20 reqs_thread_entry: start 2024-09-10T14:29:13.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.363+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-10T14:29:13.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.363+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(94 gc.3 [call] v36'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(95 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb08d0 2024-09-10T14:29:13.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(96 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:97 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(97 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:98 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(98 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:99 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(99 gc.3 [call] v36'163 uv163 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-10T14:29:13.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.367+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:100 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(100 gc.4 [call] v36'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:101 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(101 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:102 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd920061070 2024-09-10T14:29:13.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(102 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:103 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(103 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:104 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(104 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:105 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== osd_op_reply(105 gc.4 [call] v36'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-10T14:29:13.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.371+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:106 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(106 gc.5 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:107 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(107 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:108 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb52c0 2024-09-10T14:29:13.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(108 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(110 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== osd_op_reply(111 gc.5 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-10T14:29:13.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.375+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(112 gc.6 [call] v36'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(113 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(114 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:115 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 36 ==== osd_op_reply(115 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:116 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 37 ==== osd_op_reply(116 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.379+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:117 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.383+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 38 ==== osd_op_reply(117 gc.6 [call] v36'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.383+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-10T14:29:13.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.383+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:118 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.383+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(118 gc.7 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.383+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:119 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(119 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:120 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd9180dc040 2024-09-10T14:29:13.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(120 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:121 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(121 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:122 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(122 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.387+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:123 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.391+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(123 gc.7 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.391+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-10T14:29:13.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.391+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:124 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(124 gc.8 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:125 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== osd_op_reply(125 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:126 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd920061070 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(126 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:127 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(127 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:128 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== osd_op_reply(128 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:129 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== osd_op_reply(129 gc.8 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-10T14:29:13.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.395+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:130 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(130 gc.9 [call] v36'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:131 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== osd_op_reply(131 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:132 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb52c0 2024-09-10T14:29:13.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(132 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:133 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(133 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:134 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 37 ==== osd_op_reply(134 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:135 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 38 ==== osd_op_reply(135 gc.9 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-10T14:29:13.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.399+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:136 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 33 ==== osd_op_reply(136 gc.10 [call] v36'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:137 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 34 ==== osd_op_reply(137 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:138 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd920061070 2024-09-10T14:29:13.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 35 ==== osd_op_reply(138 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:139 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 36 ==== osd_op_reply(139 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:140 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 37 ==== osd_op_reply(140 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.403+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:141 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 38 ==== osd_op_reply(141 gc.10 [call] v36'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-10T14:29:13.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:142 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(142 gc.11 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:143 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(143 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:144 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd9180dc040 2024-09-10T14:29:13.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(144 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.407+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:145 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.411+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(145 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.411+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.411+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:146 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.411+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== osd_op_reply(146 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.411+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.411+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:147 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(147 gc.11 [call] v36'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-10T14:29:13.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:148 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 39 ==== osd_op_reply(148 gc.12 [call] v36'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:149 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 40 ==== osd_op_reply(149 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:150 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd920061070 2024-09-10T14:29:13.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 41 ==== osd_op_reply(150 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:151 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 42 ==== osd_op_reply(151 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:152 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 43 ==== osd_op_reply(152 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.415+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:153 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.419+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 44 ==== osd_op_reply(153 gc.12 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.419+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-10T14:29:13.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.419+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:154 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== osd_op_reply(154 gc.13 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:155 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== osd_op_reply(155 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:156 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd9180dc040 2024-09-10T14:29:13.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== osd_op_reply(156 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:157 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== osd_op_reply(157 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.423+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:158 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.427+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== osd_op_reply(158 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.427+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.427+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:159 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd9180dc040 2024-09-10T14:29:13.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(159 gc.13 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-10T14:29:13.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:160 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 39 ==== osd_op_reply(160 gc.14 [call] v36'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:161 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 40 ==== osd_op_reply(161 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:162 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb08d0 2024-09-10T14:29:13.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 41 ==== osd_op_reply(162 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:163 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 42 ==== osd_op_reply(163 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:164 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 43 ==== osd_op_reply(164 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.431+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:165 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.435+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 44 ==== osd_op_reply(165 gc.14 [call] v36'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.435+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-10T14:29:13.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.435+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:166 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.435+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 39 ==== osd_op_reply(166 gc.15 [call] v36'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.435+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:167 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.435+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 40 ==== osd_op_reply(167 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.435+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.435+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:168 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb52c0 2024-09-10T14:29:13.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 41 ==== osd_op_reply(168 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:169 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 42 ==== osd_op_reply(169 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:170 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 43 ==== osd_op_reply(170 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:171 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 44 ==== osd_op_reply(171 gc.15 [call] v36'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-10T14:29:13.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.439+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:172 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 45 ==== osd_op_reply(172 gc.16 [call] v36'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:173 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 46 ==== osd_op_reply(173 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:174 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd920061070 2024-09-10T14:29:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 47 ==== osd_op_reply(174 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:175 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 48 ==== osd_op_reply(175 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:176 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 49 ==== osd_op_reply(176 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:177 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.443+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 50 ==== osd_op_reply(177 gc.16 [call] v36'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-10T14:29:13.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:178 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 45 ==== osd_op_reply(178 gc.17 [call] v36'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:179 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 46 ==== osd_op_reply(179 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:180 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb52c0 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 47 ==== osd_op_reply(180 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:181 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 48 ==== osd_op_reply(181 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:182 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 49 ==== osd_op_reply(182 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.447+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:183 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 50 ==== osd_op_reply(183 gc.17 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-10T14:29:13.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 45 ==== osd_op_reply(184 gc.18 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 46 ==== osd_op_reply(185 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:186 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb08d0 2024-09-10T14:29:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.451+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 47 ==== osd_op_reply(186 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:187 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 48 ==== osd_op_reply(187 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:188 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 49 ==== osd_op_reply(188 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:189 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 50 ==== osd_op_reply(189 gc.18 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-10T14:29:13.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.455+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 51 ==== osd_op_reply(190 gc.19 [call] v36'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 52 ==== osd_op_reply(191 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:192 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb08d0 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 53 ==== osd_op_reply(192 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:193 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 54 ==== osd_op_reply(193 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:194 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 55 ==== osd_op_reply(194 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:195 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb08d0 2024-09-10T14:29:13.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 56 ==== osd_op_reply(195 gc.19 [call] v36'167 uv167 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-10T14:29:13.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.459+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:196 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 51 ==== osd_op_reply(196 gc.20 [call] v36'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:197 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 52 ==== osd_op_reply(197 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:198 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb52c0 2024-09-10T14:29:13.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 53 ==== osd_op_reply(198 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:199 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 54 ==== osd_op_reply(199 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:200 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 55 ==== osd_op_reply(200 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.463+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:201 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 56 ==== osd_op_reply(201 gc.20 [call] v36'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-10T14:29:13.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:202 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 51 ==== osd_op_reply(202 gc.21 [call] v36'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:203 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 52 ==== osd_op_reply(203 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:204 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x7fd920061070 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.467+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 53 ==== osd_op_reply(204 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:205 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 54 ==== osd_op_reply(205 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:206 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 55 ==== osd_op_reply(206 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:207 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x7fd920061070 2024-09-10T14:29:13.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 56 ==== osd_op_reply(207 gc.21 [call] v36'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-10T14:29:13.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:208 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 57 ==== osd_op_reply(208 gc.22 [call] v36'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.471+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:209 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 58 ==== osd_op_reply(209 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:210 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb52c0 2024-09-10T14:29:13.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 59 ==== osd_op_reply(210 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:211 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 60 ==== osd_op_reply(211 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:212 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 61 ==== osd_op_reply(212 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:213 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 62 ==== osd_op_reply(213 gc.22 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-10T14:29:13.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.475+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:214 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 63 ==== osd_op_reply(214 gc.23 [call] v36'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:215 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 64 ==== osd_op_reply(215 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:216 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea300 con 0x55b6d1fb52c0 2024-09-10T14:29:13.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 65 ==== osd_op_reply(216 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:217 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 66 ==== osd_op_reply(217 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:218 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb310 con 0x55b6d1fb52c0 2024-09-10T14:29:13.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 67 ==== osd_op_reply(218 gc.23 [call out=1702b] v0'0 uv27 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T14:29:13.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 20 garbage collection: RGWGC::process iterating over entry tag='83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.15311802062146496978', time=2024-09-10T14:29:12.872229+0000, chain.objs.size()=7 2024-09-10T14:29:13.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_1 2024-09-10T14:29:13.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:219 3.23s0 3:c4445599:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1feb7c0 con 0x7fd9180dc040 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_2 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:220 3.1ds0 3:b8ea0d17:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee330 con 0x55b6d1fb52c0 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_3 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:221 3.14s0 3:29fc9623:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1ff0ba0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_4 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:222 3.23s0 3:c650516f:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1ff34d0 con 0x7fd9180dc040 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_5 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:223 3.29s0 3:954eb0a1:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1ff5d40 con 0x7fd9180dc040 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_6 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:224 3.as0 3:513950c0:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1ff85b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_7 2024-09-10T14:29:13.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.479+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:225 3.24s0 3:25ca1ece:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1ff5d40 con 0x7fd9180dc040 2024-09-10T14:29:13.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.483+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 68 ==== osd_op_reply(220 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_2 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.483+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(223 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_5 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.483+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 69 ==== osd_op_reply(224 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_6 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.483+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 70 ==== osd_op_reply(221 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_3 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.487+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 41 ==== osd_op_reply(219 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_1 [call] v36'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.487+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 42 ==== osd_op_reply(225 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_7 [call] v36'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.491+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 43 ==== osd_op_reply(222 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.1__shadow_.gXR1-FvuE9PP7v51QzjDFBHqgsCupFh_4 [call] v36'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.491+0000 7fd92f8c3980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T14:29:13.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.491+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:226 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1ff85b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.495+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 71 ==== osd_op_reply(226 gc.23 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.495+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:227 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.495+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 72 ==== osd_op_reply(227 gc.23 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.495+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-10T14:29:13.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.495+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:228 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 73 ==== osd_op_reply(228 gc.24 [call] v36'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:229 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 74 ==== osd_op_reply(229 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:230 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea7b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 75 ==== osd_op_reply(230 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:231 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 76 ==== osd_op_reply(231 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:232 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 77 ==== osd_op_reply(232 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:233 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 78 ==== osd_op_reply(233 gc.24 [call] v36'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-10T14:29:13.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.499+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:234 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 79 ==== osd_op_reply(234 gc.25 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:235 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 80 ==== osd_op_reply(235 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:236 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 81 ==== osd_op_reply(236 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:237 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 82 ==== osd_op_reply(237 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:238 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 83 ==== osd_op_reply(238 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:239 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 84 ==== osd_op_reply(239 gc.25 [call] v36'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-10T14:29:13.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.503+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:240 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 44 ==== osd_op_reply(240 gc.26 [call] v36'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:241 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 45 ==== osd_op_reply(241 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:242 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 46 ==== osd_op_reply(242 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:243 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 47 ==== osd_op_reply(243 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.507+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:244 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.511+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 48 ==== osd_op_reply(244 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.511+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.511+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:245 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.511+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 49 ==== osd_op_reply(245 gc.26 [call] v36'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.511+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-10T14:29:13.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.511+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:246 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 85 ==== osd_op_reply(246 gc.27 [call] v36'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:247 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 86 ==== osd_op_reply(247 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:248 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 87 ==== osd_op_reply(248 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:249 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 88 ==== osd_op_reply(249 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:250 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 89 ==== osd_op_reply(250 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.515+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:251 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 90 ==== osd_op_reply(251 gc.27 [call] v36'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-10T14:29:13.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:252 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 50 ==== osd_op_reply(252 gc.28 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:253 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 51 ==== osd_op_reply(253 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:254 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 52 ==== osd_op_reply(254 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.519+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:255 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 53 ==== osd_op_reply(255 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:256 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 54 ==== osd_op_reply(256 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:257 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 55 ==== osd_op_reply(257 gc.28 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-10T14:29:13.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.523+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:258 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.527+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 91 ==== osd_op_reply(258 gc.29 [call] v36'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.527+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:259 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.527+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 92 ==== osd_op_reply(259 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.527+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.527+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:260 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fea7b0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.527+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 93 ==== osd_op_reply(260 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.527+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:261 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.531+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 94 ==== osd_op_reply(261 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.531+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.531+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:262 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.531+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 95 ==== osd_op_reply(262 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.531+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.531+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:263 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.531+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 96 ==== osd_op_reply(263 gc.29 [call] v36'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.535+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-10T14:29:13.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.535+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:264 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.535+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 56 ==== osd_op_reply(264 gc.30 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.535+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:265 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.535+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 57 ==== osd_op_reply(265 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:266 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 58 ==== osd_op_reply(266 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:267 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 59 ==== osd_op_reply(267 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:268 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 60 ==== osd_op_reply(268 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.539+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:269 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.543+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 61 ==== osd_op_reply(269 gc.30 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.543+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-10T14:29:13.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.543+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:270 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd920061070 2024-09-10T14:29:13.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 57 ==== osd_op_reply(270 gc.31 [call] v36'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:271 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd920061070 2024-09-10T14:29:13.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 58 ==== osd_op_reply(271 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:272 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd920061070 2024-09-10T14:29:13.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 59 ==== osd_op_reply(272 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:273 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd920061070 2024-09-10T14:29:13.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 60 ==== osd_op_reply(273 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:274 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd920061070 2024-09-10T14:29:13.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 61 ==== osd_op_reply(274 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.547+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:275 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd920061070 2024-09-10T14:29:13.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.551+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 62 ==== osd_op_reply(275 gc.31 [call] v36'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.551+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-10T14:29:13.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.551+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:276 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 57 ==== osd_op_reply(276 gc.0 [call] v36'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:277 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 58 ==== osd_op_reply(277 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:278 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 59 ==== osd_op_reply(278 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:279 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 60 ==== osd_op_reply(279 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:280 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 61 ==== osd_op_reply(280 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.555+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:281 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.559+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 62 ==== osd_op_reply(281 gc.0 [call] v36'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.559+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-10T14:29:13.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.559+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:282 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 62 ==== osd_op_reply(282 gc.1 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:283 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 63 ==== osd_op_reply(283 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:284 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 64 ==== osd_op_reply(284 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:285 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 65 ==== osd_op_reply(285 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.563+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:286 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.567+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 66 ==== osd_op_reply(286 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.567+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.567+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:287 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x7fd9180dc040 2024-09-10T14:29:13.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.571+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 67 ==== osd_op_reply(287 gc.1 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.571+0000 7fd92f8c3980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-10T14:29:13.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.571+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:288 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.571+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 97 ==== osd_op_reply(288 gc.2 [call] v36'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.571+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:289 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.571+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 98 ==== osd_op_reply(289 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.571+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.571+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:290 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.575+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 99 ==== osd_op_reply(290 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.575+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:291 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.575+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 100 ==== osd_op_reply(291 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.575+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:29:13.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.575+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:292 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.575+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 101 ==== osd_op_reply(292 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.575+0000 7fd92f8c3980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:29:13.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.575+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:293 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fee6d0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.579+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 102 ==== osd_op_reply(293 gc.2 [call] v36'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.579+0000 7fd7e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:13.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.579+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94243695359296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fca880 con 0x55b6d1fb08d0 2024-09-10T14:29:13.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.579+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 63 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94243695359296] v36'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.579+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94243695340448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbf540 con 0x7fd920061070 2024-09-10T14:29:13.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.583+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94243695340448] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.583+0000 7fd92f8c3980 20 remove_watcher() i=0 2024-09-10T14:29:13.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.583+0000 7fd92f8c3980 2 removed watcher, disabling cache 2024-09-10T14:29:13.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.583+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94243695346224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbaba0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.583+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 64 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94243695346224] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.583+0000 7fd92f8c3980 20 remove_watcher() i=1 2024-09-10T14:29:13.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.583+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94243695349776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbaba0 con 0x55b6d1fb52c0 2024-09-10T14:29:13.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.587+0000 7fd92d3d3640 1 -- 172.21.15.151:0/2067961206 <== osd.3 v2:172.21.15.151:6803/3136276598 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94243695349776] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92005e030 con 0x55b6d1fb52c0 2024-09-10T14:29:13.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.587+0000 7fd92f8c3980 20 remove_watcher() i=2 2024-09-10T14:29:13.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.587+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94243695347280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbd010 con 0x7fd920061070 2024-09-10T14:29:13.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.591+0000 7fd927fff640 1 -- 172.21.15.151:0/2067961206 <== osd.2 v2:172.21.15.151:6816/2885613778 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94243695347280] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9180c9030 con 0x7fd920061070 2024-09-10T14:29:13.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.591+0000 7fd92f8c3980 20 remove_watcher() i=3 2024-09-10T14:29:13.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.591+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94243695351904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbd010 con 0x55b6d1fb08d0 2024-09-10T14:29:13.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.591+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.1 v2:172.21.15.151:6800/103268966 65 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94243695351904] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x55b6d1fb08d0 2024-09-10T14:29:13.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.591+0000 7fd92f8c3980 20 remove_watcher() i=4 2024-09-10T14:29:13.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.591+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94243695358240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbd860 con 0x7fd9180dc040 2024-09-10T14:29:13.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.595+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94243695358240] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.595+0000 7fd92f8c3980 20 remove_watcher() i=5 2024-09-10T14:29:13.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.595+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94243695362112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbd010 con 0x7fd9180dc040 2024-09-10T14:29:13.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94243695362112] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 20 remove_watcher() i=6 2024-09-10T14:29:13.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94243695364672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55b6d1fbd010 con 0x7fd9180dc040 2024-09-10T14:29:13.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 <== osd.0 v2:172.21.15.52:6800/2968015226 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94243695364672] v36'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92800a4d0 con 0x7fd9180dc040 2024-09-10T14:29:13.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 20 remove_watcher() i=7 2024-09-10T14:29:13.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd9180dc040 msgr2=0x7fd9180dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd9180dc040 0x7fd9180dd430 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1fb08d0 msgr2=0x55b6d1fb2d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1fb08d0 0x55b6d1fb2d90 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd920061070 msgr2=0x7fd920079850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd920061070 0x7fd920079850 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1fb52c0 msgr2=0x55b6d1fb76b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1fb52c0 0x55b6d1fb76b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7f80346a0 msgr2=0x7fd7f8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7f80346a0 0x7fd7f8036b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd9180ae040 tx=0x7fd9180a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 msgr2=0x55b6d1fa5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92dbd4640 1 -- 172.21.15.151:0/2067961206 reap_dead start 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1fa5850 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd920050040 tx=0x7fd9200421b0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 shutdown_connections 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/2067961206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f9e670 0x55b6d1fa5850 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 >> 172.21.15.151:0/2067961206 conn(0x55b6d1f9aa50 msgr2=0x55b6d1f98b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 shutdown_connections 2024-09-10T14:29:13.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.599+0000 7fd92f8c3980 1 -- 172.21.15.151:0/2067961206 wait complete. 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/1447149956 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd808034650 msgr2=0x7fd808036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/1447149956 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd808034650 0x7fd808036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd91800a480 tx=0x7fd918005a10 comp rx=0 tx=0).stop 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/1447149956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f91e90 msgr2=0x55b6d1f922b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/1447149956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f91e90 0x55b6d1f922b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b2d0 tx=0x7fd92000db30 comp rx=0 tx=0).stop 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/1447149956 shutdown_connections 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/1447149956 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd808034650 0x7fd808036b10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/1447149956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1f91e90 0x55b6d1f922b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/1447149956 >> 172.21.15.151:0/1447149956 conn(0x55b6d1f86fe0 msgr2=0x55b6d1f89a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/1447149956 shutdown_connections 2024-09-10T14:29:13.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/1447149956 wait complete. 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b6d1f81880 msgr2=0x55b6d1f83c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55b6d1f81880 0x55b6d1f83c70 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1e85e80 msgr2=0x55b6d1f7b010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55b6d1e85e80 0x55b6d1f7b010 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1f7d980 msgr2=0x55b6d1f7fd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55b6d1f7d980 0x55b6d1f7fd70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd814034650 msgr2=0x7fd814036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd814034650 0x7fd814036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9180ad000 tx=0x7fd9180a5040 comp rx=0 tx=0).stop 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 msgr2=0x55b6d1f74020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 --2- 172.21.15.151:0/575127949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b6d1df3ab0 0x55b6d1f74020 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd920001e20 tx=0x7fd920000ee0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92dbd4640 1 -- 172.21.15.151:0/575127949 reap_dead start 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 shutdown_connections 2024-09-10T14:29:13.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 >> 172.21.15.151:0/575127949 conn(0x55b6d1e7a050 msgr2=0x55b6d1f67460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 shutdown_connections 2024-09-10T14:29:13.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.603+0000 7fd92f8c3980 1 -- 172.21.15.151:0/575127949 wait complete. 2024-09-10T14:29:13.620 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T14:29:13.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T14:29:13.620 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T14:29:13.698 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:13.698 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:13.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f8901919980 1 Processor -- start 2024-09-10T14:29:13.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f8901919980 1 -- start start 2024-09-10T14:29:13.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f8901919980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5599662f7b00 0x559966386330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f8901919980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55996620bae0 con 0x559966386870 2024-09-10T14:29:13.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f8901919980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55996622fe30 con 0x5599662f7b00 2024-09-10T14:29:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f88ff429640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5599662f7b00 0x559966386330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f88ff429640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5599662f7b00 0x559966386330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39070/0 (socket says 172.21.15.151:39070) 2024-09-10T14:29:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f88fec28640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x559966386870 0x559966388c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51310/0 (socket says 172.21.15.151:51310) 2024-09-10T14:29:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f88ff429640 1 -- 172.21.15.151:0/1533785209 learned_addr learned my addr 172.21.15.151:0/1533785209 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f88ff429640 1 -- 172.21.15.151:0/1533785209 >> v1:172.21.15.52:6789/0 conn(0x559966386870 legacy=0x559966388c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.695+0000 7f88ff429640 1 -- 172.21.15.151:0/1533785209 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996638b390 con 0x5599662f7b00 2024-09-10T14:29:13.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f88ff429640 1 --2- 172.21.15.151:0/1533785209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x559966386330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f88f800a4e0 tx=0x7f88f801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9664e27d1948f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f88fe427640 1 -- 172.21.15.151:0/1533785209 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80aa540 con 0x5599662f7b00 2024-09-10T14:29:13.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f88fe427640 1 -- 172.21.15.151:0/1533785209 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f80aa6e0 con 0x5599662f7b00 2024-09-10T14:29:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f88fe427640 1 -- 172.21.15.151:0/1533785209 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80aaa40 con 0x5599662f7b00 2024-09-10T14:29:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f8901919980 1 -- 172.21.15.151:0/1533785209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 msgr2=0x559966386330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f8901919980 1 --2- 172.21.15.151:0/1533785209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x559966386330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f88f800a4e0 tx=0x7f88f801b090 comp rx=0 tx=0).stop 2024-09-10T14:29:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f8901919980 1 -- 172.21.15.151:0/1533785209 shutdown_connections 2024-09-10T14:29:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f8901919980 1 --2- 172.21.15.151:0/1533785209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x559966386330 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f8901919980 1 -- 172.21.15.151:0/1533785209 >> 172.21.15.151:0/1533785209 conn(0x55996637e060 msgr2=0x559966380480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f8901919980 1 -- 172.21.15.151:0/1533785209 shutdown_connections 2024-09-10T14:29:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.699+0000 7f8901919980 1 -- 172.21.15.151:0/1533785209 wait complete. 2024-09-10T14:29:13.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.715+0000 7f8901919980 1 Processor -- start 2024-09-10T14:29:13.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.715+0000 7f8901919980 1 -- start start 2024-09-10T14:29:13.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.715+0000 7f8901919980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x55996646ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.715+0000 7f8901919980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559966231200 con 0x5599662f7b00 2024-09-10T14:29:13.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x55996646ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x55996646ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39080/0 (socket says 172.21.15.151:39080) 2024-09-10T14:29:13.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 -- 172.21.15.151:0/1005812964 learned_addr learned my addr 172.21.15.151:0/1005812964 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 -- 172.21.15.151:0/1005812964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996646f020 con 0x5599662f7b00 2024-09-10T14:29:13.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 --2- 172.21.15.151:0/1005812964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x55996646ea50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f88f8017ca0 tx=0x7f88f80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa845f970749c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f87ed60a640 1 -- 172.21.15.151:0/1005812964 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80b9070 con 0x5599662f7b00 2024-09-10T14:29:13.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f87ed60a640 1 -- 172.21.15.151:0/1005812964 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f80aaa80 con 0x5599662f7b00 2024-09-10T14:29:13.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f87ed60a640 1 -- 172.21.15.151:0/1005812964 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80aad60 con 0x5599662f7b00 2024-09-10T14:29:13.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 -- 172.21.15.151:0/1005812964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 msgr2=0x55996646ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 --2- 172.21.15.151:0/1005812964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x55996646ea50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f88f8017ca0 tx=0x7f88f80033b0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 -- 172.21.15.151:0/1005812964 shutdown_connections 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 --2- 172.21.15.151:0/1005812964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x55996646ea50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 -- 172.21.15.151:0/1005812964 >> 172.21.15.151:0/1005812964 conn(0x55996637e060 msgr2=0x55996646a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 -- 172.21.15.151:0/1005812964 shutdown_connections 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 -- 172.21.15.151:0/1005812964 wait complete. 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 Processor -- start 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 -- start start 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x559966475d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f8901919980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55996638ae30 con 0x5599662f7b00 2024-09-10T14:29:13.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x559966475d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x559966475d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39090/0 (socket says 172.21.15.151:39090) 2024-09-10T14:29:13.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 -- 172.21.15.151:0/376041869 learned_addr learned my addr 172.21.15.151:0/376041869 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.719+0000 7f88ff429640 1 -- 172.21.15.151:0/376041869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559966476240 con 0x5599662f7b00 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f88ff429640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x559966475d00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f88f8018cc0 tx=0x7f88f8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f87ebe07640 1 -- 172.21.15.151:0/376041869 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80cc070 con 0x5599662f7b00 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599664764d0 con 0x5599662f7b00 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f87ebe07640 1 -- 172.21.15.151:0/376041869 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f80c7410 con 0x5599662f7b00 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599664791b0 con 0x5599662f7b00 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f87ebe07640 1 -- 172.21.15.151:0/376041869 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80b9070 con 0x5599662f7b00 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f87ebe07640 1 -- 172.21.15.151:0/376041869 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f88f80b3040 con 0x5599662f7b00 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f87ebe07640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87e40346a0 0x7f87e4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f87ebe07640 1 -- 172.21.15.151:0/376041869 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f88f80c4070 con 0x5599662f7b00 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f88fec28640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87e40346a0 0x7f87e4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f8901919980 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559966386870 0x55996647ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55996647d340 con 0x559966386870 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f88ffc2a640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559966386870 0x55996647ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f88fec28640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87e40346a0 0x7f87e4036b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88e8001e50 tx=0x7f88e80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f88ffc2a640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559966386870 0x55996647ce00 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f88ffc2a640 1 -- 172.21.15.151:0/376041869 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x559966386870 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55996647a3d0 con 0x559966386870 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f88ffc2a640 1 -- 172.21.15.151:0/376041869 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88f00083f0 con 0x559966386870 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f8901919980 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55996647f600 0x5599664819f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664820c0 con 0x55996647f600 2024-09-10T14:29:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.723+0000 7f88ff429640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55996647f600 0x5599664819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88ff429640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55996647f600 0x5599664819f0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88ff429640 1 -- 172.21.15.151:0/376041869 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f88f80bd400 con 0x55996647f600 2024-09-10T14:29:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55996647e4a0 con 0x559966386870 2024-09-10T14:29:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88ffc2a640 1 -- 172.21.15.151:0/376041869 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88f00083f0 con 0x559966386870 2024-09-10T14:29:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f8901919980 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559966483500 0x5599664858f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559966486080 con 0x559966483500 2024-09-10T14:29:13.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88fec28640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559966483500 0x5599664858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88fec28640 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559966483500 0x5599664858f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88fec28640 1 -- 172.21.15.151:0/376041869 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f88e800f700 con 0x559966483500 2024-09-10T14:29:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f8901919980 1 Processor -- start 2024-09-10T14:29:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f8901919980 1 -- start start 2024-09-10T14:29:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f8901919980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966493b10 0x559966493f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f8901919980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55996628a800 con 0x559966493b10 2024-09-10T14:29:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966493b10 0x559966493f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966493b10 0x559966493f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39092/0 (socket says 172.21.15.151:39092) 2024-09-10T14:29:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.727+0000 7f88ff429640 1 -- 172.21.15.151:0/13084547 learned_addr learned my addr 172.21.15.151:0/13084547 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f88ff429640 1 -- 172.21.15.151:0/13084547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559966494470 con 0x559966493b10 2024-09-10T14:29:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f88ff429640 1 --2- 172.21.15.151:0/13084547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966493b10 0x559966493f30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f88f80a4050 tx=0x7f88f80a9c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f87e9602640 1 -- 172.21.15.151:0/13084547 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80a95d0 con 0x559966493b10 2024-09-10T14:29:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f87e9602640 1 -- 172.21.15.151:0/13084547 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f80a9770 con 0x559966493b10 2024-09-10T14:29:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f8901919980 1 -- 172.21.15.151:0/13084547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559966494700 con 0x559966493b10 2024-09-10T14:29:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f87e9602640 1 -- 172.21.15.151:0/13084547 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80ce440 con 0x559966493b10 2024-09-10T14:29:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f8901919980 1 -- 172.21.15.151:0/13084547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559966497380 con 0x559966493b10 2024-09-10T14:29:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f87e9602640 1 -- 172.21.15.151:0/13084547 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f88f80ce5e0 con 0x559966493b10 2024-09-10T14:29:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f87e9602640 1 --2- 172.21.15.151:0/13084547 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87d8034650 0x7f87d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f87e9602640 1 -- 172.21.15.151:0/13084547 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f88f80f2ac0 con 0x559966493b10 2024-09-10T14:29:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f88fec28640 1 --2- 172.21.15.151:0/13084547 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87d8034650 0x7f87d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f8901919980 1 Processor -- start 2024-09-10T14:29:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f8901919980 1 -- start start 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f8901919980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x559966383960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f8901919980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55996646f2e0 con 0x559966383580 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f88fec28640 1 --2- 172.21.15.151:0/13084547 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87d8034650 0x7f87d8036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x559966486480 tx=0x7f88e800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x559966383960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x559966383960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39108/0 (socket says 172.21.15.151:39108) 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.731+0000 7f88ff429640 1 -- 172.21.15.151:0/1280127323 learned_addr learned my addr 172.21.15.151:0/1280127323 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f88ff429640 1 -- 172.21.15.151:0/1280127323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559966383f30 con 0x559966383580 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f88ff429640 1 --2- 172.21.15.151:0/1280127323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x559966383960 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f88f80eded0 tx=0x7f88f80edd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbc96064d4b72d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f87e2ffd640 1 -- 172.21.15.151:0/1280127323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80ff020 con 0x559966383580 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f87e2ffd640 1 -- 172.21.15.151:0/1280127323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f80b46e0 con 0x559966383580 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f87e2ffd640 1 -- 172.21.15.151:0/1280127323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80daaf0 con 0x559966383580 2024-09-10T14:29:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- 172.21.15.151:0/1280127323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 msgr2=0x559966383960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 --2- 172.21.15.151:0/1280127323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x559966383960 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f88f80eded0 tx=0x7f88f80edd50 comp rx=0 tx=0).stop 2024-09-10T14:29:13.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- 172.21.15.151:0/1280127323 shutdown_connections 2024-09-10T14:29:13.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 --2- 172.21.15.151:0/1280127323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x559966383960 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- 172.21.15.151:0/1280127323 >> 172.21.15.151:0/1280127323 conn(0x55996649c7c0 msgr2=0x55996649a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- 172.21.15.151:0/1280127323 shutdown_connections 2024-09-10T14:29:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- 172.21.15.151:0/1280127323 wait complete. 2024-09-10T14:29:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 Processor -- start 2024-09-10T14:29:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- start start 2024-09-10T14:29:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x5599664a9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559966382110 con 0x559966383580 2024-09-10T14:29:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x5599664a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f88ff429640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x5599664a9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39124/0 (socket says 172.21.15.151:39124) 2024-09-10T14:29:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 learned_addr learned my addr 172.21.15.151:0/3319220455 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599664a9cd0 con 0x559966383580 2024-09-10T14:29:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f88ff429640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x5599664a9790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f88f80edd90 tx=0x7f88f8007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f87e17fa640 1 -- 172.21.15.151:0/3319220455 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f8114070 con 0x559966383580 2024-09-10T14:29:13.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599664a9cd0 con 0x559966383580 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f87e17fa640 1 -- 172.21.15.151:0/3319220455 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f80ce990 con 0x559966383580 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f87e17fa640 1 -- 172.21.15.151:0/3319220455 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f80c2130 con 0x559966383580 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.735+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599664aa140 con 0x559966383580 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f87e17fa640 1 -- 172.21.15.151:0/3319220455 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f88f8117070 con 0x559966383580 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f87e17fa640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87c8034650 0x7f87c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f87e17fa640 1 -- 172.21.15.151:0/3319220455 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f88f810b030 con 0x559966383580 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88fec28640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87c8034650 0x7f87c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599664b48a0 0x5599664b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664b74b0 con 0x5599664b48a0 2024-09-10T14:29:13.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88ffc2a640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599664b48a0 0x5599664b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88fec28640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87c8034650 0x7f87c8036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f88e800baa0 tx=0x7f88e8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88ffc2a640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599664b48a0 0x5599664b6d60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 realm 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664b78c0 con 0x5599664b48a0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:13.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8160 con 0x5599664b48a0 2024-09-10T14:29:13.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599664b9260 0x5599664bb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664bbbd0 con 0x5599664b9260 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88ff429640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599664b9260 0x5599664bb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.739+0000 7f88ff429640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599664b9260 0x5599664bb650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f8901919980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:13.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f8901919980 20 searching for the correct realm 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664bd470 con 0x5599664b9260 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ff429640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f88f8119060 0x7f88f80f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664bd470 con 0x7f88f8119060 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88fec28640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f88f8119060 0x7f88f80f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88fec28640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f88f8119060 0x7f88f80f2290 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88fec28640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f88e803a3c0 0x7f88e803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664bd470 con 0x7f88e803a3c0 2024-09-10T14:29:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ffc2a640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f88e803a3c0 0x7f88e803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ffc2a640 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f88e803a3c0 0x7f88e803a800 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.743+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88e803a3c0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88e803a3c0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88f8119060 2024-09-10T14:29:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b9260 2024-09-10T14:29:13.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88e803a3c0 2024-09-10T14:29:13.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.747+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88f8119060 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b9260 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b9260 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88f8119060 2024-09-10T14:29:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b9260 2024-09-10T14:29:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b9260 2024-09-10T14:29:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88e803a3c0 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b9260 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88f8119060 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.751+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88f8119060 2024-09-10T14:29:13.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b9260 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88e803a3c0 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88f8119060 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b9260 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88e803a3c0 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x5599664b48a0 2024-09-10T14:29:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5599664b8500 con 0x7f88f8119060 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f8901919980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f8901919980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f8901919980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f8901919980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f8901919980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f8901919980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.755+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664bc420 con 0x5599664b48a0 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664bc810 con 0x5599664b48a0 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664bc810 con 0x7f88e803a3c0 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 zone default found 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 4 Realm: () 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 zonegroup default 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664bcc30 con 0x7f88f8119060 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664bf320 con 0x5599664b9260 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados->read ofs=0 len=0 2024-09-10T14:29:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664bf6c0 con 0x5599664b9260 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 started sync module instance, tier type = 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664be7c0 con 0x7f88f8119060 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117334608816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664be420 con 0x7f88f8119060 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.759+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c0530 con 0x5599664b48a0 2024-09-10T14:29:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.763+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94117334608816] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.763+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.763+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117334614144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c04a0 con 0x5599664b48a0 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.763+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c12c0 con 0x5599664b9260 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94117334614144] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117334616352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c16b0 con 0x5599664b9260 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c2070 con 0x7f88f8119060 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117334621120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c2910 con 0x7f88f8119060 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c3310 con 0x5599664b48a0 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94117334616352] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94117334621120] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117334623328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c2e20 con 0x5599664b48a0 2024-09-10T14:29:13.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.767+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c3bb0 con 0x7f88e803a3c0 2024-09-10T14:29:13.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.771+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94117334623328] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.771+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.771+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117334617408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c3b10 con 0x7f88e803a3c0 2024-09-10T14:29:13.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.771+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c44d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94117334617408] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117334627936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c46b0 con 0x7f88e803a3c0 2024-09-10T14:29:13.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c4f00 con 0x7f88e803a3c0 2024-09-10T14:29:13.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94117334627936] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117334631184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c4d20 con 0x7f88e803a3c0 2024-09-10T14:29:13.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 20 add_watcher() i=0 2024-09-10T14:29:13.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 20 add_watcher() i=1 2024-09-10T14:29:13.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 20 add_watcher() i=2 2024-09-10T14:29:13.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 20 add_watcher() i=3 2024-09-10T14:29:13.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 20 add_watcher() i=4 2024-09-10T14:29:13.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 20 add_watcher() i=5 2024-09-10T14:29:13.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.775+0000 7f8901919980 20 add_watcher() i=6 2024-09-10T14:29:13.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94117334631184] v36'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f8901919980 20 add_watcher() i=7 2024-09-10T14:29:13.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f8901919980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:13.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664c8260 con 0x5599664b48a0 2024-09-10T14:29:13.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117334632368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c5720 con 0x5599664b48a0 2024-09-10T14:29:13.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94117334632368] v36'169 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f87b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:13.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f8901919980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:13.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f8901919980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:13.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.779+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d0940 con 0x5599664b48a0 2024-09-10T14:29:13.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.783+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.783+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d0eb0 con 0x7f88e803a3c0 2024-09-10T14:29:13.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.787+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.787+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d1420 con 0x5599664b9260 2024-09-10T14:29:13.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.787+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.787+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d14b0 con 0x5599664b48a0 2024-09-10T14:29:13.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.787+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'170 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.787+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d1960 con 0x7f88f8119060 2024-09-10T14:29:13.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.791+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.791+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664ce990 con 0x5599664b9260 2024-09-10T14:29:13.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.791+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'38 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.791+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664ce990 con 0x5599664b48a0 2024-09-10T14:29:13.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.791+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.791+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664ce990 con 0x7f88e803a3c0 2024-09-10T14:29:13.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.795+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.795+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664ce990 con 0x7f88f8119060 2024-09-10T14:29:13.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.799+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.799+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2510 con 0x5599664b9260 2024-09-10T14:29:13.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.799+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.799+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2510 con 0x7f88f8119060 2024-09-10T14:29:13.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.799+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.799+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x7f88e803a3c0 2024-09-10T14:29:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.803+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.803+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x7f88f8119060 2024-09-10T14:29:13.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.803+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.803+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x7f88e803a3c0 2024-09-10T14:29:13.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.807+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.807+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x5599664b48a0 2024-09-10T14:29:13.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.807+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'171 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.807+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x5599664b9260 2024-09-10T14:29:13.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.811+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.811+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x7f88f8119060 2024-09-10T14:29:13.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.811+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.811+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x5599664b9260 2024-09-10T14:29:13.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.815+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.815+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x5599664b48a0 2024-09-10T14:29:13.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.815+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.815+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x5599664b48a0 2024-09-10T14:29:13.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.815+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'172 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.815+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2b90 con 0x5599664b9260 2024-09-10T14:29:13.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.819+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.819+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2b90 con 0x7f88f8119060 2024-09-10T14:29:13.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.819+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.819+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2b90 con 0x5599664b9260 2024-09-10T14:29:13.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.823+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.823+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2b90 con 0x5599664b9260 2024-09-10T14:29:13.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.823+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.823+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2b90 con 0x5599664b9260 2024-09-10T14:29:13.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.823+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.823+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2b90 con 0x5599664b9260 2024-09-10T14:29:13.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.827+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.827+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2b90 con 0x7f88e803a3c0 2024-09-10T14:29:13.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.827+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.827+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d2b90 con 0x5599664b9260 2024-09-10T14:29:13.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.831+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.831+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x7f88e803a3c0 2024-09-10T14:29:13.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.831+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.835+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x5599664b9260 2024-09-10T14:29:13.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.835+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.835+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x7f88e803a3c0 2024-09-10T14:29:13.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.839+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.839+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664d29c0 con 0x7f88f8119060 2024-09-10T14:29:13.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.839+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f87b4fe1640 20 reqs_thread_entry: start 2024-09-10T14:29:13.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f8901919980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:13.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f8901919980 20 Filter name: none 2024-09-10T14:29:13.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f872e7fc640 20 reqs_thread_entry: start 2024-09-10T14:29:13.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664ee770 con 0x5599664b48a0 2024-09-10T14:29:13.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cc2c0 con 0x5599664b48a0 2024-09-10T14:29:13.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde90 con 0x5599664b48a0 2024-09-10T14:29:13.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde70 con 0x7f88e803a3c0 2024-09-10T14:29:13.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.843+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde70 con 0x7f88e803a3c0 2024-09-10T14:29:13.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde70 con 0x7f88e803a3c0 2024-09-10T14:29:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b48a0 2024-09-10T14:29:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b48a0 2024-09-10T14:29:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664ee770 con 0x5599664b48a0 2024-09-10T14:29:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664ee770 con 0x7f88f8119060 2024-09-10T14:29:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.847+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664ee770 con 0x7f88f8119060 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664ee770 con 0x5599664b9260 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b9260 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664ee770 con 0x5599664b9260 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664ee770 con 0x5599664b48a0 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b48a0 2024-09-10T14:29:13.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b48a0 2024-09-10T14:29:13.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.851+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b9260 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.855+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b9260 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b9260 2024-09-10T14:29:13.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.859+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88f8119060 2024-09-10T14:29:13.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.863+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x7f88e803a3c0 2024-09-10T14:29:13.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b48a0 2024-09-10T14:29:13.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b48a0 2024-09-10T14:29:13.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd6f0 con 0x5599664b48a0 2024-09-10T14:29:13.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde70 con 0x5599664b9260 2024-09-10T14:29:13.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x7f88f8119060 2024-09-10T14:29:13.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cbe10 con 0x7f88f8119060 2024-09-10T14:29:13.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.867+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x7f88f8119060 2024-09-10T14:29:13.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b48a0 2024-09-10T14:29:13.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cbe10 con 0x5599664b48a0 2024-09-10T14:29:13.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b48a0 2024-09-10T14:29:13.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b48a0 2024-09-10T14:29:13.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cbe10 con 0x5599664b48a0 2024-09-10T14:29:13.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv167 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b48a0 2024-09-10T14:29:13.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.871+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88f8119060 2024-09-10T14:29:13.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x7f88f8119060 2024-09-10T14:29:13.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88f8119060 2024-09-10T14:29:13.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.875+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.879+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88e803a3c0 2024-09-10T14:29:13.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x7f88e803a3c0 2024-09-10T14:29:13.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88e803a3c0 2024-09-10T14:29:13.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.883+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88e803a3c0 2024-09-10T14:29:13.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x7f88e803a3c0 2024-09-10T14:29:13.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88e803a3c0 2024-09-10T14:29:13.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.887+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x5599664b9260 2024-09-10T14:29:13.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x5599664b9260 2024-09-10T14:29:13.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88e803a3c0 2024-09-10T14:29:13.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x7f88e803a3c0 2024-09-10T14:29:13.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88e803a3c0 2024-09-10T14:29:13.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.891+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.895+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88f8119060 2024-09-10T14:29:13.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.895+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.895+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cce20 con 0x7f88f8119060 2024-09-10T14:29:13.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.895+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.895+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5599664cde30 con 0x7f88f8119060 2024-09-10T14:29:13.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.895+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.895+0000 7f87b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:13.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.895+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117334632368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664cd2d0 con 0x5599664b48a0 2024-09-10T14:29:13.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.899+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94117334632368] v36'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.899+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117334608816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c4770 con 0x7f88f8119060 2024-09-10T14:29:13.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.899+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94117334608816] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.899+0000 7f8901919980 20 remove_watcher() i=0 2024-09-10T14:29:13.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.899+0000 7f8901919980 2 removed watcher, disabling cache 2024-09-10T14:29:13.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.899+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117334614144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664bebb0 con 0x5599664b48a0 2024-09-10T14:29:13.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.903+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94117334614144] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.903+0000 7f8901919980 20 remove_watcher() i=1 2024-09-10T14:29:13.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.903+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117334616352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664bebb0 con 0x5599664b9260 2024-09-10T14:29:13.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.907+0000 7f88ff429640 1 -- 172.21.15.151:0/3319220455 <== osd.3 v2:172.21.15.151:6803/3136276598 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94117334616352] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f8116030 con 0x5599664b9260 2024-09-10T14:29:13.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.907+0000 7f8901919980 20 remove_watcher() i=2 2024-09-10T14:29:13.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.907+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117334621120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c0920 con 0x7f88f8119060 2024-09-10T14:29:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.907+0000 7f88fec28640 1 -- 172.21.15.151:0/3319220455 <== osd.2 v2:172.21.15.151:6816/2885613778 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94117334621120] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88e8037040 con 0x7f88f8119060 2024-09-10T14:29:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.907+0000 7f8901919980 20 remove_watcher() i=3 2024-09-10T14:29:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.907+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117334623328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664bebb0 con 0x5599664b48a0 2024-09-10T14:29:13.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.911+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.1 v2:172.21.15.151:6800/103268966 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94117334623328] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x5599664b48a0 2024-09-10T14:29:13.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.911+0000 7f8901919980 20 remove_watcher() i=4 2024-09-10T14:29:13.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.911+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117334617408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c1bc0 con 0x7f88e803a3c0 2024-09-10T14:29:13.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.911+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94117334617408] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.911+0000 7f8901919980 20 remove_watcher() i=5 2024-09-10T14:29:13.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.911+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117334627936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664bebb0 con 0x7f88e803a3c0 2024-09-10T14:29:13.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.915+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94117334627936] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.915+0000 7f8901919980 20 remove_watcher() i=6 2024-09-10T14:29:13.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.915+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117334631184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5599664c0dd0 con 0x7f88e803a3c0 2024-09-10T14:29:13.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 <== osd.0 v2:172.21.15.52:6800/2968015226 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94117334631184] v36'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88f00083f0 con 0x7f88e803a3c0 2024-09-10T14:29:13.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 20 remove_watcher() i=7 2024-09-10T14:29:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f88e803a3c0 msgr2=0x7f88e803a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f88e803a3c0 0x7f88e803a800 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599664b48a0 msgr2=0x5599664b6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5599664b48a0 0x5599664b6d60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f88f8119060 msgr2=0x7f88f80f2290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f88f8119060 0x7f88f80f2290 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599664b9260 msgr2=0x5599664bb650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5599664b9260 0x5599664bb650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87c8034650 msgr2=0x7f87c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87c8034650 0x7f87c8036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f88e800baa0 tx=0x7f88e8010000 comp rx=0 tx=0).stop 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 msgr2=0x5599664a9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/3319220455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966383580 0x5599664a9790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f88f80edd90 tx=0x7f88f8007da0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 reap_dead start 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f88ffc2a640 1 -- 172.21.15.151:0/3319220455 reap_dead start 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 shutdown_connections 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 >> 172.21.15.151:0/3319220455 conn(0x55996649c7c0 msgr2=0x55996649a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 shutdown_connections 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/3319220455 wait complete. 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/13084547 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87d8034650 msgr2=0x7f87d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/13084547 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87d8034650 0x7f87d8036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x559966486480 tx=0x7f88e800f000 comp rx=0 tx=0).stop 2024-09-10T14:29:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/13084547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966493b10 msgr2=0x559966493f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/13084547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966493b10 0x559966493f30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f88f80a4050 tx=0x7f88f80a9c90 comp rx=0 tx=0).stop 2024-09-10T14:29:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/13084547 shutdown_connections 2024-09-10T14:29:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/13084547 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87d8034650 0x7f87d8036b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/13084547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559966493b10 0x559966493f30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/13084547 >> 172.21.15.151:0/13084547 conn(0x559966488c60 msgr2=0x55996648b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/13084547 shutdown_connections 2024-09-10T14:29:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/13084547 wait complete. 2024-09-10T14:29:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559966483500 msgr2=0x5599664858f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x559966483500 0x5599664858f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559966386870 msgr2=0x55996647ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x559966386870 0x55996647ce00 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55996647f600 msgr2=0x5599664819f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55996647f600 0x5599664819f0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87e40346a0 msgr2=0x7f87e4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87e40346a0 0x7f87e4036b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88e8001e50 tx=0x7f88e80013b0 comp rx=0 tx=0).stop 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 msgr2=0x559966475d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 --2- 172.21.15.151:0/376041869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5599662f7b00 0x559966475d00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f88f8018cc0 tx=0x7f88f8017e30 comp rx=0 tx=0).stop 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f88ffc2a640 1 -- 172.21.15.151:0/376041869 reap_dead start 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 shutdown_connections 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 >> 172.21.15.151:0/376041869 conn(0x55996637e060 msgr2=0x559966469200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 shutdown_connections 2024-09-10T14:29:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:13.919+0000 7f8901919980 1 -- 172.21.15.151:0/376041869 wait complete. 2024-09-10T14:29:13.940 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-10T14:29:13.941 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T14:29:13.941 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T14:29:13.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T14:29:13.941 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T14:29:14.017 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:14.017 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:14.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a32c5a980 1 Processor -- start 2024-09-10T14:29:14.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a32c5a980 1 -- start start 2024-09-10T14:29:14.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a32c5a980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d3dad20c60 0x55d3dad23050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a32c5a980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d3daba2ae0 con 0x55d3dad1c8e0 2024-09-10T14:29:14.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a32c5a980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55d3dabc6e30 con 0x55d3dad20c60 2024-09-10T14:29:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a2ff69640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d3dad20c60 0x55d3dad23050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a2ff69640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d3dad20c60 0x55d3dad23050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39130/0 (socket says 172.21.15.151:39130) 2024-09-10T14:29:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a3076a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d3dad1c8e0 0x55d3dad1ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51318/0 (socket says 172.21.15.151:51318) 2024-09-10T14:29:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a2ff69640 1 -- 172.21.15.151:0/3867403013 learned_addr learned my addr 172.21.15.151:0/3867403013 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a2f768640 1 -- 172.21.15.151:0/3867403013 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554594575 0 0) 0x55d3daba2ae0 con 0x55d3dad1c8e0 2024-09-10T14:29:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a2f768640 1 -- 172.21.15.151:0/3867403013 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a1c001e20 con 0x55d3dad1c8e0 2024-09-10T14:29:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a2ff69640 1 -- 172.21.15.151:0/3867403013 >> v1:172.21.15.52:6789/0 conn(0x55d3dad1c8e0 legacy=0x55d3dad1ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.015+0000 7f3a2ff69640 1 -- 172.21.15.151:0/3867403013 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3dad245a0 con 0x55d3dad20c60 2024-09-10T14:29:14.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/3867403013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad20c60 0x55d3dad23050 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000a5c0 tx=0x7f3a2001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0ca719e92b5e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a2f768640 1 -- 172.21.15.151:0/3867403013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a200a6070 con 0x55d3dad20c60 2024-09-10T14:29:14.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a2f768640 1 -- 172.21.15.151:0/3867403013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a200af070 con 0x55d3dad20c60 2024-09-10T14:29:14.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a2f768640 1 -- 172.21.15.151:0/3867403013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a200aa5c0 con 0x55d3dad20c60 2024-09-10T14:29:14.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3867403013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad20c60 msgr2=0x55d3dad23050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/3867403013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad20c60 0x55d3dad23050 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000a5c0 tx=0x7f3a2001b340 comp rx=0 tx=0).stop 2024-09-10T14:29:14.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3867403013 shutdown_connections 2024-09-10T14:29:14.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/3867403013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad20c60 0x55d3dad23050 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3867403013 >> 172.21.15.151:0/3867403013 conn(0x55d3dac90230 msgr2=0x55d3dac90640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3867403013 shutdown_connections 2024-09-10T14:29:14.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.019+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3867403013 wait complete. 2024-09-10T14:29:14.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.035+0000 7f3a32c5a980 1 Processor -- start 2024-09-10T14:29:14.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.035+0000 7f3a32c5a980 1 -- start start 2024-09-10T14:29:14.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f3a32c5a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae07a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f3a32c5a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d3dabc8200 con 0x55d3dad1c8e0 2024-09-10T14:29:14.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae07a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae07a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39140/0 (socket says 172.21.15.151:39140) 2024-09-10T14:29:14.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f3a3076a640 1 -- 172.21.15.151:0/921466577 learned_addr learned my addr 172.21.15.151:0/921466577 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f3a3076a640 1 -- 172.21.15.151:0/921466577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3dae07ff0 con 0x55d3dad1c8e0 2024-09-10T14:29:14.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f3a3076a640 1 --2- 172.21.15.151:0/921466577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae07a20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3a18001740 tx=0x7f3a18001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e104920a6227e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f391e60c640 1 -- 172.21.15.151:0/921466577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a18003460 con 0x55d3dad1c8e0 2024-09-10T14:29:14.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f391e60c640 1 -- 172.21.15.151:0/921466577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18003600 con 0x55d3dad1c8e0 2024-09-10T14:29:14.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.039+0000 7f391e60c640 1 -- 172.21.15.151:0/921466577 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a18003920 con 0x55d3dad1c8e0 2024-09-10T14:29:14.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- 172.21.15.151:0/921466577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 msgr2=0x55d3dae07a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/921466577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae07a20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3a18001740 tx=0x7f3a18001c00 comp rx=0 tx=0).stop 2024-09-10T14:29:14.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- 172.21.15.151:0/921466577 shutdown_connections 2024-09-10T14:29:14.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/921466577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae07a20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- 172.21.15.151:0/921466577 >> 172.21.15.151:0/921466577 conn(0x55d3dac90230 msgr2=0x55d3dae03650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- 172.21.15.151:0/921466577 shutdown_connections 2024-09-10T14:29:14.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- 172.21.15.151:0/921466577 wait complete. 2024-09-10T14:29:14.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 Processor -- start 2024-09-10T14:29:14.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- start start 2024-09-10T14:29:14.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae0ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d3dad240a0 con 0x55d3dad1c8e0 2024-09-10T14:29:14.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae0ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae0ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39154/0 (socket says 172.21.15.151:39154) 2024-09-10T14:29:14.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a3076a640 1 -- 172.21.15.151:0/2732474221 learned_addr learned my addr 172.21.15.151:0/2732474221 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a3076a640 1 -- 172.21.15.151:0/2732474221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3dae0f270 con 0x55d3dad1c8e0 2024-09-10T14:29:14.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a3076a640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae0ed30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3a18014040 tx=0x7f3a18001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f391ce09640 1 -- 172.21.15.151:0/2732474221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a18022020 con 0x55d3dad1c8e0 2024-09-10T14:29:14.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3dae0f500 con 0x55d3dad1c8e0 2024-09-10T14:29:14.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f391ce09640 1 -- 172.21.15.151:0/2732474221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1801e480 con 0x55d3dad1c8e0 2024-09-10T14:29:14.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f391ce09640 1 -- 172.21.15.151:0/2732474221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1801e760 con 0x55d3dad1c8e0 2024-09-10T14:29:14.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.043+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3dae121e0 con 0x55d3dad1c8e0 2024-09-10T14:29:14.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f391ce09640 1 -- 172.21.15.151:0/2732474221 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3a18025020 con 0x55d3dad1c8e0 2024-09-10T14:29:14.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f391ce09640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3918034650 0x7f3918036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f391ce09640 1 -- 172.21.15.151:0/2732474221 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3a18049c20 con 0x55d3dad1c8e0 2024-09-10T14:29:14.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dad20c60 0x55d3dae15e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3918034650 0x7f3918036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae16370 con 0x55d3dad20c60 2024-09-10T14:29:14.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a30f6b640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dad20c60 0x55d3dae15e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a30f6b640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dad20c60 0x55d3dae15e30 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3918034650 0x7f3918036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3a200ae000 tx=0x7f3a200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2732474221 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dad20c60 2024-09-10T14:29:14.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae133e0 con 0x55d3dad20c60 2024-09-10T14:29:14.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2732474221 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dad20c60 2024-09-10T14:29:14.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae186a0 0x55d3dae1aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae1b180 con 0x55d3dae186a0 2024-09-10T14:29:14.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a3076a640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae186a0 0x55d3dae1aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a3076a640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae186a0 0x55d3dae1aa90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a3076a640 1 -- 172.21.15.151:0/2732474221 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae186a0 2024-09-10T14:29:14.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae17540 con 0x55d3dad20c60 2024-09-10T14:29:14.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2732474221 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dad20c60 2024-09-10T14:29:14.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d3dae1c5e0 0x55d3dae1e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae1f140 con 0x55d3dae1c5e0 2024-09-10T14:29:14.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.047+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d3dae1c5e0 0x55d3dae1e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d3dae1c5e0 0x55d3dae1e9d0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2732474221 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3a200aaa70 con 0x55d3dae1c5e0 2024-09-10T14:29:14.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a32c5a980 1 Processor -- start 2024-09-10T14:29:14.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a32c5a980 1 -- start start 2024-09-10T14:29:14.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a32c5a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae2cbb0 0x55d3dae2cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a32c5a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d3dac21800 con 0x55d3dae2cbb0 2024-09-10T14:29:14.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae2cbb0 0x55d3dae2cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae2cbb0 0x55d3dae2cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39156/0 (socket says 172.21.15.151:39156) 2024-09-10T14:29:14.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a3076a640 1 -- 172.21.15.151:0/3467532172 learned_addr learned my addr 172.21.15.151:0/3467532172 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a3076a640 1 -- 172.21.15.151:0/3467532172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3dae2d510 con 0x55d3dae2cbb0 2024-09-10T14:29:14.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3a3076a640 1 --2- 172.21.15.151:0/3467532172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae2cbb0 0x55d3dae2cfd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3a18012c30 tx=0x7f3a18012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.051+0000 7f3915ffb640 1 -- 172.21.15.151:0/3467532172 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1801c6a0 con 0x55d3dae2cbb0 2024-09-10T14:29:14.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3467532172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3dae2d7a0 con 0x55d3dae2cbb0 2024-09-10T14:29:14.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3915ffb640 1 -- 172.21.15.151:0/3467532172 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1801c840 con 0x55d3dae2cbb0 2024-09-10T14:29:14.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3915ffb640 1 -- 172.21.15.151:0/3467532172 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1801cb20 con 0x55d3dae2cbb0 2024-09-10T14:29:14.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3467532172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3dae30420 con 0x55d3dae2cbb0 2024-09-10T14:29:14.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3915ffb640 1 -- 172.21.15.151:0/3467532172 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3a18036570 con 0x55d3dae2cbb0 2024-09-10T14:29:14.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3915ffb640 1 --2- 172.21.15.151:0/3467532172 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3908034650 0x7f3908036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3915ffb640 1 -- 172.21.15.151:0/3467532172 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3a1803e070 con 0x55d3dae2cbb0 2024-09-10T14:29:14.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/3467532172 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3908034650 0x7f3908036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a32c5a980 1 Processor -- start 2024-09-10T14:29:14.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a32c5a980 1 -- start start 2024-09-10T14:29:14.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/3467532172 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3908034650 0x7f3908036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3a2001b380 tx=0x7f3a20005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a32c5a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae39810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a32c5a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d3dae08310 con 0x55d3dae39430 2024-09-10T14:29:14.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae39810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae39810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39160/0 (socket says 172.21.15.151:39160) 2024-09-10T14:29:14.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a3076a640 1 -- 172.21.15.151:0/1672647981 learned_addr learned my addr 172.21.15.151:0/1672647981 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a3076a640 1 -- 172.21.15.151:0/1672647981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3dae39de0 con 0x55d3dae39430 2024-09-10T14:29:14.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f3a3076a640 1 --2- 172.21.15.151:0/1672647981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae39810 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3a1803bf60 tx=0x7f3a1804bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3839efede687652 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.055+0000 7f390f7fe640 1 -- 172.21.15.151:0/1672647981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a180495d0 con 0x55d3dae39430 2024-09-10T14:29:14.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f390f7fe640 1 -- 172.21.15.151:0/1672647981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18030400 con 0x55d3dae39430 2024-09-10T14:29:14.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f390f7fe640 1 -- 172.21.15.151:0/1672647981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1804b0b0 con 0x55d3dae39430 2024-09-10T14:29:14.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- 172.21.15.151:0/1672647981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 msgr2=0x55d3dae39810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/1672647981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae39810 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3a1803bf60 tx=0x7f3a1804bf60 comp rx=0 tx=0).stop 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- 172.21.15.151:0/1672647981 shutdown_connections 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/1672647981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae39810 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- 172.21.15.151:0/1672647981 >> 172.21.15.151:0/1672647981 conn(0x55d3dae35810 msgr2=0x55d3dae33910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- 172.21.15.151:0/1672647981 shutdown_connections 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- 172.21.15.151:0/1672647981 wait complete. 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 Processor -- start 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- start start 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae40610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d3dae3a280 con 0x55d3dae39430 2024-09-10T14:29:14.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae40610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a3076a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae40610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39168/0 (socket says 172.21.15.151:39168) 2024-09-10T14:29:14.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 learned_addr learned my addr 172.21.15.151:0/2771796396 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3dae40b50 con 0x55d3dae39430 2024-09-10T14:29:14.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a3076a640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae40610 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3a18026890 tx=0x7f3a18055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f390dffb640 1 -- 172.21.15.151:0/2771796396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a180109e0 con 0x55d3dae39430 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f390dffb640 1 -- 172.21.15.151:0/2771796396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18010b80 con 0x55d3dae39430 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3dae40b50 con 0x55d3dae39430 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f390dffb640 1 -- 172.21.15.151:0/2771796396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a18010e60 con 0x55d3dae39430 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.059+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3dae40b50 con 0x55d3dae39430 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f390dffb640 1 -- 172.21.15.151:0/2771796396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3a18069020 con 0x55d3dae39430 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f390dffb640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f39000346a0 0x7f3900036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f390dffb640 1 -- 172.21.15.151:0/2771796396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3a1806cd30 con 0x55d3dae39430 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f39000346a0 0x7f3900036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dae4b670 0x55d3dae4db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4e280 con 0x55d3dae4b670 2024-09-10T14:29:14.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a30f6b640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dae4b670 0x55d3dae4db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f39000346a0 0x7f3900036b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55d3dae1f520 tx=0x7f3a200c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a30f6b640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dae4b670 0x55d3dae4db30 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 realm 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4e690 con 0x55d3dae4b670 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4ef30 con 0x55d3dae4b670 2024-09-10T14:29:14.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae50030 0x55d3dae52420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae52a70 con 0x55d3dae50030 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a3076a640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae50030 0x55d3dae52420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a3076a640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae50030 0x55d3dae52420 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:14.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 20 searching for the correct realm 2024-09-10T14:29:14.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.063+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae542d0 con 0x55d3dae50030 2024-09-10T14:29:14.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a3076a640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3a18027020 0x7f3a1800f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae542d0 con 0x7f3a18027020 2024-09-10T14:29:14.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3a18027020 0x7f3a1800f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3a18027020 0x7f3a1800f300 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a2ff69640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3a200e0040 0x7f3a200e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae542d0 con 0x7f3a200e0040 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a30f6b640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3a200e0040 0x7f3a200e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a30f6b640 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3a200e0040 0x7f3a200e0420 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.067+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a200e0040 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a200e0040 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a18027020 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae50030 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a200e0040 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a18027020 2024-09-10T14:29:14.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae50030 2024-09-10T14:29:14.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae50030 2024-09-10T14:29:14.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a18027020 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.071+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae50030 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae50030 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a200e0040 2024-09-10T14:29:14.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae50030 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a18027020 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a18027020 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae50030 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a200e0040 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.075+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a18027020 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae50030 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a200e0040 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x55d3dae4b670 2024-09-10T14:29:14.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae4f2d0 con 0x7f3a18027020 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae533f0 con 0x55d3dae4b670 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae53c40 con 0x55d3dae4b670 2024-09-10T14:29:14.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:14.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae53790 con 0x7f3a200e0040 2024-09-10T14:29:14.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 zone default found 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 4 Realm: () 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 zonegroup default 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae53bc0 con 0x7f3a18027020 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae560e0 con 0x55d3dae50030 2024-09-10T14:29:14.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.079+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae56560 con 0x55d3dae50030 2024-09-10T14:29:14.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a32c5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a32c5a980 20 started sync module instance, tier type = 2024-09-10T14:29:14.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a32c5a980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:14.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae55580 con 0x7f3a18027020 2024-09-10T14:29:14.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94368398924144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae56e70 con 0x7f3a18027020 2024-09-10T14:29:14.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae576c0 con 0x55d3dae4b670 2024-09-10T14:29:14.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94368398924144] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94368398928320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae576c0 con 0x55d3dae4b670 2024-09-10T14:29:14.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.083+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae58180 con 0x55d3dae50030 2024-09-10T14:29:14.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.087+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.087+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94368398928320] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.087+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94368398930448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae57630 con 0x55d3dae50030 2024-09-10T14:29:14.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.087+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae58f10 con 0x7f3a18027020 2024-09-10T14:29:14.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.087+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.087+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94368398938880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae59bd0 con 0x7f3a18027020 2024-09-10T14:29:14.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.087+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5a590 con 0x55d3dae4b670 2024-09-10T14:29:14.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.091+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94368398930448] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.091+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94368398938880] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.091+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.091+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94368398939936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae59b40 con 0x55d3dae4b670 2024-09-10T14:29:14.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.091+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5aa40 con 0x7f3a200e0040 2024-09-10T14:29:14.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.091+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94368398939936] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.095+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.095+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94368398942432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5a9b0 con 0x7f3a200e0040 2024-09-10T14:29:14.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.095+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5b320 con 0x7f3a200e0040 2024-09-10T14:29:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.095+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94368398942432] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.095+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.095+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94368398945840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5b500 con 0x7f3a200e0040 2024-09-10T14:29:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.095+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5bd50 con 0x7f3a200e0040 2024-09-10T14:29:14.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94368398945840] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94368398947584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5bdd0 con 0x7f3a200e0040 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 20 add_watcher() i=0 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 20 add_watcher() i=1 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 20 add_watcher() i=2 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 20 add_watcher() i=3 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 20 add_watcher() i=4 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 20 add_watcher() i=5 2024-09-10T14:29:14.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 20 add_watcher() i=6 2024-09-10T14:29:14.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94368398947584] v36'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 20 add_watcher() i=7 2024-09-10T14:29:14.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:14.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5f0f0 con 0x55d3dae4b670 2024-09-10T14:29:14.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.099+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94368398949008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5c360 con 0x55d3dae4b670 2024-09-10T14:29:14.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.103+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94368398949008] v36'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.103+0000 7f38e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:14.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.103+0000 7f3a32c5a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:14.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.103+0000 7f3a32c5a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:14.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.103+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5e880 con 0x55d3dae4b670 2024-09-10T14:29:14.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.103+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.103+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae681b0 con 0x7f3a200e0040 2024-09-10T14:29:14.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.107+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.107+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae681b0 con 0x55d3dae50030 2024-09-10T14:29:14.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.107+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.107+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae68660 con 0x55d3dae4b670 2024-09-10T14:29:14.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.111+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'175 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.111+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae68c30 con 0x7f3a18027020 2024-09-10T14:29:14.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.111+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.111+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69030 con 0x55d3dae50030 2024-09-10T14:29:14.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.111+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.111+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69030 con 0x55d3dae4b670 2024-09-10T14:29:14.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.115+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.115+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae690c0 con 0x7f3a200e0040 2024-09-10T14:29:14.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.119+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.119+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae691d0 con 0x7f3a18027020 2024-09-10T14:29:14.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.119+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.119+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69860 con 0x55d3dae50030 2024-09-10T14:29:14.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.119+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.119+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69860 con 0x7f3a18027020 2024-09-10T14:29:14.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.123+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.123+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69dd0 con 0x7f3a200e0040 2024-09-10T14:29:14.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.123+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.127+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69dd0 con 0x7f3a18027020 2024-09-10T14:29:14.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.127+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.127+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69c90 con 0x7f3a200e0040 2024-09-10T14:29:14.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.131+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.131+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69c90 con 0x55d3dae4b670 2024-09-10T14:29:14.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.131+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'176 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.131+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69c90 con 0x55d3dae50030 2024-09-10T14:29:14.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.135+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.135+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69c90 con 0x7f3a18027020 2024-09-10T14:29:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.135+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.135+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69da0 con 0x55d3dae50030 2024-09-10T14:29:14.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.135+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.135+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69da0 con 0x55d3dae4b670 2024-09-10T14:29:14.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.139+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.139+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69da0 con 0x55d3dae4b670 2024-09-10T14:29:14.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.139+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'177 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.139+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69da0 con 0x55d3dae50030 2024-09-10T14:29:14.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.143+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.143+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae69da0 con 0x7f3a18027020 2024-09-10T14:29:14.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.143+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.143+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x55d3dae50030 2024-09-10T14:29:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.147+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.147+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x55d3dae50030 2024-09-10T14:29:14.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.147+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.147+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x55d3dae50030 2024-09-10T14:29:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.151+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.151+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x55d3dae50030 2024-09-10T14:29:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.151+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.151+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x7f3a200e0040 2024-09-10T14:29:14.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.155+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.155+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x55d3dae50030 2024-09-10T14:29:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.155+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.155+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x7f3a200e0040 2024-09-10T14:29:14.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.159+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.159+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x55d3dae50030 2024-09-10T14:29:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.159+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.159+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x7f3a200e0040 2024-09-10T14:29:14.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.163+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.163+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae6a410 con 0x7f3a18027020 2024-09-10T14:29:14.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f38e57e2640 20 reqs_thread_entry: start 2024-09-10T14:29:14.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:14.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 20 Filter name: none 2024-09-10T14:29:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3856ffd640 20 reqs_thread_entry: start 2024-09-10T14:29:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:29:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae66dd0 con 0x55d3dae4b670 2024-09-10T14:29:14.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:29:14.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:29:14.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:29:14.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:14.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae66840 con 0x7f3a18027020 2024-09-10T14:29:14.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.167+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.172 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T14:29:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.171+0000 7f38e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:14.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.171+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94368398949008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae85af0 con 0x55d3dae4b670 2024-09-10T14:29:14.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.171+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94368398949008] v36'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.171+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94368398924144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5ba90 con 0x7f3a18027020 2024-09-10T14:29:14.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.171+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94368398924144] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.171+0000 7f3a32c5a980 20 remove_watcher() i=0 2024-09-10T14:29:14.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.171+0000 7f3a32c5a980 2 removed watcher, disabling cache 2024-09-10T14:29:14.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.171+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94368398928320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5ba90 con 0x55d3dae4b670 2024-09-10T14:29:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.175+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94368398928320] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.175+0000 7f3a32c5a980 20 remove_watcher() i=1 2024-09-10T14:29:14.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.175+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94368398930448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae569c0 con 0x55d3dae50030 2024-09-10T14:29:14.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.175+0000 7f3a3076a640 1 -- 172.21.15.151:0/2771796396 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94368398930448] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a1801b040 con 0x55d3dae50030 2024-09-10T14:29:14.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.179+0000 7f3a32c5a980 20 remove_watcher() i=2 2024-09-10T14:29:14.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.179+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94368398938880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5ba90 con 0x7f3a18027020 2024-09-10T14:29:14.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.179+0000 7f3a2ff69640 1 -- 172.21.15.151:0/2771796396 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94368398938880] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a200aaa70 con 0x7f3a18027020 2024-09-10T14:29:14.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.179+0000 7f3a32c5a980 20 remove_watcher() i=3 2024-09-10T14:29:14.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.179+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94368398939936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae57210 con 0x55d3dae4b670 2024-09-10T14:29:14.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.179+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94368398939936] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x55d3dae4b670 2024-09-10T14:29:14.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.179+0000 7f3a32c5a980 20 remove_watcher() i=4 2024-09-10T14:29:14.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.179+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94368398942432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5ba90 con 0x7f3a200e0040 2024-09-10T14:29:14.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.183+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94368398942432] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.183+0000 7f3a32c5a980 20 remove_watcher() i=5 2024-09-10T14:29:14.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.183+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94368398945840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae57210 con 0x7f3a200e0040 2024-09-10T14:29:14.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94368398945840] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 20 remove_watcher() i=6 2024-09-10T14:29:14.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94368398947584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d3dae5a0e0 con 0x7f3a200e0040 2024-09-10T14:29:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94368398947584] v36'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a280083f0 con 0x7f3a200e0040 2024-09-10T14:29:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 20 remove_watcher() i=7 2024-09-10T14:29:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3a200e0040 msgr2=0x7f3a200e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3a200e0040 0x7f3a200e0420 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dae4b670 msgr2=0x55d3dae4db30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dae4b670 0x55d3dae4db30 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3a18027020 msgr2=0x7f3a1800f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3a18027020 0x7f3a1800f300 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae50030 msgr2=0x55d3dae52420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae50030 0x55d3dae52420 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f39000346a0 msgr2=0x7f3900036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f39000346a0 0x7f3900036b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55d3dae1f520 tx=0x7f3a200c1040 comp rx=0 tx=0).stop 2024-09-10T14:29:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2771796396 reap_dead start 2024-09-10T14:29:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 msgr2=0x55d3dae40610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae40610 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3a18026890 tx=0x7f3a18055000 comp rx=0 tx=0).stop 2024-09-10T14:29:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 shutdown_connections 2024-09-10T14:29:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2771796396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae39430 0x55d3dae40610 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.187+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 >> 172.21.15.151:0/2771796396 conn(0x55d3dae35810 msgr2=0x55d3dae338e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 shutdown_connections 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2771796396 wait complete. 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3467532172 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3908034650 msgr2=0x7f3908036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/3467532172 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3908034650 0x7f3908036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3a2001b380 tx=0x7f3a20005ad0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3467532172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae2cbb0 msgr2=0x55d3dae2cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/3467532172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae2cbb0 0x55d3dae2cfd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3a18012c30 tx=0x7f3a18012610 comp rx=0 tx=0).stop 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3467532172 shutdown_connections 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/3467532172 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3908034650 0x7f3908036b10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/3467532172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dae2cbb0 0x55d3dae2cfd0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3467532172 >> 172.21.15.151:0/3467532172 conn(0x55d3dae21d00 msgr2=0x55d3dae24780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3467532172 shutdown_connections 2024-09-10T14:29:14.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/3467532172 wait complete. 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d3dae1c5e0 msgr2=0x55d3dae1e9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d3dae1c5e0 0x55d3dae1e9d0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dad20c60 msgr2=0x55d3dae15e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d3dad20c60 0x55d3dae15e30 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae186a0 msgr2=0x55d3dae1aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d3dae186a0 0x55d3dae1aa90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3918034650 msgr2=0x7f3918036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3918034650 0x7f3918036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3a200ae000 tx=0x7f3a200a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 msgr2=0x55d3dae0ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 --2- 172.21.15.151:0/2732474221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d3dad1c8e0 0x55d3dae0ed30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3a18014040 tx=0x7f3a18001260 comp rx=0 tx=0).stop 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a30f6b640 1 -- 172.21.15.151:0/2732474221 reap_dead start 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 shutdown_connections 2024-09-10T14:29:14.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 >> 172.21.15.151:0/2732474221 conn(0x55d3dac90230 msgr2=0x55d3dae021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 shutdown_connections 2024-09-10T14:29:14.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.191+0000 7f3a32c5a980 1 -- 172.21.15.151:0/2732474221 wait complete. 2024-09-10T14:29:14.207 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T14:29:14.224 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-10T14:29:14.230 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:14.286 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:14.305 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:14.349 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T14:29:14.361 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:14.361 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T14:29:14.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T14:29:14.361 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T14:29:14.400 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:14.400 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:14.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733e9d5980 1 Processor -- start 2024-09-10T14:29:14.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733e9d5980 1 -- start start 2024-09-10T14:29:14.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733e9d5980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d7d774c9e0 0x55d7d774edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733e9d5980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7d75d0ae0 con 0x55d7d7748660 2024-09-10T14:29:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733e9d5980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55d7d75f4e30 con 0x55d7d774c9e0 2024-09-10T14:29:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733c4e5640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d7d7748660 0x55d7d7748a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51332/0 (socket says 172.21.15.151:51332) 2024-09-10T14:29:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733c4e5640 1 -- 172.21.15.151:0/2976408100 learned_addr learned my addr 172.21.15.151:0/2976408100 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733bce4640 1 --2- 172.21.15.151:0/2976408100 >> v2:172.21.15.52:3300/0 conn(0x55d7d774c9e0 0x55d7d774edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733bce4640 1 -- 172.21.15.151:0/2976408100 >> v1:172.21.15.52:6789/0 conn(0x55d7d7748660 legacy=0x55d7d7748a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733bce4640 1 -- 172.21.15.151:0/2976408100 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d7750320 con 0x55d7d774c9e0 2024-09-10T14:29:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.399+0000 7f733bce4640 1 --2- 172.21.15.151:0/2976408100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d774c9e0 0x55d7d774edd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f733000a480 tx=0x7f733001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a255499a915409dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733b4e3640 1 -- 172.21.15.151:0/2976408100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73300b0070 con 0x55d7d774c9e0 2024-09-10T14:29:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733b4e3640 1 -- 172.21.15.151:0/2976408100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73300ab540 con 0x55d7d774c9e0 2024-09-10T14:29:14.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733b4e3640 1 -- 172.21.15.151:0/2976408100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73300ab840 con 0x55d7d774c9e0 2024-09-10T14:29:14.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733e9d5980 1 -- 172.21.15.151:0/2976408100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d774c9e0 msgr2=0x55d7d774edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733e9d5980 1 --2- 172.21.15.151:0/2976408100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d774c9e0 0x55d7d774edd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f733000a480 tx=0x7f733001b280 comp rx=0 tx=0).stop 2024-09-10T14:29:14.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733e9d5980 1 -- 172.21.15.151:0/2976408100 shutdown_connections 2024-09-10T14:29:14.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733e9d5980 1 --2- 172.21.15.151:0/2976408100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d774c9e0 0x55d7d774edd0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733e9d5980 1 -- 172.21.15.151:0/2976408100 >> 172.21.15.151:0/2976408100 conn(0x55d7d7744180 msgr2=0x55d7d77465a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733e9d5980 1 -- 172.21.15.151:0/2976408100 shutdown_connections 2024-09-10T14:29:14.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.403+0000 7f733e9d5980 1 -- 172.21.15.151:0/2976408100 wait complete. 2024-09-10T14:29:14.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 Processor -- start 2024-09-10T14:29:14.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 -- start start 2024-09-10T14:29:14.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d7833a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7d75f6200 con 0x55d7d7748660 2024-09-10T14:29:14.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d7833a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d7833a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39194/0 (socket says 172.21.15.151:39194) 2024-09-10T14:29:14.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733c4e5640 1 -- 172.21.15.151:0/695629465 learned_addr learned my addr 172.21.15.151:0/695629465 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733c4e5640 1 -- 172.21.15.151:0/695629465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d7834060 con 0x55d7d7748660 2024-09-10T14:29:14.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733c4e5640 1 --2- 172.21.15.151:0/695629465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d7833a90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f73340015f0 tx=0x7f7334001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a3c02b18af4911 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f722a60c640 1 -- 172.21.15.151:0/695629465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334004530 con 0x55d7d7748660 2024-09-10T14:29:14.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f722a60c640 1 -- 172.21.15.151:0/695629465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73340046f0 con 0x55d7d7748660 2024-09-10T14:29:14.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f722a60c640 1 -- 172.21.15.151:0/695629465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334004a90 con 0x55d7d7748660 2024-09-10T14:29:14.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 -- 172.21.15.151:0/695629465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 msgr2=0x55d7d7833a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 --2- 172.21.15.151:0/695629465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d7833a90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f73340015f0 tx=0x7f7334001ab0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 -- 172.21.15.151:0/695629465 shutdown_connections 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 --2- 172.21.15.151:0/695629465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d7833a90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 -- 172.21.15.151:0/695629465 >> 172.21.15.151:0/695629465 conn(0x55d7d7744180 msgr2=0x55d7d782f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 -- 172.21.15.151:0/695629465 shutdown_connections 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.419+0000 7f733e9d5980 1 -- 172.21.15.151:0/695629465 wait complete. 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733e9d5980 1 Processor -- start 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733e9d5980 1 -- start start 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733e9d5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d783ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733e9d5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7d774fe20 con 0x55d7d7748660 2024-09-10T14:29:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d783ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d783ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39202/0 (socket says 172.21.15.151:39202) 2024-09-10T14:29:14.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733c4e5640 1 -- 172.21.15.151:0/492279901 learned_addr learned my addr 172.21.15.151:0/492279901 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733c4e5640 1 -- 172.21.15.151:0/492279901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d783b360 con 0x55d7d7748660 2024-09-10T14:29:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733c4e5640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d783ae20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55d7d7834c70 tx=0x7f7334000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f7228e09640 1 -- 172.21.15.151:0/492279901 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334013760 con 0x55d7d7748660 2024-09-10T14:29:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f7228e09640 1 -- 172.21.15.151:0/492279901 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7334013900 con 0x55d7d7748660 2024-09-10T14:29:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f7228e09640 1 -- 172.21.15.151:0/492279901 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334013be0 con 0x55d7d7748660 2024-09-10T14:29:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7d783b5f0 con 0x55d7d7748660 2024-09-10T14:29:14.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d783e2d0 con 0x55d7d7748660 2024-09-10T14:29:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f7228e09640 1 -- 172.21.15.151:0/492279901 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7334010070 con 0x55d7d7748660 2024-09-10T14:29:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f7228e09640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7224034650 0x7f7224036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.423+0000 7f7228e09640 1 -- 172.21.15.151:0/492279901 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7334018070 con 0x55d7d7748660 2024-09-10T14:29:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733bce4640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7224034650 0x7f7224036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733e9d5980 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d774c9e0 0x55d7d7841dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7842440 con 0x55d7d774c9e0 2024-09-10T14:29:14.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733cce6640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d774c9e0 0x55d7d7841dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733bce4640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7224034650 0x7f7224036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f73300ad000 tx=0x7f73300a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733cce6640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d774c9e0 0x55d7d7841dd0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733cce6640 1 -- 172.21.15.151:0/492279901 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d774c9e0 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d783f4d0 con 0x55d7d774c9e0 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733cce6640 1 -- 172.21.15.151:0/492279901 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d774c9e0 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733e9d5980 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d78447c0 0x55d7d7846bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78472a0 con 0x55d7d78447c0 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733c4e5640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d78447c0 0x55d7d7846bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733c4e5640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d78447c0 0x55d7d7846bb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733c4e5640 1 -- 172.21.15.151:0/492279901 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f733401b030 con 0x55d7d78447c0 2024-09-10T14:29:14.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7843660 con 0x55d7d774c9e0 2024-09-10T14:29:14.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733cce6640 1 -- 172.21.15.151:0/492279901 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d774c9e0 2024-09-10T14:29:14.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733e9d5980 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7d7848700 0x55d7d784aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d784b1e0 con 0x55d7d7848700 2024-09-10T14:29:14.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733bce4640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7d7848700 0x55d7d784aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.427+0000 7f733bce4640 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7d7848700 0x55d7d784aaf0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733bce4640 1 -- 172.21.15.151:0/492279901 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f73300b3040 con 0x55d7d7848700 2024-09-10T14:29:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733e9d5980 1 Processor -- start 2024-09-10T14:29:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733e9d5980 1 -- start start 2024-09-10T14:29:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733e9d5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7858c30 0x55d7d7859050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733e9d5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7d764f800 con 0x55d7d7858c30 2024-09-10T14:29:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7858c30 0x55d7d7859050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7858c30 0x55d7d7859050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39214/0 (socket says 172.21.15.151:39214) 2024-09-10T14:29:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733c4e5640 1 -- 172.21.15.151:0/1487567808 learned_addr learned my addr 172.21.15.151:0/1487567808 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733c4e5640 1 -- 172.21.15.151:0/1487567808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d7859590 con 0x55d7d7858c30 2024-09-10T14:29:14.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733c4e5640 1 --2- 172.21.15.151:0/1487567808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7858c30 0x55d7d7859050 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7334048390 tx=0x7f7334012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f7221ffb640 1 -- 172.21.15.151:0/1487567808 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334010db0 con 0x55d7d7858c30 2024-09-10T14:29:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733e9d5980 1 -- 172.21.15.151:0/1487567808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7d7859820 con 0x55d7d7858c30 2024-09-10T14:29:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f7221ffb640 1 -- 172.21.15.151:0/1487567808 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7334029680 con 0x55d7d7858c30 2024-09-10T14:29:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f7221ffb640 1 -- 172.21.15.151:0/1487567808 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73340419c0 con 0x55d7d7858c30 2024-09-10T14:29:14.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.431+0000 7f733e9d5980 1 -- 172.21.15.151:0/1487567808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d785c4a0 con 0x55d7d7858c30 2024-09-10T14:29:14.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f7221ffb640 1 -- 172.21.15.151:0/1487567808 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7334029d10 con 0x55d7d7858c30 2024-09-10T14:29:14.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f7221ffb640 1 --2- 172.21.15.151:0/1487567808 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7214034650 0x7f7214036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f7221ffb640 1 -- 172.21.15.151:0/1487567808 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f733403b070 con 0x55d7d7858c30 2024-09-10T14:29:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733bce4640 1 --2- 172.21.15.151:0/1487567808 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7214034650 0x7f7214036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 Processor -- start 2024-09-10T14:29:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 -- start start 2024-09-10T14:29:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d76bea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733bce4640 1 --2- 172.21.15.151:0/1487567808 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7214034650 0x7f7214036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55d7d7843630 tx=0x7f7330005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7d78343e0 con 0x55d7d76be650 2024-09-10T14:29:14.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d76bea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d76bea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39216/0 (socket says 172.21.15.151:39216) 2024-09-10T14:29:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733c4e5640 1 -- 172.21.15.151:0/3305279667 learned_addr learned my addr 172.21.15.151:0/3305279667 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733c4e5640 1 -- 172.21.15.151:0/3305279667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d76bf000 con 0x55d7d76be650 2024-09-10T14:29:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733c4e5640 1 --2- 172.21.15.151:0/3305279667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d76bea30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7334013e60 tx=0x7f7334048730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4ddf8393e5a264 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f721b7fe640 1 -- 172.21.15.151:0/3305279667 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334061070 con 0x55d7d76be650 2024-09-10T14:29:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f721b7fe640 1 -- 172.21.15.151:0/3305279667 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733403f460 con 0x55d7d76be650 2024-09-10T14:29:14.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f721b7fe640 1 -- 172.21.15.151:0/3305279667 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334009270 con 0x55d7d76be650 2024-09-10T14:29:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 -- 172.21.15.151:0/3305279667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 msgr2=0x55d7d76bea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 --2- 172.21.15.151:0/3305279667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d76bea30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7334013e60 tx=0x7f7334048730 comp rx=0 tx=0).stop 2024-09-10T14:29:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 -- 172.21.15.151:0/3305279667 shutdown_connections 2024-09-10T14:29:14.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 --2- 172.21.15.151:0/3305279667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d76bea30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 -- 172.21.15.151:0/3305279667 >> 172.21.15.151:0/3305279667 conn(0x55d7d78619e0 msgr2=0x55d7d785fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 -- 172.21.15.151:0/3305279667 shutdown_connections 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 -- 172.21.15.151:0/3305279667 wait complete. 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 Processor -- start 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.435+0000 7f733e9d5980 1 -- start start 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733e9d5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d786e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733e9d5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d7d76bd1e0 con 0x55d7d76be650 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d786e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733c4e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d786e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39230/0 (socket says 172.21.15.151:39230) 2024-09-10T14:29:14.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 learned_addr learned my addr 172.21.15.151:0/942723596 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d786eec0 con 0x55d7d76be650 2024-09-10T14:29:14.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733c4e5640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d786e980 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7334037b30 tx=0x7f7334048f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f7219ffb640 1 -- 172.21.15.151:0/942723596 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f733406b030 con 0x55d7d76be650 2024-09-10T14:29:14.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f7219ffb640 1 -- 172.21.15.151:0/942723596 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7334041e90 con 0x55d7d76be650 2024-09-10T14:29:14.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f7219ffb640 1 -- 172.21.15.151:0/942723596 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7334061040 con 0x55d7d76be650 2024-09-10T14:29:14.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7d786eec0 con 0x55d7d76be650 2024-09-10T14:29:14.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d786eec0 con 0x55d7d76be650 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f7219ffb640 1 -- 172.21.15.151:0/942723596 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f733406e030 con 0x55d7d76be650 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f7219ffb640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f720c034650 0x7f720c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f7219ffb640 1 -- 172.21.15.151:0/942723596 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f733406c070 con 0x55d7d76be650 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733bce4640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f720c034650 0x7f720c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733e9d5980 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d7879a80 0x55d7d787bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787c690 con 0x55d7d7879a80 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733cce6640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d7879a80 0x55d7d787bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.439+0000 7f733bce4640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f720c034650 0x7f720c036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f73300ab510 tx=0x7f73300b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733cce6640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d7879a80 0x55d7d787bf40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 realm 2024-09-10T14:29:14.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787caa0 con 0x55d7d7879a80 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d370 con 0x55d7d7879a80 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:14.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d787e470 0x55d7d7880860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7880e20 con 0x55d7d787e470 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733c4e5640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d787e470 0x55d7d7880860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733c4e5640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d787e470 0x55d7d7880860 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 20 searching for the correct realm 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78826f0 con 0x55d7d787e470 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733c4e5640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7334050070 0x7f73340203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78826f0 con 0x7f7334050070 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733bce4640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7334050070 0x7f73340203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733bce4640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7334050070 0x7f73340203e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733bce4640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73300dc040 0x7f73300dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78826f0 con 0x7f73300dc040 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.443+0000 7f733cce6640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73300dc040 0x7f73300dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73300dc040 0x7f73300dd430 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f73300dc040 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f73300dc040 2024-09-10T14:29:14.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f7334050070 2024-09-10T14:29:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d787e470 2024-09-10T14:29:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.447+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f73300dc040 2024-09-10T14:29:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f7334050070 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d787e470 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d787e470 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f7334050070 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d787e470 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d787e470 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f73300dc040 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.451+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d787e470 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f7334050070 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f7334050070 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d787e470 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f73300dc040 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f7334050070 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d787e470 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f73300dc040 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.455+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x55d7d7879a80 2024-09-10T14:29:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d7d787d710 con 0x7f7334050070 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78817e0 con 0x55d7d7879a80 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7881420 con 0x55d7d7879a80 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7882100 con 0x7f73300dc040 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 zone default found 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 4 Realm: () 2024-09-10T14:29:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 zonegroup default 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7882530 con 0x7f7334050070 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7884500 con 0x55d7d787e470 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78848d0 con 0x55d7d787e470 2024-09-10T14:29:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 started sync module instance, tier type = 2024-09-10T14:29:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.459+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78839a0 con 0x7f7334050070 2024-09-10T14:29:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.463+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.463+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94385522359696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78851e0 con 0x7f7334050070 2024-09-10T14:29:14.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.463+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7885a30 con 0x55d7d7879a80 2024-09-10T14:29:14.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.463+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94385522359696] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.463+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.463+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94385522363696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7885a30 con 0x55d7d7879a80 2024-09-10T14:29:14.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.463+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7886510 con 0x55d7d787e470 2024-09-10T14:29:14.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.467+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94385522363696] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.467+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.467+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94385522368544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7885a30 con 0x55d7d787e470 2024-09-10T14:29:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.467+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7886f50 con 0x7f7334050070 2024-09-10T14:29:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.467+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.467+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94385522371232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78877a0 con 0x7f7334050070 2024-09-10T14:29:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.467+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78881a0 con 0x55d7d7879a80 2024-09-10T14:29:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.467+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94385522368544] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.471+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94385522371232] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.471+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.471+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94385522365824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78872f0 con 0x55d7d7879a80 2024-09-10T14:29:14.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.471+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7888a40 con 0x7f73300dc040 2024-09-10T14:29:14.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.471+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94385522365824] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.471+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.471+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94385522375856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78872f0 con 0x7f73300dc040 2024-09-10T14:29:14.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.471+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7888f10 con 0x7f73300dc040 2024-09-10T14:29:14.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.475+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94385522375856] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.475+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.475+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94385522379264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7888ed0 con 0x7f73300dc040 2024-09-10T14:29:14.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.475+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d7889910 con 0x7f73300dc040 2024-09-10T14:29:14.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94385522379264] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94385522381792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78898d0 con 0x7f73300dc040 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 20 add_watcher() i=0 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 20 add_watcher() i=1 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 20 add_watcher() i=2 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 20 add_watcher() i=3 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 20 add_watcher() i=4 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 20 add_watcher() i=5 2024-09-10T14:29:14.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 20 add_watcher() i=6 2024-09-10T14:29:14.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94385522381792] v36'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 20 add_watcher() i=7 2024-09-10T14:29:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d788cd00 con 0x55d7d7879a80 2024-09-10T14:29:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.479+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94385522377616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d788a1f0 con 0x55d7d7879a80 2024-09-10T14:29:14.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94385522377616] v36'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f71f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:14.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:14.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:14.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 5 note: GC not initialized 2024-09-10T14:29:14.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f71f1fe3640 20 reqs_thread_entry: start 2024-09-10T14:29:14.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:14.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 Filter name: none 2024-09-10T14:29:14.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f71eaffd640 20 reqs_thread_entry: start 2024-09-10T14:29:14.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:29:14.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b09b0 con 0x7f7334050070 2024-09-10T14:29:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:29:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:29:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:29:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 : miss 2024-09-10T14:29:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.1b 8:dd5d0cf7:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b2470 con 0x7f7334050070 2024-09-10T14:29:14.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(63 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:29:14.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 info.flags=0x17 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 to cache LRU end 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 get_obj_state: octx=0x55d7d76bea30 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d7d78b4b18 s->prefetch_data=0 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 3.33s0 3:cd4b0643:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x7f73300dc040 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(64 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 10 manifest: total_size = 5 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.483+0000 7f733e9d5980 20 get_obj_state: setting s->obj_tag to _tbodxeyinpSpMbT5U8IA9uyW4I0H3RC 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.487+0000 7f71f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:14.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.487+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94385522377616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78ae220 con 0x55d7d7879a80 2024-09-10T14:29:14.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.487+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94385522377616] v36'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.487+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94385522359696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x7f7334050070 2024-09-10T14:29:14.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.487+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94385522359696] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.487+0000 7f733e9d5980 20 remove_watcher() i=0 2024-09-10T14:29:14.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.487+0000 7f733e9d5980 2 removed watcher, disabling cache 2024-09-10T14:29:14.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.487+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94385522363696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x55d7d7879a80 2024-09-10T14:29:14.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.491+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94385522363696] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.491+0000 7f733e9d5980 20 remove_watcher() i=1 2024-09-10T14:29:14.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.491+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94385522368544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x55d7d787e470 2024-09-10T14:29:14.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.491+0000 7f733c4e5640 1 -- 172.21.15.151:0/942723596 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94385522368544] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7334077070 con 0x55d7d787e470 2024-09-10T14:29:14.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.491+0000 7f733e9d5980 20 remove_watcher() i=2 2024-09-10T14:29:14.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.491+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94385522371232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x7f7334050070 2024-09-10T14:29:14.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.495+0000 7f733bce4640 1 -- 172.21.15.151:0/942723596 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94385522371232] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73300c9030 con 0x7f7334050070 2024-09-10T14:29:14.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.495+0000 7f733e9d5980 20 remove_watcher() i=3 2024-09-10T14:29:14.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.495+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94385522365824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x55d7d7879a80 2024-09-10T14:29:14.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.495+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94385522365824] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x55d7d7879a80 2024-09-10T14:29:14.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.495+0000 7f733e9d5980 20 remove_watcher() i=4 2024-09-10T14:29:14.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.495+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94385522375856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x7f73300dc040 2024-09-10T14:29:14.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.499+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94385522375856] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.499+0000 7f733e9d5980 20 remove_watcher() i=5 2024-09-10T14:29:14.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.499+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94385522379264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x7f73300dc040 2024-09-10T14:29:14.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.499+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94385522379264] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.499+0000 7f733e9d5980 20 remove_watcher() i=6 2024-09-10T14:29:14.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.499+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94385522381792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d7d78b5ae0 con 0x7f73300dc040 2024-09-10T14:29:14.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94385522381792] v36'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732c0083f0 con 0x7f73300dc040 2024-09-10T14:29:14.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 20 remove_watcher() i=7 2024-09-10T14:29:14.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73300dc040 msgr2=0x7f73300dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f73300dc040 0x7f73300dd430 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d7879a80 msgr2=0x55d7d787bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d7879a80 0x55d7d787bf40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7334050070 msgr2=0x7f73340203e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7334050070 0x7f73340203e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d787e470 msgr2=0x55d7d7880860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d787e470 0x55d7d7880860 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f720c034650 msgr2=0x7f720c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f720c034650 0x7f720c036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f73300ab510 tx=0x7f73300b9040 comp rx=0 tx=0).stop 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 msgr2=0x55d7d786e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/942723596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d76be650 0x55d7d786e980 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7334037b30 tx=0x7f7334048f20 comp rx=0 tx=0).stop 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 reap_dead start 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733cce6640 1 -- 172.21.15.151:0/942723596 reap_dead start 2024-09-10T14:29:14.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 shutdown_connections 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 >> 172.21.15.151:0/942723596 conn(0x55d7d78619e0 msgr2=0x55d7d785fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 shutdown_connections 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/942723596 wait complete. 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/1487567808 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7214034650 msgr2=0x7f7214036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/1487567808 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7214034650 0x7f7214036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55d7d7843630 tx=0x7f7330005a10 comp rx=0 tx=0).stop 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/1487567808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7858c30 msgr2=0x55d7d7859050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/1487567808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7858c30 0x55d7d7859050 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7334048390 tx=0x7f7334012950 comp rx=0 tx=0).stop 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/1487567808 shutdown_connections 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/1487567808 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7214034650 0x7f7214036b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/1487567808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7858c30 0x55d7d7859050 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/1487567808 >> 172.21.15.151:0/1487567808 conn(0x55d7d784dd80 msgr2=0x55d7d7850800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/1487567808 shutdown_connections 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/1487567808 wait complete. 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7d7848700 msgr2=0x55d7d784aaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d7d7848700 0x55d7d784aaf0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d774c9e0 msgr2=0x55d7d7841dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d7d774c9e0 0x55d7d7841dd0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d78447c0 msgr2=0x55d7d7846bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d7d78447c0 0x55d7d7846bb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7224034650 msgr2=0x7f7224036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7224034650 0x7f7224036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f73300ad000 tx=0x7f73300a5040 comp rx=0 tx=0).stop 2024-09-10T14:29:14.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 msgr2=0x55d7d783ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 --2- 172.21.15.151:0/492279901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d7d7748660 0x55d7d783ae20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55d7d7834c70 tx=0x7f7334000f50 comp rx=0 tx=0).stop 2024-09-10T14:29:14.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733cce6640 1 -- 172.21.15.151:0/492279901 reap_dead start 2024-09-10T14:29:14.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 shutdown_connections 2024-09-10T14:29:14.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 >> 172.21.15.151:0/492279901 conn(0x55d7d7744180 msgr2=0x55d7d782e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 shutdown_connections 2024-09-10T14:29:14.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.503+0000 7f733e9d5980 1 -- 172.21.15.151:0/492279901 wait complete. 2024-09-10T14:29:14.520 INFO:teuthology.orchestra.run.smithi151.stdout:fooFoofooFooFULL_CONTROL 2024-09-10T14:29:14.520 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-10T14:29:14.523 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-10T14:29:14.531 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:14.531 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T14:29:14.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T14:29:14.532 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T14:29:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:14.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.591+0000 7f67980cb980 1 Processor -- start 2024-09-10T14:29:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.591+0000 7f67980cb980 1 -- start start 2024-09-10T14:29:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.591+0000 7f67980cb980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5649342072e0 0x564934295370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.591+0000 7f67980cb980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56493411aae0 con 0x5649342958b0 2024-09-10T14:29:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.591+0000 7f67980cb980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56493413ee30 con 0x5649342072e0 2024-09-10T14:29:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.595+0000 7f6795bdb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5649342072e0 0x564934295370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.595+0000 7f67953da640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5649342958b0 0x564934297ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51340/0 (socket says 172.21.15.151:51340) 2024-09-10T14:29:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.595+0000 7f6795bdb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5649342072e0 0x564934295370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39236/0 (socket says 172.21.15.151:39236) 2024-09-10T14:29:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.595+0000 7f67953da640 1 -- 172.21.15.151:0/153847471 learned_addr learned my addr 172.21.15.151:0/153847471 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.595+0000 7f6795bdb640 1 -- 172.21.15.151:0/153847471 >> v1:172.21.15.52:6789/0 conn(0x5649342958b0 legacy=0x564934297ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.595+0000 7f6795bdb640 1 -- 172.21.15.151:0/153847471 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493429a3d0 con 0x5649342072e0 2024-09-10T14:29:14.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.595+0000 7f6795bdb640 1 --2- 172.21.15.151:0/153847471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934295370 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f678800a480 tx=0x7f678801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7bc818dd2f0f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.595+0000 7f6794bd9640 1 -- 172.21.15.151:0/153847471 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880b0070 con 0x5649342072e0 2024-09-10T14:29:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f6794bd9640 1 -- 172.21.15.151:0/153847471 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880ab540 con 0x5649342072e0 2024-09-10T14:29:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f6794bd9640 1 -- 172.21.15.151:0/153847471 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880ab840 con 0x5649342072e0 2024-09-10T14:29:14.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f67980cb980 1 -- 172.21.15.151:0/153847471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 msgr2=0x564934295370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f67980cb980 1 --2- 172.21.15.151:0/153847471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934295370 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f678800a480 tx=0x7f678801b280 comp rx=0 tx=0).stop 2024-09-10T14:29:14.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f67980cb980 1 -- 172.21.15.151:0/153847471 shutdown_connections 2024-09-10T14:29:14.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f67980cb980 1 --2- 172.21.15.151:0/153847471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934295370 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f67980cb980 1 -- 172.21.15.151:0/153847471 >> 172.21.15.151:0/153847471 conn(0x56493428d0a0 msgr2=0x56493428f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f67980cb980 1 -- 172.21.15.151:0/153847471 shutdown_connections 2024-09-10T14:29:14.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.599+0000 7f67980cb980 1 -- 172.21.15.151:0/153847471 wait complete. 2024-09-10T14:29:14.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 Processor -- start 2024-09-10T14:29:14.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 -- start start 2024-09-10T14:29:14.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934292ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564934140200 con 0x5649342072e0 2024-09-10T14:29:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934292ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934292ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39238/0 (socket says 172.21.15.151:39238) 2024-09-10T14:29:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f6795bdb640 1 -- 172.21.15.151:0/152421610 learned_addr learned my addr 172.21.15.151:0/152421610 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f6795bdb640 1 -- 172.21.15.151:0/152421610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649342930a0 con 0x5649342072e0 2024-09-10T14:29:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f6795bdb640 1 --2- 172.21.15.151:0/152421610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934292ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f67880ae040 tx=0x7f6788003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2431dfdbfc31e00 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f6683e07640 1 -- 172.21.15.151:0/152421610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880b0040 con 0x5649342072e0 2024-09-10T14:29:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f6683e07640 1 -- 172.21.15.151:0/152421610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880ab9d0 con 0x5649342072e0 2024-09-10T14:29:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f6683e07640 1 -- 172.21.15.151:0/152421610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880abcf0 con 0x5649342072e0 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 -- 172.21.15.151:0/152421610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 msgr2=0x564934292ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 --2- 172.21.15.151:0/152421610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934292ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f67880ae040 tx=0x7f6788003030 comp rx=0 tx=0).stop 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 -- 172.21.15.151:0/152421610 shutdown_connections 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 --2- 172.21.15.151:0/152421610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934292ad0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.615+0000 7f67980cb980 1 -- 172.21.15.151:0/152421610 >> 172.21.15.151:0/152421610 conn(0x56493428d0a0 msgr2=0x5649343796f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f67980cb980 1 -- 172.21.15.151:0/152421610 shutdown_connections 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f67980cb980 1 -- 172.21.15.151:0/152421610 wait complete. 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f67980cb980 1 Processor -- start 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f67980cb980 1 -- start start 2024-09-10T14:29:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f67980cb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934386f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f67980cb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564934299e40 con 0x5649342072e0 2024-09-10T14:29:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934386f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934386f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39250/0 (socket says 172.21.15.151:39250) 2024-09-10T14:29:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6795bdb640 1 -- 172.21.15.151:0/2182016465 learned_addr learned my addr 172.21.15.151:0/2182016465 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6795bdb640 1 -- 172.21.15.151:0/2182016465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564934387480 con 0x5649342072e0 2024-09-10T14:29:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6795bdb640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934386f40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f678801b2c0 tx=0x7f6788018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6682604640 1 -- 172.21.15.151:0/2182016465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880c5070 con 0x5649342072e0 2024-09-10T14:29:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6682604640 1 -- 172.21.15.151:0/2182016465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880b6830 con 0x5649342072e0 2024-09-10T14:29:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564934387710 con 0x5649342072e0 2024-09-10T14:29:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6682604640 1 -- 172.21.15.151:0/2182016465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880b0050 con 0x5649342072e0 2024-09-10T14:29:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56493438a3f0 con 0x5649342072e0 2024-09-10T14:29:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6682604640 1 -- 172.21.15.151:0/2182016465 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f67880b6b30 con 0x5649342072e0 2024-09-10T14:29:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.619+0000 7f6682604640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f667c0346a0 0x7f667c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f6682604640 1 -- 172.21.15.151:0/2182016465 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f67880bc070 con 0x5649342072e0 2024-09-10T14:29:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67953da640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f667c0346a0 0x7f667c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67980cb980 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649342958b0 0x56493438ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56493438e4a0 con 0x5649342958b0 2024-09-10T14:29:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67963dc640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649342958b0 0x56493438ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67953da640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f667c0346a0 0x7f667c036b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f678c001da0 tx=0x7f678c001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67963dc640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649342958b0 0x56493438ded0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67963dc640 1 -- 172.21.15.151:0/2182016465 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649342958b0 2024-09-10T14:29:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56493438ed60 con 0x5649342958b0 2024-09-10T14:29:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67963dc640 1 -- 172.21.15.151:0/2182016465 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f679000a4d0 con 0x5649342958b0 2024-09-10T14:29:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67980cb980 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564934390670 0x564934392b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343932a0 con 0x564934390670 2024-09-10T14:29:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f6795bdb640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564934390670 0x564934392b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f6795bdb640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564934390670 0x564934392b10 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f6795bdb640 1 -- 172.21.15.151:0/2182016465 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f67880b3040 con 0x564934390670 2024-09-10T14:29:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56493438f5b0 con 0x5649342958b0 2024-09-10T14:29:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67963dc640 1 -- 172.21.15.151:0/2182016465 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f679000a4d0 con 0x5649342958b0 2024-09-10T14:29:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67980cb980 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564934394700 0x564934396af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564934397260 con 0x564934394700 2024-09-10T14:29:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67953da640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564934394700 0x564934396af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.623+0000 7f67953da640 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564934394700 0x564934396af0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f67953da640 1 -- 172.21.15.151:0/2182016465 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f678c00e6c0 con 0x564934394700 2024-09-10T14:29:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f67980cb980 1 Processor -- start 2024-09-10T14:29:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f67980cb980 1 -- start start 2024-09-10T14:29:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f67980cb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343a4d10 0x5649343a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f67980cb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564934199800 con 0x5649343a4d10 2024-09-10T14:29:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343a4d10 0x5649343a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343a4d10 0x5649343a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39260/0 (socket says 172.21.15.151:39260) 2024-09-10T14:29:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f6795bdb640 1 -- 172.21.15.151:0/3778570282 learned_addr learned my addr 172.21.15.151:0/3778570282 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f6795bdb640 1 -- 172.21.15.151:0/3778570282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649343a5670 con 0x5649343a4d10 2024-09-10T14:29:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f6795bdb640 1 --2- 172.21.15.151:0/3778570282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343a4d10 0x5649343a5130 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f67880e2580 tx=0x7f67880b78b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f667b7fe640 1 -- 172.21.15.151:0/3778570282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880e1080 con 0x5649343a4d10 2024-09-10T14:29:14.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f67980cb980 1 -- 172.21.15.151:0/3778570282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649343a5900 con 0x5649343a4d10 2024-09-10T14:29:14.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f667b7fe640 1 -- 172.21.15.151:0/3778570282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880aa5d0 con 0x5649343a4d10 2024-09-10T14:29:14.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f667b7fe640 1 -- 172.21.15.151:0/3778570282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880ec060 con 0x5649343a4d10 2024-09-10T14:29:14.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.627+0000 7f67980cb980 1 -- 172.21.15.151:0/3778570282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649343a8580 con 0x5649343a4d10 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f667b7fe640 1 -- 172.21.15.151:0/3778570282 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f67880aa8b0 con 0x5649343a4d10 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f667b7fe640 1 --2- 172.21.15.151:0/3778570282 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6670034650 0x7f6670036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f667b7fe640 1 -- 172.21.15.151:0/3778570282 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f67880a8070 con 0x5649343a4d10 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67953da640 1 --2- 172.21.15.151:0/3778570282 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6670034650 0x7f6670036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 Processor -- start 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 -- start start 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564934291200 con 0x5649343b15f0 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67953da640 1 --2- 172.21.15.151:0/3778570282 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6670034650 0x7f6670036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x564934393640 tx=0x7f678c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39266/0 (socket says 172.21.15.151:39266) 2024-09-10T14:29:14.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f6795bdb640 1 -- 172.21.15.151:0/2839714241 learned_addr learned my addr 172.21.15.151:0/2839714241 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f6795bdb640 1 -- 172.21.15.151:0/2839714241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649343b1fa0 con 0x5649343b15f0 2024-09-10T14:29:14.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f6795bdb640 1 --2- 172.21.15.151:0/2839714241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b19d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f67880e1240 tx=0x7f67880d34f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04be21d2aa7eb97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f66797fa640 1 -- 172.21.15.151:0/2839714241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880bc430 con 0x5649343b15f0 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f66797fa640 1 -- 172.21.15.151:0/2839714241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880bc7b0 con 0x5649343b15f0 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f66797fa640 1 -- 172.21.15.151:0/2839714241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880bc5d0 con 0x5649343b15f0 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 -- 172.21.15.151:0/2839714241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 msgr2=0x5649343b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 --2- 172.21.15.151:0/2839714241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b19d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f67880e1240 tx=0x7f67880d34f0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 -- 172.21.15.151:0/2839714241 shutdown_connections 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 --2- 172.21.15.151:0/2839714241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b19d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 -- 172.21.15.151:0/2839714241 >> 172.21.15.151:0/2839714241 conn(0x5649343ad9d0 msgr2=0x5649343abad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 -- 172.21.15.151:0/2839714241 shutdown_connections 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 -- 172.21.15.151:0/2839714241 wait complete. 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.631+0000 7f67980cb980 1 Processor -- start 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67980cb980 1 -- start start 2024-09-10T14:29:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67980cb980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67980cb980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5649343b2440 con 0x5649343b15f0 2024-09-10T14:29:14.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f6795bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39270/0 (socket says 172.21.15.151:39270) 2024-09-10T14:29:14.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 learned_addr learned my addr 172.21.15.151:0/1457173746 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649343b8d30 con 0x5649343b15f0 2024-09-10T14:29:14.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f6795bdb640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b87f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f67880e1340 tx=0x7f67880d0ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f66677fe640 1 -- 172.21.15.151:0/1457173746 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678810c020 con 0x5649343b15f0 2024-09-10T14:29:14.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f66677fe640 1 -- 172.21.15.151:0/1457173746 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880dfa60 con 0x5649343b15f0 2024-09-10T14:29:14.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649343b8d30 con 0x5649343b15f0 2024-09-10T14:29:14.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f66677fe640 1 -- 172.21.15.151:0/1457173746 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67880dfc10 con 0x5649343b15f0 2024-09-10T14:29:14.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649343b9200 con 0x5649343b15f0 2024-09-10T14:29:14.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f66677fe640 1 -- 172.21.15.151:0/1457173746 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f678810f020 con 0x5649343b15f0 2024-09-10T14:29:14.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f66677fe640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6660034650 0x7f6660036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f66677fe640 1 -- 172.21.15.151:0/1457173746 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f67880f7050 con 0x5649343b15f0 2024-09-10T14:29:14.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67953da640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6660034650 0x7f6660036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67980cb980 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649343c38b0 0x5649343c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.635+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343c64c0 con 0x5649343c38b0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67963dc640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649343c38b0 0x5649343c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67953da640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6660034650 0x7f6660036b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x564934397640 tx=0x7f678c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67963dc640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649343c38b0 0x5649343c5d70 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 realm 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343c68d0 con 0x5649343c38b0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:14.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343c71a0 con 0x5649343c38b0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5649343c82a0 0x5649343ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343cac60 con 0x5649343c82a0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f6795bdb640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5649343c82a0 0x5649343ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f6795bdb640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5649343c82a0 0x5649343ca690 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 20 searching for the correct realm 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343cc530 con 0x5649343c82a0 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f6795bdb640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6788111020 0x7f67880b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343cc530 con 0x7f6788111020 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67953da640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6788111020 0x7f67880b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.639+0000 7f67953da640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6788111020 0x7f67880b26c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67953da640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f678c037040 0x7f678c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343cc530 con 0x7f678c037040 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f678c037040 0x7f678c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f678c037040 0x7f678c036410 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f678c037040 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f678c037040 2024-09-10T14:29:14.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f6788111020 2024-09-10T14:29:14.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.643+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c82a0 2024-09-10T14:29:14.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f678c037040 2024-09-10T14:29:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f6788111020 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c82a0 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c82a0 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f6788111020 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c82a0 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c82a0 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.647+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f678c037040 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c82a0 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f6788111020 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f6788111020 2024-09-10T14:29:14.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c82a0 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f678c037040 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f6788111020 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c82a0 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.651+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f678c037040 2024-09-10T14:29:14.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x5649343c38b0 2024-09-10T14:29:14.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5649343c7540 con 0x7f6788111020 2024-09-10T14:29:14.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343cb650 con 0x5649343c38b0 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343cbef0 con 0x5649343c38b0 2024-09-10T14:29:14.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343cb290 con 0x7f678c037040 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 zone default found 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 4 Realm: () 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 zonegroup default 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343cbef0 con 0x7f6788111020 2024-09-10T14:29:14.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343ce390 con 0x5649343c82a0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343ce860 con 0x5649343c82a0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.655+0000 7f67980cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67980cb980 20 started sync module instance, tier type = 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67980cb980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:14.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343cd7e0 con 0x7f6788111020 2024-09-10T14:29:14.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94872409005008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343cf170 con 0x7f6788111020 2024-09-10T14:29:14.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343cf9c0 con 0x5649343c38b0 2024-09-10T14:29:14.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94872409005008] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94872409009344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343cf9c0 con 0x5649343c38b0 2024-09-10T14:29:14.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.659+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d0420 con 0x5649343c82a0 2024-09-10T14:29:14.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.663+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.663+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94872409014016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d0cc0 con 0x5649343c82a0 2024-09-10T14:29:14.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.663+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d16c0 con 0x7f6788111020 2024-09-10T14:29:14.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.663+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94872409009344] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.663+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.663+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94872409011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d1ab0 con 0x7f6788111020 2024-09-10T14:29:14.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.663+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d2470 con 0x5649343c38b0 2024-09-10T14:29:14.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.663+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94872409014016] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.667+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94872409011472] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.667+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.667+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94872409018832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d1fc0 con 0x5649343c38b0 2024-09-10T14:29:14.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.667+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d2810 con 0x7f678c037040 2024-09-10T14:29:14.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.667+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94872409018832] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.667+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.667+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94872409022400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d0920 con 0x7f678c037040 2024-09-10T14:29:14.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.667+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d3110 con 0x7f678c037040 2024-09-10T14:29:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94872409022400] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94872409025536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d30d0 con 0x7f678c037040 2024-09-10T14:29:14.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d3b10 con 0x7f678c037040 2024-09-10T14:29:14.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94872409025536] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94872409028064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d3ad0 con 0x7f678c037040 2024-09-10T14:29:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 20 add_watcher() i=0 2024-09-10T14:29:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 20 add_watcher() i=1 2024-09-10T14:29:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 20 add_watcher() i=2 2024-09-10T14:29:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 20 add_watcher() i=3 2024-09-10T14:29:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 20 add_watcher() i=4 2024-09-10T14:29:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 20 add_watcher() i=5 2024-09-10T14:29:14.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.671+0000 7f67980cb980 20 add_watcher() i=6 2024-09-10T14:29:14.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94872409028064] v36'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67980cb980 20 add_watcher() i=7 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67980cb980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343d6f30 con 0x5649343c38b0 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94872409023456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d4420 con 0x5649343c38b0 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94872409023456] v36'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f66477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67980cb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67980cb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.675+0000 7f67980cb980 5 note: GC not initialized 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f66467fc640 20 reqs_thread_entry: start 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:14.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 20 Filter name: none 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f65b7fff640 20 reqs_thread_entry: start 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343faba0 con 0x7f6788111020 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:29:14.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 : miss 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.1b 8:dd5d0cf7:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343fc630 con 0x7f6788111020 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(63 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 info.flags=0x17 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 to cache LRU end 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 20 get_obj_state: octx=0x7f679000ab00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5649343fecf8 s->prefetch_data=0 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 3.33s0 3:cd4b0643:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5649343ffca0 con 0x7f678c037040 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(64 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 10 manifest: total_size = 5 2024-09-10T14:29:14.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 20 get_obj_state: setting s->obj_tag to _M_ILZNXZ7t_3iWpdUi5kkpR00vb72Fe 2024-09-10T14:29:14.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f66477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:14.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.679+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94872409023456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343f8410 con 0x5649343c38b0 2024-09-10T14:29:14.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.683+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94872409023456] v36'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.683+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94872409005008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d23e0 con 0x7f6788111020 2024-09-10T14:29:14.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.683+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94872409005008] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.683+0000 7f67980cb980 20 remove_watcher() i=0 2024-09-10T14:29:14.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.683+0000 7f67980cb980 2 removed watcher, disabling cache 2024-09-10T14:29:14.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.683+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94872409009344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343d23e0 con 0x5649343c38b0 2024-09-10T14:29:14.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.683+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94872409009344] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.683+0000 7f67980cb980 20 remove_watcher() i=1 2024-09-10T14:29:14.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.687+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94872409014016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343ffca0 con 0x5649343c82a0 2024-09-10T14:29:14.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.687+0000 7f6795bdb640 1 -- 172.21.15.151:0/1457173746 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94872409014016] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67880b3040 con 0x5649343c82a0 2024-09-10T14:29:14.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.687+0000 7f67980cb980 20 remove_watcher() i=2 2024-09-10T14:29:14.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.687+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94872409011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343ffca0 con 0x7f6788111020 2024-09-10T14:29:14.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.687+0000 7f67953da640 1 -- 172.21.15.151:0/1457173746 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94872409011472] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f678c00e6c0 con 0x7f6788111020 2024-09-10T14:29:14.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.687+0000 7f67980cb980 20 remove_watcher() i=3 2024-09-10T14:29:14.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.687+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94872409018832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343ffca0 con 0x5649343c38b0 2024-09-10T14:29:14.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.691+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94872409018832] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x5649343c38b0 2024-09-10T14:29:14.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.691+0000 7f67980cb980 20 remove_watcher() i=4 2024-09-10T14:29:14.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.691+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94872409022400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343ffca0 con 0x7f678c037040 2024-09-10T14:29:14.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.691+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94872409022400] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.691+0000 7f67980cb980 20 remove_watcher() i=5 2024-09-10T14:29:14.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.691+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94872409025536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343ffca0 con 0x7f678c037040 2024-09-10T14:29:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94872409025536] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 20 remove_watcher() i=6 2024-09-10T14:29:14.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94872409028064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5649343ffca0 con 0x7f678c037040 2024-09-10T14:29:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94872409028064] v36'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679000a4d0 con 0x7f678c037040 2024-09-10T14:29:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 20 remove_watcher() i=7 2024-09-10T14:29:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f678c037040 msgr2=0x7f678c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f678c037040 0x7f678c036410 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649343c38b0 msgr2=0x5649343c5d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649343c38b0 0x5649343c5d70 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6788111020 msgr2=0x7f67880b26c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6788111020 0x7f67880b26c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5649343c82a0 msgr2=0x5649343ca690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5649343c82a0 0x5649343ca690 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6660034650 msgr2=0x7f6660036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6660034650 0x7f6660036b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x564934397640 tx=0x7f678c010000 comp rx=0 tx=0).stop 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 msgr2=0x5649343b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67980cb980 1 --2- 172.21.15.151:0/1457173746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343b15f0 0x5649343b87f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f67880e1340 tx=0x7f67880d0ec0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 reap_dead start 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.695+0000 7f67963dc640 1 -- 172.21.15.151:0/1457173746 reap_dead start 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 shutdown_connections 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 >> 172.21.15.151:0/1457173746 conn(0x5649343ad9d0 msgr2=0x5649343abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 shutdown_connections 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/1457173746 wait complete. 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/3778570282 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6670034650 msgr2=0x7f6670036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/3778570282 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6670034650 0x7f6670036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x564934393640 tx=0x7f678c00f000 comp rx=0 tx=0).stop 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/3778570282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343a4d10 msgr2=0x5649343a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/3778570282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343a4d10 0x5649343a5130 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f67880e2580 tx=0x7f67880b78b0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/3778570282 shutdown_connections 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/3778570282 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6670034650 0x7f6670036b10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/3778570282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649343a4d10 0x5649343a5130 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/3778570282 >> 172.21.15.151:0/3778570282 conn(0x564934399e60 msgr2=0x56493439c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/3778570282 shutdown_connections 2024-09-10T14:29:14.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/3778570282 wait complete. 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564934394700 msgr2=0x564934396af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x564934394700 0x564934396af0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649342958b0 msgr2=0x56493438ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5649342958b0 0x56493438ded0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564934390670 msgr2=0x564934392b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x564934390670 0x564934392b10 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f667c0346a0 msgr2=0x7f667c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f667c0346a0 0x7f667c036b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f678c001da0 tx=0x7f678c001300 comp rx=0 tx=0).stop 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 msgr2=0x564934386f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 --2- 172.21.15.151:0/2182016465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649342072e0 0x564934386f40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f678801b2c0 tx=0x7f6788018020 comp rx=0 tx=0).stop 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67963dc640 1 -- 172.21.15.151:0/2182016465 reap_dead start 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 shutdown_connections 2024-09-10T14:29:14.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 >> 172.21.15.151:0/2182016465 conn(0x56493428d0a0 msgr2=0x564934291720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 shutdown_connections 2024-09-10T14:29:14.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.699+0000 7f67980cb980 1 -- 172.21.15.151:0/2182016465 wait complete. 2024-09-10T14:29:14.713 INFO:teuthology.orchestra.run.smithi151.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T14:29:14.713 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T14:29:14.716 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-10T14:29:14.734 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:14.807 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T14:29:14.808 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T14:29:14.808 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T14:29:14.808 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T14:29:14.808 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T14:29:14.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T14:29:14.808 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-10T14:29:14.846 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:14.846 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:14.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa74a9e6980 1 Processor -- start 2024-09-10T14:29:14.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa74a9e6980 1 -- start start 2024-09-10T14:29:14.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa74a9e6980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c9ee3c2ea0 0x55c9ee3c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa74a9e6980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9ee244ae0 con 0x55c9ee330ad0 2024-09-10T14:29:14.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa74a9e6980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55c9ee268e30 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa747cf5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c9ee3c2ea0 0x55c9ee3c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa7484f6640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55c9ee330ad0 0x55c9ee3c1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51356/0 (socket says 172.21.15.151:51356) 2024-09-10T14:29:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa7484f6640 1 -- 172.21.15.151:0/2443268906 learned_addr learned my addr 172.21.15.151:0/2443268906 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa747cf5640 1 --2- 172.21.15.151:0/2443268906 >> v2:172.21.15.52:3300/0 conn(0x55c9ee3c2ea0 0x55c9ee3c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39280/0 (socket says 172.21.15.151:39280) 2024-09-10T14:29:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa747cf5640 1 -- 172.21.15.151:0/2443268906 >> v1:172.21.15.52:6789/0 conn(0x55c9ee330ad0 legacy=0x55c9ee3c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.843+0000 7fa747cf5640 1 -- 172.21.15.151:0/2443268906 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ee330eb0 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa747cf5640 1 --2- 172.21.15.151:0/2443268906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee3c2ea0 0x55c9ee3c5290 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa73000a480 tx=0x7fa73001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91981fb0ee5ce9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa7474f4640 1 -- 172.21.15.151:0/2443268906 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7300b0070 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa7474f4640 1 -- 172.21.15.151:0/2443268906 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7300ab540 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa7474f4640 1 -- 172.21.15.151:0/2443268906 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7300ab840 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2443268906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee3c2ea0 msgr2=0x55c9ee3c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/2443268906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee3c2ea0 0x55c9ee3c5290 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa73000a480 tx=0x7fa73001b280 comp rx=0 tx=0).stop 2024-09-10T14:29:14.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2443268906 shutdown_connections 2024-09-10T14:29:14.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/2443268906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee3c2ea0 0x55c9ee3c5290 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2443268906 >> 172.21.15.151:0/2443268906 conn(0x55c9ee3b7070 msgr2=0x55c9ee3b9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2443268906 shutdown_connections 2024-09-10T14:29:14.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.847+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2443268906 wait complete. 2024-09-10T14:29:14.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.863+0000 7fa74a9e6980 1 Processor -- start 2024-09-10T14:29:14.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.863+0000 7fa74a9e6980 1 -- start start 2024-09-10T14:29:14.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.863+0000 7fa74a9e6980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.863+0000 7fa74a9e6980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9ee26a200 con 0x55c9ee330ad0 2024-09-10T14:29:14.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.863+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.863+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39288/0 (socket says 172.21.15.151:39288) 2024-09-10T14:29:14.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.863+0000 7fa7484f6640 1 -- 172.21.15.151:0/845259063 learned_addr learned my addr 172.21.15.151:0/845259063 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.863+0000 7fa7484f6640 1 -- 172.21.15.151:0/845259063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ee4aa2a0 con 0x55c9ee330ad0 2024-09-10T14:29:14.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa7484f6640 1 --2- 172.21.15.151:0/845259063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4a9cd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa738001e20 tx=0x7fa73800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558ea2ab387a266f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa63660c640 1 -- 172.21.15.151:0/845259063 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738012020 con 0x55c9ee330ad0 2024-09-10T14:29:14.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa63660c640 1 -- 172.21.15.151:0/845259063 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73800e7c0 con 0x55c9ee330ad0 2024-09-10T14:29:14.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa63660c640 1 -- 172.21.15.151:0/845259063 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73800eb00 con 0x55c9ee330ad0 2024-09-10T14:29:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- 172.21.15.151:0/845259063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 msgr2=0x55c9ee4a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/845259063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4a9cd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa738001e20 tx=0x7fa73800b790 comp rx=0 tx=0).stop 2024-09-10T14:29:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- 172.21.15.151:0/845259063 shutdown_connections 2024-09-10T14:29:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/845259063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4a9cd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- 172.21.15.151:0/845259063 >> 172.21.15.151:0/845259063 conn(0x55c9ee3b7070 msgr2=0x55c9ee4a5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- 172.21.15.151:0/845259063 shutdown_connections 2024-09-10T14:29:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- 172.21.15.151:0/845259063 wait complete. 2024-09-10T14:29:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 Processor -- start 2024-09-10T14:29:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- start start 2024-09-10T14:29:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9ee3c8260 con 0x55c9ee330ad0 2024-09-10T14:29:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39296/0 (socket says 172.21.15.151:39296) 2024-09-10T14:29:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa7484f6640 1 -- 172.21.15.151:0/697348819 learned_addr learned my addr 172.21.15.151:0/697348819 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa7484f6640 1 -- 172.21.15.151:0/697348819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ee4b1580 con 0x55c9ee330ad0 2024-09-10T14:29:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa7484f6640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4b1040 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa738001e20 tx=0x7fa738000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa634e09640 1 -- 172.21.15.151:0/697348819 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738012030 con 0x55c9ee330ad0 2024-09-10T14:29:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ee4b1810 con 0x55c9ee330ad0 2024-09-10T14:29:14.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa634e09640 1 -- 172.21.15.151:0/697348819 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa738001480 con 0x55c9ee330ad0 2024-09-10T14:29:14.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa634e09640 1 -- 172.21.15.151:0/697348819 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73801a940 con 0x55c9ee330ad0 2024-09-10T14:29:14.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.867+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ee4b44f0 con 0x55c9ee330ad0 2024-09-10T14:29:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa634e09640 1 -- 172.21.15.151:0/697348819 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa738015020 con 0x55c9ee330ad0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa634e09640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa630034650 0x7fa630036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa634e09640 1 -- 172.21.15.151:0/697348819 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa738020030 con 0x55c9ee330ad0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa747cf5640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa630034650 0x7fa630036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee3c2ea0 0x55c9ee4b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4b8680 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa748cf7640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee3c2ea0 0x55c9ee4b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa747cf5640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa630034650 0x7fa630036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa7300ad000 tx=0x7fa7300a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa748cf7640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee3c2ea0 0x55c9ee4b8010 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa748cf7640 1 -- 172.21.15.151:0/697348819 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4b56f0 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa748cf7640 1 -- 172.21.15.151:0/697348819 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4ba9b0 0x55c9ee4bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4bd470 con 0x55c9ee4ba9b0 2024-09-10T14:29:14.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa7484f6640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4ba9b0 0x55c9ee4bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa7484f6640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4ba9b0 0x55c9ee4bcda0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa7484f6640 1 -- 172.21.15.151:0/697348819 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa738008030 con 0x55c9ee4ba9b0 2024-09-10T14:29:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4b9850 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa748cf7640 1 -- 172.21.15.151:0/697348819 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee3c2ea0 2024-09-10T14:29:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9ee4be8d0 0x55c9ee4c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4c1400 con 0x55c9ee4be8d0 2024-09-10T14:29:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.871+0000 7fa747cf5640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9ee4be8d0 0x55c9ee4c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa747cf5640 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9ee4be8d0 0x55c9ee4c0cc0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa747cf5640 1 -- 172.21.15.151:0/697348819 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7300b3040 con 0x55c9ee4be8d0 2024-09-10T14:29:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa74a9e6980 1 Processor -- start 2024-09-10T14:29:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa74a9e6980 1 -- start start 2024-09-10T14:29:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa74a9e6980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4ceed0 0x55c9ee4cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa74a9e6980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9ee2c3800 con 0x55c9ee4ceed0 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4ceed0 0x55c9ee4cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4ceed0 0x55c9ee4cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39306/0 (socket says 172.21.15.151:39306) 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa7484f6640 1 -- 172.21.15.151:0/2710925405 learned_addr learned my addr 172.21.15.151:0/2710925405 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa7484f6640 1 -- 172.21.15.151:0/2710925405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ee4cf830 con 0x55c9ee4ceed0 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa7484f6640 1 --2- 172.21.15.151:0/2710925405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4ceed0 0x55c9ee4cf2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa73800d010 tx=0x7fa738016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa62dffb640 1 -- 172.21.15.151:0/2710925405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738017c50 con 0x55c9ee4ceed0 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa62dffb640 1 -- 172.21.15.151:0/2710925405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa738017df0 con 0x55c9ee4ceed0 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2710925405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ee4cfac0 con 0x55c9ee4ceed0 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa62dffb640 1 -- 172.21.15.151:0/2710925405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738041d70 con 0x55c9ee4ceed0 2024-09-10T14:29:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.875+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2710925405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ee4d2740 con 0x55c9ee4ceed0 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa62dffb640 1 -- 172.21.15.151:0/2710925405 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa738009070 con 0x55c9ee4ceed0 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa62dffb640 1 --2- 172.21.15.151:0/2710925405 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa6200346a0 0x7fa620036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa62dffb640 1 -- 172.21.15.151:0/2710925405 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa738005050 con 0x55c9ee4ceed0 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa747cf5640 1 --2- 172.21.15.151:0/2710925405 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa6200346a0 0x7fa620036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa74a9e6980 1 Processor -- start 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa74a9e6980 1 -- start start 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa74a9e6980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4dbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa74a9e6980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9ee4aa620 con 0x55c9ee4db7f0 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa747cf5640 1 --2- 172.21.15.151:0/2710925405 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa6200346a0 0x7fa620036b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55c9ee4b8f60 tx=0x7fa730005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4dbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4dbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39316/0 (socket says 172.21.15.151:39316) 2024-09-10T14:29:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa7484f6640 1 -- 172.21.15.151:0/3650271179 learned_addr learned my addr 172.21.15.151:0/3650271179 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa7484f6640 1 -- 172.21.15.151:0/3650271179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ee4dc1a0 con 0x55c9ee4db7f0 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa7484f6640 1 --2- 172.21.15.151:0/3650271179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4dbbd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa73804a4d0 tx=0x7fa73804a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa43b9217f537b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa6277fe640 1 -- 172.21.15.151:0/3650271179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73800cbd0 con 0x55c9ee4db7f0 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa6277fe640 1 -- 172.21.15.151:0/3650271179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73805e070 con 0x55c9ee4db7f0 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.879+0000 7fa6277fe640 1 -- 172.21.15.151:0/3650271179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73800c6b0 con 0x55c9ee4db7f0 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- 172.21.15.151:0/3650271179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 msgr2=0x55c9ee4dbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/3650271179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4dbbd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa73804a4d0 tx=0x7fa73804a500 comp rx=0 tx=0).stop 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- 172.21.15.151:0/3650271179 shutdown_connections 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/3650271179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4dbbd0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- 172.21.15.151:0/3650271179 >> 172.21.15.151:0/3650271179 conn(0x55c9ee4d7bd0 msgr2=0x55c9ee4d5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- 172.21.15.151:0/3650271179 shutdown_connections 2024-09-10T14:29:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- 172.21.15.151:0/3650271179 wait complete. 2024-09-10T14:29:14.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 Processor -- start 2024-09-10T14:29:14.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- start start 2024-09-10T14:29:14.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4e2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9ee4dc640 con 0x55c9ee4db7f0 2024-09-10T14:29:14.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4e2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa7484f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4e2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39320/0 (socket says 172.21.15.151:39320) 2024-09-10T14:29:14.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 learned_addr learned my addr 172.21.15.151:0/564135856 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ee4e2f40 con 0x55c9ee4db7f0 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa7484f6640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4e2a00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa73802f0b0 tx=0x7fa73800ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa625ffb640 1 -- 172.21.15.151:0/564135856 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73804fc90 con 0x55c9ee4db7f0 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ee4e2f40 con 0x55c9ee4db7f0 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa625ffb640 1 -- 172.21.15.151:0/564135856 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73804fe30 con 0x55c9ee4db7f0 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa625ffb640 1 -- 172.21.15.151:0/564135856 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7380248d0 con 0x55c9ee4db7f0 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.883+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ee4e2f40 con 0x55c9ee4db7f0 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa625ffb640 1 -- 172.21.15.151:0/564135856 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa73802d3f0 con 0x55c9ee4db7f0 2024-09-10T14:29:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa625ffb640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa618034650 0x7fa618036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa625ffb640 1 -- 172.21.15.151:0/564135856 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa73806fd60 con 0x55c9ee4db7f0 2024-09-10T14:29:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa747cf5640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa618034650 0x7fa618036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee4edaa0 0x55c9ee4eff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f06b0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa748cf7640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee4edaa0 0x55c9ee4eff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa747cf5640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa618034650 0x7fa618036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa730000c10 tx=0x7fa7300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa748cf7640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee4edaa0 0x55c9ee4eff60 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 realm 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f0ac0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1360 con 0x55c9ee4edaa0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4f2460 0x55c9ee4f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f4ea0 con 0x55c9ee4f2460 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa7484f6640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4f2460 0x55c9ee4f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa7484f6640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4f2460 0x55c9ee4f4850 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 20 searching for the correct realm 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.887+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f6700 con 0x55c9ee4f2460 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa7484f6640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa738039070 0x7fa738059460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f6700 con 0x7fa738039070 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa747cf5640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa738039070 0x7fa738059460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa747cf5640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa738039070 0x7fa738059460 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa747cf5640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa7300dc040 0x7fa7300dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f6700 con 0x7fa7300dc040 2024-09-10T14:29:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa7300dc040 0x7fa7300dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:14.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa7300dc040 0x7fa7300dd430 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa7300dc040 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.891+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa7300dc040 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa738039070 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4f2460 2024-09-10T14:29:14.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa7300dc040 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa738039070 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4f2460 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4f2460 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa738039070 2024-09-10T14:29:14.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.895+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4f2460 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4f2460 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa7300dc040 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4f2460 2024-09-10T14:29:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa738039070 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa738039070 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4f2460 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa7300dc040 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.899+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa738039070 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4f2460 2024-09-10T14:29:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa7300dc040 2024-09-10T14:29:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x55c9ee4edaa0 2024-09-10T14:29:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f1700 con 0x7fa738039070 2024-09-10T14:29:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f57f0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f6040 con 0x55c9ee4edaa0 2024-09-10T14:29:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f5b90 con 0x7fa7300dc040 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 zone default found 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 4 Realm: () 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 zonegroup default 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f5fc0 con 0x7fa738039070 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f8540 con 0x55c9ee4f2460 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.903+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f89d0 con 0x55c9ee4f2460 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 20 started sync module instance, tier type = 2024-09-10T14:29:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:14.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f79b0 con 0x7fa738039070 2024-09-10T14:29:14.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94325774974368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f92e0 con 0x7fa738039070 2024-09-10T14:29:14.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f9b30 con 0x55c9ee4edaa0 2024-09-10T14:29:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94325774974368] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.907+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94325774978608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f9b30 con 0x55c9ee4edaa0 2024-09-10T14:29:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.911+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fa5f0 con 0x55c9ee4f2460 2024-09-10T14:29:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.911+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94325774978608] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.911+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.911+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94325774980736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4f9aa0 con 0x55c9ee4f2460 2024-09-10T14:29:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.911+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fb3b0 con 0x7fa738039070 2024-09-10T14:29:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.915+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.915+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94325774986944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fbc50 con 0x7fa738039070 2024-09-10T14:29:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.915+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fc610 con 0x55c9ee4edaa0 2024-09-10T14:29:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.915+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94325774980736] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.915+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.915+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94325774986944] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.915+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94325774985744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fc610 con 0x55c9ee4edaa0 2024-09-10T14:29:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.915+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fcee0 con 0x7fa7300dc040 2024-09-10T14:29:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.919+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94325774985744] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.919+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.919+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94325774991984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fcc60 con 0x7fa7300dc040 2024-09-10T14:29:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.919+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fd760 con 0x7fa7300dc040 2024-09-10T14:29:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.919+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94325774991984] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.919+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.919+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94325774996048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fd720 con 0x7fa7300dc040 2024-09-10T14:29:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.919+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fe1a0 con 0x7fa7300dc040 2024-09-10T14:29:14.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94325774996048] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94325774993104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4fe1a0 con 0x7fa7300dc040 2024-09-10T14:29:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa74a9e6980 20 add_watcher() i=0 2024-09-10T14:29:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa74a9e6980 20 add_watcher() i=1 2024-09-10T14:29:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa74a9e6980 20 add_watcher() i=2 2024-09-10T14:29:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa74a9e6980 20 add_watcher() i=3 2024-09-10T14:29:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa74a9e6980 20 add_watcher() i=4 2024-09-10T14:29:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa74a9e6980 20 add_watcher() i=5 2024-09-10T14:29:14.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.923+0000 7fa74a9e6980 20 add_watcher() i=6 2024-09-10T14:29:14.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94325774993104] v36'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa74a9e6980 20 add_watcher() i=7 2024-09-10T14:29:14.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa74a9e6980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:14.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5015a0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94325774999232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee4feaf0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94325774999232] v36'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa5fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:14.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa74a9e6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:14.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa74a9e6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:14.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.927+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee509e80 con 0x55c9ee4edaa0 2024-09-10T14:29:14.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.931+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.931+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50a490 con 0x7fa7300dc040 2024-09-10T14:29:14.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.931+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.931+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50aa00 con 0x55c9ee4f2460 2024-09-10T14:29:14.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.931+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.931+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50aa00 con 0x55c9ee4edaa0 2024-09-10T14:29:14.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.935+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'184 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.935+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50ae00 con 0x7fa738039070 2024-09-10T14:29:14.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.935+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.935+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50b2b0 con 0x55c9ee4f2460 2024-09-10T14:29:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.935+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'42 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.935+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50b2b0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.939+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.939+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50b2b0 con 0x7fa7300dc040 2024-09-10T14:29:14.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.939+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.939+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50b2b0 con 0x7fa738039070 2024-09-10T14:29:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.943+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.943+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50b8c0 con 0x55c9ee4f2460 2024-09-10T14:29:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.943+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.943+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50b950 con 0x7fa738039070 2024-09-10T14:29:14.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.947+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.947+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa7300dc040 2024-09-10T14:29:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.947+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.947+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa738039070 2024-09-10T14:29:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.951+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.951+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa7300dc040 2024-09-10T14:29:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.951+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.951+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4edaa0 2024-09-10T14:29:14.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.955+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'185 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.955+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.955+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.955+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa738039070 2024-09-10T14:29:14.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.959+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.959+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.959+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.959+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4edaa0 2024-09-10T14:29:14.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.959+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.959+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4edaa0 2024-09-10T14:29:14.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.963+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'186 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.963+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.963+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.963+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa738039070 2024-09-10T14:29:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.967+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.967+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.967+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.967+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.967+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.967+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.971+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.971+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.971+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.971+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa7300dc040 2024-09-10T14:29:14.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.975+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.975+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.975+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.975+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa7300dc040 2024-09-10T14:29:14.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.979+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.979+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x55c9ee4f2460 2024-09-10T14:29:14.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.979+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.979+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa7300dc040 2024-09-10T14:29:14.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee50be00 con 0x7fa738039070 2024-09-10T14:29:14.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa5fd7e2640 20 reqs_thread_entry: start 2024-09-10T14:29:14.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa74a9e6980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:14.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa74a9e6980 20 Filter name: none 2024-09-10T14:29:14.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa56effd640 20 reqs_thread_entry: start 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa74a9e6980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.983+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee508310 con 0x7fa738039070 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 : miss 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:14.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 8.1b 8:dd5d0cf7:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529080 con 0x7fa738039070 2024-09-10T14:29:14.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(95 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 info.flags=0x17 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 to cache LRU end 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 4.38 4:1d79cf1a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a65b0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(96 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 4.3a 4:5f78abaf:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a65b0 con 0x55c9ee4f2460 2024-09-10T14:29:14.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(97 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:98 4.27 4:e4e21060:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a65b0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(98 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-10T14:29:14.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.987+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:99 4.23 4:c718e97d:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a6b00 con 0x7fa7300dc040 2024-09-10T14:29:14.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(99 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74000a4d0 con 0x7fa7300dc040 2024-09-10T14:29:14.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:100 4.2b 4:d5e08adb:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a6b00 con 0x55c9ee4edaa0 2024-09-10T14:29:14.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(100 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:101 4.b 4:d3aa090d:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a6b00 con 0x7fa738039070 2024-09-10T14:29:14.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(101 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:14.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:102 4.2f 4:f7d3b08b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a6b00 con 0x55c9ee4edaa0 2024-09-10T14:29:14.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(102 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-10T14:29:14.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:103 4.29 4:9401715c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a6b00 con 0x55c9ee4f2460 2024-09-10T14:29:14.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(103 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:104 4.30 4:0d10ffd1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a6b00 con 0x55c9ee4f2460 2024-09-10T14:29:14.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(104 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T14:29:14.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:105 4.5 4:a07d4e5a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a6b00 con 0x55c9ee4f2460 2024-09-10T14:29:14.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(105 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.991+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:106 4.2c 4:34f866c1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a6b00 con 0x55c9ee4edaa0 2024-09-10T14:29:14.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(106 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 [call out=697b] v0'0 uv11 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:14.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-10T14:29:14.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-10T14:29:14.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:107 3.1bs0 3:da96d82a:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5a4130 con 0x55c9ee4f2460 2024-09-10T14:29:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(107 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 10 manifest: total_size = 6 2024-09-10T14:29:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 20 get_obj_state: setting s->obj_tag to 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.4615565428603541299 2024-09-10T14:29:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 20 prepare_atomic_modification: state is not atomic. state=0x55c9ee529908 2024-09-10T14:29:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2 2024-09-10T14:29:14.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:108 4.27 4:e4e21060:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52e770 con 0x55c9ee4edaa0 2024-09-10T14:29:15.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(108 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2 [stat,call,call] v36'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa74000a4d0 con 0x55c9ee4edaa0 2024-09-10T14:29:15.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.995+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:109 3.1bs0 3:da96d82a:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52c750 con 0x55c9ee4f2460 2024-09-10T14:29:15.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== osd_op_reply(109 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_9c8454ddf7aa50116496bac348d7550d [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:110 4.27 4:e4e21060:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52e750 con 0x55c9ee4edaa0 2024-09-10T14:29:15.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:15.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:111 3.3cs0 3:3ff4a4ea:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52e750 con 0x7fa738039070 2024-09-10T14:29:15.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(111 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 10 manifest: total_size = 3 2024-09-10T14:29:15.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 20 get_obj_state: setting s->obj_tag to 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.17648944646723314010 2024-09-10T14:29:15.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:15.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 20 prepare_atomic_modification: state is not atomic. state=0x55c9ee529908 2024-09-10T14:29:15.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6 2024-09-10T14:29:15.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:112 4.2f 4:f7d3b08b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee533a00 con 0x55c9ee4edaa0 2024-09-10T14:29:15.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(110 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2 [stat,call,call] v36'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa6277fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-10T14:29:15.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(112 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6 [stat,call,call] v36'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:14.999+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:113 3.3cs0 3:3ff4a4ea:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52c2a0 con 0x7fa738039070 2024-09-10T14:29:15.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(113 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_b1b9a972ccd8c962a473909b97007eb4 [call] v36'3 uv3 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:114 4.2f 4:f7d3b08b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52f960 con 0x55c9ee4edaa0 2024-09-10T14:29:15.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:15.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:115 3.3cs0 3:3cb88265:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee530510 con 0x7fa738039070 2024-09-10T14:29:15.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== osd_op_reply(115 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 10 manifest: total_size = 4 2024-09-10T14:29:15.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 20 get_obj_state: setting s->obj_tag to 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.15698050894494113439 2024-09-10T14:29:15.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:15.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 20 prepare_atomic_modification: state is not atomic. state=0x55c9ee529908 2024-09-10T14:29:15.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8 2024-09-10T14:29:15.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:116 4.30 4:0d10ffd1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee533090 con 0x55c9ee4f2460 2024-09-10T14:29:15.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(114 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6 [stat,call,call] v36'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.003+0000 7fa626ffd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-10T14:29:15.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(116 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:117 3.3cs0 3:3cb88265:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52f960 con 0x7fa738039070 2024-09-10T14:29:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(117 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v36'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:118 4.30 4:0d10ffd1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52f960 con 0x55c9ee4f2460 2024-09-10T14:29:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:119 3.34s0 3:2cfa3a3f:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52b740 con 0x55c9ee4edaa0 2024-09-10T14:29:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 36 ==== osd_op_reply(119 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 10 manifest: total_size = 5 2024-09-10T14:29:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 20 get_obj_state: setting s->obj_tag to 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.2507120964912971348 2024-09-10T14:29:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 20 prepare_atomic_modification: state is not atomic. state=0x55c9ee529908 2024-09-10T14:29:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 2024-09-10T14:29:15.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.007+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:120 4.2c 4:34f866c1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee534b70 con 0x55c9ee4edaa0 2024-09-10T14:29:15.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.011+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== osd_op_reply(118 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.011+0000 7fa6277fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T14:29:15.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.011+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 37 ==== osd_op_reply(120 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 [stat,call,call] v36'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.011+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:121 3.34s0 3:2cfa3a3f:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52f4b0 con 0x55c9ee4edaa0 2024-09-10T14:29:15.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 38 ==== osd_op_reply(121 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_24d27c169c2c881eb09a065116f2aa5c [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:122 4.2c 4:34f866c1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee534b70 con 0x55c9ee4edaa0 2024-09-10T14:29:15.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:15.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:123 3.33s0 3:cd4b0643:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52a3f0 con 0x7fa7300dc040 2024-09-10T14:29:15.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(123 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 10 manifest: total_size = 5 2024-09-10T14:29:15.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 20 get_obj_state: setting s->obj_tag to _M_ILZNXZ7t_3iWpdUi5kkpR00vb72Fe 2024-09-10T14:29:15.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 20 get_obj_state: octx=0x7fa74000ab00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c9ee529908 s->prefetch_data=0 2024-09-10T14:29:15.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 20 prepare_atomic_modification: state is not atomic. state=0x55c9ee529908 2024-09-10T14:29:15.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 2024-09-10T14:29:15.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:124 4.2c 4:34f866c1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52d420 con 0x55c9ee4edaa0 2024-09-10T14:29:15.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 39 ==== osd_op_reply(122 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 [stat,call,call] v36'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.015+0000 7fa626ffd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-10T14:29:15.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.019+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 40 ==== osd_op_reply(124 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 [stat,call,call] v36'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.019+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:125 3.33s0 3:cd4b0643:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52f4b0 con 0x7fa7300dc040 2024-09-10T14:29:15.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.019+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(125 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5_bb3aec0fdcdbc2974890f805c585d432 [call] v36'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.019+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:126 4.2c 4:34f866c1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52da50 con 0x55c9ee4edaa0 2024-09-10T14:29:15.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.019+0000 7fa74a9e6980 20 list_objects_ordered: starting attempt 1 2024-09-10T14:29:15.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T14:29:15.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:127 4.38 4:1d79cf1a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52da30 con 0x55c9ee4edaa0 2024-09-10T14:29:15.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:128 4.3a 4:5f78abaf:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529720 con 0x55c9ee4f2460 2024-09-10T14:29:15.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:129 4.27 4:e4e21060:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee538090 con 0x55c9ee4edaa0 2024-09-10T14:29:15.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:130 4.23 4:c718e97d:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52da30 con 0x7fa7300dc040 2024-09-10T14:29:15.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:131 4.2b 4:d5e08adb:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x55c9ee4edaa0 2024-09-10T14:29:15.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:132 4.b 4:d3aa090d:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529720 con 0x7fa738039070 2024-09-10T14:29:15.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:133 4.2f 4:f7d3b08b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52da30 con 0x55c9ee4edaa0 2024-09-10T14:29:15.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:134 4.29 4:9401715c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee544970 con 0x55c9ee4f2460 2024-09-10T14:29:15.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:135 4.30 4:0d10ffd1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee547220 con 0x55c9ee4f2460 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:136 4.5 4:a07d4e5a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee549d20 con 0x55c9ee4f2460 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:137 4.2c 4:34f866c1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee547220 con 0x55c9ee4edaa0 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== osd_op_reply(132 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(134 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(135 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(130 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 37 ==== osd_op_reply(136 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 38 ==== osd_op_reply(128 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 41 ==== osd_op_reply(127 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 42 ==== osd_op_reply(129 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 43 ==== osd_op_reply(131 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 44 ==== osd_op_reply(133 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 45 ==== osd_op_reply(126 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 [stat,call,call] v36'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa626ffd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-10T14:29:15.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 46 ==== osd_op_reply(137 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T14:29:15.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5])"; uploads.size()=0; is_truncated=0 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:138 4.38 4:1d79cf1a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x55c9ee4edaa0 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:139 4.3a 4:5f78abaf:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee544420 con 0x55c9ee4f2460 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:140 4.27 4:e4e21060:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529b30 con 0x55c9ee4edaa0 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:141 4.23 4:c718e97d:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee545d00 con 0x7fa7300dc040 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:142 4.2b 4:d5e08adb:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x55c9ee4edaa0 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:143 4.b 4:d3aa090d:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529b30 con 0x7fa738039070 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:144 4.2f 4:f7d3b08b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee544420 con 0x55c9ee4edaa0 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:145 4.29 4:9401715c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x55c9ee4f2460 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:146 4.30 4:0d10ffd1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529b30 con 0x55c9ee4f2460 2024-09-10T14:29:15.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:147 4.5 4:a07d4e5a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee544420 con 0x55c9ee4f2460 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.023+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:148 4.2c 4:34f866c1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x55c9ee4edaa0 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(143 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 39 ==== osd_op_reply(139 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 47 ==== osd_op_reply(138 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 48 ==== osd_op_reply(142 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 49 ==== osd_op_reply(144 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 50 ==== osd_op_reply(140 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 40 ==== osd_op_reply(145 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 41 ==== osd_op_reply(146 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(141 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 42 ==== osd_op_reply(147 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 51 ==== osd_op_reply(148 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x7fa738039070 2024-09-10T14:29:15.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(149 foo.buckets [call] v36'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa74a9e6980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-10T14:29:15.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.027+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x7fa738039070 2024-09-10T14:29:15.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== osd_op_reply(150 myfoo [call,call,delete] v36'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa74a9e6980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T14:29:15.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa74a9e6980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T14:29:15.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94325775178544 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x7fa7300dc040 2024-09-10T14:29:15.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== watch-notify(notify (1) cookie 94325774996048 notify 154618822670 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55c9ee50b020 con 0x7fa7300dc040 2024-09-10T14:29:15.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa626ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822670 cookie 94325774996048 notifier 4645 bl.length()=149 2024-09-10T14:29:15.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa626ffd640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa57c003330 con 0x7fa7300dc040 2024-09-10T14:29:15.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(151 notify.6 [notify cookie 94325775178544 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== watch-notify(notify_complete (2) cookie 94325775178544 notify 154618822670 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c9ee50a830 con 0x7fa7300dc040 2024-09-10T14:29:15.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.031+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:153 8.1b 8:dd5d0cf7:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x7fa738039070 2024-09-10T14:29:15.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== osd_op_reply(153 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 [call,call,delete] v36'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 from cache 2024-09-10T14:29:15.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5, ofs0, ns] 2024-09-10T14:29:15.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94325775178544 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x7fa738039070 2024-09-10T14:29:15.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 33 ==== watch-notify(notify (1) cookie 94325774974368 notify 154618822687 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55c9ee528650 con 0x7fa738039070 2024-09-10T14:29:15.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa6277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 94325774974368 notifier 4645 bl.length()=206 2024-09-10T14:29:15.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 34 ==== osd_op_reply(154 notify.0 [notify cookie 94325775178544 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa6277fe640 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa60c003d70 con 0x7fa738039070 2024-09-10T14:29:15.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 35 ==== watch-notify(notify_complete (2) cookie 94325775178544 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c9ee50b670 con 0x7fa738039070 2024-09-10T14:29:15.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:156 4.38 4:1d79cf1a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529b30 con 0x55c9ee4edaa0 2024-09-10T14:29:15.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 36 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:157 4.3a 4:5f78abaf:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x55c9ee4f2460 2024-09-10T14:29:15.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:158 4.27 4:e4e21060:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52f4b0 con 0x55c9ee4edaa0 2024-09-10T14:29:15.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:159 4.23 4:c718e97d:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529b30 con 0x7fa7300dc040 2024-09-10T14:29:15.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:160 4.2b 4:d5e08adb:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52f4b0 con 0x55c9ee4edaa0 2024-09-10T14:29:15.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:161 4.b 4:d3aa090d:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529b30 con 0x7fa738039070 2024-09-10T14:29:15.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:162 4.2f 4:f7d3b08b:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee52f4b0 con 0x55c9ee4edaa0 2024-09-10T14:29:15.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:163 4.29 4:9401715c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee53d110 con 0x55c9ee4f2460 2024-09-10T14:29:15.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:164 4.30 4:0d10ffd1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529b30 con 0x55c9ee4f2460 2024-09-10T14:29:15.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:165 4.5 4:a07d4e5a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee5335d0 con 0x55c9ee4f2460 2024-09-10T14:29:15.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.035+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:166 4.2c 4:34f866c1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee533f80 con 0x55c9ee4edaa0 2024-09-10T14:29:15.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 37 ==== osd_op_reply(161 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.5 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 43 ==== osd_op_reply(157 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.1 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 44 ==== osd_op_reply(164 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.8 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 45 ==== osd_op_reply(163 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.7 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 46 ==== osd_op_reply(165 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.9 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(159 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.3 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 52 ==== osd_op_reply(156 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.0 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 53 ==== osd_op_reply(160 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.4 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 54 ==== osd_op_reply(158 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.2 [delete] v36'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 55 ==== osd_op_reply(162 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.6 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 56 ==== osd_op_reply(166 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5.10 [delete] v36'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa74a9e6980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 : miss 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa74a9e6980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:167 6.1a 6:59c7564b:::pubsub..bucket.myfoo%2f83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ae0 con 0x55c9ee4f2460 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 47 ==== osd_op_reply(167 pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa74a9e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa74a9e6980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 info.flags=0x0 2024-09-10T14:29:15.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa74a9e6980 10 adding default.rgw.log++pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 to cache LRU end 2024-09-10T14:29:15.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:168 6.1a 6:59c7564b:::pubsub..bucket.myfoo%2f83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ae0 con 0x55c9ee4f2460 2024-09-10T14:29:15.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.039+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 48 ==== osd_op_reply(168 pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.5 [delete] v36'25 uv21 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.043+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x7fa738039070 2024-09-10T14:29:15.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.043+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 38 ==== osd_op_reply(169 foo.buckets [call] v36'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.043+0000 7fa5fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:15.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.043+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94325774999232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x55c9ee4edaa0 2024-09-10T14:29:15.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.047+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 57 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94325774999232] v36'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.047+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94325774974368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x7fa738039070 2024-09-10T14:29:15.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.047+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 39 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94325774974368] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.047+0000 7fa74a9e6980 20 remove_watcher() i=0 2024-09-10T14:29:15.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.047+0000 7fa74a9e6980 2 removed watcher, disabling cache 2024-09-10T14:29:15.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.047+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94325774978608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x55c9ee4edaa0 2024-09-10T14:29:15.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.051+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 58 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94325774978608] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.051+0000 7fa74a9e6980 20 remove_watcher() i=1 2024-09-10T14:29:15.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.051+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94325774980736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x55c9ee4f2460 2024-09-10T14:29:15.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.051+0000 7fa7484f6640 1 -- 172.21.15.151:0/564135856 <== osd.3 v2:172.21.15.151:6803/3136276598 49 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94325774980736] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa738074020 con 0x55c9ee4f2460 2024-09-10T14:29:15.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.051+0000 7fa74a9e6980 20 remove_watcher() i=2 2024-09-10T14:29:15.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.051+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94325774986944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x7fa738039070 2024-09-10T14:29:15.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.055+0000 7fa747cf5640 1 -- 172.21.15.151:0/564135856 <== osd.2 v2:172.21.15.151:6816/2885613778 40 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94325774986944] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7300c9030 con 0x7fa738039070 2024-09-10T14:29:15.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.055+0000 7fa74a9e6980 20 remove_watcher() i=3 2024-09-10T14:29:15.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.055+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94325774985744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x55c9ee4edaa0 2024-09-10T14:29:15.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.055+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.1 v2:172.21.15.151:6800/103268966 59 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94325774985744] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x55c9ee4edaa0 2024-09-10T14:29:15.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.055+0000 7fa74a9e6980 20 remove_watcher() i=4 2024-09-10T14:29:15.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.055+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94325774991984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x7fa7300dc040 2024-09-10T14:29:15.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.059+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94325774991984] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.059+0000 7fa74a9e6980 20 remove_watcher() i=5 2024-09-10T14:29:15.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.059+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94325774996048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x7fa7300dc040 2024-09-10T14:29:15.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.059+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94325774996048] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.059+0000 7fa74a9e6980 20 remove_watcher() i=6 2024-09-10T14:29:15.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.059+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94325774993104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c9ee529ac0 con 0x7fa7300dc040 2024-09-10T14:29:15.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94325774993104] v36'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa74003f040 con 0x7fa7300dc040 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 20 remove_watcher() i=7 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa7300dc040 msgr2=0x7fa7300dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa7300dc040 0x7fa7300dd430 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee4edaa0 msgr2=0x55c9ee4eff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee4edaa0 0x55c9ee4eff60 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa738039070 msgr2=0x7fa738059460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa738039070 0x7fa738059460 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4f2460 msgr2=0x55c9ee4f4850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4f2460 0x55c9ee4f4850 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa618034650 msgr2=0x7fa618036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa618034650 0x7fa618036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa730000c10 tx=0x7fa7300a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 msgr2=0x55c9ee4e2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4e2a00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa73802f0b0 tx=0x7fa73800ff20 comp rx=0 tx=0).stop 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa748cf7640 1 -- 172.21.15.151:0/564135856 reap_dead start 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 shutdown_connections 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/564135856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4db7f0 0x55c9ee4e2a00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 >> 172.21.15.151:0/564135856 conn(0x55c9ee4d7bd0 msgr2=0x55c9ee4d5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 shutdown_connections 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/564135856 wait complete. 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2710925405 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa6200346a0 msgr2=0x7fa620036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/2710925405 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa6200346a0 0x7fa620036b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55c9ee4b8f60 tx=0x7fa730005a10 comp rx=0 tx=0).stop 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2710925405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4ceed0 msgr2=0x55c9ee4cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/2710925405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4ceed0 0x55c9ee4cf2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa73800d010 tx=0x7fa738016b00 comp rx=0 tx=0).stop 2024-09-10T14:29:15.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2710925405 shutdown_connections 2024-09-10T14:29:15.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/2710925405 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa6200346a0 0x7fa620036b60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/2710925405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee4ceed0 0x55c9ee4cf2f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2710925405 >> 172.21.15.151:0/2710925405 conn(0x55c9ee4c4020 msgr2=0x55c9ee4c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2710925405 shutdown_connections 2024-09-10T14:29:15.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/2710925405 wait complete. 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9ee4be8d0 msgr2=0x55c9ee4c0cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9ee4be8d0 0x55c9ee4c0cc0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee3c2ea0 msgr2=0x55c9ee4b8010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9ee3c2ea0 0x55c9ee4b8010 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4ba9b0 msgr2=0x55c9ee4bcda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c9ee4ba9b0 0x55c9ee4bcda0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa630034650 msgr2=0x7fa630036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa630034650 0x7fa630036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa7300ad000 tx=0x7fa7300a5040 comp rx=0 tx=0).stop 2024-09-10T14:29:15.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 msgr2=0x55c9ee4b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 --2- 172.21.15.151:0/697348819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9ee330ad0 0x55c9ee4b1040 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa738001e20 tx=0x7fa738000ee0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa748cf7640 1 -- 172.21.15.151:0/697348819 reap_dead start 2024-09-10T14:29:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 shutdown_connections 2024-09-10T14:29:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 >> 172.21.15.151:0/697348819 conn(0x55c9ee3b7070 msgr2=0x55c9ee4a4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 shutdown_connections 2024-09-10T14:29:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.063+0000 7fa74a9e6980 1 -- 172.21.15.151:0/697348819 wait complete. 2024-09-10T14:29:15.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T14:29:15.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T14:29:15.081 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-10T14:29:15.160 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:15.160 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:15.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.155+0000 7f3130eaa980 1 Processor -- start 2024-09-10T14:29:15.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.155+0000 7f3130eaa980 1 -- start start 2024-09-10T14:29:15.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.155+0000 7f3130eaa980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55f42b10cc70 0x55f42b10f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.155+0000 7f3130eaa980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f42af8eae0 con 0x55f42b1088f0 2024-09-10T14:29:15.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.155+0000 7f3130eaa980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55f42afb2e30 con 0x55f42b10cc70 2024-09-10T14:29:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.159+0000 7f312e9ba640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55f42b1088f0 0x55f42b108cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51360/0 (socket says 172.21.15.151:51360) 2024-09-10T14:29:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.159+0000 7f312e9ba640 1 -- 172.21.15.151:0/1036430793 learned_addr learned my addr 172.21.15.151:0/1036430793 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.159+0000 7f312e1b9640 1 --2- 172.21.15.151:0/1036430793 >> v2:172.21.15.52:3300/0 conn(0x55f42b10cc70 0x55f42b10f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.159+0000 7f312d9b8640 1 -- 172.21.15.151:0/1036430793 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967000922 0 0) 0x55f42af8eae0 con 0x55f42b1088f0 2024-09-10T14:29:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.159+0000 7f312d9b8640 1 -- 172.21.15.151:0/1036430793 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3118001e20 con 0x55f42b1088f0 2024-09-10T14:29:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.159+0000 7f312e1b9640 1 -- 172.21.15.151:0/1036430793 >> v1:172.21.15.52:6789/0 conn(0x55f42b1088f0 legacy=0x55f42b108cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.159+0000 7f312e1b9640 1 -- 172.21.15.151:0/1036430793 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42b1105b0 con 0x55f42b10cc70 2024-09-10T14:29:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.159+0000 7f312e1b9640 1 --2- 172.21.15.151:0/1036430793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b10cc70 0x55f42b10f060 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f312400a480 tx=0x7f312401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88916729e1d5f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f312d9b8640 1 -- 172.21.15.151:0/1036430793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31240b0070 con 0x55f42b10cc70 2024-09-10T14:29:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f312d9b8640 1 -- 172.21.15.151:0/1036430793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31240ab540 con 0x55f42b10cc70 2024-09-10T14:29:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f312d9b8640 1 -- 172.21.15.151:0/1036430793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31240ab840 con 0x55f42b10cc70 2024-09-10T14:29:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f3130eaa980 1 -- 172.21.15.151:0/1036430793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b10cc70 msgr2=0x55f42b10f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f3130eaa980 1 --2- 172.21.15.151:0/1036430793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b10cc70 0x55f42b10f060 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f312400a480 tx=0x7f312401b280 comp rx=0 tx=0).stop 2024-09-10T14:29:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f3130eaa980 1 -- 172.21.15.151:0/1036430793 shutdown_connections 2024-09-10T14:29:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f3130eaa980 1 --2- 172.21.15.151:0/1036430793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b10cc70 0x55f42b10f060 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f3130eaa980 1 -- 172.21.15.151:0/1036430793 >> 172.21.15.151:0/1036430793 conn(0x55f42b07c240 msgr2=0x55f42b07c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f3130eaa980 1 -- 172.21.15.151:0/1036430793 shutdown_connections 2024-09-10T14:29:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.163+0000 7f3130eaa980 1 -- 172.21.15.151:0/1036430793 wait complete. 2024-09-10T14:29:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 Processor -- start 2024-09-10T14:29:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 -- start start 2024-09-10T14:29:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f42afb4200 con 0x55f42b1088f0 2024-09-10T14:29:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1f3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39342/0 (socket says 172.21.15.151:39342) 2024-09-10T14:29:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f312e9ba640 1 -- 172.21.15.151:0/1501400913 learned_addr learned my addr 172.21.15.151:0/1501400913 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f312e9ba640 1 -- 172.21.15.151:0/1501400913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42b1f4020 con 0x55f42b1088f0 2024-09-10T14:29:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f312e9ba640 1 --2- 172.21.15.151:0/1501400913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1f3a50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3120001e40 tx=0x7f312000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a114c74731fda1f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f301ce09640 1 -- 172.21.15.151:0/1501400913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3120012020 con 0x55f42b1088f0 2024-09-10T14:29:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f301ce09640 1 -- 172.21.15.151:0/1501400913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f312000e7c0 con 0x55f42b1088f0 2024-09-10T14:29:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f301ce09640 1 -- 172.21.15.151:0/1501400913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f312000eb00 con 0x55f42b1088f0 2024-09-10T14:29:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 -- 172.21.15.151:0/1501400913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 msgr2=0x55f42b1f3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 --2- 172.21.15.151:0/1501400913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1f3a50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3120001e40 tx=0x7f312000b790 comp rx=0 tx=0).stop 2024-09-10T14:29:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 -- 172.21.15.151:0/1501400913 shutdown_connections 2024-09-10T14:29:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 --2- 172.21.15.151:0/1501400913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1f3a50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 -- 172.21.15.151:0/1501400913 >> 172.21.15.151:0/1501400913 conn(0x55f42b07c240 msgr2=0x55f42b1ef680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 -- 172.21.15.151:0/1501400913 shutdown_connections 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.179+0000 7f3130eaa980 1 -- 172.21.15.151:0/1501400913 wait complete. 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f3130eaa980 1 Processor -- start 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f3130eaa980 1 -- start start 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f3130eaa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1fae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f3130eaa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f42b1100b0 con 0x55f42b1088f0 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1fae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1fae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39348/0 (socket says 172.21.15.151:39348) 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f312e9ba640 1 -- 172.21.15.151:0/2266086662 learned_addr learned my addr 172.21.15.151:0/2266086662 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f312e9ba640 1 -- 172.21.15.151:0/2266086662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42b1fb360 con 0x55f42b1088f0 2024-09-10T14:29:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f312e9ba640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1fae20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f312000b7d0 tx=0x7f3120000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f301b606640 1 -- 172.21.15.151:0/2266086662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3120012030 con 0x55f42b1088f0 2024-09-10T14:29:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f42b1fb5f0 con 0x55f42b1088f0 2024-09-10T14:29:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f301b606640 1 -- 172.21.15.151:0/2266086662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31200014a0 con 0x55f42b1088f0 2024-09-10T14:29:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f301b606640 1 -- 172.21.15.151:0/2266086662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f312001aaf0 con 0x55f42b1088f0 2024-09-10T14:29:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42b1fe2d0 con 0x55f42b1088f0 2024-09-10T14:29:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f301b606640 1 -- 172.21.15.151:0/2266086662 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3120015020 con 0x55f42b1088f0 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f301b606640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3014034650 0x7f3014036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f301b606640 1 -- 172.21.15.151:0/2266086662 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3120020030 con 0x55f42b1088f0 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3014034650 0x7f3014036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b10cc70 0x55f42b201e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b202450 con 0x55f42b10cc70 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.183+0000 7f312f1bb640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b10cc70 0x55f42b201e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3014034650 0x7f3014036b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f31240ad000 tx=0x7f31240a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312f1bb640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b10cc70 0x55f42b201e10 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312f1bb640 1 -- 172.21.15.151:0/2266086662 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b10cc70 2024-09-10T14:29:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b1ff4f0 con 0x55f42b10cc70 2024-09-10T14:29:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312f1bb640 1 -- 172.21.15.151:0/2266086662 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b10cc70 2024-09-10T14:29:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b204780 0x55f42b206b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b207240 con 0x55f42b204780 2024-09-10T14:29:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312e9ba640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b204780 0x55f42b206b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312e9ba640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b204780 0x55f42b206b70 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312e9ba640 1 -- 172.21.15.151:0/2266086662 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3120008030 con 0x55f42b204780 2024-09-10T14:29:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b203620 con 0x55f42b10cc70 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312f1bb640 1 -- 172.21.15.151:0/2266086662 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b10cc70 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f42b208680 0x55f42b20aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b20b200 con 0x55f42b208680 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f42b208680 0x55f42b20aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.187+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f42b208680 0x55f42b20aa70 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f312e1b9640 1 -- 172.21.15.151:0/2266086662 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31240b3040 con 0x55f42b208680 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3130eaa980 1 Processor -- start 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3130eaa980 1 -- start start 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3130eaa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b218c90 0x55f42b2190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3130eaa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f42b00d800 con 0x55f42b218c90 2024-09-10T14:29:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b218c90 0x55f42b2190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b218c90 0x55f42b2190b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39364/0 (socket says 172.21.15.151:39364) 2024-09-10T14:29:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f312e9ba640 1 -- 172.21.15.151:0/1977689435 learned_addr learned my addr 172.21.15.151:0/1977689435 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f312e9ba640 1 -- 172.21.15.151:0/1977689435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42b2195f0 con 0x55f42b218c90 2024-09-10T14:29:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f312e9ba640 1 --2- 172.21.15.151:0/1977689435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b218c90 0x55f42b2190b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3120016570 tx=0x7f312000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3018e01640 1 -- 172.21.15.151:0/1977689435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3120042100 con 0x55f42b218c90 2024-09-10T14:29:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3018e01640 1 -- 172.21.15.151:0/1977689435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31200165e0 con 0x55f42b218c90 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3130eaa980 1 -- 172.21.15.151:0/1977689435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f42b219880 con 0x55f42b218c90 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3018e01640 1 -- 172.21.15.151:0/1977689435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3120016900 con 0x55f42b218c90 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3130eaa980 1 -- 172.21.15.151:0/1977689435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42b219880 con 0x55f42b218c90 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3018e01640 1 -- 172.21.15.151:0/1977689435 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3120009070 con 0x55f42b218c90 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3018e01640 1 --2- 172.21.15.151:0/1977689435 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f30080347f0 0x7f3008036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3018e01640 1 -- 172.21.15.151:0/1977689435 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3120005050 con 0x55f42b218c90 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f312e1b9640 1 --2- 172.21.15.151:0/1977689435 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f30080347f0 0x7f3008036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.191+0000 7f3130eaa980 1 Processor -- start 2024-09-10T14:29:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- start start 2024-09-10T14:29:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e1b9640 1 --2- 172.21.15.151:0/1977689435 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f30080347f0 0x7f3008036cb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3124000c10 tx=0x7f3124005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b225840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f42b1f43a0 con 0x55f42b225440 2024-09-10T14:29:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b225840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b225840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39372/0 (socket says 172.21.15.151:39372) 2024-09-10T14:29:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e9ba640 1 -- 172.21.15.151:0/957028179 learned_addr learned my addr 172.21.15.151:0/957028179 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e9ba640 1 -- 172.21.15.151:0/957028179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42b225e10 con 0x55f42b225440 2024-09-10T14:29:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e9ba640 1 --2- 172.21.15.151:0/957028179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b225840 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3120016db0 tx=0x7f312003ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdae022b1ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f30127fc640 1 -- 172.21.15.151:0/957028179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f312005b070 con 0x55f42b225440 2024-09-10T14:29:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f30127fc640 1 -- 172.21.15.151:0/957028179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3120041390 con 0x55f42b225440 2024-09-10T14:29:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f30127fc640 1 -- 172.21.15.151:0/957028179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31200457c0 con 0x55f42b225440 2024-09-10T14:29:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- 172.21.15.151:0/957028179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 msgr2=0x55f42b225840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 --2- 172.21.15.151:0/957028179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b225840 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3120016db0 tx=0x7f312003ab80 comp rx=0 tx=0).stop 2024-09-10T14:29:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- 172.21.15.151:0/957028179 shutdown_connections 2024-09-10T14:29:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 --2- 172.21.15.151:0/957028179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b225840 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- 172.21.15.151:0/957028179 >> 172.21.15.151:0/957028179 conn(0x55f42b221770 msgr2=0x55f42b21f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- 172.21.15.151:0/957028179 shutdown_connections 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- 172.21.15.151:0/957028179 wait complete. 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 Processor -- start 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- start start 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b22c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f3130eaa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f42b226300 con 0x55f42b225440 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b22c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e9ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b22c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39386/0 (socket says 172.21.15.151:39386) 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.195+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 learned_addr learned my addr 172.21.15.151:0/2071347677 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f42b22cac0 con 0x55f42b225440 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312e9ba640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b22c580 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f312001aa40 tx=0x7f3120035ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3010ff9640 1 -- 172.21.15.151:0/2071347677 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3120070070 con 0x55f42b225440 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f42b22cac0 con 0x55f42b225440 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3010ff9640 1 -- 172.21.15.151:0/2071347677 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31200457c0 con 0x55f42b225440 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3010ff9640 1 -- 172.21.15.151:0/2071347677 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3120004150 con 0x55f42b225440 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f42b22cac0 con 0x55f42b225440 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3010ff9640 1 -- 172.21.15.151:0/2071347677 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3120073070 con 0x55f42b225440 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3010ff9640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ff80346a0 0x7f2ff8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3010ff9640 1 -- 172.21.15.151:0/2071347677 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3120067030 con 0x55f42b225440 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ff80346a0 0x7f2ff8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b237660 0x55f42b239b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23a220 con 0x55f42b237660 2024-09-10T14:29:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312f1bb640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b237660 0x55f42b239b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ff80346a0 0x7f2ff8036b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f31240ab510 tx=0x7f31240b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312f1bb640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b237660 0x55f42b239b20 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 20 realm 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23a630 con 0x55f42b237660 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23af00 con 0x55f42b237660 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.199+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f3130eaa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b23c000 0x55f42b23e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23e9c0 con 0x55f42b23c000 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e9ba640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b23c000 0x55f42b23e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e9ba640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b23c000 0x55f42b23e3f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f3130eaa980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f3130eaa980 20 searching for the correct realm 2024-09-10T14:29:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b240290 con 0x55f42b23c000 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e9ba640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3120075060 0x7f312003d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b240290 con 0x7f3120075060 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3120075060 0x7f312003d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3120075060 0x7f312003d1b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e1b9640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f31240cd040 0x7f31240b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b240290 con 0x7f31240cd040 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312f1bb640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f31240cd040 0x7f31240b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312f1bb640 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f31240cd040 0x7f31240b7420 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.203+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f31240cd040 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f31240cd040 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f3120075060 2024-09-10T14:29:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b23c000 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f31240cd040 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f3120075060 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.207+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b23c000 2024-09-10T14:29:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b23c000 2024-09-10T14:29:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f3120075060 2024-09-10T14:29:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b23c000 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b23c000 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f31240cd040 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b23c000 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f3120075060 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f3120075060 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.211+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b23c000 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f31240cd040 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f3120075060 2024-09-10T14:29:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b23c000 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f31240cd040 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x55f42b237660 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23b2a0 con 0x7f3120075060 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23f3b0 con 0x55f42b237660 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23fc50 con 0x55f42b237660 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.215+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23f7a0 con 0x7f31240cd040 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 zone default found 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 4 Realm: () 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 zonegroup default 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b23fbd0 con 0x7f3120075060 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b2420d0 con 0x55f42b23c000 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b242540 con 0x55f42b23c000 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 started sync module instance, tier type = 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b241540 con 0x7f3120075060 2024-09-10T14:29:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94507184165008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b2429a0 con 0x7f3120075060 2024-09-10T14:29:15.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.219+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b2431f0 con 0x55f42b237660 2024-09-10T14:29:15.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.223+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94507184165008] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.223+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.223+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94507184172352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b243610 con 0x55f42b237660 2024-09-10T14:29:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.223+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b243e60 con 0x55f42b23c000 2024-09-10T14:29:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.223+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94507184172352] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.223+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.223+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94507184173680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b243c80 con 0x55f42b23c000 2024-09-10T14:29:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.223+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b2447a0 con 0x7f3120075060 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.227+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.227+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94507184177776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b245040 con 0x7f3120075060 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.227+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b245a40 con 0x55f42b237660 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.227+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94507184173680] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.227+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94507184177776] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.227+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.227+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94507184174800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b244b90 con 0x55f42b237660 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.227+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b2462e0 con 0x7f31240cd040 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.231+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94507184174800] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.231+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.231+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94507184182608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b244b90 con 0x7f31240cd040 2024-09-10T14:29:15.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.231+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b2467d0 con 0x7f31240cd040 2024-09-10T14:29:15.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.231+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94507184182608] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.231+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.231+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94507184186016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b246790 con 0x7f31240cd040 2024-09-10T14:29:15.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.231+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b2471b0 con 0x7f31240cd040 2024-09-10T14:29:15.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94507184186016] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94507184188576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b247170 con 0x7f31240cd040 2024-09-10T14:29:15.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f3130eaa980 20 add_watcher() i=0 2024-09-10T14:29:15.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f3130eaa980 20 add_watcher() i=1 2024-09-10T14:29:15.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f3130eaa980 20 add_watcher() i=2 2024-09-10T14:29:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f3130eaa980 20 add_watcher() i=3 2024-09-10T14:29:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f3130eaa980 20 add_watcher() i=4 2024-09-10T14:29:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f3130eaa980 20 add_watcher() i=5 2024-09-10T14:29:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.235+0000 7f3130eaa980 20 add_watcher() i=6 2024-09-10T14:29:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94507184188576] v36'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 20 add_watcher() i=7 2024-09-10T14:29:15.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:15.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b24a5d0 con 0x55f42b237660 2024-09-10T14:29:15.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94507184184272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b247af0 con 0x55f42b237660 2024-09-10T14:29:15.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94507184184272] v36'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f2fe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:15.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:15.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:15.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 5 note: GC not initialized 2024-09-10T14:29:15.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f2fe4fe1640 20 reqs_thread_entry: start 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 20 Filter name: none 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f2fddffb640 20 reqs_thread_entry: start 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26dc40 con 0x55f42b237660 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:29:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.239+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b273e00 con 0x55f42b237660 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v36'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f3130eaa980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f3130eaa980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f3130eaa980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94507184371824 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26f6c0 con 0x55f42b237660 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 94507184174800 notify 154618822672 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f312802d060 con 0x55f42b237660 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f30127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822672 cookie 94507184174800 notifier 4652 bl.length()=579 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f30127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:29:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f30127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:29:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(64 notify.4 [notify cookie 94507184371824 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f30127fc640 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f2ff4003eb0 con 0x55f42b237660 2024-09-10T14:29:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 94507184371824 notify 154618822672 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f312801e040 con 0x55f42b237660 2024-09-10T14:29:15.248 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:29:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f2fe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94507184184272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26baa0 con 0x55f42b237660 2024-09-10T14:29:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94507184184272] v36'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.243+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94507184165008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26baa0 con 0x7f3120075060 2024-09-10T14:29:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.247+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94507184165008] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.247+0000 7f3130eaa980 20 remove_watcher() i=0 2024-09-10T14:29:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.247+0000 7f3130eaa980 2 removed watcher, disabling cache 2024-09-10T14:29:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.247+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94507184172352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26baa0 con 0x55f42b237660 2024-09-10T14:29:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.247+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94507184172352] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.247+0000 7f3130eaa980 20 remove_watcher() i=1 2024-09-10T14:29:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.247+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94507184173680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26baa0 con 0x55f42b23c000 2024-09-10T14:29:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.251+0000 7f312e9ba640 1 -- 172.21.15.151:0/2071347677 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94507184173680] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3120072030 con 0x55f42b23c000 2024-09-10T14:29:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.251+0000 7f3130eaa980 20 remove_watcher() i=2 2024-09-10T14:29:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.251+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94507184177776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26baa0 con 0x7f3120075060 2024-09-10T14:29:15.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.251+0000 7f312e1b9640 1 -- 172.21.15.151:0/2071347677 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94507184177776] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31240d8070 con 0x7f3120075060 2024-09-10T14:29:15.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.251+0000 7f3130eaa980 20 remove_watcher() i=3 2024-09-10T14:29:15.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.251+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94507184174800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26baa0 con 0x55f42b237660 2024-09-10T14:29:15.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.255+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94507184174800] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x55f42b237660 2024-09-10T14:29:15.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.255+0000 7f3130eaa980 20 remove_watcher() i=4 2024-09-10T14:29:15.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.255+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94507184182608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b243720 con 0x7f31240cd040 2024-09-10T14:29:15.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.255+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94507184182608] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.255+0000 7f3130eaa980 20 remove_watcher() i=5 2024-09-10T14:29:15.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.255+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94507184186016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26baa0 con 0x7f31240cd040 2024-09-10T14:29:15.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94507184186016] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 20 remove_watcher() i=6 2024-09-10T14:29:15.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94507184188576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55f42b26baa0 con 0x7f31240cd040 2024-09-10T14:29:15.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94507184188576] v36'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f312800a4d0 con 0x7f31240cd040 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 20 remove_watcher() i=7 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f31240cd040 msgr2=0x7f31240b7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f31240cd040 0x7f31240b7420 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b237660 msgr2=0x55f42b239b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b237660 0x55f42b239b20 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3120075060 msgr2=0x7f312003d1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f3120075060 0x7f312003d1b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b23c000 msgr2=0x55f42b23e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b23c000 0x55f42b23e3f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ff80346a0 msgr2=0x7f2ff8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2ff80346a0 0x7f2ff8036b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f31240ab510 tx=0x7f31240b9040 comp rx=0 tx=0).stop 2024-09-10T14:29:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 msgr2=0x55f42b22c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2071347677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b225440 0x55f42b22c580 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f312001aa40 tx=0x7f3120035ed0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 reap_dead start 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f312f1bb640 1 -- 172.21.15.151:0/2071347677 reap_dead start 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 shutdown_connections 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 >> 172.21.15.151:0/2071347677 conn(0x55f42b221770 msgr2=0x55f42b21f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 shutdown_connections 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/2071347677 wait complete. 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/1977689435 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f30080347f0 msgr2=0x7f3008036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/1977689435 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f30080347f0 0x7f3008036cb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3124000c10 tx=0x7f3124005a10 comp rx=0 tx=0).stop 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/1977689435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b218c90 msgr2=0x55f42b2190b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/1977689435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b218c90 0x55f42b2190b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3120016570 tx=0x7f312000db30 comp rx=0 tx=0).stop 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/1977689435 shutdown_connections 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/1977689435 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f30080347f0 0x7f3008036cb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 --2- 172.21.15.151:0/1977689435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b218c90 0x55f42b2190b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/1977689435 >> 172.21.15.151:0/1977689435 conn(0x55f42b20dde0 msgr2=0x55f42b210860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/1977689435 shutdown_connections 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.259+0000 7f3130eaa980 1 -- 172.21.15.151:0/1977689435 wait complete. 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f42b208680 msgr2=0x55f42b20aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55f42b208680 0x55f42b20aa70 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b10cc70 msgr2=0x55f42b201e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55f42b10cc70 0x55f42b201e10 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b204780 msgr2=0x55f42b206b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55f42b204780 0x55f42b206b70 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3014034650 msgr2=0x7f3014036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3014034650 0x7f3014036b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f31240ad000 tx=0x7f31240a5040 comp rx=0 tx=0).stop 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 msgr2=0x55f42b1fae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 --2- 172.21.15.151:0/2266086662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f42b1088f0 0x55f42b1fae20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f312000b7d0 tx=0x7f3120000ee0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f312f1bb640 1 -- 172.21.15.151:0/2266086662 reap_dead start 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 shutdown_connections 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 >> 172.21.15.151:0/2266086662 conn(0x55f42b07c240 msgr2=0x55f42b1ee200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 shutdown_connections 2024-09-10T14:29:15.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.263+0000 7f3130eaa980 1 -- 172.21.15.151:0/2266086662 wait complete. 2024-09-10T14:29:15.277 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:29:15.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T14:29:15.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T14:29:15.277 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-10T14:29:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.351+0000 7f752942c980 1 Processor -- start 2024-09-10T14:29:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.351+0000 7f752942c980 1 -- start start 2024-09-10T14:29:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.351+0000 7f752942c980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e9b85e58f0 0x55e9b85e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.351+0000 7f752942c980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e9b846bae0 con 0x55e9b85e6240 2024-09-10T14:29:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.351+0000 7f752942c980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55e9b848fe30 con 0x55e9b85e58f0 2024-09-10T14:29:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7526f3c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e9b85e58f0 0x55e9b85e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7526f3c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55e9b85e58f0 0x55e9b85e5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39396/0 (socket says 172.21.15.151:39396) 2024-09-10T14:29:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7526f3c640 1 -- 172.21.15.151:0/2356323758 learned_addr learned my addr 172.21.15.151:0/2356323758 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f752673b640 1 --1- 172.21.15.151:0/2356323758 >> v1:172.21.15.52:6789/0 conn(0x55e9b85e6240 0x55e9b85eac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51370/0 (socket says 172.21.15.151:51370) 2024-09-10T14:29:15.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7526f3c640 1 -- 172.21.15.151:0/2356323758 >> v1:172.21.15.52:6789/0 conn(0x55e9b85e6240 legacy=0x55e9b85eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7526f3c640 1 -- 172.21.15.151:0/2356323758 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b85ed4c0 con 0x55e9b85e58f0 2024-09-10T14:29:15.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7525f3a640 1 -- 172.21.15.151:0/2356323758 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860178917 0 0) 0x55e9b846bae0 con 0x55e9b85e6240 2024-09-10T14:29:15.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7526f3c640 1 --2- 172.21.15.151:0/2356323758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b85e5cd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f751800a4e0 tx=0x7f751801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74e97e5d475b5c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7525f3a640 1 -- 172.21.15.151:0/2356323758 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180aa540 con 0x55e9b85e58f0 2024-09-10T14:29:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7525f3a640 1 -- 172.21.15.151:0/2356323758 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75180aa6e0 con 0x55e9b85e58f0 2024-09-10T14:29:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.355+0000 7f7525f3a640 1 -- 172.21.15.151:0/2356323758 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180aaa00 con 0x55e9b85e58f0 2024-09-10T14:29:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.359+0000 7f752942c980 1 -- 172.21.15.151:0/2356323758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 msgr2=0x55e9b85e5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.359+0000 7f752942c980 1 --2- 172.21.15.151:0/2356323758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b85e5cd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f751800a4e0 tx=0x7f751801b090 comp rx=0 tx=0).stop 2024-09-10T14:29:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.359+0000 7f752942c980 1 -- 172.21.15.151:0/2356323758 shutdown_connections 2024-09-10T14:29:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.359+0000 7f752942c980 1 --2- 172.21.15.151:0/2356323758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b85e5cd0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.359+0000 7f752942c980 1 -- 172.21.15.151:0/2356323758 >> 172.21.15.151:0/2356323758 conn(0x55e9b8559240 msgr2=0x55e9b8559650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.359+0000 7f752942c980 1 -- 172.21.15.151:0/2356323758 shutdown_connections 2024-09-10T14:29:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.359+0000 7f752942c980 1 -- 172.21.15.151:0/2356323758 wait complete. 2024-09-10T14:29:15.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.371+0000 7f752942c980 1 Processor -- start 2024-09-10T14:29:15.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.371+0000 7f752942c980 1 -- start start 2024-09-10T14:29:15.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.371+0000 7f752942c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e9b8491200 con 0x55e9b85e58f0 2024-09-10T14:29:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39398/0 (socket says 172.21.15.151:39398) 2024-09-10T14:29:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7526f3c640 1 -- 172.21.15.151:0/3920810301 learned_addr learned my addr 172.21.15.151:0/3920810301 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7526f3c640 1 -- 172.21.15.151:0/3920810301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b86d0fb0 con 0x55e9b85e58f0 2024-09-10T14:29:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3920810301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d09e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7518017ca0 tx=0x7f75180033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e73dc1757537df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7413e17640 1 -- 172.21.15.151:0/3920810301 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180b9070 con 0x55e9b85e58f0 2024-09-10T14:29:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7413e17640 1 -- 172.21.15.151:0/3920810301 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75180aaa80 con 0x55e9b85e58f0 2024-09-10T14:29:15.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7413e17640 1 -- 172.21.15.151:0/3920810301 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180aad60 con 0x55e9b85e58f0 2024-09-10T14:29:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 -- 172.21.15.151:0/3920810301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 msgr2=0x55e9b86d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 --2- 172.21.15.151:0/3920810301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d09e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7518017ca0 tx=0x7f75180033b0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 -- 172.21.15.151:0/3920810301 shutdown_connections 2024-09-10T14:29:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 --2- 172.21.15.151:0/3920810301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d09e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 -- 172.21.15.151:0/3920810301 >> 172.21.15.151:0/3920810301 conn(0x55e9b8559240 msgr2=0x55e9b86cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 -- 172.21.15.151:0/3920810301 shutdown_connections 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 -- 172.21.15.151:0/3920810301 wait complete. 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 Processor -- start 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 -- start start 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f752942c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e9b85ecf00 con 0x55e9b85e58f0 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39400/0 (socket says 172.21.15.151:39400) 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.375+0000 7f7526f3c640 1 -- 172.21.15.151:0/3142784249 learned_addr learned my addr 172.21.15.151:0/3142784249 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f7526f3c640 1 -- 172.21.15.151:0/3142784249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b86d8190 con 0x55e9b85e58f0 2024-09-10T14:29:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d7c50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f751801aec0 tx=0x7f7518017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f7412614640 1 -- 172.21.15.151:0/3142784249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180cc070 con 0x55e9b85e58f0 2024-09-10T14:29:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f7412614640 1 -- 172.21.15.151:0/3142784249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75180c7410 con 0x55e9b85e58f0 2024-09-10T14:29:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9b86d8420 con 0x55e9b85e58f0 2024-09-10T14:29:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f7412614640 1 -- 172.21.15.151:0/3142784249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180b9070 con 0x55e9b85e58f0 2024-09-10T14:29:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b86db100 con 0x55e9b85e58f0 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f7412614640 1 -- 172.21.15.151:0/3142784249 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f75180b3040 con 0x55e9b85e58f0 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f7412614640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f740c034650 0x7f740c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f7412614640 1 -- 172.21.15.151:0/3142784249 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f75180c4070 con 0x55e9b85e58f0 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752673b640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f740c034650 0x7f740c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752942c980 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b85e6240 0x55e9b86ded50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b86df2d0 con 0x55e9b85e6240 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752773d640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b85e6240 0x55e9b86ded50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752673b640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f740c034650 0x7f740c036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7510000c10 tx=0x7f75100013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752773d640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b85e6240 0x55e9b86ded50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752773d640 1 -- 172.21.15.151:0/3142784249 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b85e6240 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b86dc300 con 0x55e9b85e6240 2024-09-10T14:29:15.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752773d640 1 -- 172.21.15.151:0/3142784249 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b85e6240 2024-09-10T14:29:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752942c980 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b86e1630 0x55e9b86e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.379+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b86e4110 con 0x55e9b86e1630 2024-09-10T14:29:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b86e1630 0x55e9b86e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b86e1630 0x55e9b86e3a20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f7526f3c640 1 -- 172.21.15.151:0/3142784249 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f75180d1c90 con 0x55e9b86e1630 2024-09-10T14:29:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b86e04d0 con 0x55e9b85e6240 2024-09-10T14:29:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752773d640 1 -- 172.21.15.151:0/3142784249 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b85e6240 2024-09-10T14:29:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752942c980 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e9b86e5570 0x55e9b86e7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b86e80a0 con 0x55e9b86e5570 2024-09-10T14:29:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752673b640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e9b86e5570 0x55e9b86e7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752673b640 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e9b86e5570 0x55e9b86e7960 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752673b640 1 -- 172.21.15.151:0/3142784249 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f751000f680 con 0x55e9b86e5570 2024-09-10T14:29:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752942c980 1 Processor -- start 2024-09-10T14:29:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752942c980 1 -- start start 2024-09-10T14:29:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752942c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b86f5b70 0x55e9b86f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f752942c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e9b84ea800 con 0x55e9b86f5b70 2024-09-10T14:29:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b86f5b70 0x55e9b86f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b86f5b70 0x55e9b86f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39412/0 (socket says 172.21.15.151:39412) 2024-09-10T14:29:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.383+0000 7f7526f3c640 1 -- 172.21.15.151:0/1548423125 learned_addr learned my addr 172.21.15.151:0/1548423125 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f7526f3c640 1 -- 172.21.15.151:0/1548423125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b86f64d0 con 0x55e9b86f5b70 2024-09-10T14:29:15.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f7526f3c640 1 --2- 172.21.15.151:0/1548423125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b86f5b70 0x55e9b86f5f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f75180c6900 tx=0x7f75180e30e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f740b7fe640 1 -- 172.21.15.151:0/1548423125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180cf760 con 0x55e9b86f5b70 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f740b7fe640 1 -- 172.21.15.151:0/1548423125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7518005020 con 0x55e9b86f5b70 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f752942c980 1 -- 172.21.15.151:0/1548423125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9b86f6760 con 0x55e9b86f5b70 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f740b7fe640 1 -- 172.21.15.151:0/1548423125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7518005320 con 0x55e9b86f5b70 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f752942c980 1 -- 172.21.15.151:0/1548423125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b86f93e0 con 0x55e9b86f5b70 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f740b7fe640 1 -- 172.21.15.151:0/1548423125 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f75180eb060 con 0x55e9b86f5b70 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f740b7fe640 1 --2- 172.21.15.151:0/1548423125 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74000346a0 0x7f7400036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f740b7fe640 1 -- 172.21.15.151:0/1548423125 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f75180e0030 con 0x55e9b86f5b70 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f752673b640 1 --2- 172.21.15.151:0/1548423125 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74000346a0 0x7f7400036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f752942c980 1 Processor -- start 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f752942c980 1 -- start start 2024-09-10T14:29:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f752673b640 1 --2- 172.21.15.151:0/1548423125 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74000346a0 0x7f7400036b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55e9b86df7d0 tx=0x7f7510006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f752942c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87028b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f752942c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e9b86d1270 con 0x55e9b87024d0 2024-09-10T14:29:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87028b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39418/0 (socket says 172.21.15.151:39418) 2024-09-10T14:29:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.387+0000 7f7526f3c640 1 -- 172.21.15.151:0/3610759044 learned_addr learned my addr 172.21.15.151:0/3610759044 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f7526f3c640 1 -- 172.21.15.151:0/3610759044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b8702e80 con 0x55e9b87024d0 2024-09-10T14:29:15.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3610759044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87028b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f75180b5c20 tx=0x7f75180e49f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db1183df49a8518 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f74097fa640 1 -- 172.21.15.151:0/3610759044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180fe070 con 0x55e9b87024d0 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f74097fa640 1 -- 172.21.15.151:0/3610759044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75180ce770 con 0x55e9b87024d0 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f74097fa640 1 -- 172.21.15.151:0/3610759044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180f3040 con 0x55e9b87024d0 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- 172.21.15.151:0/3610759044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 msgr2=0x55e9b87028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 --2- 172.21.15.151:0/3610759044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87028b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f75180b5c20 tx=0x7f75180e49f0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- 172.21.15.151:0/3610759044 shutdown_connections 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 --2- 172.21.15.151:0/3610759044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87028b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- 172.21.15.151:0/3610759044 >> 172.21.15.151:0/3610759044 conn(0x55e9b86fe8b0 msgr2=0x55e9b86fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- 172.21.15.151:0/3610759044 shutdown_connections 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- 172.21.15.151:0/3610759044 wait complete. 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 Processor -- start 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- start start 2024-09-10T14:29:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87096d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e9b8703320 con 0x55e9b87024d0 2024-09-10T14:29:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f7526f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39422/0 (socket says 172.21.15.151:39422) 2024-09-10T14:29:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 learned_addr learned my addr 172.21.15.151:0/3170051634 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b8709c10 con 0x55e9b87024d0 2024-09-10T14:29:15.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87096d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f75180d1fd0 tx=0x7f75180e0eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f73f77fe640 1 -- 172.21.15.151:0/3170051634 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7518109020 con 0x55e9b87024d0 2024-09-10T14:29:15.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9b8709c10 con 0x55e9b87024d0 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f73f77fe640 1 -- 172.21.15.151:0/3170051634 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75180ff040 con 0x55e9b87024d0 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f73f77fe640 1 -- 172.21.15.151:0/3170051634 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75180fe070 con 0x55e9b87024d0 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.391+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b870a080 con 0x55e9b87024d0 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f73f77fe640 1 -- 172.21.15.151:0/3170051634 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f751810c020 con 0x55e9b87024d0 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f73f77fe640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73f0034650 0x7f73f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f73f77fe640 1 -- 172.21.15.151:0/3170051634 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f75180d6040 con 0x55e9b87024d0 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752673b640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73f0034650 0x7f73f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b8714630 0x55e9b8716ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8717220 con 0x55e9b8714630 2024-09-10T14:29:15.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752773d640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b8714630 0x55e9b8716ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752673b640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73f0034650 0x7f73f0036b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f751000ffd0 tx=0x7f7510023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752773d640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b8714630 0x55e9b8716ad0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 realm 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8717630 con 0x55e9b8714630 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8717ed0 con 0x55e9b8714630 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b8718fd0 0x55e9b871b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871ba10 con 0x55e9b8718fd0 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b8718fd0 0x55e9b871b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.395+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b8718fd0 0x55e9b871b3c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752942c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752942c980 20 searching for the correct realm 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871d270 con 0x55e9b8718fd0 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f7526f3c640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f751810e020 0x7f751810a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871d270 con 0x7f751810e020 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752673b640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f751810e020 0x7f751810a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752673b640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f751810e020 0x7f751810a980 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752673b640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f751001f940 0x7f751003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871d270 con 0x7f751001f940 2024-09-10T14:29:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752773d640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f751001f940 0x7f751003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752773d640 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f751001f940 0x7f751003a3c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.399+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751001f940 2024-09-10T14:29:15.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751001f940 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751810e020 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8718fd0 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751001f940 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751810e020 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8718fd0 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8718fd0 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.403+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751810e020 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8718fd0 2024-09-10T14:29:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8718fd0 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751001f940 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8718fd0 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751810e020 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751810e020 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8718fd0 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.407+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751001f940 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751810e020 2024-09-10T14:29:15.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8718fd0 2024-09-10T14:29:15.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751001f940 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x55e9b8714630 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8718270 con 0x7f751810e020 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:15.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871c390 con 0x55e9b8714630 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871cbe0 con 0x55e9b8714630 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871bff0 con 0x7f751001f940 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 zone default found 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 4 Realm: () 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 zonegroup default 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871d140 con 0x7f751810e020 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.411+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871f0e0 con 0x55e9b8718fd0 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871f5b0 con 0x55e9b8718fd0 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 20 started sync module instance, tier type = 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871e520 con 0x7f751810e020 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94462310213904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871fec0 con 0x7f751810e020 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8720710 con 0x55e9b8714630 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.415+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94462310213904] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94462310218256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8720710 con 0x55e9b8714630 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b87211f0 con 0x55e9b8718fd0 2024-09-10T14:29:15.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94462310218256] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94462310220384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8720680 con 0x55e9b8718fd0 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8721f80 con 0x7f751810e020 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94462310226576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8722820 con 0x7f751810e020 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.419+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b87231e0 con 0x55e9b8714630 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.423+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94462310220384] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.423+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94462310226576] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.423+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.423+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94462310225376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8722480 con 0x55e9b8714630 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.423+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b87231e0 con 0x7f751001f940 2024-09-10T14:29:15.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.423+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.423+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94462310232544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8723da0 con 0x7f751001f940 2024-09-10T14:29:15.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.423+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8724870 con 0x7f751001f940 2024-09-10T14:29:15.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.427+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94462310225376] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.427+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94462310232544] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.427+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.427+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94462310234144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8722d30 con 0x7f751001f940 2024-09-10T14:29:15.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.427+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8724d20 con 0x7f751001f940 2024-09-10T14:29:15.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94462310234144] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94462310237024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8724ce0 con 0x7f751001f940 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 20 add_watcher() i=0 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 20 add_watcher() i=1 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 20 add_watcher() i=2 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 20 add_watcher() i=3 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 20 add_watcher() i=4 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 20 add_watcher() i=5 2024-09-10T14:29:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 20 add_watcher() i=6 2024-09-10T14:29:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94462310237024] v36'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 20 add_watcher() i=7 2024-09-10T14:29:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8728140 con 0x55e9b8714630 2024-09-10T14:29:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.431+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94462310238720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8725690 con 0x55e9b8714630 2024-09-10T14:29:15.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94462310238720] v36'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f73d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:15.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:15.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:15.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 5 note: GC not initialized 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f73d67fc640 20 reqs_thread_entry: start 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 20 Filter name: none 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f7347fff640 20 reqs_thread_entry: start 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b874b740 con 0x55e9b8714630 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 20 rados_obj.operate() r=0 bl.length=403 2024-09-10T14:29:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:29:15.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:29:15.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:15.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8751930 con 0x55e9b8714630 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v36'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94462310421408 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55e9b874d1c0 con 0x55e9b8714630 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify (1) cookie 94462310225376 notify 154618822673 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f7520010040 con 0x55e9b8714630 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f74097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822673 cookie 94462310225376 notifier 4659 bl.length()=567 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f74097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T14:29:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f74097fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:29:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(64 notify.4 [notify cookie 94462310421408 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f74097fa640 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f73e8003eb0 con 0x55e9b8714630 2024-09-10T14:29:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.435+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== watch-notify(notify_complete (2) cookie 94462310421408 notify 154618822673 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f752000bdd0 con 0x55e9b8714630 2024-09-10T14:29:15.442 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T14:28:48.603921Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:28:48.603904Z","tags":[],"group_ids":[]} 2024-09-10T14:29:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.439+0000 7f73d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:15.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.439+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94462310238720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8749570 con 0x55e9b8714630 2024-09-10T14:29:15.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.439+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94462310238720] v36'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.439+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94462310213904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8749570 con 0x7f751810e020 2024-09-10T14:29:15.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.439+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94462310213904] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.439+0000 7f752942c980 20 remove_watcher() i=0 2024-09-10T14:29:15.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.439+0000 7f752942c980 2 removed watcher, disabling cache 2024-09-10T14:29:15.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.439+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94462310218256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871e910 con 0x55e9b8714630 2024-09-10T14:29:15.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.443+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94462310218256] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.443+0000 7f752942c980 20 remove_watcher() i=1 2024-09-10T14:29:15.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.443+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94462310220384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871e910 con 0x55e9b8718fd0 2024-09-10T14:29:15.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.443+0000 7f7526f3c640 1 -- 172.21.15.151:0/3170051634 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94462310220384] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75180f6040 con 0x55e9b8718fd0 2024-09-10T14:29:15.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.443+0000 7f752942c980 20 remove_watcher() i=2 2024-09-10T14:29:15.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.443+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94462310226576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871e910 con 0x7f751810e020 2024-09-10T14:29:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.447+0000 7f752673b640 1 -- 172.21.15.151:0/3170051634 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94462310226576] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7510037040 con 0x7f751810e020 2024-09-10T14:29:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.447+0000 7f752942c980 20 remove_watcher() i=3 2024-09-10T14:29:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.447+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94462310225376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b8721a90 con 0x55e9b8714630 2024-09-10T14:29:15.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.447+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94462310225376] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x55e9b8714630 2024-09-10T14:29:15.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.447+0000 7f752942c980 20 remove_watcher() i=4 2024-09-10T14:29:15.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.447+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94462310232544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871e910 con 0x7f751001f940 2024-09-10T14:29:15.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.451+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94462310232544] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.451+0000 7f752942c980 20 remove_watcher() i=5 2024-09-10T14:29:15.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.451+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94462310234144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871e910 con 0x7f751001f940 2024-09-10T14:29:15.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.451+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94462310234144] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.451+0000 7f752942c980 20 remove_watcher() i=6 2024-09-10T14:29:15.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.451+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94462310237024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55e9b871e910 con 0x7f751001f940 2024-09-10T14:29:15.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94462310237024] v36'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75200083f0 con 0x7f751001f940 2024-09-10T14:29:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 20 remove_watcher() i=7 2024-09-10T14:29:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f751001f940 msgr2=0x7f751003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f751001f940 0x7f751003a3c0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b8714630 msgr2=0x55e9b8716ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b8714630 0x55e9b8716ad0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f751810e020 msgr2=0x7f751810a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f751810e020 0x7f751810a980 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b8718fd0 msgr2=0x55e9b871b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b8718fd0 0x55e9b871b3c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73f0034650 msgr2=0x7f73f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f73f0034650 0x7f73f0036b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f751000ffd0 tx=0x7f7510023040 comp rx=0 tx=0).stop 2024-09-10T14:29:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752773d640 1 -- 172.21.15.151:0/3170051634 reap_dead start 2024-09-10T14:29:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 msgr2=0x55e9b87096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87096d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f75180d1fd0 tx=0x7f75180e0eb0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 shutdown_connections 2024-09-10T14:29:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3170051634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b87024d0 0x55e9b87096d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 >> 172.21.15.151:0/3170051634 conn(0x55e9b86fe8b0 msgr2=0x55e9b86fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 shutdown_connections 2024-09-10T14:29:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3170051634 wait complete. 2024-09-10T14:29:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/1548423125 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74000346a0 msgr2=0x7f7400036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/1548423125 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74000346a0 0x7f7400036b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55e9b86df7d0 tx=0x7f7510006000 comp rx=0 tx=0).stop 2024-09-10T14:29:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/1548423125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b86f5b70 msgr2=0x55e9b86f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/1548423125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b86f5b70 0x55e9b86f5f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f75180c6900 tx=0x7f75180e30e0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/1548423125 shutdown_connections 2024-09-10T14:29:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/1548423125 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f74000346a0 0x7f7400036b60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/1548423125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b86f5b70 0x55e9b86f5f90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/1548423125 >> 172.21.15.151:0/1548423125 conn(0x55e9b86eacc0 msgr2=0x55e9b86ed740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/1548423125 shutdown_connections 2024-09-10T14:29:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/1548423125 wait complete. 2024-09-10T14:29:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e9b86e5570 msgr2=0x55e9b86e7960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55e9b86e5570 0x55e9b86e7960 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b85e6240 msgr2=0x55e9b86ded50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55e9b85e6240 0x55e9b86ded50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b86e1630 msgr2=0x55e9b86e3a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55e9b86e1630 0x55e9b86e3a20 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f740c034650 msgr2=0x7f740c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f740c034650 0x7f740c036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7510000c10 tx=0x7f75100013c0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 msgr2=0x55e9b86d7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 --2- 172.21.15.151:0/3142784249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9b85e58f0 0x55e9b86d7c50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f751801aec0 tx=0x7f7518017e30 comp rx=0 tx=0).stop 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752773d640 1 -- 172.21.15.151:0/3142784249 reap_dead start 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 shutdown_connections 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 >> 172.21.15.151:0/3142784249 conn(0x55e9b8559240 msgr2=0x55e9b86cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 shutdown_connections 2024-09-10T14:29:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.455+0000 7f752942c980 1 -- 172.21.15.151:0/3142784249 wait complete. 2024-09-10T14:29:15.470 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T14:28:48.603921Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:28:48.603904Z', 'tags': [], 'group_ids': []} 2024-09-10T14:29:15.487 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:15.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T14:29:15.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T14:29:15.487 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T14:29:15.548 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:15.548 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:15.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f1221b980 1 Processor -- start 2024-09-10T14:29:15.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f1221b980 1 -- start start 2024-09-10T14:29:15.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f1221b980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5644cbe628e0 0x5644cbe62cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f1221b980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5644cbce8ae0 con 0x5644cbe63230 2024-09-10T14:29:15.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f1221b980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5644cbd0ce30 con 0x5644cbe628e0 2024-09-10T14:29:15.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f0fd2b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5644cbe628e0 0x5644cbe62cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f0752a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5644cbe63230 0x5644cbe67c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:51378/0 (socket says 172.21.15.151:51378) 2024-09-10T14:29:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f0fd2b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5644cbe628e0 0x5644cbe62cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39438/0 (socket says 172.21.15.151:39438) 2024-09-10T14:29:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f0752a640 1 -- 172.21.15.151:0/465813961 learned_addr learned my addr 172.21.15.151:0/465813961 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/465813961 >> v1:172.21.15.52:6789/0 conn(0x5644cbe63230 legacy=0x5644cbe67c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.547+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/465813961 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644cbe6a4b0 con 0x5644cbe628e0 2024-09-10T14:29:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/465813961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe628e0 0x5644cbe62cc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000a480 tx=0x7f3f0001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cc47ad75be3e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f0f52a640 1 -- 172.21.15.151:0/465813961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000b0070 con 0x5644cbe628e0 2024-09-10T14:29:15.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f0f52a640 1 -- 172.21.15.151:0/465813961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f000ab540 con 0x5644cbe628e0 2024-09-10T14:29:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f0f52a640 1 -- 172.21.15.151:0/465813961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000ab840 con 0x5644cbe628e0 2024-09-10T14:29:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f1221b980 1 -- 172.21.15.151:0/465813961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe628e0 msgr2=0x5644cbe62cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f1221b980 1 --2- 172.21.15.151:0/465813961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe628e0 0x5644cbe62cc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000a480 tx=0x7f3f0001b280 comp rx=0 tx=0).stop 2024-09-10T14:29:15.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f1221b980 1 -- 172.21.15.151:0/465813961 shutdown_connections 2024-09-10T14:29:15.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f1221b980 1 --2- 172.21.15.151:0/465813961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe628e0 0x5644cbe62cc0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f1221b980 1 -- 172.21.15.151:0/465813961 >> 172.21.15.151:0/465813961 conn(0x5644cbdd6230 msgr2=0x5644cbdd6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f1221b980 1 -- 172.21.15.151:0/465813961 shutdown_connections 2024-09-10T14:29:15.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.551+0000 7f3f1221b980 1 -- 172.21.15.151:0/465813961 wait complete. 2024-09-10T14:29:15.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 Processor -- start 2024-09-10T14:29:15.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- start start 2024-09-10T14:29:15.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf4dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644cbd0e200 con 0x5644cbe63230 2024-09-10T14:29:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf4dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf4dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39440/0 (socket says 172.21.15.151:39440) 2024-09-10T14:29:15.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/1134507936 learned_addr learned my addr 172.21.15.151:0/1134507936 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/1134507936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644cbf4e300 con 0x5644cbe63230 2024-09-10T14:29:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/1134507936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf4dd30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000a480 tx=0x7f3f00003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5053e02da3f76ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3dfde0b640 1 -- 172.21.15.151:0/1134507936 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000b0040 con 0x5644cbe63230 2024-09-10T14:29:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3dfde0b640 1 -- 172.21.15.151:0/1134507936 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f000ab8a0 con 0x5644cbe63230 2024-09-10T14:29:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3dfde0b640 1 -- 172.21.15.151:0/1134507936 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000abb80 con 0x5644cbe63230 2024-09-10T14:29:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- 172.21.15.151:0/1134507936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 msgr2=0x5644cbf4dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 --2- 172.21.15.151:0/1134507936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf4dd30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000a480 tx=0x7f3f00003030 comp rx=0 tx=0).stop 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- 172.21.15.151:0/1134507936 shutdown_connections 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 --2- 172.21.15.151:0/1134507936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf4dd30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- 172.21.15.151:0/1134507936 >> 172.21.15.151:0/1134507936 conn(0x5644cbdd6230 msgr2=0x5644cbf498c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- 172.21.15.151:0/1134507936 shutdown_connections 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- 172.21.15.151:0/1134507936 wait complete. 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 Processor -- start 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- start start 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf54fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.567+0000 7f3f1221b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644cbe69ef0 con 0x5644cbe63230 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf54fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf54fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39452/0 (socket says 172.21.15.151:39452) 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2059282204 learned_addr learned my addr 172.21.15.151:0/2059282204 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2059282204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644cbf554f0 con 0x5644cbe63230 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf54fb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000a480 tx=0x7f3f00018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3df7fff640 1 -- 172.21.15.151:0/2059282204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000b0070 con 0x5644cbe63230 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644cbf55780 con 0x5644cbe63230 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3df7fff640 1 -- 172.21.15.151:0/2059282204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f00000e50 con 0x5644cbe63230 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3df7fff640 1 -- 172.21.15.151:0/2059282204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000b6900 con 0x5644cbe63230 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644cbf58460 con 0x5644cbe63230 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3df7fff640 1 -- 172.21.15.151:0/2059282204 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f000b6b70 con 0x5644cbe63230 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3df7fff640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df8034650 0x7f3df8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3df7fff640 1 -- 172.21.15.151:0/2059282204 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3f000bc070 con 0x5644cbe63230 2024-09-10T14:29:15.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df8034650 0x7f3df8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf59f30 0x5644cbf5c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf5c960 con 0x5644cbf59f30 2024-09-10T14:29:15.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f1052c640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf59f30 0x5644cbf5c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df8034650 0x7f3df8036b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8000f70 tx=0x7f3ef80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f1052c640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf59f30 0x5644cbf5c320 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f1052c640 1 -- 172.21.15.151:0/2059282204 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf59f30 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.571+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf59680 con 0x5644cbf59f30 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1052c640 1 -- 172.21.15.151:0/2059282204 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf59f30 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf5ec90 0x5644cbf61080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf61750 con 0x5644cbf5ec90 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf5ec90 0x5644cbf61080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf5ec90 0x5644cbf61080 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2059282204 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f000b3040 con 0x5644cbf5ec90 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf5db30 con 0x5644cbf59f30 2024-09-10T14:29:15.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1052c640 1 -- 172.21.15.151:0/2059282204 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf59f30 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5644cbf62b90 0x5644cbf64f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf65710 con 0x5644cbf62b90 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5644cbf62b90 0x5644cbf64f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5644cbf62b90 0x5644cbf64f80 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f0752a640 1 -- 172.21.15.151:0/2059282204 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbf62b90 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 Processor -- start 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 -- start start 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf731a0 0x5644cbf735c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.575+0000 7f3f1221b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644cbd67800 con 0x5644cbf731a0 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf731a0 0x5644cbf735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf731a0 0x5644cbf735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39464/0 (socket says 172.21.15.151:39464) 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2002012247 learned_addr learned my addr 172.21.15.151:0/2002012247 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2002012247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644cbf73b00 con 0x5644cbf731a0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/2002012247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf731a0 0x5644cbf735c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3f000030b0 tx=0x7f3f000c7460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3df57fa640 1 -- 172.21.15.151:0/2002012247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000e4a00 con 0x5644cbf731a0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3df57fa640 1 -- 172.21.15.151:0/2002012247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f000e4ba0 con 0x5644cbf731a0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f1221b980 1 -- 172.21.15.151:0/2002012247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644cbf73d90 con 0x5644cbf731a0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3df57fa640 1 -- 172.21.15.151:0/2002012247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000c05e0 con 0x5644cbf731a0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f1221b980 1 -- 172.21.15.151:0/2002012247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644cbf76a10 con 0x5644cbf731a0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3df57fa640 1 -- 172.21.15.151:0/2002012247 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f000c0780 con 0x5644cbf731a0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3df57fa640 1 --2- 172.21.15.151:0/2002012247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de8034650 0x7f3de8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3df57fa640 1 -- 172.21.15.151:0/2002012247 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3f000a8070 con 0x5644cbf731a0 2024-09-10T14:29:15.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2002012247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de8034650 0x7f3de8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f1221b980 1 Processor -- start 2024-09-10T14:29:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f1221b980 1 -- start start 2024-09-10T14:29:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2002012247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de8034650 0x7f3de8036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800bf60 tx=0x7f3ef800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f1221b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf7fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f1221b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644cbf4e5c0 con 0x5644cbf7f9f0 2024-09-10T14:29:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.579+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf7fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf7fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39466/0 (socket says 172.21.15.151:39466) 2024-09-10T14:29:15.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/1147933752 learned_addr learned my addr 172.21.15.151:0/1147933752 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/1147933752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644cbf803c0 con 0x5644cbf7f9f0 2024-09-10T14:29:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/1147933752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf7fdf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3f000d3bc0 tx=0x7f3f000d3430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa57c2b1463ff71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3deeffd640 1 -- 172.21.15.151:0/1147933752 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000aa820 con 0x5644cbf7f9f0 2024-09-10T14:29:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3deeffd640 1 -- 172.21.15.151:0/1147933752 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f000de440 con 0x5644cbf7f9f0 2024-09-10T14:29:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3deeffd640 1 -- 172.21.15.151:0/1147933752 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000b5760 con 0x5644cbf7f9f0 2024-09-10T14:29:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 -- 172.21.15.151:0/1147933752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 msgr2=0x5644cbf7fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 --2- 172.21.15.151:0/1147933752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf7fdf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3f000d3bc0 tx=0x7f3f000d3430 comp rx=0 tx=0).stop 2024-09-10T14:29:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 -- 172.21.15.151:0/1147933752 shutdown_connections 2024-09-10T14:29:15.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 --2- 172.21.15.151:0/1147933752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf7fdf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 -- 172.21.15.151:0/1147933752 >> 172.21.15.151:0/1147933752 conn(0x5644cbf7bdd0 msgr2=0x5644cbf79ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 -- 172.21.15.151:0/1147933752 shutdown_connections 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 -- 172.21.15.151:0/1147933752 wait complete. 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 Processor -- start 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 -- start start 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf86c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f1221b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644cbf80840 con 0x5644cbf7f9f0 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf86c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf86c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39472/0 (socket says 172.21.15.151:39472) 2024-09-10T14:29:15.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 learned_addr learned my addr 172.21.15.151:0/2682800027 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644cbf871d0 con 0x5644cbf7f9f0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf86c90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3f000c0c70 tx=0x7f3f000dce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.583+0000 7f3ded7fa640 1 -- 172.21.15.151:0/2682800027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f00107070 con 0x5644cbf7f9f0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644cbf871d0 con 0x5644cbf7f9f0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3ded7fa640 1 -- 172.21.15.151:0/2682800027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f000e41e0 con 0x5644cbf7f9f0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3ded7fa640 1 -- 172.21.15.151:0/2682800027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f000de7d0 con 0x5644cbf7f9f0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644cbf871d0 con 0x5644cbf7f9f0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3ded7fa640 1 -- 172.21.15.151:0/2682800027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f000ff070 con 0x5644cbf7f9f0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3ded7fa640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dd8034650 0x7f3dd8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3ded7fa640 1 -- 172.21.15.151:0/2682800027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3f000fd020 con 0x5644cbf7f9f0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dd8034650 0x7f3dd8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf91ae0 0x5644cbf93fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf946f0 con 0x5644cbf91ae0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1052c640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf91ae0 0x5644cbf93fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dd8034650 0x7f3dd8036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x5644cbf65b10 tx=0x7f3ef8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1052c640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf91ae0 0x5644cbf93fa0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 realm 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf94b00 con 0x5644cbf91ae0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf953d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf964d0 0x5644cbf988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf98e90 con 0x5644cbf964d0 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.587+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf964d0 0x5644cbf988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf964d0 0x5644cbf988c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1221b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1221b980 20 searching for the correct realm 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9a760 con 0x5644cbf964d0 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0fd2b640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x5644cbe628e0 0x7f3f00103840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9a760 con 0x5644cbe628e0 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x5644cbe628e0 0x7f3f00103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x5644cbe628e0 0x7f3f00103840 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0752a640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3ef8037040 0x7f3ef8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:15.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9a760 con 0x7f3ef8037040 2024-09-10T14:29:15.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1052c640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3ef8037040 0x7f3ef8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:15.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1052c640 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3ef8037040 0x7f3ef8036410 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.591+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x7f3ef8037040 2024-09-10T14:29:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x7f3ef8037040 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbe628e0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf964d0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x7f3ef8037040 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbe628e0 2024-09-10T14:29:15.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf964d0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf964d0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.595+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbe628e0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf964d0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf964d0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x7f3ef8037040 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf964d0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbe628e0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbe628e0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf964d0 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.599+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x7f3ef8037040 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbe628e0 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf964d0 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x7f3ef8037040 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbf91ae0 2024-09-10T14:29:15.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf95770 con 0x5644cbe628e0 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf99880 con 0x5644cbf91ae0 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9a120 con 0x5644cbf91ae0 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.603+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf99c70 con 0x7f3ef8037040 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 zone default found 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 4 Realm: () 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 zonegroup default 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9a0a0 con 0x5644cbe628e0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9c600 con 0x5644cbf964d0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9ca70 con 0x5644cbf964d0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 started sync module instance, tier type = 2024-09-10T14:29:15.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:15.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9ba10 con 0x5644cbe628e0 2024-09-10T14:29:15.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94853479906736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9c1d0 con 0x5644cbe628e0 2024-09-10T14:29:15.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9d9a0 con 0x5644cbf91ae0 2024-09-10T14:29:15.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.607+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94853479906736] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.611+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.611+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94853479912688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9d910 con 0x5644cbf91ae0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.611+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9e750 con 0x5644cbf964d0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.611+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.611+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94853479916096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9f020 con 0x5644cbf964d0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.611+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9fa20 con 0x5644cbe628e0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.611+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94853479912688] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.615+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.615+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94853479914896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9fe10 con 0x5644cbe628e0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.615+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa07d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.615+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94853479916096] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.615+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94853479914896] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.615+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.615+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94853479920944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa0320 con 0x5644cbf91ae0 2024-09-10T14:29:15.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.615+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa0bb0 con 0x7f3ef8037040 2024-09-10T14:29:15.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.619+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94853479920944] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.619+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.619+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94853479918448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa07d0 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.619+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa15c0 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.619+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94853479918448] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.619+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.619+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94853479924992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa15c0 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.619+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa1f80 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94853479924992] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94853479928080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa1f80 con 0x7f3ef8037040 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 20 add_watcher() i=0 2024-09-10T14:29:15.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 20 add_watcher() i=1 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 20 add_watcher() i=2 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 20 add_watcher() i=3 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 20 add_watcher() i=4 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 20 add_watcher() i=5 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 20 add_watcher() i=6 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94853479928080] v36'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 20 add_watcher() i=7 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa52b0 con 0x5644cbf91ae0 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.623+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94853479930944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa2510 con 0x5644cbf91ae0 2024-09-10T14:29:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.627+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94853479930944] v36'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.627+0000 7f3dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:15.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.627+0000 7f3f1221b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:15.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.627+0000 7f3f1221b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:15.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.627+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa4a20 con 0x5644cbf91ae0 2024-09-10T14:29:15.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.627+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.627+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfae370 con 0x7f3ef8037040 2024-09-10T14:29:15.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.631+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.631+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfae370 con 0x5644cbf964d0 2024-09-10T14:29:15.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.631+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.631+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfae370 con 0x5644cbf91ae0 2024-09-10T14:29:15.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.635+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'193 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.635+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfae9f0 con 0x5644cbe628e0 2024-09-10T14:29:15.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.635+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.635+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfaef60 con 0x5644cbf964d0 2024-09-10T14:29:15.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.635+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.635+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfaeff0 con 0x5644cbf91ae0 2024-09-10T14:29:15.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.639+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.639+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfaf080 con 0x7f3ef8037040 2024-09-10T14:29:15.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.639+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.639+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfaf110 con 0x5644cbe628e0 2024-09-10T14:29:15.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.643+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.643+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfaf680 con 0x5644cbf964d0 2024-09-10T14:29:15.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.643+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.643+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfaf680 con 0x5644cbe628e0 2024-09-10T14:29:15.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.647+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.647+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x7f3ef8037040 2024-09-10T14:29:15.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.647+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.647+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbe628e0 2024-09-10T14:29:15.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.647+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.647+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x7f3ef8037040 2024-09-10T14:29:15.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.651+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.651+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbf91ae0 2024-09-10T14:29:15.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.651+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'194 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.651+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbf964d0 2024-09-10T14:29:15.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.655+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.655+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbe628e0 2024-09-10T14:29:15.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.655+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.655+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbf964d0 2024-09-10T14:29:15.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.659+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.659+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbf91ae0 2024-09-10T14:29:15.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.659+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.659+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbf91ae0 2024-09-10T14:29:15.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.659+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'195 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.659+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbf964d0 2024-09-10T14:29:15.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.663+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.663+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafb30 con 0x5644cbe628e0 2024-09-10T14:29:15.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.663+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.663+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x5644cbf964d0 2024-09-10T14:29:15.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.667+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.667+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x5644cbf964d0 2024-09-10T14:29:15.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.667+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.667+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x5644cbf964d0 2024-09-10T14:29:15.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.667+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.667+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x5644cbf964d0 2024-09-10T14:29:15.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.671+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.671+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x7f3ef8037040 2024-09-10T14:29:15.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.671+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.671+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x5644cbf964d0 2024-09-10T14:29:15.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.675+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.675+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x7f3ef8037040 2024-09-10T14:29:15.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.675+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.675+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x5644cbf964d0 2024-09-10T14:29:15.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.679+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.679+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x7f3ef8037040 2024-09-10T14:29:15.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfafbe0 con 0x5644cbe628e0 2024-09-10T14:29:15.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3dc4fe1640 20 reqs_thread_entry: start 2024-09-10T14:29:15.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3f1221b980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:15.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3f1221b980 20 Filter name: none 2024-09-10T14:29:15.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3d3e7fc640 20 reqs_thread_entry: start 2024-09-10T14:29:15.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3f1221b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:29:15.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3f1221b980 20 rados->read ofs=0 len=0 2024-09-10T14:29:15.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.683+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfcb190 con 0x5644cbf91ae0 2024-09-10T14:29:15.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3f1221b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:29:15.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3f1221b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:29:15.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3f1221b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:29:15.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3f1221b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:15.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfcd660 con 0x5644cbe628e0 2024-09-10T14:29:15.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.692 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T14:29:15.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3dc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:15.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.687+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94853479930944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf8b370 con 0x5644cbf91ae0 2024-09-10T14:29:15.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94853479930944] v36'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94853479906736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa1c40 con 0x5644cbe628e0 2024-09-10T14:29:15.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94853479906736] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f1221b980 20 remove_watcher() i=0 2024-09-10T14:29:15.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f1221b980 2 removed watcher, disabling cache 2024-09-10T14:29:15.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94853479912688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa1c40 con 0x5644cbf91ae0 2024-09-10T14:29:15.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94853479912688] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f1221b980 20 remove_watcher() i=1 2024-09-10T14:29:15.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.691+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94853479916096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9d4f0 con 0x5644cbf964d0 2024-09-10T14:29:15.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.695+0000 7f3f0fd2b640 1 -- 172.21.15.151:0/2682800027 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94853479916096] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f000dc070 con 0x5644cbf964d0 2024-09-10T14:29:15.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.695+0000 7f3f1221b980 20 remove_watcher() i=2 2024-09-10T14:29:15.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.695+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94853479914896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa1c40 con 0x5644cbe628e0 2024-09-10T14:29:15.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.695+0000 7f3f0752a640 1 -- 172.21.15.151:0/2682800027 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94853479914896] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef800e620 con 0x5644cbe628e0 2024-09-10T14:29:15.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.695+0000 7f3f1221b980 20 remove_watcher() i=3 2024-09-10T14:29:15.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.695+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94853479920944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9d4f0 con 0x5644cbf91ae0 2024-09-10T14:29:15.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.699+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94853479920944] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x5644cbf91ae0 2024-09-10T14:29:15.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.699+0000 7f3f1221b980 20 remove_watcher() i=4 2024-09-10T14:29:15.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.699+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94853479918448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbfa1c40 con 0x7f3ef8037040 2024-09-10T14:29:15.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.699+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94853479918448] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.699+0000 7f3f1221b980 20 remove_watcher() i=5 2024-09-10T14:29:15.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.703+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94853479924992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9f530 con 0x7f3ef8037040 2024-09-10T14:29:15.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.703+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94853479924992] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.703+0000 7f3f1221b980 20 remove_watcher() i=6 2024-09-10T14:29:15.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.703+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94853479928080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5644cbf9d4f0 con 0x7f3ef8037040 2024-09-10T14:29:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94853479928080] v36'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f0800a4d0 con 0x7f3ef8037040 2024-09-10T14:29:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 20 remove_watcher() i=7 2024-09-10T14:29:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3ef8037040 msgr2=0x7f3ef8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f3ef8037040 0x7f3ef8036410 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf91ae0 msgr2=0x5644cbf93fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf91ae0 0x5644cbf93fa0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x5644cbe628e0 msgr2=0x7f3f00103840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x5644cbe628e0 0x7f3f00103840 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf964d0 msgr2=0x5644cbf988c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf964d0 0x5644cbf988c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dd8034650 msgr2=0x7f3dd8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3dd8034650 0x7f3dd8036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x5644cbf65b10 tx=0x7f3ef8010000 comp rx=0 tx=0).stop 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 msgr2=0x5644cbf86c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1052c640 1 -- 172.21.15.151:0/2682800027 reap_dead start 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf86c90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3f000c0c70 tx=0x7f3f000dce80 comp rx=0 tx=0).stop 2024-09-10T14:29:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 shutdown_connections 2024-09-10T14:29:15.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2682800027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf7f9f0 0x5644cbf86c90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 >> 172.21.15.151:0/2682800027 conn(0x5644cbf7bdd0 msgr2=0x5644cbf79ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 shutdown_connections 2024-09-10T14:29:15.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2682800027 wait complete. 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2002012247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de8034650 msgr2=0x7f3de8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2002012247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de8034650 0x7f3de8036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800bf60 tx=0x7f3ef800f000 comp rx=0 tx=0).stop 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2002012247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf731a0 msgr2=0x5644cbf735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2002012247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf731a0 0x5644cbf735c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3f000030b0 tx=0x7f3f000c7460 comp rx=0 tx=0).stop 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2002012247 shutdown_connections 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2002012247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3de8034650 0x7f3de8036b10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2002012247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbf731a0 0x5644cbf735c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2002012247 >> 172.21.15.151:0/2002012247 conn(0x5644cbf682f0 msgr2=0x5644cbf6ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2002012247 shutdown_connections 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2002012247 wait complete. 2024-09-10T14:29:15.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5644cbf62b90 msgr2=0x5644cbf64f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5644cbf62b90 0x5644cbf64f80 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf59f30 msgr2=0x5644cbf5c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5644cbf59f30 0x5644cbf5c320 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf5ec90 msgr2=0x5644cbf61080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5644cbf5ec90 0x5644cbf61080 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df8034650 msgr2=0x7f3df8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3df8034650 0x7f3df8036b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8000f70 tx=0x7f3ef80012c0 comp rx=0 tx=0).stop 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 msgr2=0x5644cbf54fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 --2- 172.21.15.151:0/2059282204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644cbe63230 0x5644cbf54fb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000a480 tx=0x7f3f00018020 comp rx=0 tx=0).stop 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1052c640 1 -- 172.21.15.151:0/2059282204 reap_dead start 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 shutdown_connections 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 >> 172.21.15.151:0/2059282204 conn(0x5644cbdd6230 msgr2=0x5644cbf48440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 shutdown_connections 2024-09-10T14:29:15.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:15.707+0000 7f3f1221b980 1 -- 172.21.15.151:0/2059282204 wait complete. 2024-09-10T14:29:15.724 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T14:29:15.747 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:15.794 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T14:29:50.794 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-10T14:29:50.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-10T14:29:50.795 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-10T14:29:50.834 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:50.835 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:50.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f815bd34980 1 Processor -- start 2024-09-10T14:29:50.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f815bd34980 1 -- start start 2024-09-10T14:29:50.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f815bd34980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562d69378290 0x562d694087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f815bd34980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d6928bae0 con 0x562d69408ce0 2024-09-10T14:29:50.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f815bd34980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x562d692afe30 con 0x562d69378290 2024-09-10T14:29:50.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f8159844640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562d69378290 0x562d694087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f8159043640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x562d69408ce0 0x562d6940b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:52546/0 (socket says 172.21.15.151:52546) 2024-09-10T14:29:50.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f8159844640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562d69378290 0x562d694087a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39912/0 (socket says 172.21.15.151:39912) 2024-09-10T14:29:50.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f8159043640 1 -- 172.21.15.151:0/3434093955 learned_addr learned my addr 172.21.15.151:0/3434093955 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:50.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f8159844640 1 -- 172.21.15.151:0/3434093955 >> v1:172.21.15.52:6789/0 conn(0x562d69408ce0 legacy=0x562d6940b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.833+0000 7f8159844640 1 -- 172.21.15.151:0/3434093955 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d69378670 con 0x562d69378290 2024-09-10T14:29:50.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f8159844640 1 --2- 172.21.15.151:0/3434093955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694087a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f814c00a420 tx=0x7f814c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9c234b0b32e9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f8158842640 1 -- 172.21.15.151:0/3434093955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0af070 con 0x562d69378290 2024-09-10T14:29:50.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f8158842640 1 -- 172.21.15.151:0/3434093955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0aa530 con 0x562d69378290 2024-09-10T14:29:50.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f8158842640 1 -- 172.21.15.151:0/3434093955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0aa850 con 0x562d69378290 2024-09-10T14:29:50.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f815bd34980 1 -- 172.21.15.151:0/3434093955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 msgr2=0x562d694087a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f815bd34980 1 --2- 172.21.15.151:0/3434093955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694087a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f814c00a420 tx=0x7f814c01afd0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f815bd34980 1 -- 172.21.15.151:0/3434093955 shutdown_connections 2024-09-10T14:29:50.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f815bd34980 1 --2- 172.21.15.151:0/3434093955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694087a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f815bd34980 1 -- 172.21.15.151:0/3434093955 >> 172.21.15.151:0/3434093955 conn(0x562d693fe090 msgr2=0x562d694004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:50.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f815bd34980 1 -- 172.21.15.151:0/3434093955 shutdown_connections 2024-09-10T14:29:50.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.837+0000 7f815bd34980 1 -- 172.21.15.151:0/3434093955 wait complete. 2024-09-10T14:29:50.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.853+0000 7f815bd34980 1 Processor -- start 2024-09-10T14:29:50.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.853+0000 7f815bd34980 1 -- start start 2024-09-10T14:29:50.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.853+0000 7f815bd34980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.853+0000 7f815bd34980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d692b1200 con 0x562d69378290 2024-09-10T14:29:50.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.853+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39916/0 (socket says 172.21.15.151:39916) 2024-09-10T14:29:50.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8159844640 1 -- 172.21.15.151:0/105172949 learned_addr learned my addr 172.21.15.151:0/105172949 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:50.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8159844640 1 -- 172.21.15.151:0/105172949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d694f1290 con 0x562d69378290 2024-09-10T14:29:50.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8159844640 1 --2- 172.21.15.151:0/105172949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f0cc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f814c018c00 tx=0x7f814c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09f681f005ea7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8047e07640 1 -- 172.21.15.151:0/105172949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0af070 con 0x562d69378290 2024-09-10T14:29:50.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8047e07640 1 -- 172.21.15.151:0/105172949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0b0040 con 0x562d69378290 2024-09-10T14:29:50.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8047e07640 1 -- 172.21.15.151:0/105172949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0aac20 con 0x562d69378290 2024-09-10T14:29:50.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 -- 172.21.15.151:0/105172949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 msgr2=0x562d694f0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 --2- 172.21.15.151:0/105172949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f0cc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f814c018c00 tx=0x7f814c0033b0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 -- 172.21.15.151:0/105172949 shutdown_connections 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 --2- 172.21.15.151:0/105172949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f0cc0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 -- 172.21.15.151:0/105172949 >> 172.21.15.151:0/105172949 conn(0x562d693fe090 msgr2=0x562d694ec8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 -- 172.21.15.151:0/105172949 shutdown_connections 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 -- 172.21.15.151:0/105172949 wait complete. 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 Processor -- start 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 -- start start 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f815bd34980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d6940f220 con 0x562d69378290 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39926/0 (socket says 172.21.15.151:39926) 2024-09-10T14:29:50.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8159844640 1 -- 172.21.15.151:0/3057343472 learned_addr learned my addr 172.21.15.151:0/3057343472 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:50.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.857+0000 7f8159844640 1 -- 172.21.15.151:0/3057343472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d694f83b0 con 0x562d69378290 2024-09-10T14:29:50.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8159844640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f7e70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f814c018c00 tx=0x7f814c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8046604640 1 -- 172.21.15.151:0/3057343472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0b6880 con 0x562d69378290 2024-09-10T14:29:50.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d694f8640 con 0x562d69378290 2024-09-10T14:29:50.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d694fb320 con 0x562d69378290 2024-09-10T14:29:50.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8046604640 1 -- 172.21.15.151:0/3057343472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0b6a20 con 0x562d69378290 2024-09-10T14:29:50.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8046604640 1 -- 172.21.15.151:0/3057343472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0cf060 con 0x562d69378290 2024-09-10T14:29:50.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8046604640 1 -- 172.21.15.151:0/3057343472 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f814c0b6d00 con 0x562d69378290 2024-09-10T14:29:50.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8046604640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8040034650 0x7f8040036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8046604640 1 -- 172.21.15.151:0/3057343472 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f814c0bb070 con 0x562d69378290 2024-09-10T14:29:50.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8159043640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8040034650 0x7f8040036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815bd34980 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69408ce0 0x562d694fee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d694ff450 con 0x562d69408ce0 2024-09-10T14:29:50.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815a045640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69408ce0 0x562d694fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f8159043640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8040034650 0x7f8040036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8150001da0 tx=0x7f8150001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815a045640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69408ce0 0x562d694fee00 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815a045640 1 -- 172.21.15.151:0/3057343472 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69408ce0 2024-09-10T14:29:50.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d694fc520 con 0x562d69408ce0 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815a045640 1 -- 172.21.15.151:0/3057343472 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81540083f0 con 0x562d69408ce0 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815bd34980 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d69501760 0x562d69503b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.861+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d69504220 con 0x562d69501760 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f8159844640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d69501760 0x562d69503b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f8159844640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d69501760 0x562d69503b50 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f8159844640 1 -- 172.21.15.151:0/3057343472 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f814c0c7020 con 0x562d69501760 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d69500600 con 0x562d69408ce0 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f815a045640 1 -- 172.21.15.151:0/3057343472 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81540083f0 con 0x562d69408ce0 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f815bd34980 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562d69505680 0x562d69507a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d69508170 con 0x562d69505680 2024-09-10T14:29:50.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f8159043640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562d69505680 0x562d69507a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f8159043640 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562d69505680 0x562d69507a70 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f8159043640 1 -- 172.21.15.151:0/3057343472 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f815000e6c0 con 0x562d69505680 2024-09-10T14:29:50.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f815bd34980 1 Processor -- start 2024-09-10T14:29:50.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f815bd34980 1 -- start start 2024-09-10T14:29:50.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f815bd34980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69515c40 0x562d69516060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f815bd34980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d6930a800 con 0x562d69515c40 2024-09-10T14:29:50.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69515c40 0x562d69516060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.865+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69515c40 0x562d69516060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39934/0 (socket says 172.21.15.151:39934) 2024-09-10T14:29:50.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f8159844640 1 -- 172.21.15.151:0/4053078426 learned_addr learned my addr 172.21.15.151:0/4053078426 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:50.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f8159844640 1 -- 172.21.15.151:0/4053078426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d695165a0 con 0x562d69515c40 2024-09-10T14:29:50.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f8159844640 1 --2- 172.21.15.151:0/4053078426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69515c40 0x562d69516060 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f814c0be900 tx=0x7f814c0befa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f803f7fe640 1 -- 172.21.15.151:0/4053078426 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0e20c0 con 0x562d69515c40 2024-09-10T14:29:50.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f815bd34980 1 -- 172.21.15.151:0/4053078426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d69516830 con 0x562d69515c40 2024-09-10T14:29:50.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f803f7fe640 1 -- 172.21.15.151:0/4053078426 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0e2260 con 0x562d69515c40 2024-09-10T14:29:50.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f803f7fe640 1 -- 172.21.15.151:0/4053078426 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0afc50 con 0x562d69515c40 2024-09-10T14:29:50.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f815bd34980 1 -- 172.21.15.151:0/4053078426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d695194b0 con 0x562d69515c40 2024-09-10T14:29:50.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f803f7fe640 1 -- 172.21.15.151:0/4053078426 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f814c0de030 con 0x562d69515c40 2024-09-10T14:29:50.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f803f7fe640 1 --2- 172.21.15.151:0/4053078426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8034034650 0x7f8034036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f803f7fe640 1 -- 172.21.15.151:0/4053078426 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f814c0efd10 con 0x562d69515c40 2024-09-10T14:29:50.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f8159043640 1 --2- 172.21.15.151:0/4053078426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8034034650 0x7f8034036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f815bd34980 1 Processor -- start 2024-09-10T14:29:50.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f815bd34980 1 -- start start 2024-09-10T14:29:50.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f8159043640 1 --2- 172.21.15.151:0/4053078426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8034034650 0x7f8034036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x562d694ffd10 tx=0x7f815000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f815bd34980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69522950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f815bd34980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d694f1550 con 0x562d69522570 2024-09-10T14:29:50.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69522950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69522950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39940/0 (socket says 172.21.15.151:39940) 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.869+0000 7f8159844640 1 -- 172.21.15.151:0/3586793512 learned_addr learned my addr 172.21.15.151:0/3586793512 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f8159844640 1 -- 172.21.15.151:0/3586793512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d69522f20 con 0x562d69522570 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f8159844640 1 --2- 172.21.15.151:0/3586793512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69522950 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f814c0c9780 tx=0x7f814c0090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb7df6c5a7eef33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f803d7fa640 1 -- 172.21.15.151:0/3586793512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0d3730 con 0x562d69522570 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f803d7fa640 1 -- 172.21.15.151:0/3586793512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0bf710 con 0x562d69522570 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f803d7fa640 1 -- 172.21.15.151:0/3586793512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0d38d0 con 0x562d69522570 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 -- 172.21.15.151:0/3586793512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 msgr2=0x562d69522950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 --2- 172.21.15.151:0/3586793512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69522950 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f814c0c9780 tx=0x7f814c0090d0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 -- 172.21.15.151:0/3586793512 shutdown_connections 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 --2- 172.21.15.151:0/3586793512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69522950 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 -- 172.21.15.151:0/3586793512 >> 172.21.15.151:0/3586793512 conn(0x562d6951e950 msgr2=0x562d6951ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:50.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 -- 172.21.15.151:0/3586793512 shutdown_connections 2024-09-10T14:29:50.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 -- 172.21.15.151:0/3586793512 wait complete. 2024-09-10T14:29:50.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 Processor -- start 2024-09-10T14:29:50.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 -- start start 2024-09-10T14:29:50.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69529790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f815bd34980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d695233c0 con 0x562d69522570 2024-09-10T14:29:50.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69529790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f8159844640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69529790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39950/0 (socket says 172.21.15.151:39950) 2024-09-10T14:29:50.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 learned_addr learned my addr 172.21.15.151:0/1606710426 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:50.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d69529cd0 con 0x562d69522570 2024-09-10T14:29:50.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.873+0000 7f8159844640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69529790 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f814c0e24c0 tx=0x7f814c0e7220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f802b7fe640 1 -- 172.21.15.151:0/1606710426 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c10b070 con 0x562d69522570 2024-09-10T14:29:50.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d69529cd0 con 0x562d69522570 2024-09-10T14:29:50.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f802b7fe640 1 -- 172.21.15.151:0/1606710426 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814c0092f0 con 0x562d69522570 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f802b7fe640 1 -- 172.21.15.151:0/1606710426 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f814c0095f0 con 0x562d69522570 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d69529cd0 con 0x562d69522570 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f802b7fe640 1 -- 172.21.15.151:0/1606710426 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f814c116060 con 0x562d69522570 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f802b7fe640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 0x7f8024036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f802b7fe640 1 -- 172.21.15.151:0/1606710426 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f814c110d20 con 0x562d69522570 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f8159043640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 0x7f8024036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69534810 0x562d69536cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d69537420 con 0x562d69534810 2024-09-10T14:29:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815a045640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69534810 0x562d69536cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f8159043640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 0x7f8024036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x562d69508570 tx=0x7f8150010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815a045640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69534810 0x562d69536cd0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 20 realm 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d69537830 con 0x562d69534810 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d695380d0 con 0x562d69534810 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.877+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815bd34980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d695391d0 0x562d6953b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6953bb00 con 0x562d695391d0 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159844640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d695391d0 0x562d6953b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159844640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d695391d0 0x562d6953b5c0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815bd34980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815bd34980 20 searching for the correct realm 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d6953d3a0 con 0x562d695391d0 2024-09-10T14:29:50.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159844640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f814c118070 0x7f814c0f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d6953d3a0 con 0x7f814c118070 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159043640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f814c118070 0x7f814c0f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159043640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f814c118070 0x7f814c0f82b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159043640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8150037040 0x7f8150036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d6953d3a0 con 0x7f8150037040 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.881+0000 7f815a045640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8150037040 0x7f8150036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:50.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8150037040 0x7f8150036410 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:50.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f8150037040 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f8150037040 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f814c118070 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d695391d0 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.885+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f8150037040 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f814c118070 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d695391d0 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d695391d0 2024-09-10T14:29:50.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f814c118070 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d695391d0 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d695391d0 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.889+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f8150037040 2024-09-10T14:29:50.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d695391d0 2024-09-10T14:29:50.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f814c118070 2024-09-10T14:29:50.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f814c118070 2024-09-10T14:29:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d695391d0 2024-09-10T14:29:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f8150037040 2024-09-10T14:29:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f814c118070 2024-09-10T14:29:50.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d695391d0 2024-09-10T14:29:50.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f8150037040 2024-09-10T14:29:50.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.893+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x562d69534810 2024-09-10T14:29:50.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562d69538470 con 0x7f814c118070 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6953c350 con 0x562d69534810 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6953c740 con 0x562d69534810 2024-09-10T14:29:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6953c740 con 0x7f8150037040 2024-09-10T14:29:50.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 zone default found 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 4 Realm: () 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 zonegroup default 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6953cb60 con 0x7f814c118070 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:50.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6953f250 con 0x562d695391d0 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados->read ofs=0 len=0 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6953f5f0 con 0x562d695391d0 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 started sync module instance, tier type = 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.897+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6953e6f0 con 0x7f814c118070 2024-09-10T14:29:50.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.901+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.901+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94753040624352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6953fe90 con 0x7f814c118070 2024-09-10T14:29:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.901+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d695406e0 con 0x562d69534810 2024-09-10T14:29:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.901+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94753040624352] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.901+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.901+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94753040628192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69540720 con 0x562d69534810 2024-09-10T14:29:50.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.901+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69541200 con 0x562d695391d0 2024-09-10T14:29:50.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.905+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94753040628192] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.905+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.905+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94753040630320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69541620 con 0x562d695391d0 2024-09-10T14:29:50.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.905+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69541fe0 con 0x7f814c118070 2024-09-10T14:29:50.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.905+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.905+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94753040638928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69542ca0 con 0x7f814c118070 2024-09-10T14:29:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.905+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69543660 con 0x562d69534810 2024-09-10T14:29:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94753040630320] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94753040638928] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94753040642480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69542ca0 con 0x562d69534810 2024-09-10T14:29:50.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d695435d0 con 0x7f8150037040 2024-09-10T14:29:50.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94753040642480] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94753040639984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69542c10 con 0x7f8150037040 2024-09-10T14:29:50.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.909+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69544490 con 0x7f8150037040 2024-09-10T14:29:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.913+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.913+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94753040646112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d695448b0 con 0x7f8150037040 2024-09-10T14:29:50.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.913+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d695452f0 con 0x7f8150037040 2024-09-10T14:29:50.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.913+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94753040639984] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.913+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94753040646112] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.913+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94753040649664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69544400 con 0x7f8150037040 2024-09-10T14:29:50.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 add_watcher() i=0 2024-09-10T14:29:50.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 add_watcher() i=1 2024-09-10T14:29:50.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 add_watcher() i=2 2024-09-10T14:29:50.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 add_watcher() i=3 2024-09-10T14:29:50.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 add_watcher() i=4 2024-09-10T14:29:50.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 add_watcher() i=5 2024-09-10T14:29:50.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 add_watcher() i=6 2024-09-10T14:29:50.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94753040649664] v36'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 add_watcher() i=7 2024-09-10T14:29:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d695483f0 con 0x562d69534810 2024-09-10T14:29:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94753040644432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d69545870 con 0x562d69534810 2024-09-10T14:29:50.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94753040644432] v36'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f800ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.917+0000 7f815bd34980 5 note: GC not initialized 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f800efe5640 20 reqs_thread_entry: start 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 20 Filter name: none 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f800cfe1640 20 reqs_thread_entry: start 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956bde0 con 0x562d69534810 2024-09-10T14:29:50.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956bde0 con 0x7f814c118070 2024-09-10T14:29:50.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956bda0 con 0x562d69534810 2024-09-10T14:29:50.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956bda0 con 0x562d695391d0 2024-09-10T14:29:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c280 con 0x562d695391d0 2024-09-10T14:29:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c280 con 0x562d695391d0 2024-09-10T14:29:50.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c280 con 0x562d69534810 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c280 con 0x562d69534810 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c230 con 0x562d695391d0 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c230 con 0x562d695391d0 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.921+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c230 con 0x7f8150037040 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956dc60 con 0x562d69534810 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956dc60 con 0x7f814c118070 2024-09-10T14:29:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956dc60 con 0x562d695391d0 2024-09-10T14:29:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956dc60 con 0x7f8150037040 2024-09-10T14:29:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956dbc0 con 0x7f8150037040 2024-09-10T14:29:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956dbc0 con 0x562d695391d0 2024-09-10T14:29:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db70 con 0x7f8150037040 2024-09-10T14:29:50.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.925+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db70 con 0x562d69534810 2024-09-10T14:29:50.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db70 con 0x562d695391d0 2024-09-10T14:29:50.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db70 con 0x7f8150037040 2024-09-10T14:29:50.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x7f814c118070 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x7f8150037040 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x562d69534810 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x562d69534810 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x562d695391d0 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x562d69534810 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x562d69534810 2024-09-10T14:29:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.929+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x562d695391d0 2024-09-10T14:29:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x562d695391d0 2024-09-10T14:29:50.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x562d695391d0 2024-09-10T14:29:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562d6956db50 con 0x7f8150037040 2024-09-10T14:29:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f800ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:50.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.933+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94753040644432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x562d69534810 2024-09-10T14:29:50.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94753040644432] v36'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94753040624352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x7f814c118070 2024-09-10T14:29:50.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94753040624352] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f815bd34980 20 remove_watcher() i=0 2024-09-10T14:29:50.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f815bd34980 2 removed watcher, disabling cache 2024-09-10T14:29:50.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94753040628192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x562d69534810 2024-09-10T14:29:50.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94753040628192] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f815bd34980 20 remove_watcher() i=1 2024-09-10T14:29:50.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.937+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94753040630320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x562d695391d0 2024-09-10T14:29:50.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.941+0000 7f8159844640 1 -- 172.21.15.151:0/1606710426 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94753040630320] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f814c0fa070 con 0x562d695391d0 2024-09-10T14:29:50.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.941+0000 7f815bd34980 20 remove_watcher() i=2 2024-09-10T14:29:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.941+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94753040638928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x7f814c118070 2024-09-10T14:29:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.941+0000 7f8159043640 1 -- 172.21.15.151:0/1606710426 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94753040638928] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f815000e6c0 con 0x7f814c118070 2024-09-10T14:29:50.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.941+0000 7f815bd34980 20 remove_watcher() i=3 2024-09-10T14:29:50.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.941+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94753040642480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x562d69534810 2024-09-10T14:29:50.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.945+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94753040642480] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x562d69534810 2024-09-10T14:29:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.945+0000 7f815bd34980 20 remove_watcher() i=4 2024-09-10T14:29:50.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.945+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94753040639984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x7f8150037040 2024-09-10T14:29:50.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.945+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94753040639984] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.945+0000 7f815bd34980 20 remove_watcher() i=5 2024-09-10T14:29:50.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.945+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94753040646112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x7f8150037040 2024-09-10T14:29:50.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94753040646112] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 20 remove_watcher() i=6 2024-09-10T14:29:50.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94753040649664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562d6956c210 con 0x7f8150037040 2024-09-10T14:29:50.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94753040649664] v36'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81540083f0 con 0x7f8150037040 2024-09-10T14:29:50.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 20 remove_watcher() i=7 2024-09-10T14:29:50.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8150037040 msgr2=0x7f8150036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8150037040 0x7f8150036410 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69534810 msgr2=0x562d69536cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69534810 0x562d69536cd0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f814c118070 msgr2=0x7f814c0f82b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f814c118070 0x7f814c0f82b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d695391d0 msgr2=0x562d6953b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d695391d0 0x562d6953b5c0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 msgr2=0x7f8024036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8024034650 0x7f8024036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x562d69508570 tx=0x7f8150010000 comp rx=0 tx=0).stop 2024-09-10T14:29:50.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815a045640 1 -- 172.21.15.151:0/1606710426 reap_dead start 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 msgr2=0x562d69529790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69529790 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f814c0e24c0 tx=0x7f814c0e7220 comp rx=0 tx=0).stop 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 shutdown_connections 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 --2- 172.21.15.151:0/1606710426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69522570 0x562d69529790 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 >> 172.21.15.151:0/1606710426 conn(0x562d6951e950 msgr2=0x562d6951ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.949+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 shutdown_connections 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/1606710426 wait complete. 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/4053078426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8034034650 msgr2=0x7f8034036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/4053078426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8034034650 0x7f8034036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x562d694ffd10 tx=0x7f815000f000 comp rx=0 tx=0).stop 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/4053078426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69515c40 msgr2=0x562d69516060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/4053078426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69515c40 0x562d69516060 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f814c0be900 tx=0x7f814c0befa0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/4053078426 shutdown_connections 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/4053078426 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8034034650 0x7f8034036b10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/4053078426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69515c40 0x562d69516060 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/4053078426 >> 172.21.15.151:0/4053078426 conn(0x562d6950ad90 msgr2=0x562d6950d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/4053078426 shutdown_connections 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/4053078426 wait complete. 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562d69505680 msgr2=0x562d69507a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562d69505680 0x562d69507a70 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69408ce0 msgr2=0x562d694fee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562d69408ce0 0x562d694fee00 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d69501760 msgr2=0x562d69503b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562d69501760 0x562d69503b50 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8040034650 msgr2=0x7f8040036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8040034650 0x7f8040036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8150001da0 tx=0x7f8150001300 comp rx=0 tx=0).stop 2024-09-10T14:29:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 msgr2=0x562d694f7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 --2- 172.21.15.151:0/3057343472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d69378290 0x562d694f7e70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f814c018c00 tx=0x7f814c017d70 comp rx=0 tx=0).stop 2024-09-10T14:29:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815a045640 1 -- 172.21.15.151:0/3057343472 reap_dead start 2024-09-10T14:29:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 shutdown_connections 2024-09-10T14:29:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 >> 172.21.15.151:0/3057343472 conn(0x562d693fe090 msgr2=0x562d694eb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 shutdown_connections 2024-09-10T14:29:50.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:50.953+0000 7f815bd34980 1 -- 172.21.15.151:0/3057343472 wait complete. 2024-09-10T14:29:50.966 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-10T14:29:50.966 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-10T14:29:50.966 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T14:29:50.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T14:29:50.967 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T14:29:51.039 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:51.039 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:51.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2ddc7c980 1 Processor -- start 2024-09-10T14:29:51.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2ddc7c980 1 -- start start 2024-09-10T14:29:51.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2ddc7c980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557b5f3e02c0 0x557b5f470750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2ddc7c980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b5f2f3ae0 con 0x557b5f470c90 2024-09-10T14:29:51.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2ddc7c980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x557b5f317e30 con 0x557b5f3e02c0 2024-09-10T14:29:51.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2db78c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557b5f3e02c0 0x557b5f470750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2db78c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557b5f3e02c0 0x557b5f470750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39958/0 (socket says 172.21.15.151:39958) 2024-09-10T14:29:51.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2daf8b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x557b5f470c90 0x557b5f473080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:52562/0 (socket says 172.21.15.151:52562) 2024-09-10T14:29:51.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2db78c640 1 -- 172.21.15.151:0/3096615910 learned_addr learned my addr 172.21.15.151:0/3096615910 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2db78c640 1 -- 172.21.15.151:0/3096615910 >> v1:172.21.15.52:6789/0 conn(0x557b5f470c90 legacy=0x557b5f473080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.037+0000 7fc2db78c640 1 -- 172.21.15.151:0/3096615910 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b5f3e06a0 con 0x557b5f3e02c0 2024-09-10T14:29:51.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2db78c640 1 --2- 172.21.15.151:0/3096615910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f470750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00a4e0 tx=0x7fc2cc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d862c0ed18136e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2da78a640 1 -- 172.21.15.151:0/3096615910 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0aa540 con 0x557b5f3e02c0 2024-09-10T14:29:51.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2da78a640 1 -- 172.21.15.151:0/3096615910 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0aa6e0 con 0x557b5f3e02c0 2024-09-10T14:29:51.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2da78a640 1 -- 172.21.15.151:0/3096615910 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0aaa40 con 0x557b5f3e02c0 2024-09-10T14:29:51.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3096615910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 msgr2=0x557b5f470750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3096615910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f470750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00a4e0 tx=0x7fc2cc01b090 comp rx=0 tx=0).stop 2024-09-10T14:29:51.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3096615910 shutdown_connections 2024-09-10T14:29:51.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3096615910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f470750 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3096615910 >> 172.21.15.151:0/3096615910 conn(0x557b5f466080 msgr2=0x557b5f4684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3096615910 shutdown_connections 2024-09-10T14:29:51.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.041+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3096615910 wait complete. 2024-09-10T14:29:51.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2ddc7c980 1 Processor -- start 2024-09-10T14:29:51.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2ddc7c980 1 -- start start 2024-09-10T14:29:51.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2ddc7c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f558b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2ddc7c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557b5f319200 con 0x557b5f3e02c0 2024-09-10T14:29:51.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f558b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f558b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39970/0 (socket says 172.21.15.151:39970) 2024-09-10T14:29:51.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2db78c640 1 -- 172.21.15.151:0/652971590 learned_addr learned my addr 172.21.15.151:0/652971590 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2db78c640 1 -- 172.21.15.151:0/652971590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b5f559120 con 0x557b5f3e02c0 2024-09-10T14:29:51.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc2db78c640 1 --2- 172.21.15.151:0/652971590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f558b50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc019740 tx=0x7fc2cc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80efd5537f7fb470 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc1c960a640 1 -- 172.21.15.151:0/652971590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0b9070 con 0x557b5f3e02c0 2024-09-10T14:29:51.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc1c960a640 1 -- 172.21.15.151:0/652971590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0aab60 con 0x557b5f3e02c0 2024-09-10T14:29:51.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.057+0000 7fc1c960a640 1 -- 172.21.15.151:0/652971590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0b5440 con 0x557b5f3e02c0 2024-09-10T14:29:51.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/652971590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 msgr2=0x557b5f558b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/652971590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f558b50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc019740 tx=0x7fc2cc0033b0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/652971590 shutdown_connections 2024-09-10T14:29:51.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/652971590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f558b50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/652971590 >> 172.21.15.151:0/652971590 conn(0x557b5f466080 msgr2=0x557b5f554780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/652971590 shutdown_connections 2024-09-10T14:29:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/652971590 wait complete. 2024-09-10T14:29:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 Processor -- start 2024-09-10T14:29:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- start start 2024-09-10T14:29:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f55fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557b5f477200 con 0x557b5f3e02c0 2024-09-10T14:29:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f55fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f55fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39976/0 (socket says 172.21.15.151:39976) 2024-09-10T14:29:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2db78c640 1 -- 172.21.15.151:0/1816138181 learned_addr learned my addr 172.21.15.151:0/1816138181 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2db78c640 1 -- 172.21.15.151:0/1816138181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b5f5602c0 con 0x557b5f3e02c0 2024-09-10T14:29:51.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2db78c640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f55fd80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc01aec0 tx=0x7fc2cc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc1c7e07640 1 -- 172.21.15.151:0/1816138181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0b9070 con 0x557b5f3e02c0 2024-09-10T14:29:51.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b5f560550 con 0x557b5f3e02c0 2024-09-10T14:29:51.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc1c7e07640 1 -- 172.21.15.151:0/1816138181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0c7410 con 0x557b5f3e02c0 2024-09-10T14:29:51.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc1c7e07640 1 -- 172.21.15.151:0/1816138181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0a3b40 con 0x557b5f3e02c0 2024-09-10T14:29:51.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.061+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b5f563230 con 0x557b5f3e02c0 2024-09-10T14:29:51.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc1c7e07640 1 -- 172.21.15.151:0/1816138181 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2cc0aad10 con 0x557b5f3e02c0 2024-09-10T14:29:51.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc1c7e07640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1c0034650 0x7fc1c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc1c7e07640 1 -- 172.21.15.151:0/1816138181 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc2cc0c4070 con 0x557b5f3e02c0 2024-09-10T14:29:51.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1c0034650 0x7fc1c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f470c90 0x557b5f566e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5673c0 con 0x557b5f470c90 2024-09-10T14:29:51.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2dbf8d640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f470c90 0x557b5f566e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1c0034650 0x7fc1c0036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0001e50 tx=0x7fc2d00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2dbf8d640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f470c90 0x557b5f566e80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/1816138181 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f470c90 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f567cb0 con 0x557b5f470c90 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/1816138181 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f470c90 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5695c0 0x557b5f56ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f56c1f0 con 0x557b5f5695c0 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2db78c640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5695c0 0x557b5f56ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2db78c640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5695c0 0x557b5f56ba60 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2db78c640 1 -- 172.21.15.151:0/1816138181 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2cc0cd060 con 0x557b5f5695c0 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f568500 con 0x557b5f470c90 2024-09-10T14:29:51.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/1816138181 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f470c90 2024-09-10T14:29:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557b5f56d650 0x557b5f56fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5701b0 con 0x557b5f56d650 2024-09-10T14:29:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.065+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557b5f56d650 0x557b5f56fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557b5f56d650 0x557b5f56fa40 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2daf8b640 1 -- 172.21.15.151:0/1816138181 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2d000f700 con 0x557b5f56d650 2024-09-10T14:29:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2ddc7c980 1 Processor -- start 2024-09-10T14:29:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2ddc7c980 1 -- start start 2024-09-10T14:29:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2ddc7c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f57dc60 0x557b5f57e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2ddc7c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557b5f372800 con 0x557b5f57dc60 2024-09-10T14:29:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f57dc60 0x557b5f57e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f57dc60 0x557b5f57e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39980/0 (socket says 172.21.15.151:39980) 2024-09-10T14:29:51.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2db78c640 1 -- 172.21.15.151:0/2300227167 learned_addr learned my addr 172.21.15.151:0/2300227167 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2db78c640 1 -- 172.21.15.151:0/2300227167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b5f57e5c0 con 0x557b5f57dc60 2024-09-10T14:29:51.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2db78c640 1 --2- 172.21.15.151:0/2300227167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f57dc60 0x557b5f57e080 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc01b0d0 tx=0x7fc2cc0c6c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc1c5602640 1 -- 172.21.15.151:0/2300227167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0e4ba0 con 0x557b5f57dc60 2024-09-10T14:29:51.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2300227167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b5f57e850 con 0x557b5f57dc60 2024-09-10T14:29:51.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc1c5602640 1 -- 172.21.15.151:0/2300227167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0e2e50 con 0x557b5f57dc60 2024-09-10T14:29:51.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc1c5602640 1 -- 172.21.15.151:0/2300227167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0b4a10 con 0x557b5f57dc60 2024-09-10T14:29:51.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.069+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2300227167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b5f5814d0 con 0x557b5f57dc60 2024-09-10T14:29:51.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc1c5602640 1 -- 172.21.15.151:0/2300227167 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2cc0b3040 con 0x557b5f57dc60 2024-09-10T14:29:51.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc1c5602640 1 --2- 172.21.15.151:0/2300227167 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1b4034650 0x7fc1b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc1c5602640 1 -- 172.21.15.151:0/2300227167 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc2cc0d11d0 con 0x557b5f57dc60 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/2300227167 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1b4034650 0x7fc1b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 Processor -- start 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 -- start start 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/2300227167 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1b4034650 0x7fc1b4036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x557b5f56c590 tx=0x7fc2d000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f58a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557b5f5593e0 con 0x557b5f58a3d0 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f58a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f58a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39990/0 (socket says 172.21.15.151:39990) 2024-09-10T14:29:51.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2db78c640 1 -- 172.21.15.151:0/2333778461 learned_addr learned my addr 172.21.15.151:0/2333778461 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2db78c640 1 -- 172.21.15.151:0/2333778461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b5f58ad80 con 0x557b5f58a3d0 2024-09-10T14:29:51.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2db78c640 1 --2- 172.21.15.151:0/2333778461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f58a7b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0affd0 tx=0x7fc2cc0ed8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbf08fc70d42a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc1beffd640 1 -- 172.21.15.151:0/2333778461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0b4d90 con 0x557b5f58a3d0 2024-09-10T14:29:51.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc1beffd640 1 -- 172.21.15.151:0/2333778461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0bd8d0 con 0x557b5f58a3d0 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc1beffd640 1 -- 172.21.15.151:0/2333778461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0bd400 con 0x557b5f58a3d0 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2333778461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 msgr2=0x557b5f58a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/2333778461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f58a7b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0affd0 tx=0x7fc2cc0ed8e0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2333778461 shutdown_connections 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/2333778461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f58a7b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2333778461 >> 172.21.15.151:0/2333778461 conn(0x557b5f5867b0 msgr2=0x557b5f5848b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2333778461 shutdown_connections 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.073+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2333778461 wait complete. 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 1 Processor -- start 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 1 -- start start 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f591580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557b5f58b220 con 0x557b5f58a3d0 2024-09-10T14:29:51.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f591580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2db78c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f591580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:39998/0 (socket says 172.21.15.151:39998) 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 learned_addr learned my addr 172.21.15.151:0/3578774064 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b5f591ac0 con 0x557b5f58a3d0 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2db78c640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f591580 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0ed920 tx=0x7fc2cc0a8f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc1bd7fa640 1 -- 172.21.15.151:0/3578774064 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc106070 con 0x557b5f58a3d0 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b5f591ac0 con 0x557b5f58a3d0 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc1bd7fa640 1 -- 172.21.15.151:0/3578774064 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0edc10 con 0x557b5f58a3d0 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc1bd7fa640 1 -- 172.21.15.151:0/3578774064 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc0dbb70 con 0x557b5f58a3d0 2024-09-10T14:29:51.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b5f591f30 con 0x557b5f58a3d0 2024-09-10T14:29:51.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc1bd7fa640 1 -- 172.21.15.151:0/3578774064 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2cc0ff040 con 0x557b5f58a3d0 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc1bd7fa640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1a4034650 0x7fc1a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc1bd7fa640 1 -- 172.21.15.151:0/3578774064 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fc2cc0f4070 con 0x557b5f58a3d0 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1a4034650 0x7fc1a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f59c690 0x557b5f59eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f59f2a0 con 0x557b5f59c690 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2dbf8d640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f59c690 0x557b5f59eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1a4034650 0x7fc1a4036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x557b5f570590 tx=0x7fc2d0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.077+0000 7fc2dbf8d640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f59c690 0x557b5f59eb50 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 realm 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f59f6b0 con 0x557b5f59c690 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f59ff50 con 0x557b5f59c690 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5a1050 0x557b5f5a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a39c0 con 0x557b5f5a1050 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2db78c640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5a1050 0x557b5f5a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2db78c640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5a1050 0x557b5f5a3440 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 20 searching for the correct realm 2024-09-10T14:29:51.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a5220 con 0x557b5f5a1050 2024-09-10T14:29:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2db78c640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc2cc102040 0x7fc2cc0a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a5220 con 0x7fc2cc102040 2024-09-10T14:29:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc2cc102040 0x7fc2cc0a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc2cc102040 0x7fc2cc0a9950 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2daf8b640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc2d001fbe0 0x7fc2d003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a5220 con 0x7fc2d001fbe0 2024-09-10T14:29:51.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.081+0000 7fc2dbf8d640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc2d001fbe0 0x7fc2d003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc2d001fbe0 0x7fc2d003a3c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2cc102040 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f5a1050 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.085+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2cc102040 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f5a1050 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f5a1050 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2cc102040 2024-09-10T14:29:51.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f5a1050 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f5a1050 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f5a1050 2024-09-10T14:29:51.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2cc102040 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.089+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2cc102040 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f5a1050 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2cc102040 2024-09-10T14:29:51.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f5a1050 2024-09-10T14:29:51.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x557b5f59c690 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a02f0 con 0x7fc2cc102040 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:51.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a4340 con 0x557b5f59c690 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a4be0 con 0x557b5f59c690 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.093+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a3f80 con 0x7fc2d001fbe0 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 zone default found 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 4 Realm: () 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 zonegroup default 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a4730 con 0x7fc2cc102040 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a70a0 con 0x557b5f5a1050 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a7440 con 0x557b5f5a1050 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 started sync module instance, tier type = 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:51.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a50a0 con 0x7fc2cc102040 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93988369098224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a7850 con 0x7fc2cc102040 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.097+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a82c0 con 0x557b5f59c690 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.101+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.101+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93988369104304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a8b90 con 0x557b5f59c690 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.101+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a9590 con 0x557b5f5a1050 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.101+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93988369098224] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.101+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.101+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93988369099488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a99b0 con 0x557b5f5a1050 2024-09-10T14:29:51.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.101+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5aa370 con 0x7fc2cc102040 2024-09-10T14:29:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.101+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93988369104304] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.105+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.105+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93988369112768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5aa710 con 0x7fc2cc102040 2024-09-10T14:29:51.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.105+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5ab0d0 con 0x557b5f59c690 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.105+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93988369099488] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.105+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93988369112768] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.105+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.105+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93988369109152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5a87f0 con 0x557b5f59c690 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.105+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5ab7e0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.109+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93988369109152] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.109+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.109+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93988369117840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5ab7a0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.109+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5ac1f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.109+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93988369117840] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.109+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.109+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93988369116192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5ac1f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.109+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5acbb0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93988369116192] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93988369120576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5acd90 con 0x7fc2d001fbe0 2024-09-10T14:29:51.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2ddc7c980 20 add_watcher() i=0 2024-09-10T14:29:51.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2ddc7c980 20 add_watcher() i=1 2024-09-10T14:29:51.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2ddc7c980 20 add_watcher() i=2 2024-09-10T14:29:51.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2ddc7c980 20 add_watcher() i=3 2024-09-10T14:29:51.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2ddc7c980 20 add_watcher() i=4 2024-09-10T14:29:51.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2ddc7c980 20 add_watcher() i=5 2024-09-10T14:29:51.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2ddc7c980 20 add_watcher() i=6 2024-09-10T14:29:51.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.113+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93988369120576] v36'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 20 add_watcher() i=7 2024-09-10T14:29:51.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:51.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5aff50 con 0x557b5f59c690 2024-09-10T14:29:51.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93988369135856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5acd00 con 0x557b5f59c690 2024-09-10T14:29:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93988369135856] v36'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc191fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 5 note: GC not initialized 2024-09-10T14:29:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc190fe1640 20 reqs_thread_entry: start 2024-09-10T14:29:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:51.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 20 Filter name: none 2024-09-10T14:29:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc10a7fc640 20 reqs_thread_entry: start 2024-09-10T14:29:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d3bd0 con 0x557b5f59c690 2024-09-10T14:29:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d3bd0 con 0x7fc2cc102040 2024-09-10T14:29:51.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d3bd0 con 0x557b5f59c690 2024-09-10T14:29:51.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d3b90 con 0x557b5f5a1050 2024-09-10T14:29:51.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d40f0 con 0x557b5f5a1050 2024-09-10T14:29:51.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d40f0 con 0x557b5f5a1050 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.117+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d40f0 con 0x557b5f59c690 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d40f0 con 0x557b5f59c690 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d4070 con 0x557b5f5a1050 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d4070 con 0x557b5f5a1050 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d4070 con 0x7fc2d001fbe0 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f59c690 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x7fc2cc102040 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f5a1050 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.121+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f5a1050 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f59c690 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f5a1050 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x7fc2cc102040 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.125+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f59c690 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f59c690 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f5a1050 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f59c690 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f59c690 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f5a1050 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f5a1050 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x557b5f5a1050 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d57b0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc191fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.129+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93988369135856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d19c0 con 0x557b5f59c690 2024-09-10T14:29:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93988369135856] v36'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93988369098224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d1050 con 0x7fc2cc102040 2024-09-10T14:29:51.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93988369098224] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2ddc7c980 20 remove_watcher() i=0 2024-09-10T14:29:51.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2ddc7c980 2 removed watcher, disabling cache 2024-09-10T14:29:51.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93988369104304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d1050 con 0x557b5f59c690 2024-09-10T14:29:51.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93988369104304] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2ddc7c980 20 remove_watcher() i=1 2024-09-10T14:29:51.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.133+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93988369099488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d1050 con 0x557b5f5a1050 2024-09-10T14:29:51.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.137+0000 7fc2db78c640 1 -- 172.21.15.151:0/3578774064 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93988369099488] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2cc0e1070 con 0x557b5f5a1050 2024-09-10T14:29:51.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.137+0000 7fc2ddc7c980 20 remove_watcher() i=2 2024-09-10T14:29:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.137+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93988369112768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d1050 con 0x7fc2cc102040 2024-09-10T14:29:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.137+0000 7fc2daf8b640 1 -- 172.21.15.151:0/3578774064 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93988369112768] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d0037040 con 0x7fc2cc102040 2024-09-10T14:29:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.137+0000 7fc2ddc7c980 20 remove_watcher() i=3 2024-09-10T14:29:51.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.137+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93988369109152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d1050 con 0x557b5f59c690 2024-09-10T14:29:51.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.141+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93988369109152] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x557b5f59c690 2024-09-10T14:29:51.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.141+0000 7fc2ddc7c980 20 remove_watcher() i=4 2024-09-10T14:29:51.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.141+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93988369117840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d1050 con 0x7fc2d001fbe0 2024-09-10T14:29:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.141+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93988369117840] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.141+0000 7fc2ddc7c980 20 remove_watcher() i=5 2024-09-10T14:29:51.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.141+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93988369116192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d1050 con 0x7fc2d001fbe0 2024-09-10T14:29:51.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93988369116192] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 20 remove_watcher() i=6 2024-09-10T14:29:51.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93988369120576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557b5f5d1050 con 0x7fc2d001fbe0 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93988369120576] v36'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2d40083f0 con 0x7fc2d001fbe0 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 20 remove_watcher() i=7 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc2d001fbe0 msgr2=0x7fc2d003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fc2d001fbe0 0x7fc2d003a3c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f59c690 msgr2=0x557b5f59eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f59c690 0x557b5f59eb50 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc2cc102040 msgr2=0x7fc2cc0a9950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fc2cc102040 0x7fc2cc0a9950 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5a1050 msgr2=0x557b5f5a3440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5a1050 0x557b5f5a3440 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1a4034650 msgr2=0x7fc1a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1a4034650 0x7fc1a4036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x557b5f570590 tx=0x7fc2d0010000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 msgr2=0x557b5f591580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/3578774064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f58a3d0 0x557b5f591580 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0ed920 tx=0x7fc2cc0a8f90 comp rx=0 tx=0).stop 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 reap_dead start 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/3578774064 reap_dead start 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 shutdown_connections 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 >> 172.21.15.151:0/3578774064 conn(0x557b5f5867b0 msgr2=0x557b5f584880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 shutdown_connections 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.145+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/3578774064 wait complete. 2024-09-10T14:29:51.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2300227167 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1b4034650 msgr2=0x7fc1b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/2300227167 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1b4034650 0x7fc1b4036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x557b5f56c590 tx=0x7fc2d000f000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2300227167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f57dc60 msgr2=0x557b5f57e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/2300227167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f57dc60 0x557b5f57e080 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc01b0d0 tx=0x7fc2cc0c6c80 comp rx=0 tx=0).stop 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2300227167 shutdown_connections 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/2300227167 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1b4034650 0x7fc1b4036b10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/2300227167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f57dc60 0x557b5f57e080 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2300227167 >> 172.21.15.151:0/2300227167 conn(0x557b5f572db0 msgr2=0x557b5f575830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2300227167 shutdown_connections 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/2300227167 wait complete. 2024-09-10T14:29:51.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557b5f56d650 msgr2=0x557b5f56fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557b5f56d650 0x557b5f56fa40 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f470c90 msgr2=0x557b5f566e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557b5f470c90 0x557b5f566e80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5695c0 msgr2=0x557b5f56ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557b5f5695c0 0x557b5f56ba60 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1c0034650 msgr2=0x7fc1c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fc1c0034650 0x7fc1c0036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0001e50 tx=0x7fc2d00013b0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 msgr2=0x557b5f55fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 --2- 172.21.15.151:0/1816138181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557b5f3e02c0 0x557b5f55fd80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc01aec0 tx=0x7fc2cc017e30 comp rx=0 tx=0).stop 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2dbf8d640 1 -- 172.21.15.151:0/1816138181 reap_dead start 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 shutdown_connections 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 >> 172.21.15.151:0/1816138181 conn(0x557b5f466080 msgr2=0x557b5f553300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 shutdown_connections 2024-09-10T14:29:51.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.149+0000 7fc2ddc7c980 1 -- 172.21.15.151:0/1816138181 wait complete. 2024-09-10T14:29:51.160 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-10T14:29:51.161 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-10T14:29:51.161 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T14:29:51.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T14:29:51.161 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T14:29:51.242 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:51.242 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:51.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff80469d980 1 Processor -- start 2024-09-10T14:29:51.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff80469d980 1 -- start start 2024-09-10T14:29:51.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff80469d980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562718e03ec0 0x562718e062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff80469d980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562718c85ae0 con 0x562718d72290 2024-09-10T14:29:51.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff80469d980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x562718ca9e30 con 0x562718e03ec0 2024-09-10T14:29:51.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff8019ac640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562718e03ec0 0x562718e062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff8019ac640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562718e03ec0 0x562718e062b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40000/0 (socket says 172.21.15.151:40000) 2024-09-10T14:29:51.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff8019ac640 1 -- 172.21.15.151:0/3187633230 learned_addr learned my addr 172.21.15.151:0/3187633230 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff8021ad640 1 --1- 172.21.15.151:0/3187633230 >> v1:172.21.15.52:6789/0 conn(0x562718d72290 0x562718e027a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:52576/0 (socket says 172.21.15.151:52576) 2024-09-10T14:29:51.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff8019ac640 1 -- 172.21.15.151:0/3187633230 >> v1:172.21.15.52:6789/0 conn(0x562718d72290 legacy=0x562718e027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.241+0000 7ff8019ac640 1 -- 172.21.15.151:0/3187633230 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562718d72670 con 0x562718e03ec0 2024-09-10T14:29:51.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff8019ac640 1 --2- 172.21.15.151:0/3187633230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718e03ec0 0x562718e062b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800a5c0 tx=0x7ff7f801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e11cd1dad545f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff8011ab640 1 -- 172.21.15.151:0/3187633230 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f80a6070 con 0x562718e03ec0 2024-09-10T14:29:51.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff8011ab640 1 -- 172.21.15.151:0/3187633230 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f80af070 con 0x562718e03ec0 2024-09-10T14:29:51.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff8011ab640 1 -- 172.21.15.151:0/3187633230 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f80aa5c0 con 0x562718e03ec0 2024-09-10T14:29:51.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff80469d980 1 -- 172.21.15.151:0/3187633230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718e03ec0 msgr2=0x562718e062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff80469d980 1 --2- 172.21.15.151:0/3187633230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718e03ec0 0x562718e062b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800a5c0 tx=0x7ff7f801b340 comp rx=0 tx=0).stop 2024-09-10T14:29:51.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff80469d980 1 -- 172.21.15.151:0/3187633230 shutdown_connections 2024-09-10T14:29:51.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff80469d980 1 --2- 172.21.15.151:0/3187633230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718e03ec0 0x562718e062b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff80469d980 1 -- 172.21.15.151:0/3187633230 >> 172.21.15.151:0/3187633230 conn(0x562718df8090 msgr2=0x562718dfa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff80469d980 1 -- 172.21.15.151:0/3187633230 shutdown_connections 2024-09-10T14:29:51.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.245+0000 7ff80469d980 1 -- 172.21.15.151:0/3187633230 wait complete. 2024-09-10T14:29:51.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.257+0000 7ff80469d980 1 Processor -- start 2024-09-10T14:29:51.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.257+0000 7ff80469d980 1 -- start start 2024-09-10T14:29:51.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.257+0000 7ff80469d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718eeac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.257+0000 7ff80469d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562718cab200 con 0x562718d72290 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718eeac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718eeac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40004/0 (socket says 172.21.15.151:40004) 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 -- 172.21.15.151:0/1131570324 learned_addr learned my addr 172.21.15.151:0/1131570324 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 -- 172.21.15.151:0/1131570324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562718eeb230 con 0x562718d72290 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 --2- 172.21.15.151:0/1131570324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718eeac60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400b240 tx=0x7ff7f400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dc5aed543c98e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff6f0608640 1 -- 172.21.15.151:0/1131570324 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f400e700 con 0x562718d72290 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff6f0608640 1 -- 172.21.15.151:0/1131570324 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f400e8a0 con 0x562718d72290 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff6f0608640 1 -- 172.21.15.151:0/1131570324 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f400eb80 con 0x562718d72290 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 -- 172.21.15.151:0/1131570324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 msgr2=0x562718eeac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 --2- 172.21.15.151:0/1131570324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718eeac60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400b240 tx=0x7ff7f400b700 comp rx=0 tx=0).stop 2024-09-10T14:29:51.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 -- 172.21.15.151:0/1131570324 shutdown_connections 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 --2- 172.21.15.151:0/1131570324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718eeac60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 -- 172.21.15.151:0/1131570324 >> 172.21.15.151:0/1131570324 conn(0x562718df8090 msgr2=0x562718ee6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 -- 172.21.15.151:0/1131570324 shutdown_connections 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 -- 172.21.15.151:0/1131570324 wait complete. 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 Processor -- start 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 -- start start 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718ef1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff80469d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562718e09220 con 0x562718d72290 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718ef1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718ef1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40016/0 (socket says 172.21.15.151:40016) 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 -- 172.21.15.151:0/3642787080 learned_addr learned my addr 172.21.15.151:0/3642787080 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.261+0000 7ff8021ad640 1 -- 172.21.15.151:0/3642787080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562718ef24d0 con 0x562718d72290 2024-09-10T14:29:51.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8021ad640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718ef1f90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4000c10 tx=0x7ff7f4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff6eee05640 1 -- 172.21.15.151:0/3642787080 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f400fa90 con 0x562718d72290 2024-09-10T14:29:51.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff6eee05640 1 -- 172.21.15.151:0/3642787080 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f400fc50 con 0x562718d72290 2024-09-10T14:29:51.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562718ef2760 con 0x562718d72290 2024-09-10T14:29:51.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff6eee05640 1 -- 172.21.15.151:0/3642787080 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f401a480 con 0x562718d72290 2024-09-10T14:29:51.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562718ef5440 con 0x562718d72290 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff6eee05640 1 -- 172.21.15.151:0/3642787080 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7f4017070 con 0x562718d72290 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff6eee05640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6e80346f0 0x7ff6e8036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff6eee05640 1 -- 172.21.15.151:0/3642787080 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff7f4015020 con 0x562718d72290 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8019ac640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6e80346f0 0x7ff6e8036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff80469d980 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718e03ec0 0x562718ef8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718ef9540 con 0x562718e03ec0 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8029ae640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718e03ec0 0x562718ef8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8019ac640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6e80346f0 0x7ff6e8036bb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80ae000 tx=0x7ff7f80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8029ae640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718e03ec0 0x562718ef8f20 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8029ae640 1 -- 172.21.15.151:0/3642787080 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718e03ec0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718ef6640 con 0x562718e03ec0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8029ae640 1 -- 172.21.15.151:0/3642787080 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718e03ec0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff80469d980 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718efb8c0 0x562718efdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718efe3a0 con 0x562718efb8c0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8021ad640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718efb8c0 0x562718efdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8021ad640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718efb8c0 0x562718efdcb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.265+0000 7ff8021ad640 1 -- 172.21.15.151:0/3642787080 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff7f402e070 con 0x562718efb8c0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718efa760 con 0x562718e03ec0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8029ae640 1 -- 172.21.15.151:0/3642787080 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718e03ec0 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff80469d980 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562718eff800 0x562718f01bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f02330 con 0x562718eff800 2024-09-10T14:29:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8019ac640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562718eff800 0x562718f01bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8019ac640 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562718eff800 0x562718f01bf0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8019ac640 1 -- 172.21.15.151:0/3642787080 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff7f80aaa70 con 0x562718eff800 2024-09-10T14:29:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff80469d980 1 Processor -- start 2024-09-10T14:29:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff80469d980 1 -- start start 2024-09-10T14:29:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff80469d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f0fdc0 0x562718f101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff80469d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562718d04800 con 0x562718f0fdc0 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f0fdc0 0x562718f101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f0fdc0 0x562718f101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40020/0 (socket says 172.21.15.151:40020) 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8021ad640 1 -- 172.21.15.151:0/2633806452 learned_addr learned my addr 172.21.15.151:0/2633806452 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8021ad640 1 -- 172.21.15.151:0/2633806452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562718f10720 con 0x562718f0fdc0 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.269+0000 7ff8021ad640 1 --2- 172.21.15.151:0/2633806452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f0fdc0 0x562718f101e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4048e70 tx=0x7ff7f40199f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff6e7fff640 1 -- 172.21.15.151:0/2633806452 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f4040020 con 0x562718f0fdc0 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff6e7fff640 1 -- 172.21.15.151:0/2633806452 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f401a830 con 0x562718f0fdc0 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff80469d980 1 -- 172.21.15.151:0/2633806452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562718f109b0 con 0x562718f0fdc0 2024-09-10T14:29:51.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff6e7fff640 1 -- 172.21.15.151:0/2633806452 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f40424a0 con 0x562718f0fdc0 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff80469d980 1 -- 172.21.15.151:0/2633806452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562718f13630 con 0x562718f0fdc0 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff6e7fff640 1 -- 172.21.15.151:0/2633806452 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7f4042640 con 0x562718f0fdc0 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff6e7fff640 1 --2- 172.21.15.151:0/2633806452 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6dc0346a0 0x7ff6dc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff6e7fff640 1 -- 172.21.15.151:0/2633806452 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff7f403e0d0 con 0x562718f0fdc0 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff8019ac640 1 --2- 172.21.15.151:0/2633806452 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6dc0346a0 0x7ff6dc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff80469d980 1 Processor -- start 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff80469d980 1 -- start start 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff80469d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f1c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff8019ac640 1 --2- 172.21.15.151:0/2633806452 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6dc0346a0 0x7ff6dc036b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x562718ef9a60 tx=0x7ff7f8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff80469d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562718eeb5b0 con 0x562718f1c550 2024-09-10T14:29:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f1c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f1c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40030/0 (socket says 172.21.15.151:40030) 2024-09-10T14:29:51.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff8021ad640 1 -- 172.21.15.151:0/2687804874 learned_addr learned my addr 172.21.15.151:0/2687804874 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff8021ad640 1 -- 172.21.15.151:0/2687804874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562718f1cf00 con 0x562718f1c550 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.273+0000 7ff8021ad640 1 --2- 172.21.15.151:0/2687804874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f1c930 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4017fd0 tx=0x7ff7f403cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5eaee3f4dd624a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff6e5ffb640 1 -- 172.21.15.151:0/2687804874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f401dce0 con 0x562718f1c550 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff6e5ffb640 1 -- 172.21.15.151:0/2687804874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f4047980 con 0x562718f1c550 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff6e5ffb640 1 -- 172.21.15.151:0/2687804874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f401d7c0 con 0x562718f1c550 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- 172.21.15.151:0/2687804874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 msgr2=0x562718f1c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 --2- 172.21.15.151:0/2687804874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f1c930 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4017fd0 tx=0x7ff7f403cb60 comp rx=0 tx=0).stop 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- 172.21.15.151:0/2687804874 shutdown_connections 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 --2- 172.21.15.151:0/2687804874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f1c930 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- 172.21.15.151:0/2687804874 >> 172.21.15.151:0/2687804874 conn(0x562718f18930 msgr2=0x562718f16a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- 172.21.15.151:0/2687804874 shutdown_connections 2024-09-10T14:29:51.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- 172.21.15.151:0/2687804874 wait complete. 2024-09-10T14:29:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 Processor -- start 2024-09-10T14:29:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- start start 2024-09-10T14:29:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f23720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562718f1d3a0 con 0x562718f1c550 2024-09-10T14:29:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f23720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff8021ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f23720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40044/0 (socket says 172.21.15.151:40044) 2024-09-10T14:29:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 learned_addr learned my addr 172.21.15.151:0/510405710 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562718f23c60 con 0x562718f1c550 2024-09-10T14:29:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff8021ad640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f23720 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4000fc0 tx=0x7ff7f405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff6d3fff640 1 -- 172.21.15.151:0/510405710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f406b070 con 0x562718f1c550 2024-09-10T14:29:51.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff6d3fff640 1 -- 172.21.15.151:0/510405710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f401dce0 con 0x562718f1c550 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff6d3fff640 1 -- 172.21.15.151:0/510405710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7f4010da0 con 0x562718f1c550 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562718f23c60 con 0x562718f1c550 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.277+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562718f23c60 con 0x562718f1c550 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff6d3fff640 1 -- 172.21.15.151:0/510405710 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7f406e070 con 0x562718f1c550 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff6d3fff640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6cc034600 0x7ff6cc036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff6d3fff640 1 -- 172.21.15.151:0/510405710 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff7f405c030 con 0x562718f1c550 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8019ac640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6cc034600 0x7ff6cc036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718f2e770 0x562718f30c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f31360 con 0x562718f2e770 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8029ae640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718f2e770 0x562718f30c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8019ac640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6cc034600 0x7ff6cc036ac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff7f801b380 tx=0x7ff7f80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8029ae640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718f2e770 0x562718f30c10 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 realm 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f31770 con 0x562718f2e770 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f32010 con 0x562718f2e770 2024-09-10T14:29:51.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718f33110 0x562718f35500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f35a80 con 0x562718f33110 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8021ad640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718f33110 0x562718f35500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8021ad640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718f33110 0x562718f35500 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 20 searching for the correct realm 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f37320 con 0x562718f33110 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8021ad640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff7f4070070 0x7ff7f4046900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f37320 con 0x7ff7f4070070 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8019ac640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff7f4070070 0x7ff7f4046900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.281+0000 7ff8019ac640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff7f4070070 0x7ff7f4046900 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8019ac640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff7f80e0040 0x7ff7f80e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f37320 con 0x7ff7f80e0040 2024-09-10T14:29:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff7f80e0040 0x7ff7f80e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff7f80e0040 0x7ff7f80e0420 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f80e0040 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f80e0040 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f4070070 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f33110 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.285+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f80e0040 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f4070070 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f33110 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f33110 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f4070070 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f33110 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f33110 2024-09-10T14:29:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.289+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f80e0040 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f33110 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f4070070 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f4070070 2024-09-10T14:29:51.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f33110 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f80e0040 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f4070070 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f33110 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f80e0040 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x562718f2e770 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562718f323b0 con 0x7ff7f4070070 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff80469d980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff80469d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff80469d980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff80469d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff80469d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.293+0000 7ff80469d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f362d0 con 0x562718f2e770 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f366c0 con 0x562718f2e770 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f366c0 con 0x7ff7f80e0040 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 zone default found 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 4 Realm: () 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:51.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 zonegroup default 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f36ae0 con 0x7ff7f4070070 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f391d0 con 0x562718f33110 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f39570 con 0x562718f33110 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 started sync module instance, tier type = 2024-09-10T14:29:51.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:51.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f38670 con 0x7ff7f4070070 2024-09-10T14:29:51.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725922327136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f39dc0 con 0x7ff7f4070070 2024-09-10T14:29:51.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.297+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3a610 con 0x562718f2e770 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.301+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725922327136] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.301+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.301+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725922330896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3a610 con 0x562718f2e770 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.301+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3afd0 con 0x562718f33110 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.301+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725922330896] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.301+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.301+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725922333024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3a580 con 0x562718f33110 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.301+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3be90 con 0x7ff7f4070070 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.305+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.305+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725922341424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3cb00 con 0x7ff7f4070070 2024-09-10T14:29:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.305+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3d4c0 con 0x562718f2e770 2024-09-10T14:29:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.305+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725922333024] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.305+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725922341424] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.305+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.305+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725922342480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3b4d0 con 0x562718f2e770 2024-09-10T14:29:51.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.305+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3d970 con 0x7ff7f80e0040 2024-09-10T14:29:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.309+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725922342480] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.309+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.309+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725922344976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3d8e0 con 0x7ff7f80e0040 2024-09-10T14:29:51.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.309+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3e170 con 0x7ff7f80e0040 2024-09-10T14:29:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.309+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.309+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725922347232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3e840 con 0x7ff7f80e0040 2024-09-10T14:29:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.309+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3f0f0 con 0x7ff7f80e0040 2024-09-10T14:29:51.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.309+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725922344976] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725922346032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3ecf0 con 0x7ff7f80e0040 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 20 add_watcher() i=0 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 20 add_watcher() i=1 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 20 add_watcher() i=2 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 20 add_watcher() i=3 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 20 add_watcher() i=4 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 20 add_watcher() i=5 2024-09-10T14:29:51.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725922347232] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 20 add_watcher() i=6 2024-09-10T14:29:51.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725922346032] v36'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 20 add_watcher() i=7 2024-09-10T14:29:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f3eb20 con 0x562718f2e770 2024-09-10T14:29:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.313+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725922351856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3f500 con 0x562718f2e770 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725922351856] v36'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff6b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 5 note: GC not initialized 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff6337fe640 20 reqs_thread_entry: start 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 20 Filter name: none 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff6317fa640 20 reqs_thread_entry: start 2024-09-10T14:29:51.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f65150 con 0x562718f2e770 2024-09-10T14:29:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:29:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562718f666a0 con 0x7ff7f80e0040 2024-09-10T14:29:51.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff6b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.317+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725922351856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f44680 con 0x562718f2e770 2024-09-10T14:29:51.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94725922351856] v36'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725922327136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3eaf0 con 0x7ff7f4070070 2024-09-10T14:29:51.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94725922327136] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff80469d980 20 remove_watcher() i=0 2024-09-10T14:29:51.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff80469d980 2 removed watcher, disabling cache 2024-09-10T14:29:51.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725922330896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f38a60 con 0x562718f2e770 2024-09-10T14:29:51.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94725922330896] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff80469d980 20 remove_watcher() i=1 2024-09-10T14:29:51.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.321+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725922333024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f38a60 con 0x562718f33110 2024-09-10T14:29:51.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.325+0000 7ff8021ad640 1 -- 172.21.15.151:0/510405710 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94725922333024] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f406d030 con 0x562718f33110 2024-09-10T14:29:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.325+0000 7ff80469d980 20 remove_watcher() i=2 2024-09-10T14:29:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.325+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725922341424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3a160 con 0x7ff7f4070070 2024-09-10T14:29:51.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.325+0000 7ff8019ac640 1 -- 172.21.15.151:0/510405710 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94725922341424] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7f80aaa70 con 0x7ff7f4070070 2024-09-10T14:29:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.325+0000 7ff80469d980 20 remove_watcher() i=3 2024-09-10T14:29:51.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.325+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725922342480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f38a60 con 0x562718f2e770 2024-09-10T14:29:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.329+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94725922342480] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x562718f2e770 2024-09-10T14:29:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.329+0000 7ff80469d980 20 remove_watcher() i=4 2024-09-10T14:29:51.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.329+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725922344976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3a160 con 0x7ff7f80e0040 2024-09-10T14:29:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.329+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94725922344976] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.329+0000 7ff80469d980 20 remove_watcher() i=5 2024-09-10T14:29:51.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.329+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725922347232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f3c6e0 con 0x7ff7f80e0040 2024-09-10T14:29:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94725922347232] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 20 remove_watcher() i=6 2024-09-10T14:29:51.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725922346032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562718f38a60 con 0x7ff7f80e0040 2024-09-10T14:29:51.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94725922346032] v36'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7fc00a4d0 con 0x7ff7f80e0040 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 20 remove_watcher() i=7 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff7f80e0040 msgr2=0x7ff7f80e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff7f80e0040 0x7ff7f80e0420 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718f2e770 msgr2=0x562718f30c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718f2e770 0x562718f30c10 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff7f4070070 msgr2=0x7ff7f4046900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff7f4070070 0x7ff7f4046900 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718f33110 msgr2=0x562718f35500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718f33110 0x562718f35500 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6cc034600 msgr2=0x7ff6cc036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6cc034600 0x7ff6cc036ac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff7f801b380 tx=0x7ff7f80c1040 comp rx=0 tx=0).stop 2024-09-10T14:29:51.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 msgr2=0x562718f23720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff8029ae640 1 -- 172.21.15.151:0/510405710 reap_dead start 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f23720 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4000fc0 tx=0x7ff7f405b000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 shutdown_connections 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/510405710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f1c550 0x562718f23720 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 >> 172.21.15.151:0/510405710 conn(0x562718f18930 msgr2=0x562718f16a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 shutdown_connections 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/510405710 wait complete. 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/2633806452 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6dc0346a0 msgr2=0x7ff6dc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/2633806452 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6dc0346a0 0x7ff6dc036b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x562718ef9a60 tx=0x7ff7f8005ad0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/2633806452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f0fdc0 msgr2=0x562718f101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/2633806452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f0fdc0 0x562718f101e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4048e70 tx=0x7ff7f40199f0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/2633806452 shutdown_connections 2024-09-10T14:29:51.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/2633806452 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6dc0346a0 0x7ff6dc036b60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/2633806452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718f0fdc0 0x562718f101e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/2633806452 >> 172.21.15.151:0/2633806452 conn(0x562718f04f10 msgr2=0x562718f07990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/2633806452 shutdown_connections 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/2633806452 wait complete. 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562718eff800 msgr2=0x562718f01bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562718eff800 0x562718f01bf0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718e03ec0 msgr2=0x562718ef8f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562718e03ec0 0x562718ef8f20 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718efb8c0 msgr2=0x562718efdcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562718efb8c0 0x562718efdcb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6e80346f0 msgr2=0x7ff6e8036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6e80346f0 0x7ff6e8036bb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80ae000 tx=0x7ff7f80a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 msgr2=0x562718ef1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 --2- 172.21.15.151:0/3642787080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562718d72290 0x562718ef1f90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4000c10 tx=0x7ff7f4000ee0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff8029ae640 1 -- 172.21.15.151:0/3642787080 reap_dead start 2024-09-10T14:29:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 shutdown_connections 2024-09-10T14:29:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 >> 172.21.15.151:0/3642787080 conn(0x562718df8090 msgr2=0x562718ee5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 shutdown_connections 2024-09-10T14:29:51.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.333+0000 7ff80469d980 1 -- 172.21.15.151:0/3642787080 wait complete. 2024-09-10T14:29:51.347 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-10T14:29:51.347 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-10T14:29:51.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T14:29:51.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T14:29:51.348 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-10T14:29:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.421+0000 7ff7338f9980 1 Processor -- start 2024-09-10T14:29:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.421+0000 7ff7338f9980 1 -- start start 2024-09-10T14:29:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.421+0000 7ff7338f9980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562bd68ffad0 0x562bd6990780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.421+0000 7ff7338f9980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562bd6813ae0 con 0x562bd6990cc0 2024-09-10T14:29:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.421+0000 7ff7338f9980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x562bd6837e30 con 0x562bd68ffad0 2024-09-10T14:29:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.425+0000 7ff731409640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562bd68ffad0 0x562bd6990780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.425+0000 7ff731409640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562bd68ffad0 0x562bd6990780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40056/0 (socket says 172.21.15.151:40056) 2024-09-10T14:29:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.425+0000 7ff730c08640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x562bd6990cc0 0x562bd69930b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:52584/0 (socket says 172.21.15.151:52584) 2024-09-10T14:29:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.425+0000 7ff731409640 1 -- 172.21.15.151:0/3539383094 learned_addr learned my addr 172.21.15.151:0/3539383094 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.425+0000 7ff731409640 1 -- 172.21.15.151:0/3539383094 >> v1:172.21.15.52:6789/0 conn(0x562bd6990cc0 legacy=0x562bd69930b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.425+0000 7ff731409640 1 -- 172.21.15.151:0/3539383094 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd68ffeb0 con 0x562bd68ffad0 2024-09-10T14:29:51.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.425+0000 7ff731409640 1 --2- 172.21.15.151:0/3539383094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6990780 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff72400a5c0 tx=0x7ff72401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2042c7b57f803f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff72bfff640 1 -- 172.21.15.151:0/3539383094 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240a6070 con 0x562bd68ffad0 2024-09-10T14:29:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff72bfff640 1 -- 172.21.15.151:0/3539383094 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7240af070 con 0x562bd68ffad0 2024-09-10T14:29:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff72bfff640 1 -- 172.21.15.151:0/3539383094 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240aa5c0 con 0x562bd68ffad0 2024-09-10T14:29:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff7338f9980 1 -- 172.21.15.151:0/3539383094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 msgr2=0x562bd6990780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff7338f9980 1 --2- 172.21.15.151:0/3539383094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6990780 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff72400a5c0 tx=0x7ff72401b340 comp rx=0 tx=0).stop 2024-09-10T14:29:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff7338f9980 1 -- 172.21.15.151:0/3539383094 shutdown_connections 2024-09-10T14:29:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff7338f9980 1 --2- 172.21.15.151:0/3539383094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6990780 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff7338f9980 1 -- 172.21.15.151:0/3539383094 >> 172.21.15.151:0/3539383094 conn(0x562bd6986070 msgr2=0x562bd6988490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff7338f9980 1 -- 172.21.15.151:0/3539383094 shutdown_connections 2024-09-10T14:29:51.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.429+0000 7ff7338f9980 1 -- 172.21.15.151:0/3539383094 wait complete. 2024-09-10T14:29:51.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff7338f9980 1 Processor -- start 2024-09-10T14:29:51.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff7338f9980 1 -- start start 2024-09-10T14:29:51.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff7338f9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6a78c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff7338f9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bd6839200 con 0x562bd68ffad0 2024-09-10T14:29:51.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6a78c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6a78c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40058/0 (socket says 172.21.15.151:40058) 2024-09-10T14:29:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff731409640 1 -- 172.21.15.151:0/3869475691 learned_addr learned my addr 172.21.15.151:0/3869475691 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff731409640 1 -- 172.21.15.151:0/3869475691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd6a791e0 con 0x562bd68ffad0 2024-09-10T14:29:51.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff731409640 1 --2- 172.21.15.151:0/3869475691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6a78c10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff724018f70 tx=0x7ff724003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd94c583ee1673cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff61f606640 1 -- 172.21.15.151:0/3869475691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240aaa00 con 0x562bd68ffad0 2024-09-10T14:29:51.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff61f606640 1 -- 172.21.15.151:0/3869475691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7240aaba0 con 0x562bd68ffad0 2024-09-10T14:29:51.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.441+0000 7ff61f606640 1 -- 172.21.15.151:0/3869475691 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240bd3f0 con 0x562bd68ffad0 2024-09-10T14:29:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- 172.21.15.151:0/3869475691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 msgr2=0x562bd6a78c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 --2- 172.21.15.151:0/3869475691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6a78c10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff724018f70 tx=0x7ff724003030 comp rx=0 tx=0).stop 2024-09-10T14:29:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- 172.21.15.151:0/3869475691 shutdown_connections 2024-09-10T14:29:51.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 --2- 172.21.15.151:0/3869475691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd68ffad0 0x562bd6a78c10 secure :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff724018f70 tx=0x7ff724003030 comp rx=0 tx=0).stop 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- 172.21.15.151:0/3869475691 >> 172.21.15.151:0/3869475691 conn(0x562bd6986070 msgr2=0x562bd6a74840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- 172.21.15.151:0/3869475691 shutdown_connections 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- 172.21.15.151:0/3869475691 wait complete. 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 Processor -- start 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- start start 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6990cc0 0x562bd6a80110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bd6997260 con 0x562bd6990cc0 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6990cc0 0x562bd6a80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6990cc0 0x562bd6a80110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40064/0 (socket says 172.21.15.151:40064) 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff731409640 1 -- 172.21.15.151:0/2055330553 learned_addr learned my addr 172.21.15.151:0/2055330553 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff731409640 1 -- 172.21.15.151:0/2055330553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd6a80650 con 0x562bd6990cc0 2024-09-10T14:29:51.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff731409640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6990cc0 0x562bd6a80110 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff724000c10 tx=0x7ff7240180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff61de03640 1 -- 172.21.15.151:0/2055330553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240cb020 con 0x562bd6990cc0 2024-09-10T14:29:51.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff61de03640 1 -- 172.21.15.151:0/2055330553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7240c6650 con 0x562bd6990cc0 2024-09-10T14:29:51.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bd6a808e0 con 0x562bd6990cc0 2024-09-10T14:29:51.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff61de03640 1 -- 172.21.15.151:0/2055330553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240c6930 con 0x562bd6990cc0 2024-09-10T14:29:51.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.445+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bd6a835c0 con 0x562bd6990cc0 2024-09-10T14:29:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff61de03640 1 -- 172.21.15.151:0/2055330553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7240ce020 con 0x562bd6990cc0 2024-09-10T14:29:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff61de03640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6180346a0 0x7ff618036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff61de03640 1 -- 172.21.15.151:0/2055330553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff7240e52f0 con 0x562bd6990cc0 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff730c08640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6180346a0 0x7ff618036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6a85090 0x562bd6a874c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6a87b30 con 0x562bd6a85090 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff731c0a640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6a85090 0x562bd6a874c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff730c08640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6180346a0 0x7ff618036b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0016c0 tx=0x7ff71c0066c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff731c0a640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6a85090 0x562bd6a874c0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff731c0a640 1 -- 172.21.15.151:0/2055330553 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6a85090 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6a883d0 con 0x562bd6a85090 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff731c0a640 1 -- 172.21.15.151:0/2055330553 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6a85090 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6a89ce0 0x562bd6a8c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6a8c930 con 0x562bd6a89ce0 2024-09-10T14:29:51.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff731409640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6a89ce0 0x562bd6a8c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff731409640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6a89ce0 0x562bd6a8c1a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff731409640 1 -- 172.21.15.151:0/2055330553 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff7240bd910 con 0x562bd6a89ce0 2024-09-10T14:29:51.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6a88c20 con 0x562bd6a85090 2024-09-10T14:29:51.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff731c0a640 1 -- 172.21.15.151:0/2055330553 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6a85090 2024-09-10T14:29:51.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562bd6a8dd90 0x562bd6a90180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6a90880 con 0x562bd6a8dd90 2024-09-10T14:29:51.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.449+0000 7ff730c08640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562bd6a8dd90 0x562bd6a90180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff730c08640 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562bd6a8dd90 0x562bd6a90180 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff730c08640 1 -- 172.21.15.151:0/2055330553 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff71c00f070 con 0x562bd6a8dd90 2024-09-10T14:29:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff7338f9980 1 Processor -- start 2024-09-10T14:29:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff7338f9980 1 -- start start 2024-09-10T14:29:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff7338f9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6a9e350 0x562bd6a9e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff7338f9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bd6892800 con 0x562bd6a9e350 2024-09-10T14:29:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6a9e350 0x562bd6a9e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6a9e350 0x562bd6a9e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40068/0 (socket says 172.21.15.151:40068) 2024-09-10T14:29:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff731409640 1 -- 172.21.15.151:0/2492815341 learned_addr learned my addr 172.21.15.151:0/2492815341 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff731409640 1 -- 172.21.15.151:0/2492815341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd6a9ecb0 con 0x562bd6a9e350 2024-09-10T14:29:51.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff731409640 1 --2- 172.21.15.151:0/2492815341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6a9e350 0x562bd6a9e770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff7240b5010 tx=0x7ff7240c7f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff616ffd640 1 -- 172.21.15.151:0/2492815341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240ea070 con 0x562bd6a9e350 2024-09-10T14:29:51.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff7338f9980 1 -- 172.21.15.151:0/2492815341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bd6a9ef40 con 0x562bd6a9e350 2024-09-10T14:29:51.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff7338f9980 1 -- 172.21.15.151:0/2492815341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bd6aa1bc0 con 0x562bd6a9e350 2024-09-10T14:29:51.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff616ffd640 1 -- 172.21.15.151:0/2492815341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7240e3410 con 0x562bd6a9e350 2024-09-10T14:29:51.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.453+0000 7ff616ffd640 1 -- 172.21.15.151:0/2492815341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240cf860 con 0x562bd6a9e350 2024-09-10T14:29:51.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff616ffd640 1 -- 172.21.15.151:0/2492815341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7240ed070 con 0x562bd6a9e350 2024-09-10T14:29:51.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff616ffd640 1 --2- 172.21.15.151:0/2492815341 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff608034650 0x7ff608036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff616ffd640 1 -- 172.21.15.151:0/2492815341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff7240f0d60 con 0x562bd6a9e350 2024-09-10T14:29:51.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff730c08640 1 --2- 172.21.15.151:0/2492815341 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff608034650 0x7ff608036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 Processor -- start 2024-09-10T14:29:51.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- start start 2024-09-10T14:29:51.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff730c08640 1 --2- 172.21.15.151:0/2492815341 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff608034650 0x7ff608036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x562bd6a84820 tx=0x7ff71c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6aab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bd6a794a0 con 0x562bd6aaad30 2024-09-10T14:29:51.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6aab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6aab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40080/0 (socket says 172.21.15.151:40080) 2024-09-10T14:29:51.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff731409640 1 -- 172.21.15.151:0/709855265 learned_addr learned my addr 172.21.15.151:0/709855265 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff731409640 1 -- 172.21.15.151:0/709855265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd6aab700 con 0x562bd6aaad30 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff731409640 1 --2- 172.21.15.151:0/709855265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6aab130 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff72401bbe0 tx=0x7ff7240d1890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3f9b6b4aec56d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff614ff9640 1 -- 172.21.15.151:0/709855265 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240e3cb0 con 0x562bd6aaad30 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff614ff9640 1 -- 172.21.15.151:0/709855265 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7240d9b60 con 0x562bd6aaad30 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff614ff9640 1 -- 172.21.15.151:0/709855265 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240bc5b0 con 0x562bd6aaad30 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- 172.21.15.151:0/709855265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 msgr2=0x562bd6aab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 --2- 172.21.15.151:0/709855265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6aab130 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff72401bbe0 tx=0x7ff7240d1890 comp rx=0 tx=0).stop 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- 172.21.15.151:0/709855265 shutdown_connections 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 --2- 172.21.15.151:0/709855265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6aab130 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- 172.21.15.151:0/709855265 >> 172.21.15.151:0/709855265 conn(0x562bd6aa7110 msgr2=0x562bd6aa5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- 172.21.15.151:0/709855265 shutdown_connections 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- 172.21.15.151:0/709855265 wait complete. 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 Processor -- start 2024-09-10T14:29:51.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- start start 2024-09-10T14:29:51.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6ab1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.457+0000 7ff7338f9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bd6aabb20 con 0x562bd6aaad30 2024-09-10T14:29:51.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6ab1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6ab1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40094/0 (socket says 172.21.15.151:40094) 2024-09-10T14:29:51.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 learned_addr learned my addr 172.21.15.151:0/2510109731 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd6ab2450 con 0x562bd6aaad30 2024-09-10T14:29:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731409640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6ab1f10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff7240c2f20 tx=0x7ff7240c2db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff606ffd640 1 -- 172.21.15.151:0/2510109731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724113070 con 0x562bd6aaad30 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bd6ab2450 con 0x562bd6aaad30 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff606ffd640 1 -- 172.21.15.151:0/2510109731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7240e5830 con 0x562bd6aaad30 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bd6ab2450 con 0x562bd6aaad30 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff606ffd640 1 -- 172.21.15.151:0/2510109731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240e3cb0 con 0x562bd6aaad30 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff606ffd640 1 -- 172.21.15.151:0/2510109731 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff724116070 con 0x562bd6aaad30 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff606ffd640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff5fc034650 0x7ff5fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff606ffd640 1 -- 172.21.15.151:0/2510109731 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff724119d60 con 0x562bd6aaad30 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff730c08640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff5fc034650 0x7ff5fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6abcf50 0x562bd6abf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6abfb40 con 0x562bd6abcf50 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731c0a640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6abcf50 0x562bd6abf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff730c08640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff5fc034650 0x7ff5fc036b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff71c004fd0 tx=0x7ff71c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731c0a640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6abcf50 0x562bd6abf3f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 20 realm 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6abff50 con 0x562bd6abcf50 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac07f0 con 0x562bd6abcf50 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.461+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff7338f9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6ac16c0 0x562bd6ac3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac41f0 con 0x562bd6ac16c0 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731409640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6ac16c0 0x562bd6ac3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731409640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6ac16c0 0x562bd6ac3ab0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff7338f9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff7338f9980 20 searching for the correct realm 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac5ac0 con 0x562bd6ac16c0 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731409640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff724118060 0x7ff724118440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac5ac0 con 0x7ff724118060 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff730c08640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff724118060 0x7ff724118440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff730c08640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff724118060 0x7ff724118440 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00f070 con 0x7ff724118060 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff730c08640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff71c024070 0x7ff71c031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac5ac0 con 0x7ff71c024070 2024-09-10T14:29:51.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff71c024070 0x7ff71c031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff71c024070 0x7ff71c031970 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.465+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff71c024070 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff71c024070 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff724118060 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c00f070 con 0x7ff724118060 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6ac16c0 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff71c024070 2024-09-10T14:29:51.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff724118060 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6ac16c0 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6ac16c0 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff724118060 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6ac16c0 2024-09-10T14:29:51.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.469+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6ac16c0 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff71c024070 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6ac16c0 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff724118060 2024-09-10T14:29:51.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff724118060 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6ac16c0 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff71c024070 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff724118060 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6ac16c0 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.473+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff71c024070 2024-09-10T14:29:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x562bd6abcf50 2024-09-10T14:29:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac0b90 con 0x7ff724118060 2024-09-10T14:29:51.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac4be0 con 0x562bd6abcf50 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac5480 con 0x562bd6abcf50 2024-09-10T14:29:51.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac4820 con 0x7ff71c024070 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 zone default found 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 4 Realm: () 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 zonegroup default 2024-09-10T14:29:51.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac4fd0 con 0x7ff724118060 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac7950 con 0x562bd6ac16c0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac7cf0 con 0x562bd6ac16c0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 started sync module instance, tier type = 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.477+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac5940 con 0x7ff724118060 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.481+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.481+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94746285207200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac8090 con 0x7ff724118060 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.481+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac8bb0 con 0x562bd6abcf50 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.481+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94746285207200] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.481+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.481+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94746285213312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac8fa0 con 0x562bd6abcf50 2024-09-10T14:29:51.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.481+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac99a0 con 0x562bd6ac16c0 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94746285213312] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94746285208464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac9d90 con 0x562bd6ac16c0 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6aca750 con 0x7ff724118060 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94746285222640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acb3c0 con 0x7ff724118060 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acbd80 con 0x562bd6abcf50 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94746285208464] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94746285222640] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.485+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94746285216944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acb020 con 0x562bd6abcf50 2024-09-10T14:29:51.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.489+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acc4a0 con 0x7ff71c024070 2024-09-10T14:29:51.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.489+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94746285216944] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.489+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.489+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94746285227856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acc460 con 0x7ff71c024070 2024-09-10T14:29:51.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.489+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acceb0 con 0x7ff71c024070 2024-09-10T14:29:51.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94746285230592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acd2d0 con 0x7ff71c024070 2024-09-10T14:29:51.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acdd70 con 0x7ff71c024070 2024-09-10T14:29:51.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94746285227856] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94746285230592] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94746285234240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acce20 con 0x7ff71c024070 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 20 add_watcher() i=0 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 20 add_watcher() i=1 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 20 add_watcher() i=2 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 20 add_watcher() i=3 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 20 add_watcher() i=4 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 20 add_watcher() i=5 2024-09-10T14:29:51.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.493+0000 7ff7338f9980 20 add_watcher() i=6 2024-09-10T14:29:51.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94746285234240] v36'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 20 add_watcher() i=7 2024-09-10T14:29:51.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:51.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ad0e70 con 0x562bd6abcf50 2024-09-10T14:29:51.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94746285226192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ace2f0 con 0x562bd6abcf50 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94746285226192] v36'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff5e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 5 note: GC not initialized 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff5e67e4640 20 reqs_thread_entry: start 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 20 Filter name: none 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff557fff640 20 reqs_thread_entry: start 2024-09-10T14:29:51.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6af3e10 con 0x562bd6abcf50 2024-09-10T14:29:51.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:29:51.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562bd6af5360 con 0x7ff71c024070 2024-09-10T14:29:51.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.497+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.501+0000 7ff5e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.501+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94746285226192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6af2570 con 0x562bd6abcf50 2024-09-10T14:29:51.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.501+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94746285226192] v36'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.501+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94746285207200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acb8d0 con 0x7ff724118060 2024-09-10T14:29:51.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.501+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94746285207200] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.501+0000 7ff7338f9980 20 remove_watcher() i=0 2024-09-10T14:29:51.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.501+0000 7ff7338f9980 2 removed watcher, disabling cache 2024-09-10T14:29:51.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.501+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94746285213312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acb8d0 con 0x562bd6abcf50 2024-09-10T14:29:51.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94746285213312] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff7338f9980 20 remove_watcher() i=1 2024-09-10T14:29:51.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94746285208464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acb8d0 con 0x562bd6ac16c0 2024-09-10T14:29:51.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff731409640 1 -- 172.21.15.151:0/2510109731 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94746285208464] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff724115030 con 0x562bd6ac16c0 2024-09-10T14:29:51.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff7338f9980 20 remove_watcher() i=2 2024-09-10T14:29:51.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94746285222640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac6ea0 con 0x7ff724118060 2024-09-10T14:29:51.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff730c08640 1 -- 172.21.15.151:0/2510109731 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94746285222640] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff71c040040 con 0x7ff724118060 2024-09-10T14:29:51.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff7338f9980 20 remove_watcher() i=3 2024-09-10T14:29:51.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.505+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94746285216944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac6ea0 con 0x562bd6abcf50 2024-09-10T14:29:51.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.509+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94746285216944] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x562bd6abcf50 2024-09-10T14:29:51.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.509+0000 7ff7338f9980 20 remove_watcher() i=4 2024-09-10T14:29:51.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.509+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94746285227856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac94b0 con 0x7ff71c024070 2024-09-10T14:29:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.509+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94746285227856] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.509+0000 7ff7338f9980 20 remove_watcher() i=5 2024-09-10T14:29:51.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.509+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94746285230592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6ac6ea0 con 0x7ff71c024070 2024-09-10T14:29:51.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94746285230592] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 20 remove_watcher() i=6 2024-09-10T14:29:51.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94746285234240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562bd6acbf50 con 0x7ff71c024070 2024-09-10T14:29:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94746285234240] v36'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff72c0083f0 con 0x7ff71c024070 2024-09-10T14:29:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 20 remove_watcher() i=7 2024-09-10T14:29:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff71c024070 msgr2=0x7ff71c031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7ff71c024070 0x7ff71c031970 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6abcf50 msgr2=0x562bd6abf3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6abcf50 0x562bd6abf3f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff724118060 msgr2=0x7ff724118440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff724118060 0x7ff724118440 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6ac16c0 msgr2=0x562bd6ac3ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6ac16c0 0x562bd6ac3ab0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff5fc034650 msgr2=0x7ff5fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff5fc034650 0x7ff5fc036b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff71c004fd0 tx=0x7ff71c010000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 msgr2=0x562bd6ab1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6ab1f10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff7240c2f20 tx=0x7ff7240c2db0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff731c0a640 1 -- 172.21.15.151:0/2510109731 reap_dead start 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 shutdown_connections 2024-09-10T14:29:51.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2510109731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6aaad30 0x562bd6ab1f10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 >> 172.21.15.151:0/2510109731 conn(0x562bd6aa7110 msgr2=0x562bd6aa51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 shutdown_connections 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2510109731 wait complete. 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2492815341 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff608034650 msgr2=0x7ff608036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2492815341 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff608034650 0x7ff608036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x562bd6a84820 tx=0x7ff71c00f000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2492815341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6a9e350 msgr2=0x562bd6a9e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2492815341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6a9e350 0x562bd6a9e770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff7240b5010 tx=0x7ff7240c7f70 comp rx=0 tx=0).stop 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2492815341 shutdown_connections 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2492815341 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff608034650 0x7ff608036b10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2492815341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6a9e350 0x562bd6a9e770 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2492815341 >> 172.21.15.151:0/2492815341 conn(0x562bd6a934a0 msgr2=0x562bd6a95f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2492815341 shutdown_connections 2024-09-10T14:29:51.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.513+0000 7ff7338f9980 1 -- 172.21.15.151:0/2492815341 wait complete. 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562bd6a8dd90 msgr2=0x562bd6a90180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562bd6a8dd90 0x562bd6a90180 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6a85090 msgr2=0x562bd6a874c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562bd6a85090 0x562bd6a874c0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6a89ce0 msgr2=0x562bd6a8c1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562bd6a89ce0 0x562bd6a8c1a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6180346a0 msgr2=0x7ff618036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff6180346a0 0x7ff618036b60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0016c0 tx=0x7ff71c0066c0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6990cc0 msgr2=0x562bd6a80110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 --2- 172.21.15.151:0/2055330553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bd6990cc0 0x562bd6a80110 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff724000c10 tx=0x7ff7240180e0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff731c0a640 1 -- 172.21.15.151:0/2055330553 reap_dead start 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 shutdown_connections 2024-09-10T14:29:51.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 >> 172.21.15.151:0/2055330553 conn(0x562bd6986070 msgr2=0x562bd6a733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 shutdown_connections 2024-09-10T14:29:51.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.517+0000 7ff7338f9980 1 -- 172.21.15.151:0/2055330553 wait complete. 2024-09-10T14:29:51.528 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-10T14:29:51.528 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-10T14:29:51.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T14:29:51.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T14:29:51.528 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-10T14:29:51.600 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:51.600 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:51.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce43393980 1 Processor -- start 2024-09-10T14:29:51.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce43393980 1 -- start start 2024-09-10T14:29:51.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce43393980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562e4e74a580 0x562e4e74a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce43393980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e4e5d3ae0 con 0x562e4e74aed0 2024-09-10T14:29:51.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce43393980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x562e4e5f7e30 con 0x562e4e74a580 2024-09-10T14:29:51.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce40ea3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562e4e74a580 0x562e4e74a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce40ea3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x562e4e74a580 0x562e4e74a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40102/0 (socket says 172.21.15.151:40102) 2024-09-10T14:29:51.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce40ea3640 1 -- 172.21.15.151:0/2754274736 learned_addr learned my addr 172.21.15.151:0/2754274736 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce40ea3640 1 -- 172.21.15.151:0/2754274736 >> v1:172.21.15.52:6789/0 conn(0x562e4e74aed0 legacy=0x562e4e74f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.597+0000 7fce40ea3640 1 -- 172.21.15.151:0/2754274736 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4e752150 con 0x562e4e74a580 2024-09-10T14:29:51.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce40ea3640 1 --2- 172.21.15.151:0/2754274736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e74a960 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fce3000a5c0 tx=0x7fce3001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca350037929a9c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce3fea1640 1 -- 172.21.15.151:0/2754274736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300a6070 con 0x562e4e74a580 2024-09-10T14:29:51.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce3fea1640 1 -- 172.21.15.151:0/2754274736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce300af070 con 0x562e4e74a580 2024-09-10T14:29:51.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce3fea1640 1 -- 172.21.15.151:0/2754274736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300aa5c0 con 0x562e4e74a580 2024-09-10T14:29:51.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce43393980 1 -- 172.21.15.151:0/2754274736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 msgr2=0x562e4e74a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce43393980 1 --2- 172.21.15.151:0/2754274736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e74a960 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fce3000a5c0 tx=0x7fce3001b340 comp rx=0 tx=0).stop 2024-09-10T14:29:51.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce43393980 1 -- 172.21.15.151:0/2754274736 shutdown_connections 2024-09-10T14:29:51.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce43393980 1 --2- 172.21.15.151:0/2754274736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e74a960 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce43393980 1 -- 172.21.15.151:0/2754274736 >> 172.21.15.151:0/2754274736 conn(0x562e4e7460a0 msgr2=0x562e4e7484c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce43393980 1 -- 172.21.15.151:0/2754274736 shutdown_connections 2024-09-10T14:29:51.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.601+0000 7fce43393980 1 -- 172.21.15.151:0/2754274736 wait complete. 2024-09-10T14:29:51.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.613+0000 7fce43393980 1 Processor -- start 2024-09-10T14:29:51.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.613+0000 7fce43393980 1 -- start start 2024-09-10T14:29:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e6bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e4e5f9200 con 0x562e4e74a580 2024-09-10T14:29:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e6bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e6bfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40114/0 (socket says 172.21.15.151:40114) 2024-09-10T14:29:51.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 -- 172.21.15.151:0/2666436429 learned_addr learned my addr 172.21.15.151:0/2666436429 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 -- 172.21.15.151:0/2666436429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4e6c01e0 con 0x562e4e74a580 2024-09-10T14:29:51.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 --2- 172.21.15.151:0/2666436429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e6bfc10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fce300199f0 tx=0x7fce30003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c1ce5d549fda93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fcd2ee0d640 1 -- 172.21.15.151:0/2666436429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300aaa00 con 0x562e4e74a580 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fcd2ee0d640 1 -- 172.21.15.151:0/2666436429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce300aaba0 con 0x562e4e74a580 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fcd2ee0d640 1 -- 172.21.15.151:0/2666436429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300bd3f0 con 0x562e4e74a580 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 -- 172.21.15.151:0/2666436429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 msgr2=0x562e4e6bfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 --2- 172.21.15.151:0/2666436429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e6bfc10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fce300199f0 tx=0x7fce30003030 comp rx=0 tx=0).stop 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 -- 172.21.15.151:0/2666436429 shutdown_connections 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 --2- 172.21.15.151:0/2666436429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e6bfc10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 -- 172.21.15.151:0/2666436429 >> 172.21.15.151:0/2666436429 conn(0x562e4e7460a0 msgr2=0x562e4e831550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 -- 172.21.15.151:0/2666436429 shutdown_connections 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 -- 172.21.15.151:0/2666436429 wait complete. 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 Processor -- start 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 -- start start 2024-09-10T14:29:51.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e8370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce43393980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e4e751b90 con 0x562e4e74a580 2024-09-10T14:29:51.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e8370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e8370c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40116/0 (socket says 172.21.15.151:40116) 2024-09-10T14:29:51.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 -- 172.21.15.151:0/1054555397 learned_addr learned my addr 172.21.15.151:0/1054555397 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.617+0000 7fce40ea3640 1 -- 172.21.15.151:0/1054555397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4e837600 con 0x562e4e74a580 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce40ea3640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e8370c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fce300199f0 tx=0x7fce300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fcd2d60a640 1 -- 172.21.15.151:0/1054555397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300bd7c0 con 0x562e4e74a580 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fcd2d60a640 1 -- 172.21.15.151:0/1054555397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce300bd960 con 0x562e4e74a580 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e4e8357e0 con 0x562e4e74a580 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e4e835cd0 con 0x562e4e74a580 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fcd2d60a640 1 -- 172.21.15.151:0/1054555397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300bdc40 con 0x562e4e74a580 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fcd2d60a640 1 -- 172.21.15.151:0/1054555397 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce300ce020 con 0x562e4e74a580 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fcd2d60a640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd28034650 0x7fcd28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fcd2d60a640 1 -- 172.21.15.151:0/1054555397 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fce300cc020 con 0x562e4e74a580 2024-09-10T14:29:51.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce406a2640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd28034650 0x7fcd28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce43393980 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e74aed0 0x562e4e847090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8475d0 con 0x562e4e74aed0 2024-09-10T14:29:51.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce416a4640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e74aed0 0x562e4e847090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce406a2640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd28034650 0x7fcd28036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fce34000f70 tx=0x7fce34001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce416a4640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e74aed0 0x562e4e847090 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce416a4640 1 -- 172.21.15.151:0/1054555397 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e74aed0 2024-09-10T14:29:51.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e847970 con 0x562e4e74aed0 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce416a4640 1 -- 172.21.15.151:0/1054555397 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e74aed0 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce43393980 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e849730 0x562e4e84bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e84c1f0 con 0x562e4e849730 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce40ea3640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e849730 0x562e4e84bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce40ea3640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e849730 0x562e4e84bb20 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce40ea3640 1 -- 172.21.15.151:0/1054555397 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce300c6d20 con 0x562e4e849730 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.621+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8485d0 con 0x562e4e74aed0 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce416a4640 1 -- 172.21.15.151:0/1054555397 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e74aed0 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce43393980 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e4e84d630 0x562e4e84fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8501b0 con 0x562e4e84d630 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce406a2640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e4e84d630 0x562e4e84fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce406a2640 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e4e84d630 0x562e4e84fa20 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce406a2640 1 -- 172.21.15.151:0/1054555397 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce3400d040 con 0x562e4e84d630 2024-09-10T14:29:51.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce43393980 1 Processor -- start 2024-09-10T14:29:51.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce43393980 1 -- start start 2024-09-10T14:29:51.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce43393980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e85dc40 0x562e4e85e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce43393980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e4e652800 con 0x562e4e85dc40 2024-09-10T14:29:51.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e85dc40 0x562e4e85e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e85dc40 0x562e4e85e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40118/0 (socket says 172.21.15.151:40118) 2024-09-10T14:29:51.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce40ea3640 1 -- 172.21.15.151:0/3650350663 learned_addr learned my addr 172.21.15.151:0/3650350663 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce40ea3640 1 -- 172.21.15.151:0/3650350663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4e85e5a0 con 0x562e4e85dc40 2024-09-10T14:29:51.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.625+0000 7fce40ea3640 1 --2- 172.21.15.151:0/3650350663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e85dc40 0x562e4e85e060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fce300c6fd0 tx=0x7fce300c5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd267fc640 1 -- 172.21.15.151:0/3650350663 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300bcbf0 con 0x562e4e85dc40 2024-09-10T14:29:51.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce43393980 1 -- 172.21.15.151:0/3650350663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e4e85e830 con 0x562e4e85dc40 2024-09-10T14:29:51.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd267fc640 1 -- 172.21.15.151:0/3650350663 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce300bcd90 con 0x562e4e85dc40 2024-09-10T14:29:51.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce43393980 1 -- 172.21.15.151:0/3650350663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e4e8614b0 con 0x562e4e85dc40 2024-09-10T14:29:51.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd267fc640 1 -- 172.21.15.151:0/3650350663 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300f2060 con 0x562e4e85dc40 2024-09-10T14:29:51.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd267fc640 1 -- 172.21.15.151:0/3650350663 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce300e3130 con 0x562e4e85dc40 2024-09-10T14:29:51.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd267fc640 1 --2- 172.21.15.151:0/3650350663 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd18034650 0x7fcd18036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd267fc640 1 -- 172.21.15.151:0/3650350663 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fce300c01b0 con 0x562e4e85dc40 2024-09-10T14:29:51.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce406a2640 1 --2- 172.21.15.151:0/3650350663 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd18034650 0x7fcd18036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce43393980 1 Processor -- start 2024-09-10T14:29:51.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce43393980 1 -- start start 2024-09-10T14:29:51.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce406a2640 1 --2- 172.21.15.151:0/3650350663 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd18034650 0x7fcd18036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x562e4e8505b0 tx=0x7fce34006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce43393980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e86aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce43393980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e4e6c04a0 con 0x562e4e86a640 2024-09-10T14:29:51.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e86aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e86aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40126/0 (socket says 172.21.15.151:40126) 2024-09-10T14:29:51.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce40ea3640 1 -- 172.21.15.151:0/3905299666 learned_addr learned my addr 172.21.15.151:0/3905299666 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce40ea3640 1 -- 172.21.15.151:0/3905299666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4e86aff0 con 0x562e4e86a640 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fce40ea3640 1 --2- 172.21.15.151:0/3905299666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e86aa20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fce300e49b0 tx=0x7fce300e4be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231b8308ba01e144 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd17fff640 1 -- 172.21.15.151:0/3905299666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300c6480 con 0x562e4e86a640 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd17fff640 1 -- 172.21.15.151:0/3905299666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce300e3420 con 0x562e4e86a640 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.629+0000 7fcd17fff640 1 -- 172.21.15.151:0/3905299666 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300c6620 con 0x562e4e86a640 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- 172.21.15.151:0/3905299666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 msgr2=0x562e4e86aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 --2- 172.21.15.151:0/3905299666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e86aa20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fce300e49b0 tx=0x7fce300e4be0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- 172.21.15.151:0/3905299666 shutdown_connections 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 --2- 172.21.15.151:0/3905299666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e86aa20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- 172.21.15.151:0/3905299666 >> 172.21.15.151:0/3905299666 conn(0x562e4e866970 msgr2=0x562e4e864a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- 172.21.15.151:0/3905299666 shutdown_connections 2024-09-10T14:29:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- 172.21.15.151:0/3905299666 wait complete. 2024-09-10T14:29:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 Processor -- start 2024-09-10T14:29:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- start start 2024-09-10T14:29:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e871710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562e4e86b380 con 0x562e4e86a640 2024-09-10T14:29:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e871710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce40ea3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e871710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40138/0 (socket says 172.21.15.151:40138) 2024-09-10T14:29:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 learned_addr learned my addr 172.21.15.151:0/2376938827 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4e871c50 con 0x562e4e86a640 2024-09-10T14:29:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce40ea3640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e871710 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fce300e4ca0 tx=0x7fce300c3e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fcd167fc640 1 -- 172.21.15.151:0/2376938827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300e5240 con 0x562e4e86a640 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e4e871c50 con 0x562e4e86a640 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fcd167fc640 1 -- 172.21.15.151:0/2376938827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce30110070 con 0x562e4e86a640 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e4e871c50 con 0x562e4e86a640 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fcd167fc640 1 -- 172.21.15.151:0/2376938827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce300e35d0 con 0x562e4e86a640 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fcd167fc640 1 -- 172.21.15.151:0/2376938827 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fce300cf890 con 0x562e4e86a640 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fcd167fc640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd0c034650 0x7fcd0c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fcd167fc640 1 -- 172.21.15.151:0/2376938827 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fce301071b0 con 0x562e4e86a640 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce406a2640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd0c034650 0x7fcd0c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e87c6a0 0x562e4e87eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.633+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e87f290 con 0x562e4e87c6a0 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce416a4640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e87c6a0 0x562e4e87eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce406a2640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd0c034650 0x7fcd0c036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce34010fd0 tx=0x7fce34011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce416a4640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e87c6a0 0x562e4e87eb40 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 realm 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e87f6a0 con 0x562e4e87c6a0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e87ff40 con 0x562e4e87c6a0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e881040 0x562e4e883430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8839b0 con 0x562e4e881040 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce40ea3640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e881040 0x562e4e883430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce40ea3640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e881040 0x562e4e883430 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 20 searching for the correct realm 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e885210 con 0x562e4e881040 2024-09-10T14:29:51.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce40ea3640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fce30009040 0x7fce300b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e885210 con 0x7fce30009040 2024-09-10T14:29:51.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce406a2640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fce30009040 0x7fce300b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce406a2640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fce30009040 0x7fce300b09d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce406a2640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fce3400f3d0 0x7fce3400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e885210 con 0x7fce3400f3d0 2024-09-10T14:29:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.637+0000 7fce416a4640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fce3400f3d0 0x7fce3400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fce3400f3d0 0x7fce3400f7f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce3400f3d0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce3400f3d0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce30009040 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e881040 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce3400f3d0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.641+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce30009040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e881040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e881040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce30009040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e881040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e881040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce3400f3d0 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e881040 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce30009040 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce30009040 2024-09-10T14:29:51.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e881040 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.645+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce3400f3d0 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce30009040 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e881040 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce3400f3d0 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x562e4e87c6a0 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8802e0 con 0x7fce30009040 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e884330 con 0x562e4e87c6a0 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e884bd0 con 0x562e4e87c6a0 2024-09-10T14:29:51.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e883f70 con 0x7fce3400f3d0 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 zone default found 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 4 Realm: () 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 zonegroup default 2024-09-10T14:29:51.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e884720 con 0x7fce30009040 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.649+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8870c0 con 0x562e4e881040 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e887460 con 0x562e4e881040 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 20 started sync module instance, tier type = 2024-09-10T14:29:51.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e886560 con 0x7fce30009040 2024-09-10T14:29:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94756886046976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e886d20 con 0x7fce30009040 2024-09-10T14:29:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e888340 con 0x562e4e87c6a0 2024-09-10T14:29:51.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94756886046976] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.653+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94756886052496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e888760 con 0x562e4e87c6a0 2024-09-10T14:29:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.657+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e889010 con 0x562e4e881040 2024-09-10T14:29:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.657+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94756886052496] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.657+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.657+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94756886053552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e888b80 con 0x562e4e881040 2024-09-10T14:29:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.657+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e889a50 con 0x7fce30009040 2024-09-10T14:29:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.657+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.657+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94756886058400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8899c0 con 0x7fce30009040 2024-09-10T14:29:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.657+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88a9c0 con 0x562e4e87c6a0 2024-09-10T14:29:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.661+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94756886053552] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.661+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94756886058400] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.661+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.661+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94756886060608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88a980 con 0x562e4e87c6a0 2024-09-10T14:29:51.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.661+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88b260 con 0x7fce3400f3d0 2024-09-10T14:29:51.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.661+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94756886060608] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.661+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.661+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94756886062224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88ae30 con 0x7fce3400f3d0 2024-09-10T14:29:51.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.665+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88b7f0 con 0x7fce3400f3d0 2024-09-10T14:29:51.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.665+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94756886062224] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.665+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.665+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94756886063968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88b7f0 con 0x7fce3400f3d0 2024-09-10T14:29:51.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.665+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88c1b0 con 0x7fce3400f3d0 2024-09-10T14:29:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94756886068480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88c5d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 add_watcher() i=0 2024-09-10T14:29:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 add_watcher() i=1 2024-09-10T14:29:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 add_watcher() i=2 2024-09-10T14:29:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 add_watcher() i=3 2024-09-10T14:29:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 add_watcher() i=4 2024-09-10T14:29:51.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 add_watcher() i=5 2024-09-10T14:29:51.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94756886063968] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 add_watcher() i=6 2024-09-10T14:29:51.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94756886068480] v36'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 add_watcher() i=7 2024-09-10T14:29:51.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:51.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88b340 con 0x562e4e87c6a0 2024-09-10T14:29:51.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94756886065984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88cb10 con 0x562e4e87c6a0 2024-09-10T14:29:51.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94756886065984] v36'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fccf6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:51.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:51.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.669+0000 7fce43393980 5 note: GC not initialized 2024-09-10T14:29:51.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fccf5fe3640 20 reqs_thread_entry: start 2024-09-10T14:29:51.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce43393980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce43393980 20 Filter name: none 2024-09-10T14:29:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fcc677fe640 20 reqs_thread_entry: start 2024-09-10T14:29:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce43393980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8b27a0 con 0x562e4e87c6a0 2024-09-10T14:29:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce43393980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:29:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8b3cf0 con 0x7fce3400f3d0 2024-09-10T14:29:51.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fccf6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94756886065984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e8916a0 con 0x562e4e87c6a0 2024-09-10T14:29:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94756886065984] v36'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.673+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94756886046976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e88b340 con 0x7fce30009040 2024-09-10T14:29:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.677+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94756886046976] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.677+0000 7fce43393980 20 remove_watcher() i=0 2024-09-10T14:29:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.677+0000 7fce43393980 2 removed watcher, disabling cache 2024-09-10T14:29:51.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.677+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94756886052496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e886900 con 0x562e4e87c6a0 2024-09-10T14:29:51.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.677+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94756886052496] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.677+0000 7fce43393980 20 remove_watcher() i=1 2024-09-10T14:29:51.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.677+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94756886053552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e886900 con 0x562e4e881040 2024-09-10T14:29:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce40ea3640 1 -- 172.21.15.151:0/2376938827 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94756886053552] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce300f4070 con 0x562e4e881040 2024-09-10T14:29:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce43393980 20 remove_watcher() i=2 2024-09-10T14:29:51.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94756886058400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e886900 con 0x7fce30009040 2024-09-10T14:29:51.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce406a2640 1 -- 172.21.15.151:0/2376938827 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94756886058400] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce34036040 con 0x7fce30009040 2024-09-10T14:29:51.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce43393980 20 remove_watcher() i=3 2024-09-10T14:29:51.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94756886060608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e886900 con 0x562e4e87c6a0 2024-09-10T14:29:51.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94756886060608] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x562e4e87c6a0 2024-09-10T14:29:51.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce43393980 20 remove_watcher() i=4 2024-09-10T14:29:51.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.681+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94756886062224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e889e40 con 0x7fce3400f3d0 2024-09-10T14:29:51.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.685+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94756886062224] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.685+0000 7fce43393980 20 remove_watcher() i=5 2024-09-10T14:29:51.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.685+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94756886063968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e886900 con 0x7fce3400f3d0 2024-09-10T14:29:51.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94756886063968] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 20 remove_watcher() i=6 2024-09-10T14:29:51.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94756886068480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562e4e886900 con 0x7fce3400f3d0 2024-09-10T14:29:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94756886068480] v36'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3800a4d0 con 0x7fce3400f3d0 2024-09-10T14:29:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 20 remove_watcher() i=7 2024-09-10T14:29:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fce3400f3d0 msgr2=0x7fce3400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fce3400f3d0 0x7fce3400f7f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e87c6a0 msgr2=0x562e4e87eb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e87c6a0 0x562e4e87eb40 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fce30009040 msgr2=0x7fce300b09d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fce30009040 0x7fce300b09d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e881040 msgr2=0x562e4e883430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e881040 0x562e4e883430 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd0c034650 msgr2=0x7fcd0c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd0c034650 0x7fcd0c036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce34010fd0 tx=0x7fce34011000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 msgr2=0x562e4e871710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/2376938827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e86a640 0x562e4e871710 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fce300e4ca0 tx=0x7fce300c3e90 comp rx=0 tx=0).stop 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 reap_dead start 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce416a4640 1 -- 172.21.15.151:0/2376938827 reap_dead start 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 shutdown_connections 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 >> 172.21.15.151:0/2376938827 conn(0x562e4e866970 msgr2=0x562e4e864a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 shutdown_connections 2024-09-10T14:29:51.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/2376938827 wait complete. 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/3650350663 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd18034650 msgr2=0x7fcd18036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/3650350663 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd18034650 0x7fcd18036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x562e4e8505b0 tx=0x7fce34006000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/3650350663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e85dc40 msgr2=0x562e4e85e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/3650350663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e85dc40 0x562e4e85e060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fce300c6fd0 tx=0x7fce300c5890 comp rx=0 tx=0).stop 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/3650350663 shutdown_connections 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/3650350663 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd18034650 0x7fcd18036b10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/3650350663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e85dc40 0x562e4e85e060 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/3650350663 >> 172.21.15.151:0/3650350663 conn(0x562e4e852d90 msgr2=0x562e4e855810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/3650350663 shutdown_connections 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/3650350663 wait complete. 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e4e84d630 msgr2=0x562e4e84fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x562e4e84d630 0x562e4e84fa20 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e74aed0 msgr2=0x562e4e847090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x562e4e74aed0 0x562e4e847090 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e849730 msgr2=0x562e4e84bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x562e4e849730 0x562e4e84bb20 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd28034650 msgr2=0x7fcd28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcd28034650 0x7fcd28036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fce34000f70 tx=0x7fce34001420 comp rx=0 tx=0).stop 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 msgr2=0x562e4e8370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 --2- 172.21.15.151:0/1054555397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562e4e74a580 0x562e4e8370c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fce300199f0 tx=0x7fce300180e0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce416a4640 1 -- 172.21.15.151:0/1054555397 reap_dead start 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 shutdown_connections 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 >> 172.21.15.151:0/1054555397 conn(0x562e4e7460a0 msgr2=0x562e4e8300d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.689+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 shutdown_connections 2024-09-10T14:29:51.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.693+0000 7fce43393980 1 -- 172.21.15.151:0/1054555397 wait complete. 2024-09-10T14:29:51.703 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-10T14:29:51.703 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-10T14:29:51.704 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T14:29:51.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T14:29:51.704 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-10T14:29:51.776 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:51.776 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:51.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82ad30f980 1 Processor -- start 2024-09-10T14:29:51.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82ad30f980 1 -- start start 2024-09-10T14:29:51.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82ad30f980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56434e83d6a0 0x56434e83da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82ad30f980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56434e6c5ae0 con 0x56434e83dff0 2024-09-10T14:29:51.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82ad30f980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56434e6e9e30 con 0x56434e83d6a0 2024-09-10T14:29:51.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82aae1f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56434e83d6a0 0x56434e83da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82aa61e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x56434e83dff0 0x56434e842a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:52598/0 (socket says 172.21.15.151:52598) 2024-09-10T14:29:51.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82aa61e640 1 -- 172.21.15.151:0/4057773259 learned_addr learned my addr 172.21.15.151:0/4057773259 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:51.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.773+0000 7f82aae1f640 1 --2- 172.21.15.151:0/4057773259 >> v2:172.21.15.52:3300/0 conn(0x56434e83d6a0 0x56434e83da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40140/0 (socket says 172.21.15.151:40140) 2024-09-10T14:29:51.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82aae1f640 1 -- 172.21.15.151:0/4057773259 >> v1:172.21.15.52:6789/0 conn(0x56434e83dff0 legacy=0x56434e842a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82aae1f640 1 -- 172.21.15.151:0/4057773259 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434e845270 con 0x56434e83d6a0 2024-09-10T14:29:51.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82aae1f640 1 --2- 172.21.15.151:0/4057773259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e83da80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f829c00a480 tx=0x7f829c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07e92a869a73c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82a9e1d640 1 -- 172.21.15.151:0/4057773259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0b0070 con 0x56434e83d6a0 2024-09-10T14:29:51.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82a9e1d640 1 -- 172.21.15.151:0/4057773259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c0ab540 con 0x56434e83d6a0 2024-09-10T14:29:51.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82a9e1d640 1 -- 172.21.15.151:0/4057773259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0ab840 con 0x56434e83d6a0 2024-09-10T14:29:51.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82ad30f980 1 -- 172.21.15.151:0/4057773259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 msgr2=0x56434e83da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82ad30f980 1 --2- 172.21.15.151:0/4057773259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e83da80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f829c00a480 tx=0x7f829c01b280 comp rx=0 tx=0).stop 2024-09-10T14:29:51.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82ad30f980 1 -- 172.21.15.151:0/4057773259 shutdown_connections 2024-09-10T14:29:51.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82ad30f980 1 --2- 172.21.15.151:0/4057773259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e83da80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82ad30f980 1 -- 172.21.15.151:0/4057773259 >> 172.21.15.151:0/4057773259 conn(0x56434e8391c0 msgr2=0x56434e83b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82ad30f980 1 -- 172.21.15.151:0/4057773259 shutdown_connections 2024-09-10T14:29:51.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.777+0000 7f82ad30f980 1 -- 172.21.15.151:0/4057773259 wait complete. 2024-09-10T14:29:51.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 Processor -- start 2024-09-10T14:29:51.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- start start 2024-09-10T14:29:51.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e928aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56434e6eb200 con 0x56434e83d6a0 2024-09-10T14:29:51.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e928aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e928aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40142/0 (socket says 172.21.15.151:40142) 2024-09-10T14:29:51.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82aae1f640 1 -- 172.21.15.151:0/440302427 learned_addr learned my addr 172.21.15.151:0/440302427 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82aae1f640 1 -- 172.21.15.151:0/440302427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434e929070 con 0x56434e83d6a0 2024-09-10T14:29:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82aae1f640 1 --2- 172.21.15.151:0/440302427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e928aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f829c0ae040 tx=0x7f829c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d0933829a3f40e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f8198e09640 1 -- 172.21.15.151:0/440302427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0b0040 con 0x56434e83d6a0 2024-09-10T14:29:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f8198e09640 1 -- 172.21.15.151:0/440302427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c0ab9b0 con 0x56434e83d6a0 2024-09-10T14:29:51.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f8198e09640 1 -- 172.21.15.151:0/440302427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0abc90 con 0x56434e83d6a0 2024-09-10T14:29:51.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- 172.21.15.151:0/440302427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 msgr2=0x56434e928aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 --2- 172.21.15.151:0/440302427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e928aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f829c0ae040 tx=0x7f829c003030 comp rx=0 tx=0).stop 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- 172.21.15.151:0/440302427 shutdown_connections 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 --2- 172.21.15.151:0/440302427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e928aa0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- 172.21.15.151:0/440302427 >> 172.21.15.151:0/440302427 conn(0x56434e8391c0 msgr2=0x56434e9246d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- 172.21.15.151:0/440302427 shutdown_connections 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- 172.21.15.151:0/440302427 wait complete. 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 Processor -- start 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- start start 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e7b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.793+0000 7f82ad30f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56434e844cb0 con 0x56434e83d6a0 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e7b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e7b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40152/0 (socket says 172.21.15.151:40152) 2024-09-10T14:29:51.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f82aae1f640 1 -- 172.21.15.151:0/1943325718 learned_addr learned my addr 172.21.15.151:0/1943325718 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f82aae1f640 1 -- 172.21.15.151:0/1943325718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434e7b4a00 con 0x56434e83d6a0 2024-09-10T14:29:51.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f82aae1f640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e7b44c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f829c0030b0 tx=0x7f829c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f8197606640 1 -- 172.21.15.151:0/1943325718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0c5070 con 0x56434e83d6a0 2024-09-10T14:29:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56434e7b2be0 con 0x56434e83d6a0 2024-09-10T14:29:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f8197606640 1 -- 172.21.15.151:0/1943325718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c0b6970 con 0x56434e83d6a0 2024-09-10T14:29:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56434e7b30d0 con 0x56434e83d6a0 2024-09-10T14:29:51.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.797+0000 7f8197606640 1 -- 172.21.15.151:0/1943325718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0b0050 con 0x56434e83d6a0 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f8197606640 1 -- 172.21.15.151:0/1943325718 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f829c0c8070 con 0x56434e83d6a0 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f8197606640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8190034650 0x7f8190036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f8197606640 1 -- 172.21.15.151:0/1943325718 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f829c0bc070 con 0x56434e83d6a0 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8190034650 0x7f8190036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e83dff0 0x56434e9390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e939620 con 0x56434e83dff0 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ab620640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e83dff0 0x56434e9390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8190034650 0x7f8190036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8294000f70 tx=0x7f82940012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ab620640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e83dff0 0x56434e9390e0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ab620640 1 -- 172.21.15.151:0/1943325718 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e83dff0 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e9399c0 con 0x56434e83dff0 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ab620640 1 -- 172.21.15.151:0/1943325718 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e83dff0 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e93b7a0 0x56434e93db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e93e2d0 con 0x56434e93b7a0 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82aae1f640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e93b7a0 0x56434e93db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82aae1f640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e93b7a0 0x56434e93db90 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82aae1f640 1 -- 172.21.15.151:0/1943325718 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f829c0c7030 con 0x56434e93b7a0 2024-09-10T14:29:51.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e93a610 con 0x56434e83dff0 2024-09-10T14:29:51.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ab620640 1 -- 172.21.15.151:0/1943325718 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e83dff0 2024-09-10T14:29:51.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56434e93f710 0x56434e941b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e942240 con 0x56434e93f710 2024-09-10T14:29:51.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.801+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56434e93f710 0x56434e941b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56434e93f710 0x56434e941b00 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82aa61e640 1 -- 172.21.15.151:0/1943325718 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f829400e620 con 0x56434e93f710 2024-09-10T14:29:51.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82ad30f980 1 Processor -- start 2024-09-10T14:29:51.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82ad30f980 1 -- start start 2024-09-10T14:29:51.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82ad30f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e94fcb0 0x56434e9500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82ad30f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56434e744800 con 0x56434e94fcb0 2024-09-10T14:29:51.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e94fcb0 0x56434e9500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e94fcb0 0x56434e9500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40162/0 (socket says 172.21.15.151:40162) 2024-09-10T14:29:51.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82aae1f640 1 -- 172.21.15.151:0/3748759885 learned_addr learned my addr 172.21.15.151:0/3748759885 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82aae1f640 1 -- 172.21.15.151:0/3748759885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434e950610 con 0x56434e94fcb0 2024-09-10T14:29:51.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82aae1f640 1 --2- 172.21.15.151:0/3748759885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e94fcb0 0x56434e9500d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f829c0e1fd0 tx=0x7f829c0aacb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f8194e01640 1 -- 172.21.15.151:0/3748759885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0d5040 con 0x56434e94fcb0 2024-09-10T14:29:51.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82ad30f980 1 -- 172.21.15.151:0/3748759885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56434e9508a0 con 0x56434e94fcb0 2024-09-10T14:29:51.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f8194e01640 1 -- 172.21.15.151:0/3748759885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c0ad000 con 0x56434e94fcb0 2024-09-10T14:29:51.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f8194e01640 1 -- 172.21.15.151:0/3748759885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0ad1b0 con 0x56434e94fcb0 2024-09-10T14:29:51.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.805+0000 7f82ad30f980 1 -- 172.21.15.151:0/3748759885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56434e953520 con 0x56434e94fcb0 2024-09-10T14:29:51.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f8194e01640 1 -- 172.21.15.151:0/3748759885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f829c0c93b0 con 0x56434e94fcb0 2024-09-10T14:29:51.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f8194e01640 1 --2- 172.21.15.151:0/3748759885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8184034650 0x7f8184036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f8194e01640 1 -- 172.21.15.151:0/3748759885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f829c0a8070 con 0x56434e94fcb0 2024-09-10T14:29:51.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82aa61e640 1 --2- 172.21.15.151:0/3748759885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8184034650 0x7f8184036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 Processor -- start 2024-09-10T14:29:51.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- start start 2024-09-10T14:29:51.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e95c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82aa61e640 1 --2- 172.21.15.151:0/3748759885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8184034650 0x7f8184036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f829400bf60 tx=0x7f829400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56434e929330 con 0x56434e95c580 2024-09-10T14:29:51.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e95c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e95c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40172/0 (socket says 172.21.15.151:40172) 2024-09-10T14:29:51.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82aae1f640 1 -- 172.21.15.151:0/1438764323 learned_addr learned my addr 172.21.15.151:0/1438764323 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82aae1f640 1 -- 172.21.15.151:0/1438764323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434e95cf30 con 0x56434e95c580 2024-09-10T14:29:51.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82aae1f640 1 --2- 172.21.15.151:0/1438764323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e95c960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f829c0d13f0 tx=0x7f829c0ad410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ebe7b643c4bbf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f818e7fc640 1 -- 172.21.15.151:0/1438764323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c100070 con 0x56434e95c580 2024-09-10T14:29:51.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f818e7fc640 1 -- 172.21.15.151:0/1438764323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c0aa730 con 0x56434e95c580 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f818e7fc640 1 -- 172.21.15.151:0/1438764323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0f7040 con 0x56434e95c580 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- 172.21.15.151:0/1438764323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 msgr2=0x56434e95c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1438764323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e95c960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f829c0d13f0 tx=0x7f829c0ad410 comp rx=0 tx=0).stop 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- 172.21.15.151:0/1438764323 shutdown_connections 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1438764323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e95c960 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- 172.21.15.151:0/1438764323 >> 172.21.15.151:0/1438764323 conn(0x56434e958960 msgr2=0x56434e956a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- 172.21.15.151:0/1438764323 shutdown_connections 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- 172.21.15.151:0/1438764323 wait complete. 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 Processor -- start 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- start start 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e9636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.809+0000 7f82ad30f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56434e95d3d0 con 0x56434e95c580 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e9636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82aae1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e9636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40186/0 (socket says 172.21.15.151:40186) 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 learned_addr learned my addr 172.21.15.151:0/1699648081 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434e963c00 con 0x56434e95c580 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82aae1f640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e9636c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f829c0aac30 tx=0x7f829c0dff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f818cff9640 1 -- 172.21.15.151:0/1699648081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c100070 con 0x56434e95c580 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56434e963c00 con 0x56434e95c580 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f818cff9640 1 -- 172.21.15.151:0/1699648081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c101040 con 0x56434e95c580 2024-09-10T14:29:51.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f818cff9640 1 -- 172.21.15.151:0/1699648081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f829c0e3580 con 0x56434e95c580 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56434e963c00 con 0x56434e95c580 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f818cff9640 1 -- 172.21.15.151:0/1699648081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f829c10c020 con 0x56434e95c580 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f818cff9640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8174034650 0x7f8174036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f818cff9640 1 -- 172.21.15.151:0/1699648081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f829c10a020 con 0x56434e95c580 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8174034650 0x7f8174036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e96e7b0 0x56434e970c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e9713a0 con 0x56434e96e7b0 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ab620640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e96e7b0 0x56434e970c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ab620640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e96e7b0 0x56434e970c50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8174034650 0x7f8174036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56434e942620 tx=0x7f8294010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 20 realm 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e9717b0 con 0x56434e96e7b0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e972050 con 0x56434e96e7b0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.813+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ad30f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e973150 0x56434e975540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e975ac0 con 0x56434e973150 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aae1f640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e973150 0x56434e975540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aae1f640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e973150 0x56434e975540 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ad30f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ad30f980 20 searching for the correct realm 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e977320 con 0x56434e973150 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aae1f640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f829c0b5c50 0x7f829c10e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e977320 con 0x7f829c0b5c50 2024-09-10T14:29:51.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f829c0b5c50 0x7f829c10e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f829c0b5c50 0x7f829c10e850 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aa61e640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8294037040 0x7f8294036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e977320 con 0x7f8294037040 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ab620640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8294037040 0x7f8294036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ab620640 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8294037040 0x7f8294036410 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.817+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f8294037040 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f8294037040 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f829c0b5c50 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e973150 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f8294037040 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f829c0b5c50 2024-09-10T14:29:51.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e973150 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.821+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e973150 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f829c0b5c50 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e973150 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e973150 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f8294037040 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e973150 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f829c0b5c50 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f829c0b5c50 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e973150 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f8294037040 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.825+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f829c0b5c50 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e973150 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f8294037040 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x56434e96e7b0 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56434e9723f0 con 0x7f829c0b5c50 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e976410 con 0x56434e96e7b0 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e976cb0 con 0x56434e96e7b0 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e976050 con 0x7f8294037040 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 zone default found 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 4 Realm: () 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 zonegroup default 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e976800 con 0x7f829c0b5c50 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e9791b0 con 0x56434e973150 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e979550 con 0x56434e973150 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 started sync module instance, tier type = 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:51.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.829+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e978650 con 0x7f829c0b5c50 2024-09-10T14:29:51.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.833+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.833+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94847081351744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e9782b0 con 0x7f829c0b5c50 2024-09-10T14:29:51.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.833+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97a410 con 0x56434e96e7b0 2024-09-10T14:29:51.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.833+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94847081351744] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.833+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.833+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94847081357152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97a380 con 0x56434e96e7b0 2024-09-10T14:29:51.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.833+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97b1e0 con 0x56434e973150 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94847081357152] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94847081359360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97b5d0 con 0x56434e973150 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97bf90 con 0x7f829c0b5c50 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94847081364192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97c7e0 con 0x7f829c0b5c50 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97d1a0 con 0x56434e96e7b0 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94847081359360] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.837+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94847081364192] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.841+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.841+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94847081360416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97ccf0 con 0x56434e96e7b0 2024-09-10T14:29:51.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.841+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97d6b0 con 0x7f8294037040 2024-09-10T14:29:51.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.841+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94847081360416] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.841+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.841+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94847081366320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97d6b0 con 0x7f8294037040 2024-09-10T14:29:51.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.841+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97df80 con 0x7f8294037040 2024-09-10T14:29:51.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94847081366320] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94847081370592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97df40 con 0x7f8294037040 2024-09-10T14:29:51.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97e940 con 0x7f8294037040 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94847081374800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97e8b0 con 0x7f8294037040 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 20 add_watcher() i=0 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 20 add_watcher() i=1 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 20 add_watcher() i=2 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 20 add_watcher() i=3 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 20 add_watcher() i=4 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 20 add_watcher() i=5 2024-09-10T14:29:51.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94847081370592] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.845+0000 7f82ad30f980 20 add_watcher() i=6 2024-09-10T14:29:51.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94847081374800] v36'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 20 add_watcher() i=7 2024-09-10T14:29:51.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:51.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e97d8c0 con 0x56434e96e7b0 2024-09-10T14:29:51.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94847081371776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97f2d0 con 0x56434e96e7b0 2024-09-10T14:29:51.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94847081371776] v36'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f81617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:51.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 5 note: GC not initialized 2024-09-10T14:29:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f80dbfff640 20 reqs_thread_entry: start 2024-09-10T14:29:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 20 Filter name: none 2024-09-10T14:29:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f80d9ffb640 20 reqs_thread_entry: start 2024-09-10T14:29:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e9a4fb0 con 0x56434e96e7b0 2024-09-10T14:29:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:29:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.849+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56434e9a6500 con 0x7f8294037040 2024-09-10T14:29:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f81617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:51.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94847081371776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e9a49d0 con 0x56434e96e7b0 2024-09-10T14:29:51.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94847081371776] v36'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94847081351744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97d880 con 0x7f829c0b5c50 2024-09-10T14:29:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94847081351744] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f82ad30f980 20 remove_watcher() i=0 2024-09-10T14:29:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f82ad30f980 2 removed watcher, disabling cache 2024-09-10T14:29:51.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.853+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94847081357152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97d880 con 0x56434e96e7b0 2024-09-10T14:29:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.857+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94847081357152] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.857+0000 7f82ad30f980 20 remove_watcher() i=1 2024-09-10T14:29:51.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.857+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94847081359360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e979f60 con 0x56434e973150 2024-09-10T14:29:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.857+0000 7f82aae1f640 1 -- 172.21.15.151:0/1699648081 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94847081359360] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829c103070 con 0x56434e973150 2024-09-10T14:29:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.857+0000 7f82ad30f980 20 remove_watcher() i=2 2024-09-10T14:29:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.857+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94847081364192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97d880 con 0x7f829c0b5c50 2024-09-10T14:29:51.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.861+0000 7f82aa61e640 1 -- 172.21.15.151:0/1699648081 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94847081364192] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f829400e620 con 0x7f829c0b5c50 2024-09-10T14:29:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.861+0000 7f82ad30f980 20 remove_watcher() i=3 2024-09-10T14:29:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.861+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94847081360416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97a800 con 0x56434e96e7b0 2024-09-10T14:29:51.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.861+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94847081360416] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x56434e96e7b0 2024-09-10T14:29:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.861+0000 7f82ad30f980 20 remove_watcher() i=4 2024-09-10T14:29:51.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.861+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94847081366320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e979f60 con 0x7f8294037040 2024-09-10T14:29:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94847081366320] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 20 remove_watcher() i=5 2024-09-10T14:29:51.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94847081370592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97bae0 con 0x7f8294037040 2024-09-10T14:29:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94847081370592] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 20 remove_watcher() i=6 2024-09-10T14:29:51.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94847081374800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56434e97d880 con 0x7f8294037040 2024-09-10T14:29:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94847081374800] v36'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82a400a4d0 con 0x7f8294037040 2024-09-10T14:29:51.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 20 remove_watcher() i=7 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8294037040 msgr2=0x7f8294036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8294037040 0x7f8294036410 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e96e7b0 msgr2=0x56434e970c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e96e7b0 0x56434e970c50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f829c0b5c50 msgr2=0x7f829c10e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f829c0b5c50 0x7f829c10e850 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e973150 msgr2=0x56434e975540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.865+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e973150 0x56434e975540 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8174034650 msgr2=0x7f8174036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8174034650 0x7f8174036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56434e942620 tx=0x7f8294010000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 msgr2=0x56434e9636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ab620640 1 -- 172.21.15.151:0/1699648081 reap_dead start 2024-09-10T14:29:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e9636c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f829c0aac30 tx=0x7f829c0dff90 comp rx=0 tx=0).stop 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 shutdown_connections 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1699648081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e95c580 0x56434e9636c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 >> 172.21.15.151:0/1699648081 conn(0x56434e958960 msgr2=0x56434e956a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 shutdown_connections 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1699648081 wait complete. 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/3748759885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8184034650 msgr2=0x7f8184036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/3748759885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8184034650 0x7f8184036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f829400bf60 tx=0x7f829400f000 comp rx=0 tx=0).stop 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/3748759885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e94fcb0 msgr2=0x56434e9500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/3748759885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e94fcb0 0x56434e9500d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f829c0e1fd0 tx=0x7f829c0aacb0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/3748759885 shutdown_connections 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/3748759885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8184034650 0x7f8184036b10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/3748759885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e94fcb0 0x56434e9500d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/3748759885 >> 172.21.15.151:0/3748759885 conn(0x56434e944e00 msgr2=0x56434e947880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/3748759885 shutdown_connections 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/3748759885 wait complete. 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56434e93f710 msgr2=0x56434e941b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56434e93f710 0x56434e941b00 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e83dff0 msgr2=0x56434e9390e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56434e83dff0 0x56434e9390e0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e93b7a0 msgr2=0x56434e93db90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56434e93b7a0 0x56434e93db90 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8190034650 msgr2=0x7f8190036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8190034650 0x7f8190036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8294000f70 tx=0x7f82940012c0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 msgr2=0x56434e7b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 --2- 172.21.15.151:0/1943325718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56434e83d6a0 0x56434e7b44c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f829c0030b0 tx=0x7f829c018020 comp rx=0 tx=0).stop 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ab620640 1 -- 172.21.15.151:0/1943325718 reap_dead start 2024-09-10T14:29:51.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 shutdown_connections 2024-09-10T14:29:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 >> 172.21.15.151:0/1943325718 conn(0x56434e8391c0 msgr2=0x56434e923250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 shutdown_connections 2024-09-10T14:29:51.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.869+0000 7f82ad30f980 1 -- 172.21.15.151:0/1943325718 wait complete. 2024-09-10T14:29:51.881 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-10T14:29:51.881 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-10T14:29:51.881 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T14:29:51.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T14:29:51.881 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-10T14:29:51.958 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:51.958 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:51.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fdae3d980 1 Processor -- start 2024-09-10T14:29:51.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fdae3d980 1 -- start start 2024-09-10T14:29:51.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fdae3d980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a88d503660 0x55a88d505a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fdae3d980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a88d388ae0 con 0x55a88d4ffb50 2024-09-10T14:29:51.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fdae3d980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55a88d3ace30 con 0x55a88d503660 2024-09-10T14:29:51.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fd814c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a88d503660 0x55a88d505a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fd894d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55a88d4ffb50 0x55a88d501f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:52604/0 (socket says 172.21.15.151:52604) 2024-09-10T14:29:51.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fd894d640 1 -- 172.21.15.151:0/1107486386 learned_addr learned my addr 172.21.15.151:0/1107486386 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:51.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fd814c640 1 -- 172.21.15.151:0/1107486386 >> v1:172.21.15.52:6789/0 conn(0x55a88d4ffb50 legacy=0x55a88d501f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fd814c640 1 -- 172.21.15.151:0/1107486386 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88d507120 con 0x55a88d503660 2024-09-10T14:29:51.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.957+0000 7f9fd814c640 1 --2- 172.21.15.151:0/1107486386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d503660 0x55a88d505a80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000a480 tx=0x7f9fc001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e055a97cae816bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fd794b640 1 -- 172.21.15.151:0/1107486386 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc00b0070 con 0x55a88d503660 2024-09-10T14:29:51.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fd794b640 1 -- 172.21.15.151:0/1107486386 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc00ab540 con 0x55a88d503660 2024-09-10T14:29:51.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fd794b640 1 -- 172.21.15.151:0/1107486386 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc00ab840 con 0x55a88d503660 2024-09-10T14:29:51.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1107486386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d503660 msgr2=0x55a88d505a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/1107486386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d503660 0x55a88d505a80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000a480 tx=0x7f9fc001b280 comp rx=0 tx=0).stop 2024-09-10T14:29:51.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1107486386 shutdown_connections 2024-09-10T14:29:51.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/1107486386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d503660 0x55a88d505a80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1107486386 >> 172.21.15.151:0/1107486386 conn(0x55a88d4fa7b0 msgr2=0x55a88d4fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1107486386 shutdown_connections 2024-09-10T14:29:51.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.961+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1107486386 wait complete. 2024-09-10T14:29:51.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fdae3d980 1 Processor -- start 2024-09-10T14:29:51.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fdae3d980 1 -- start start 2024-09-10T14:29:51.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fdae3d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d508d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fdae3d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a88d3ae200 con 0x55a88d4ffb50 2024-09-10T14:29:51.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d508d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d508d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40200/0 (socket says 172.21.15.151:40200) 2024-09-10T14:29:51.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fd894d640 1 -- 172.21.15.151:0/495866186 learned_addr learned my addr 172.21.15.151:0/495866186 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fd894d640 1 -- 172.21.15.151:0/495866186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88d509300 con 0x55a88d4ffb50 2024-09-10T14:29:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.973+0000 7f9fd894d640 1 --2- 172.21.15.151:0/495866186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d508d30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00015f0 tx=0x7f9fd0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1450459af30651b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9ec6e0d640 1 -- 172.21.15.151:0/495866186 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0004530 con 0x55a88d4ffb50 2024-09-10T14:29:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9ec6e0d640 1 -- 172.21.15.151:0/495866186 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd00046f0 con 0x55a88d4ffb50 2024-09-10T14:29:51.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9ec6e0d640 1 -- 172.21.15.151:0/495866186 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0004a90 con 0x55a88d4ffb50 2024-09-10T14:29:51.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- 172.21.15.151:0/495866186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 msgr2=0x55a88d508d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/495866186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d508d30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00015f0 tx=0x7f9fd0001ab0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- 172.21.15.151:0/495866186 shutdown_connections 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/495866186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d508d30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- 172.21.15.151:0/495866186 >> 172.21.15.151:0/495866186 conn(0x55a88d4fa7b0 msgr2=0x55a88d5e76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- 172.21.15.151:0/495866186 shutdown_connections 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- 172.21.15.151:0/495866186 wait complete. 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 Processor -- start 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- start start 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d5f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a88d506bf0 con 0x55a88d4ffb50 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d5f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d5f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40212/0 (socket says 172.21.15.151:40212) 2024-09-10T14:29:51.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fd894d640 1 -- 172.21.15.151:0/3039297294 learned_addr learned my addr 172.21.15.151:0/3039297294 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fd894d640 1 -- 172.21.15.151:0/3039297294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88d5f55b0 con 0x55a88d4ffb50 2024-09-10T14:29:51.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fd894d640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d5f5070 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x55a88d5088b0 tx=0x7f9fd0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9ec560a640 1 -- 172.21.15.151:0/3039297294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0013760 con 0x55a88d4ffb50 2024-09-10T14:29:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a88d5f5840 con 0x55a88d4ffb50 2024-09-10T14:29:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88d5f8520 con 0x55a88d4ffb50 2024-09-10T14:29:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9ec560a640 1 -- 172.21.15.151:0/3039297294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0013900 con 0x55a88d4ffb50 2024-09-10T14:29:51.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.977+0000 7f9ec560a640 1 -- 172.21.15.151:0/3039297294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0013be0 con 0x55a88d4ffb50 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9ec560a640 1 -- 172.21.15.151:0/3039297294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9fd0010070 con 0x55a88d4ffb50 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9ec560a640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ec00346a0 0x7f9ec0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9ec560a640 1 -- 172.21.15.151:0/3039297294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9fd0018070 con 0x55a88d4ffb50 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ec00346a0 0x7f9ec0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d503660 0x55a88d5fc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d5fc6d0 con 0x55a88d503660 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd914e640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d503660 0x55a88d5fc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ec00346a0 0x7f9ec0036b60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ad000 tx=0x7f9fc00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd914e640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d503660 0x55a88d5fc060 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd914e640 1 -- 172.21.15.151:0/3039297294 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d503660 2024-09-10T14:29:51.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d5f9740 con 0x55a88d503660 2024-09-10T14:29:51.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd914e640 1 -- 172.21.15.151:0/3039297294 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d503660 2024-09-10T14:29:51.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d5fea00 0x55a88d600df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d6014c0 con 0x55a88d5fea00 2024-09-10T14:29:51.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd894d640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d5fea00 0x55a88d600df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd894d640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d5fea00 0x55a88d600df0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd894d640 1 -- 172.21.15.151:0/3039297294 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9fd001b030 con 0x55a88d5fea00 2024-09-10T14:29:51.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d5fd870 con 0x55a88d503660 2024-09-10T14:29:51.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd914e640 1 -- 172.21.15.151:0/3039297294 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d503660 2024-09-10T14:29:51.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a88d602900 0x55a88d604cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d605460 con 0x55a88d602900 2024-09-10T14:29:51.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a88d602900 0x55a88d604cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.981+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a88d602900 0x55a88d604cf0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fd814c640 1 -- 172.21.15.151:0/3039297294 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9fc00b3040 con 0x55a88d602900 2024-09-10T14:29:51.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fdae3d980 1 Processor -- start 2024-09-10T14:29:51.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fdae3d980 1 -- start start 2024-09-10T14:29:51.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fdae3d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d612ef0 0x55a88d613310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fdae3d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a88d407800 con 0x55a88d612ef0 2024-09-10T14:29:51.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d612ef0 0x55a88d613310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d612ef0 0x55a88d613310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40224/0 (socket says 172.21.15.151:40224) 2024-09-10T14:29:51.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fd894d640 1 -- 172.21.15.151:0/1648631972 learned_addr learned my addr 172.21.15.151:0/1648631972 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fd894d640 1 -- 172.21.15.151:0/1648631972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88d613850 con 0x55a88d612ef0 2024-09-10T14:29:51.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fd894d640 1 --2- 172.21.15.151:0/1648631972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d612ef0 0x55a88d613310 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0010410 tx=0x7f9fd0029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9ebe7fc640 1 -- 172.21.15.151:0/1648631972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0038070 con 0x55a88d612ef0 2024-09-10T14:29:51.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9ebe7fc640 1 -- 172.21.15.151:0/1648631972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0041420 con 0x55a88d612ef0 2024-09-10T14:29:51.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1648631972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a88d613ae0 con 0x55a88d612ef0 2024-09-10T14:29:51.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9ebe7fc640 1 -- 172.21.15.151:0/1648631972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0041700 con 0x55a88d612ef0 2024-09-10T14:29:51.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.985+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1648631972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88d616760 con 0x55a88d612ef0 2024-09-10T14:29:51.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9ebe7fc640 1 -- 172.21.15.151:0/1648631972 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9fd0041a50 con 0x55a88d612ef0 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9ebe7fc640 1 --2- 172.21.15.151:0/1648631972 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9eb0034650 0x7f9eb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9ebe7fc640 1 -- 172.21.15.151:0/1648631972 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9fd0050d90 con 0x55a88d612ef0 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fd814c640 1 --2- 172.21.15.151:0/1648631972 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9eb0034650 0x7f9eb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 Processor -- start 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- start start 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fd814c640 1 --2- 172.21.15.151:0/1648631972 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9eb0034650 0x7f9eb0036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9fc001b2c0 tx=0x7f9fc0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d61fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a88d507520 con 0x55a88d61f840 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d61fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d61fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40228/0 (socket says 172.21.15.151:40228) 2024-09-10T14:29:51.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fd894d640 1 -- 172.21.15.151:0/1078994693 learned_addr learned my addr 172.21.15.151:0/1078994693 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fd894d640 1 -- 172.21.15.151:0/1078994693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88d6201f0 con 0x55a88d61f840 2024-09-10T14:29:51.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fd894d640 1 --2- 172.21.15.151:0/1078994693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d61fc20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0011fb0 tx=0x7f9fd0033840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82373948e648f991 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9eaffff640 1 -- 172.21.15.151:0/1078994693 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0064070 con 0x55a88d61f840 2024-09-10T14:29:51.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9eaffff640 1 -- 172.21.15.151:0/1078994693 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0012d40 con 0x55a88d61f840 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9eaffff640 1 -- 172.21.15.151:0/1078994693 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0057070 con 0x55a88d61f840 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1078994693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 msgr2=0x55a88d61fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/1078994693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d61fc20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0011fb0 tx=0x7f9fd0033840 comp rx=0 tx=0).stop 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1078994693 shutdown_connections 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/1078994693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d61fc20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1078994693 >> 172.21.15.151:0/1078994693 conn(0x55a88d61bc20 msgr2=0x55a88d619d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1078994693 shutdown_connections 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1078994693 wait complete. 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 Processor -- start 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- start start 2024-09-10T14:29:51.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d626a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.989+0000 7f9fdae3d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a88d620690 con 0x55a88d61f840 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d626a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd894d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d626a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40232/0 (socket says 172.21.15.151:40232) 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 learned_addr learned my addr 172.21.15.151:0/3664610353 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88d626f40 con 0x55a88d61f840 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd894d640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d626a00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0012fd0 tx=0x7f9fd0047740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9eae7fc640 1 -- 172.21.15.151:0/3664610353 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd0064040 con 0x55a88d61f840 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a88d626f40 con 0x55a88d61f840 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9eae7fc640 1 -- 172.21.15.151:0/3664610353 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd006f020 con 0x55a88d61f840 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9eae7fc640 1 -- 172.21.15.151:0/3664610353 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd005a040 con 0x55a88d61f840 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88d6273b0 con 0x55a88d61f840 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:51.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9eae7fc640 1 -- 172.21.15.151:0/3664610353 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9fd00333d0 con 0x55a88d61f840 2024-09-10T14:29:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9eae7fc640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ea4034600 0x7f9ea4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9eae7fc640 1 -- 172.21.15.151:0/3664610353 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9fd0070030 con 0x55a88d61f840 2024-09-10T14:29:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ea4034600 0x7f9ea4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d631ae0 0x55a88d633f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d6346d0 con 0x55a88d631ae0 2024-09-10T14:29:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd914e640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d631ae0 0x55a88d633f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ea4034600 0x7f9ea4036ac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00abaa0 tx=0x7f9fc00b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd914e640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d631ae0 0x55a88d633f80 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 20 realm 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d634ae0 con 0x55a88d631ae0 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635380 con 0x55a88d631ae0 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.993+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fdae3d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d636480 0x55a88d638870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d638df0 con 0x55a88d636480 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd894d640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d636480 0x55a88d638870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd894d640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d636480 0x55a88d638870 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fdae3d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fdae3d980 20 searching for the correct realm 2024-09-10T14:29:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63a650 con 0x55a88d636480 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd894d640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9fd0023190 0x7f9fd006e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63a650 con 0x7f9fd0023190 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9fd0023190 0x7f9fd006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9fd0023190 0x7f9fd006e590 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd814c640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9fc00dc040 0x7f9fc00ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63a650 con 0x7f9fc00dc040 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9fc00dc040 0x7f9fc00ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9fc00dc040 0x7f9fc00ce430 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:51.997+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fc00dc040 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fc00dc040 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fd0023190 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d636480 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fc00dc040 2024-09-10T14:29:52.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fd0023190 2024-09-10T14:29:52.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d636480 2024-09-10T14:29:52.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d636480 2024-09-10T14:29:52.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fd0023190 2024-09-10T14:29:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.001+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d636480 2024-09-10T14:29:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d636480 2024-09-10T14:29:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fc00dc040 2024-09-10T14:29:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d636480 2024-09-10T14:29:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fd0023190 2024-09-10T14:29:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fd0023190 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d636480 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fc00dc040 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fd0023190 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.005+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d636480 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fc00dc040 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x55a88d631ae0 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a88d635720 con 0x7f9fd0023190 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:52.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d639740 con 0x55a88d631ae0 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d639380 con 0x55a88d631ae0 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d639350 con 0x7f9fc00dc040 2024-09-10T14:29:52.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:52.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 zone default found 2024-09-10T14:29:52.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 4 Realm: () 2024-09-10T14:29:52.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:52.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:52.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:52.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 zonegroup default 2024-09-10T14:29:52.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63a0b0 con 0x7f9fd0023190 2024-09-10T14:29:52.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63c4e0 con 0x55a88d636480 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63c880 con 0x55a88d636480 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 started sync module instance, tier type = 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.009+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63b980 con 0x7f9fd0023190 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.013+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.013+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94182414990752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63b5e0 con 0x7f9fd0023190 2024-09-10T14:29:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.013+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63d6f0 con 0x55a88d631ae0 2024-09-10T14:29:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.013+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94182414990752] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.013+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.013+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94182414996032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63db10 con 0x55a88d631ae0 2024-09-10T14:29:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.013+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63e3a0 con 0x55a88d636480 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94182414998592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63ec40 con 0x55a88d636480 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63f640 con 0x7f9fd0023190 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94182414996032] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94182414997088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63fa30 con 0x7f9fd0023190 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d6403f0 con 0x55a88d631ae0 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94182414997088] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94182414998592] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94182415001488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63ff40 con 0x55a88d631ae0 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.017+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d640900 con 0x7f9fc00dc040 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.021+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94182415001488] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.021+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.021+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94182415003984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d640900 con 0x7f9fc00dc040 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.021+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d641150 con 0x7f9fc00dc040 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94182415003984] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94182415009328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d641020 con 0x7f9fc00dc040 2024-09-10T14:29:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d641b40 con 0x7f9fc00dc040 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94182415013392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d641b00 con 0x7f9fc00dc040 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 20 add_watcher() i=0 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 20 add_watcher() i=1 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 20 add_watcher() i=2 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 20 add_watcher() i=3 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 20 add_watcher() i=4 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 20 add_watcher() i=5 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94182415009328] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.025+0000 7f9fdae3d980 20 add_watcher() i=6 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94182415013392] v36'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 20 add_watcher() i=7 2024-09-10T14:29:52.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d640a90 con 0x55a88d631ae0 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94182415010448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d642500 con 0x55a88d631ae0 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94182415010448] v36'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9e8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 5 note: GC not initialized 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9e8dfe3640 20 reqs_thread_entry: start 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 20 Filter name: none 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9dff7fe640 20 reqs_thread_entry: start 2024-09-10T14:29:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d668170 con 0x55a88d631ae0 2024-09-10T14:29:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:29:52.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a88d6696c0 con 0x7f9fc00dc040 2024-09-10T14:29:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.029+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.033+0000 7f9e8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:52.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.033+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94182415010448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d6668d0 con 0x55a88d631ae0 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.033+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94182415010448] v36'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.033+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94182414990752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d640a90 con 0x7f9fd0023190 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.033+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94182414990752] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.033+0000 7f9fdae3d980 20 remove_watcher() i=0 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.033+0000 7f9fdae3d980 2 removed watcher, disabling cache 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.033+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94182414996032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63bda0 con 0x55a88d631ae0 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94182414996032] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fdae3d980 20 remove_watcher() i=1 2024-09-10T14:29:52.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94182414998592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63d240 con 0x55a88d636480 2024-09-10T14:29:52.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fd894d640 1 -- 172.21.15.151:0/3664610353 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94182414998592] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd0067070 con 0x55a88d636480 2024-09-10T14:29:52.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fdae3d980 20 remove_watcher() i=2 2024-09-10T14:29:52.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94182414997088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63d240 con 0x7f9fd0023190 2024-09-10T14:29:52.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fd814c640 1 -- 172.21.15.151:0/3664610353 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94182414997088] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00c9030 con 0x7f9fd0023190 2024-09-10T14:29:52.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fdae3d980 20 remove_watcher() i=3 2024-09-10T14:29:52.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.037+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94182415001488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63bda0 con 0x55a88d631ae0 2024-09-10T14:29:52.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.041+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94182415001488] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x55a88d631ae0 2024-09-10T14:29:52.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.041+0000 7f9fdae3d980 20 remove_watcher() i=4 2024-09-10T14:29:52.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.041+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94182415003984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63e790 con 0x7f9fc00dc040 2024-09-10T14:29:52.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.041+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94182415003984] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.041+0000 7f9fdae3d980 20 remove_watcher() i=5 2024-09-10T14:29:52.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.041+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94182415009328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63e790 con 0x7f9fc00dc040 2024-09-10T14:29:52.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.045+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94182415009328] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.045+0000 7f9fdae3d980 20 remove_watcher() i=6 2024-09-10T14:29:52.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.045+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94182415013392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a88d63e790 con 0x7f9fc00dc040 2024-09-10T14:29:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94182415013392] v36'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc80083f0 con 0x7f9fc00dc040 2024-09-10T14:29:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 20 remove_watcher() i=7 2024-09-10T14:29:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9fc00dc040 msgr2=0x7f9fc00ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f9fc00dc040 0x7f9fc00ce430 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d631ae0 msgr2=0x55a88d633f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d631ae0 0x55a88d633f80 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9fd0023190 msgr2=0x7f9fd006e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9fd0023190 0x7f9fd006e590 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d636480 msgr2=0x55a88d638870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d636480 0x55a88d638870 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ea4034600 msgr2=0x7f9ea4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ea4034600 0x7f9ea4036ac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00abaa0 tx=0x7f9fc00b9040 comp rx=0 tx=0).stop 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 msgr2=0x55a88d626a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fd914e640 1 -- 172.21.15.151:0/3664610353 reap_dead start 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d626a00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0012fd0 tx=0x7f9fd0047740 comp rx=0 tx=0).stop 2024-09-10T14:29:52.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 shutdown_connections 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3664610353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d61f840 0x55a88d626a00 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 >> 172.21.15.151:0/3664610353 conn(0x55a88d61bc20 msgr2=0x55a88d619cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 shutdown_connections 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3664610353 wait complete. 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1648631972 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9eb0034650 msgr2=0x7f9eb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/1648631972 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9eb0034650 0x7f9eb0036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9fc001b2c0 tx=0x7f9fc0005a10 comp rx=0 tx=0).stop 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1648631972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d612ef0 msgr2=0x55a88d613310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/1648631972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d612ef0 0x55a88d613310 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0010410 tx=0x7f9fd0029840 comp rx=0 tx=0).stop 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1648631972 shutdown_connections 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/1648631972 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9eb0034650 0x7f9eb0036b10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/1648631972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d612ef0 0x55a88d613310 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1648631972 >> 172.21.15.151:0/1648631972 conn(0x55a88d608040 msgr2=0x55a88d60aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1648631972 shutdown_connections 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/1648631972 wait complete. 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a88d602900 msgr2=0x55a88d604cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a88d602900 0x55a88d604cf0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d503660 msgr2=0x55a88d5fc060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a88d503660 0x55a88d5fc060 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d5fea00 msgr2=0x55a88d600df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a88d5fea00 0x55a88d600df0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ec00346a0 msgr2=0x7f9ec0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f9ec00346a0 0x7f9ec0036b60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ad000 tx=0x7f9fc00a5040 comp rx=0 tx=0).stop 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 msgr2=0x55a88d5f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 --2- 172.21.15.151:0/3039297294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a88d4ffb50 0x55a88d5f5070 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x55a88d5088b0 tx=0x7f9fd0000f50 comp rx=0 tx=0).stop 2024-09-10T14:29:52.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fd914e640 1 -- 172.21.15.151:0/3039297294 reap_dead start 2024-09-10T14:29:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 shutdown_connections 2024-09-10T14:29:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 >> 172.21.15.151:0/3039297294 conn(0x55a88d4fa7b0 msgr2=0x55a88d5e7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 shutdown_connections 2024-09-10T14:29:52.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.049+0000 7f9fdae3d980 1 -- 172.21.15.151:0/3039297294 wait complete. 2024-09-10T14:29:52.061 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-10T14:00:00.000000Z","epoch":1725976800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-10T14:29:52.061 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-10T14:29:52.062 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T14:29:52.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T14:29:52.062 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-10T14:29:52.139 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:52.139 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079d1a3980 1 Processor -- start 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079d1a3980 1 -- start start 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079d1a3980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560975a0dca0 0x560975a10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079d1a3980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56097588fae0 con 0x560975a09920 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079d1a3980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5609758b3e30 con 0x560975a0dca0 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079a4b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560975a0dca0 0x560975a10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079a4b2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560975a0dca0 0x560975a10090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40246/0 (socket says 172.21.15.151:40246) 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079a4b2640 1 -- 172.21.15.151:0/2384880589 learned_addr learned my addr 172.21.15.151:0/2384880589 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079acb3640 1 --1- 172.21.15.151:0/2384880589 >> v1:172.21.15.52:6789/0 conn(0x560975a09920 0x560975a09d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:52620/0 (socket says 172.21.15.151:52620) 2024-09-10T14:29:52.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079a4b2640 1 -- 172.21.15.151:0/2384880589 >> v1:172.21.15.52:6789/0 conn(0x560975a09920 legacy=0x560975a09d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.137+0000 7f079a4b2640 1 -- 172.21.15.151:0/2384880589 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560975a115e0 con 0x560975a0dca0 2024-09-10T14:29:52.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f079a4b2640 1 --2- 172.21.15.151:0/2384880589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 0x560975a10090 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f078400a4e0 tx=0x7f078401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a80e7a57fff779 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f0799cb1640 1 -- 172.21.15.151:0/2384880589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07840aa540 con 0x560975a0dca0 2024-09-10T14:29:52.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f0799cb1640 1 -- 172.21.15.151:0/2384880589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07840aa6e0 con 0x560975a0dca0 2024-09-10T14:29:52.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f0799cb1640 1 -- 172.21.15.151:0/2384880589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07840aaa40 con 0x560975a0dca0 2024-09-10T14:29:52.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f079d1a3980 1 -- 172.21.15.151:0/2384880589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 msgr2=0x560975a10090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2384880589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 0x560975a10090 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f078400a4e0 tx=0x7f078401b090 comp rx=0 tx=0).stop 2024-09-10T14:29:52.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f079d1a3980 1 -- 172.21.15.151:0/2384880589 shutdown_connections 2024-09-10T14:29:52.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2384880589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 0x560975a10090 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f079d1a3980 1 -- 172.21.15.151:0/2384880589 >> 172.21.15.151:0/2384880589 conn(0x56097597d270 msgr2=0x56097597d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f079d1a3980 1 -- 172.21.15.151:0/2384880589 shutdown_connections 2024-09-10T14:29:52.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.141+0000 7f079d1a3980 1 -- 172.21.15.151:0/2384880589 wait complete. 2024-09-10T14:29:52.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.153+0000 7f079d1a3980 1 Processor -- start 2024-09-10T14:29:52.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.153+0000 7f079d1a3980 1 -- start start 2024-09-10T14:29:52.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.153+0000 7f079d1a3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a09920 0x560975af4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.153+0000 7f079d1a3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5609758b5200 con 0x560975a09920 2024-09-10T14:29:52.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.153+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a09920 0x560975af4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.153+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a09920 0x560975af4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40254/0 (socket says 172.21.15.151:40254) 2024-09-10T14:29:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.153+0000 7f079acb3640 1 -- 172.21.15.151:0/1103690167 learned_addr learned my addr 172.21.15.151:0/1103690167 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.153+0000 7f079acb3640 1 -- 172.21.15.151:0/1103690167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560975af5300 con 0x560975a09920 2024-09-10T14:29:52.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079acb3640 1 --2- 172.21.15.151:0/1103690167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a09920 0x560975af4d30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f078c00b240 tx=0x7f078c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d394cc4a4da141c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f0688e09640 1 -- 172.21.15.151:0/1103690167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c00e700 con 0x560975a09920 2024-09-10T14:29:52.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f0688e09640 1 -- 172.21.15.151:0/1103690167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c00e8a0 con 0x560975a09920 2024-09-10T14:29:52.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f0688e09640 1 -- 172.21.15.151:0/1103690167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c00eb80 con 0x560975a09920 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- 172.21.15.151:0/1103690167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a09920 msgr2=0x560975af4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1103690167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a09920 0x560975af4d30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f078c00b240 tx=0x7f078c00b700 comp rx=0 tx=0).stop 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- 172.21.15.151:0/1103690167 shutdown_connections 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1103690167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a09920 0x560975af4d30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- 172.21.15.151:0/1103690167 >> 172.21.15.151:0/1103690167 conn(0x56097597d270 msgr2=0x560975af0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- 172.21.15.151:0/1103690167 shutdown_connections 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- 172.21.15.151:0/1103690167 wait complete. 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 Processor -- start 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- start start 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 0x560975afc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560975a110e0 con 0x560975a0dca0 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 0x560975afc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 0x560975afc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40260/0 (socket says 172.21.15.151:40260) 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079acb3640 1 -- 172.21.15.151:0/2088876812 learned_addr learned my addr 172.21.15.151:0/2088876812 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079acb3640 1 -- 172.21.15.151:0/2088876812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560975afc820 con 0x560975a0dca0 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079acb3640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 0x560975afc2e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f078c000c10 tx=0x7f078c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f0687606640 1 -- 172.21.15.151:0/2088876812 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c001530 con 0x560975a0dca0 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560975afcab0 con 0x560975a0dca0 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560975aff790 con 0x560975a0dca0 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f0687606640 1 -- 172.21.15.151:0/2088876812 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c00f9f0 con 0x560975a0dca0 2024-09-10T14:29:52.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.157+0000 7f0687606640 1 -- 172.21.15.151:0/2088876812 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c02c060 con 0x560975a0dca0 2024-09-10T14:29:52.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f0687606640 1 -- 172.21.15.151:0/2088876812 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f078c017070 con 0x560975a0dca0 2024-09-10T14:29:52.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f0687606640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0680034650 0x7f0680036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f0687606640 1 -- 172.21.15.151:0/2088876812 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f078c015020 con 0x560975a0dca0 2024-09-10T14:29:52.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079a4b2640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0680034650 0x7f0680036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b01260 0x560975b03650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b03ca0 con 0x560975b01260 2024-09-10T14:29:52.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079b4b4640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b01260 0x560975b03650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079a4b2640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0680034650 0x7f0680036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f07840ab000 tx=0x7f07840a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079b4b4640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b01260 0x560975b03650 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079b4b4640 1 -- 172.21.15.151:0/2088876812 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b01260 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b009b0 con 0x560975b01260 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079b4b4640 1 -- 172.21.15.151:0/2088876812 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07940083f0 con 0x560975b01260 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b05fd0 0x560975b083c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b08ab0 con 0x560975b05fd0 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079acb3640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b05fd0 0x560975b083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079acb3640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b05fd0 0x560975b083c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079acb3640 1 -- 172.21.15.151:0/2088876812 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f078c02e070 con 0x560975b05fd0 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b04e70 con 0x560975b01260 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079b4b4640 1 -- 172.21.15.151:0/2088876812 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07940083f0 con 0x560975b01260 2024-09-10T14:29:52.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560975b09f10 0x560975b0c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b0ca40 con 0x560975b09f10 2024-09-10T14:29:52.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.161+0000 7f079a4b2640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560975b09f10 0x560975b0c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079a4b2640 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560975b09f10 0x560975b0c300 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079a4b2640 1 -- 172.21.15.151:0/2088876812 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07840bc040 con 0x560975b09f10 2024-09-10T14:29:52.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079d1a3980 1 Processor -- start 2024-09-10T14:29:52.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079d1a3980 1 -- start start 2024-09-10T14:29:52.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079d1a3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b1a510 0x560975b1a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079d1a3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56097590e800 con 0x560975b1a510 2024-09-10T14:29:52.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b1a510 0x560975b1a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b1a510 0x560975b1a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40268/0 (socket says 172.21.15.151:40268) 2024-09-10T14:29:52.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079acb3640 1 -- 172.21.15.151:0/575002918 learned_addr learned my addr 172.21.15.151:0/575002918 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079acb3640 1 -- 172.21.15.151:0/575002918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560975b1ae70 con 0x560975b1a510 2024-09-10T14:29:52.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079acb3640 1 --2- 172.21.15.151:0/575002918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b1a510 0x560975b1a930 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f078c048ce0 tx=0x7f078c043e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f0684e01640 1 -- 172.21.15.151:0/575002918 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c01bd50 con 0x560975b1a510 2024-09-10T14:29:52.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f0684e01640 1 -- 172.21.15.151:0/575002918 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c01a480 con 0x560975b1a510 2024-09-10T14:29:52.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079d1a3980 1 -- 172.21.15.151:0/575002918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560975b1b100 con 0x560975b1a510 2024-09-10T14:29:52.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f0684e01640 1 -- 172.21.15.151:0/575002918 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c01a760 con 0x560975b1a510 2024-09-10T14:29:52.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.165+0000 7f079d1a3980 1 -- 172.21.15.151:0/575002918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560975b1b100 con 0x560975b1a510 2024-09-10T14:29:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f0684e01640 1 -- 172.21.15.151:0/575002918 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f078c04ab40 con 0x560975b1a510 2024-09-10T14:29:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f0684e01640 1 --2- 172.21.15.151:0/575002918 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0674034650 0x7f0674036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f0684e01640 1 -- 172.21.15.151:0/575002918 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f078c03fd80 con 0x560975b1a510 2024-09-10T14:29:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079a4b2640 1 --2- 172.21.15.151:0/575002918 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0674034650 0x7f0674036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 Processor -- start 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- start start 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b27090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560975af5680 con 0x560975b26c90 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079a4b2640 1 --2- 172.21.15.151:0/575002918 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0674034650 0x7f0674036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x560975b04150 tx=0x7f0784005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b27090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b27090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40282/0 (socket says 172.21.15.151:40282) 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079acb3640 1 -- 172.21.15.151:0/3355273656 learned_addr learned my addr 172.21.15.151:0/3355273656 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079acb3640 1 -- 172.21.15.151:0/3355273656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560975b27660 con 0x560975b26c90 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079acb3640 1 --2- 172.21.15.151:0/3355273656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b27090 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f078c02aff0 tx=0x7f078c027560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ad0e20ea42b563 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f067e7fc640 1 -- 172.21.15.151:0/3355273656 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c032460 con 0x560975b26c90 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f067e7fc640 1 -- 172.21.15.151:0/3355273656 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c049050 con 0x560975b26c90 2024-09-10T14:29:52.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f067e7fc640 1 -- 172.21.15.151:0/3355273656 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c004140 con 0x560975b26c90 2024-09-10T14:29:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- 172.21.15.151:0/3355273656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 msgr2=0x560975b27090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 --2- 172.21.15.151:0/3355273656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b27090 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f078c02aff0 tx=0x7f078c027560 comp rx=0 tx=0).stop 2024-09-10T14:29:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- 172.21.15.151:0/3355273656 shutdown_connections 2024-09-10T14:29:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 --2- 172.21.15.151:0/3355273656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b27090 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- 172.21.15.151:0/3355273656 >> 172.21.15.151:0/3355273656 conn(0x560975b23070 msgr2=0x560975b21170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- 172.21.15.151:0/3355273656 shutdown_connections 2024-09-10T14:29:52.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- 172.21.15.151:0/3355273656 wait complete. 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 Processor -- start 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- start start 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b2dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.169+0000 7f079d1a3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560975b27660 con 0x560975b26c90 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b2dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079acb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b2dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40284/0 (socket says 172.21.15.151:40284) 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 learned_addr learned my addr 172.21.15.151:0/1872532291 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560975b2e2e0 con 0x560975b26c90 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079acb3640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b2dda0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f078c032bc0 tx=0x7f078c010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f067cff9640 1 -- 172.21.15.151:0/1872532291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c0470c0 con 0x560975b26c90 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560975b2e2e0 con 0x560975b26c90 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f067cff9640 1 -- 172.21.15.151:0/1872532291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c069070 con 0x560975b26c90 2024-09-10T14:29:52.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f067cff9640 1 -- 172.21.15.151:0/1872532291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f078c027da0 con 0x560975b26c90 2024-09-10T14:29:52.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560975b2e750 con 0x560975b26c90 2024-09-10T14:29:52.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f067cff9640 1 -- 172.21.15.151:0/1872532291 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f078c027880 con 0x560975b26c90 2024-09-10T14:29:52.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f067cff9640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0664034600 0x7f0664036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f067cff9640 1 -- 172.21.15.151:0/1872532291 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f078c0381a0 con 0x560975b26c90 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079a4b2640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0664034600 0x7f0664036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b38cb0 0x560975b3b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b3b8c0 con 0x560975b38cb0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079b4b4640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b38cb0 0x560975b3b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079a4b2640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0664034600 0x7f0664036ac0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f078400a190 tx=0x7f07840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.173+0000 7f079b4b4640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b38cb0 0x560975b3b170 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 realm 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b3bcd0 con 0x560975b38cb0 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c5a0 con 0x560975b38cb0 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b3d6a0 0x560975b3fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b40060 con 0x560975b3d6a0 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079acb3640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b3d6a0 0x560975b3fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079acb3640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b3d6a0 0x560975b3fa90 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 20 searching for the correct realm 2024-09-10T14:29:52.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b41930 con 0x560975b3d6a0 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079acb3640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x560975a09920 0x7f078c05a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b41930 con 0x560975a09920 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079a4b2640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x560975a09920 0x7f078c05a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079a4b2640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x560975a09920 0x7f078c05a910 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079a4b2640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07840cd050 0x7f07840cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b41930 con 0x7f07840cd050 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079b4b4640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07840cd050 0x7f07840cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.177+0000 7f079b4b4640 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07840cd050 0x7f07840cd430 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x7f07840cd050 2024-09-10T14:29:52.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x7f07840cd050 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975a09920 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b3d6a0 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x7f07840cd050 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.181+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975a09920 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b3d6a0 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b3d6a0 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975a09920 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b3d6a0 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b3d6a0 2024-09-10T14:29:52.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x7f07840cd050 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b3d6a0 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975a09920 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975a09920 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b3d6a0 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.185+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x7f07840cd050 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975a09920 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b3d6a0 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x7f07840cd050 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975b38cb0 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560975b3c940 con 0x560975a09920 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b40a20 con 0x560975b38cb0 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b412c0 con 0x560975b38cb0 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.189+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b40e10 con 0x7f07840cd050 2024-09-10T14:29:52.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 zone default found 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 4 Realm: () 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 zonegroup default 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b41240 con 0x560975a09920 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b43770 con 0x560975b3d6a0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b43c90 con 0x560975b3d6a0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 started sync module instance, tier type = 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b42be0 con 0x560975a09920 2024-09-10T14:29:52.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94598629437392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b445a0 con 0x560975a09920 2024-09-10T14:29:52.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b44df0 con 0x560975b38cb0 2024-09-10T14:29:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.193+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94598629437392] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94598629441776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b44df0 con 0x560975b38cb0 2024-09-10T14:29:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b45810 con 0x560975b3d6a0 2024-09-10T14:29:52.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94598629446400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b460e0 con 0x560975b3d6a0 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b46b00 con 0x560975a09920 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94598629441776] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94598629451248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b46ef0 con 0x560975a09920 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.197+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b478b0 con 0x560975b38cb0 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94598629451248] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94598629446400] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94598629443904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b45d40 con 0x560975b38cb0 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b47fe0 con 0x7f07840cd050 2024-09-10T14:29:52.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94598629443904] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94598629456592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b47fa0 con 0x7f07840cd050 2024-09-10T14:29:52.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.201+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b48960 con 0x7f07840cd050 2024-09-10T14:29:52.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94598629456592] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94598629454848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b48960 con 0x7f07840cd050 2024-09-10T14:29:52.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b48960 con 0x7f07840cd050 2024-09-10T14:29:52.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94598629461616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b497c0 con 0x7f07840cd050 2024-09-10T14:29:52.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 20 add_watcher() i=0 2024-09-10T14:29:52.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 20 add_watcher() i=1 2024-09-10T14:29:52.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 20 add_watcher() i=2 2024-09-10T14:29:52.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 20 add_watcher() i=3 2024-09-10T14:29:52.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 20 add_watcher() i=4 2024-09-10T14:29:52.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.205+0000 7f079d1a3980 20 add_watcher() i=5 2024-09-10T14:29:52.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94598629454848] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 20 add_watcher() i=6 2024-09-10T14:29:52.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94598629461616] v36'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 20 add_watcher() i=7 2024-09-10T14:29:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b484b0 con 0x560975b38cb0 2024-09-10T14:29:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94598629459120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b49d40 con 0x560975b38cb0 2024-09-10T14:29:52.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94598629459120] v36'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f06517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 5 note: GC not initialized 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f05cbfff640 20 reqs_thread_entry: start 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.209+0000 7f079d1a3980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 20 Filter name: none 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f05c9ffb640 20 reqs_thread_entry: start 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b6ff00 con 0x7f07840cd050 2024-09-10T14:29:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T14:29:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T14:29:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-10T14:29:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b6e6a0 con 0x560975b38cb0 2024-09-10T14:29:52.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-10T14:29:52.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T14:29:52.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T14:29:52.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T14:29:52.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b6ef40 con 0x7f07840cd050 2024-09-10T14:29:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v36'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T14:29:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T14:29:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T14:29:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.213+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94598629616272 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b739a0 con 0x7f07840cd050 2024-09-10T14:29:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== watch-notify(notify (1) cookie 94598629461616 notify 154618822672 ret 0) ==== 598+0+0 (crc 0 0 0) 0x560975b6f2e0 con 0x7f07840cd050 2024-09-10T14:29:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(65 notify.7 [notify cookie 94598629616272 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f067dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822672 cookie 94598629461616 notifier 4722 bl.length()=556 2024-09-10T14:29:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f067dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T14:29:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f067dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T14:29:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f067dffb640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f05d0003440 con 0x7f07840cd050 2024-09-10T14:29:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== watch-notify(notify_complete (2) cookie 94598629616272 notify 154618822672 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560975b6f950 con 0x7f07840cd050 2024-09-10T14:29:52.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b714d0 con 0x560975b38cb0 2024-09-10T14:29:52.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v36'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079d1a3980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T14:29:52.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079d1a3980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T14:29:52.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079d1a3980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T14:29:52.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94598629616160 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560975b739a0 con 0x7f07840cd050 2024-09-10T14:29:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== watch-notify(notify (1) cookie 94598629456592 notify 154618822673 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560975b6f950 con 0x7f07840cd050 2024-09-10T14:29:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f067dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822673 cookie 94598629456592 notifier 4722 bl.length()=177 2024-09-10T14:29:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f067dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T14:29:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f067dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T14:29:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f067dffb640 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f05d0003400 con 0x7f07840cd050 2024-09-10T14:29:52.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.217+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(68 notify.5 [notify cookie 94598629616160 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== watch-notify(notify_complete (2) cookie 94598629616160 notify 154618822673 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0794010040 con 0x7f07840cd050 2024-09-10T14:29:52.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.223 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T14:29:52.216548Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:29:52.216530Z","tags":[],"group_ids":[]} 2024-09-10T14:29:52.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f06517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:52.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94598629459120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b6dca0 con 0x560975b38cb0 2024-09-10T14:29:52.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94598629459120] v36'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94598629437392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b6dca0 con 0x560975a09920 2024-09-10T14:29:52.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94598629437392] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079d1a3980 20 remove_watcher() i=0 2024-09-10T14:29:52.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079d1a3980 2 removed watcher, disabling cache 2024-09-10T14:29:52.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.221+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94598629441776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b6dca0 con 0x560975b38cb0 2024-09-10T14:29:52.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.225+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94598629441776] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.225+0000 7f079d1a3980 20 remove_watcher() i=1 2024-09-10T14:29:52.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.225+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94598629446400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b440f0 con 0x560975b3d6a0 2024-09-10T14:29:52.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.225+0000 7f079acb3640 1 -- 172.21.15.151:0/1872532291 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94598629446400] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f078c02e070 con 0x560975b3d6a0 2024-09-10T14:29:52.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.225+0000 7f079d1a3980 20 remove_watcher() i=2 2024-09-10T14:29:52.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.225+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94598629451248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b6dca0 con 0x560975a09920 2024-09-10T14:29:52.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.229+0000 7f079a4b2640 1 -- 172.21.15.151:0/1872532291 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94598629451248] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07840ca070 con 0x560975a09920 2024-09-10T14:29:52.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.229+0000 7f079d1a3980 20 remove_watcher() i=3 2024-09-10T14:29:52.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.229+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94598629443904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b440f0 con 0x560975b38cb0 2024-09-10T14:29:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.229+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94598629443904] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x560975b38cb0 2024-09-10T14:29:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.229+0000 7f079d1a3980 20 remove_watcher() i=4 2024-09-10T14:29:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.229+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94598629456592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b6dca0 con 0x7f07840cd050 2024-09-10T14:29:52.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.233+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94598629456592] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.233+0000 7f079d1a3980 20 remove_watcher() i=5 2024-09-10T14:29:52.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.233+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94598629454848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b44940 con 0x7f07840cd050 2024-09-10T14:29:52.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.233+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94598629454848] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.233+0000 7f079d1a3980 20 remove_watcher() i=6 2024-09-10T14:29:52.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.233+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94598629461616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560975b440f0 con 0x7f07840cd050 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94598629461616] v36'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07940083f0 con 0x7f07840cd050 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 20 remove_watcher() i=7 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07840cd050 msgr2=0x7f07840cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f07840cd050 0x7f07840cd430 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b38cb0 msgr2=0x560975b3b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b38cb0 0x560975b3b170 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x560975a09920 msgr2=0x7f078c05a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x560975a09920 0x7f078c05a910 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b3d6a0 msgr2=0x560975b3fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b3d6a0 0x560975b3fa90 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0664034600 msgr2=0x7f0664036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0664034600 0x7f0664036ac0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f078400a190 tx=0x7f07840a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079b4b4640 1 -- 172.21.15.151:0/1872532291 reap_dead start 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 msgr2=0x560975b2dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b2dda0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f078c032bc0 tx=0x7f078c010e70 comp rx=0 tx=0).stop 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 shutdown_connections 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/1872532291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b26c90 0x560975b2dda0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 >> 172.21.15.151:0/1872532291 conn(0x560975b23070 msgr2=0x560975b21140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 shutdown_connections 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/1872532291 wait complete. 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/575002918 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0674034650 msgr2=0x7f0674036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/575002918 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0674034650 0x7f0674036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x560975b04150 tx=0x7f0784005e50 comp rx=0 tx=0).stop 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/575002918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b1a510 msgr2=0x560975b1a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/575002918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b1a510 0x560975b1a930 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f078c048ce0 tx=0x7f078c043e80 comp rx=0 tx=0).stop 2024-09-10T14:29:52.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/575002918 shutdown_connections 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/575002918 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0674034650 0x7f0674036b10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/575002918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975b1a510 0x560975b1a930 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/575002918 >> 172.21.15.151:0/575002918 conn(0x560975b0f660 msgr2=0x560975b120e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/575002918 shutdown_connections 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/575002918 wait complete. 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560975b09f10 msgr2=0x560975b0c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560975b09f10 0x560975b0c300 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b01260 msgr2=0x560975b03650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560975b01260 0x560975b03650 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b05fd0 msgr2=0x560975b083c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560975b05fd0 0x560975b083c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0680034650 msgr2=0x7f0680036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0680034650 0x7f0680036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f07840ab000 tx=0x7f07840a5000 comp rx=0 tx=0).stop 2024-09-10T14:29:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 msgr2=0x560975afc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 --2- 172.21.15.151:0/2088876812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560975a0dca0 0x560975afc2e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f078c000c10 tx=0x7f078c000ee0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079b4b4640 1 -- 172.21.15.151:0/2088876812 reap_dead start 2024-09-10T14:29:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 shutdown_connections 2024-09-10T14:29:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 >> 172.21.15.151:0/2088876812 conn(0x56097597d270 msgr2=0x560975aef4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 shutdown_connections 2024-09-10T14:29:52.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.237+0000 7f079d1a3980 1 -- 172.21.15.151:0/2088876812 wait complete. 2024-09-10T14:29:52.250 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T14:29:52.216548Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:29:52.216530Z', 'tags': [], 'group_ids': []} 2024-09-10T14:29:52.266 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:52.272 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-10T14:29:52.272 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T14:29:52.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T14:29:52.272 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-10T14:29:52.320 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:52.320 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:52.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c33ca980 1 Processor -- start 2024-09-10T14:29:52.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c33ca980 1 -- start start 2024-09-10T14:29:52.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c33ca980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d04ea04940 0x55d04ea06d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c33ca980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d04e886ae0 con 0x55d04ea00e00 2024-09-10T14:29:52.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c33ca980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55d04e8aae30 con 0x55d04ea04940 2024-09-10T14:29:52.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c06d9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d04ea04940 0x55d04ea06d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c06d9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d04ea04940 0x55d04ea06d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40300/0 (socket says 172.21.15.151:40300) 2024-09-10T14:29:52.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c06d9640 1 -- 172.21.15.151:0/215991369 learned_addr learned my addr 172.21.15.151:0/215991369 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c0eda640 1 --1- 172.21.15.151:0/215991369 >> v1:172.21.15.52:6789/0 conn(0x55d04ea00e00 0x55d04ea031f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:52624/0 (socket says 172.21.15.151:52624) 2024-09-10T14:29:52.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c06d9640 1 -- 172.21.15.151:0/215991369 >> v1:172.21.15.52:6789/0 conn(0x55d04ea00e00 legacy=0x55d04ea031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.317+0000 7fb3c06d9640 1 -- 172.21.15.151:0/215991369 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04ea08400 con 0x55d04ea04940 2024-09-10T14:29:52.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/215991369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea04940 0x55d04ea06d60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400a5c0 tx=0x7fb3b401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7185b2fc3d0495 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3bfed8640 1 -- 172.21.15.151:0/215991369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b40a6070 con 0x55d04ea04940 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3bfed8640 1 -- 172.21.15.151:0/215991369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b40af070 con 0x55d04ea04940 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3bfed8640 1 -- 172.21.15.151:0/215991369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b40aa5c0 con 0x55d04ea04940 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3c33ca980 1 -- 172.21.15.151:0/215991369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea04940 msgr2=0x55d04ea06d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/215991369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea04940 0x55d04ea06d60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400a5c0 tx=0x7fb3b401b340 comp rx=0 tx=0).stop 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3c33ca980 1 -- 172.21.15.151:0/215991369 shutdown_connections 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/215991369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea04940 0x55d04ea06d60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3c33ca980 1 -- 172.21.15.151:0/215991369 >> 172.21.15.151:0/215991369 conn(0x55d04e974290 msgr2=0x55d04e9746a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3c33ca980 1 -- 172.21.15.151:0/215991369 shutdown_connections 2024-09-10T14:29:52.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.321+0000 7fb3c33ca980 1 -- 172.21.15.151:0/215991369 wait complete. 2024-09-10T14:29:52.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 Processor -- start 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- start start 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaebca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d04e8ac200 con 0x55d04ea00e00 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaebca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaebca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40310/0 (socket says 172.21.15.151:40310) 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c0eda640 1 -- 172.21.15.151:0/3024812525 learned_addr learned my addr 172.21.15.151:0/3024812525 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c0eda640 1 -- 172.21.15.151:0/3024812525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04eaec270 con 0x55d04ea00e00 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/3024812525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaebca0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000b240 tx=0x7fb3b000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933bb4191c6d3ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb2aee0d640 1 -- 172.21.15.151:0/3024812525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b000e700 con 0x55d04ea00e00 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb2aee0d640 1 -- 172.21.15.151:0/3024812525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b000e8a0 con 0x55d04ea00e00 2024-09-10T14:29:52.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb2aee0d640 1 -- 172.21.15.151:0/3024812525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b000eb80 con 0x55d04ea00e00 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3024812525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 msgr2=0x55d04eaebca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/3024812525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaebca0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000b240 tx=0x7fb3b000b700 comp rx=0 tx=0).stop 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3024812525 shutdown_connections 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/3024812525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaebca0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3024812525 >> 172.21.15.151:0/3024812525 conn(0x55d04e974290 msgr2=0x55d04eae78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3024812525 shutdown_connections 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3024812525 wait complete. 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 Processor -- start 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- start start 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaf2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c33ca980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d04ea07ed0 con 0x55d04ea00e00 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaf2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaf2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40324/0 (socket says 172.21.15.151:40324) 2024-09-10T14:29:52.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.337+0000 7fb3c0eda640 1 -- 172.21.15.151:0/473602727 learned_addr learned my addr 172.21.15.151:0/473602727 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c0eda640 1 -- 172.21.15.151:0/473602727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04eaf3490 con 0x55d04ea00e00 2024-09-10T14:29:52.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaf2f50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0000c10 tx=0x7fb3b0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb2ad60a640 1 -- 172.21.15.151:0/473602727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b000fa90 con 0x55d04ea00e00 2024-09-10T14:29:52.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d04eaf3720 con 0x55d04ea00e00 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb2ad60a640 1 -- 172.21.15.151:0/473602727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b000fc50 con 0x55d04ea00e00 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb2ad60a640 1 -- 172.21.15.151:0/473602727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b001a480 con 0x55d04ea00e00 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d04eaf6400 con 0x55d04ea00e00 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb2ad60a640 1 -- 172.21.15.151:0/473602727 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb3b0017070 con 0x55d04ea00e00 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb2ad60a640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2a8034650 0x7fb2a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb2ad60a640 1 -- 172.21.15.151:0/473602727 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb3b0015020 con 0x55d04ea00e00 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2a8034650 0x7fb2a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04ea04940 0x55d04eaf9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eafa500 con 0x55d04ea04940 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c16db640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04ea04940 0x55d04eaf9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2a8034650 0x7fb2a8036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40ae000 tx=0x7fb3b40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c16db640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04ea04940 0x55d04eaf9ee0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c16db640 1 -- 172.21.15.151:0/473602727 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04ea04940 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eaf7620 con 0x55d04ea04940 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c16db640 1 -- 172.21.15.151:0/473602727 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04ea04940 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eafc8a0 0x55d04eafec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eaff360 con 0x55d04eafc8a0 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eafc8a0 0x55d04eafec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.341+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eafc8a0 0x55d04eafec90 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c0eda640 1 -- 172.21.15.151:0/473602727 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb3b002e070 con 0x55d04eafc8a0 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eafb740 con 0x55d04ea04940 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c16db640 1 -- 172.21.15.151:0/473602727 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04ea04940 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d04eb007a0 0x55d04eb02b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb03320 con 0x55d04eb007a0 2024-09-10T14:29:52.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d04eb007a0 0x55d04eb02b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d04eb007a0 0x55d04eb02b90 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c06d9640 1 -- 172.21.15.151:0/473602727 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb3b40aaad0 con 0x55d04eb007a0 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c33ca980 1 Processor -- start 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c33ca980 1 -- start start 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c33ca980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb10d70 0x55d04eb11190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c33ca980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d04e905800 con 0x55d04eb10d70 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb10d70 0x55d04eb11190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb10d70 0x55d04eb11190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40334/0 (socket says 172.21.15.151:40334) 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.345+0000 7fb3c0eda640 1 -- 172.21.15.151:0/3995319027 learned_addr learned my addr 172.21.15.151:0/3995319027 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c0eda640 1 -- 172.21.15.151:0/3995319027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04eb116d0 con 0x55d04eb10d70 2024-09-10T14:29:52.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/3995319027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb10d70 0x55d04eb11190 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0048ee0 tx=0x7fb3b0019e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb2a67fc640 1 -- 172.21.15.151:0/3995319027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b003e020 con 0x55d04eb10d70 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb2a67fc640 1 -- 172.21.15.151:0/3995319027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0042640 con 0x55d04eb10d70 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb2a67fc640 1 -- 172.21.15.151:0/3995319027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0042920 con 0x55d04eb10d70 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3995319027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d04eb11900 con 0x55d04eb10d70 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3995319027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d04eb11900 con 0x55d04eb10d70 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb2a67fc640 1 -- 172.21.15.151:0/3995319027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb3b004ad10 con 0x55d04eb10d70 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb2a67fc640 1 --2- 172.21.15.151:0/3995319027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2980346a0 0x7fb298036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb2a67fc640 1 -- 172.21.15.151:0/3995319027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb3b001e040 con 0x55d04eb10d70 2024-09-10T14:29:52.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/3995319027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2980346a0 0x7fb298036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c33ca980 1 Processor -- start 2024-09-10T14:29:52.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c33ca980 1 -- start start 2024-09-10T14:29:52.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/3995319027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2980346a0 0x7fb298036b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4017f50 tx=0x7fb3b4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c33ca980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb1d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c33ca980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d04eaec5f0 con 0x55d04eb1d2d0 2024-09-10T14:29:52.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb1d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb1d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40348/0 (socket says 172.21.15.151:40348) 2024-09-10T14:29:52.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2340343040 learned_addr learned my addr 172.21.15.151:0/2340343040 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.349+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2340343040 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04eb1dca0 con 0x55d04eb1d2d0 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/2340343040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb1d6d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0036010 tx=0x7fb3b001db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4512b91c8c252a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb297fff640 1 -- 172.21.15.151:0/2340343040 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b003a3f0 con 0x55d04eb1d2d0 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb297fff640 1 -- 172.21.15.151:0/2340343040 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b001dc90 con 0x55d04eb1d2d0 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb297fff640 1 -- 172.21.15.151:0/2340343040 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b003a590 con 0x55d04eb1d2d0 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2340343040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 msgr2=0x55d04eb1d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2340343040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb1d6d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0036010 tx=0x7fb3b001db90 comp rx=0 tx=0).stop 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2340343040 shutdown_connections 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2340343040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb1d6d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2340343040 >> 172.21.15.151:0/2340343040 conn(0x55d04eb19700 msgr2=0x55d04eb17800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2340343040 shutdown_connections 2024-09-10T14:29:52.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2340343040 wait complete. 2024-09-10T14:29:52.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 Processor -- start 2024-09-10T14:29:52.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- start start 2024-09-10T14:29:52.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb24530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d04eb1e170 con 0x55d04eb1d2d0 2024-09-10T14:29:52.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb24530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c0eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb24530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:40362/0 (socket says 172.21.15.151:40362) 2024-09-10T14:29:52.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 learned_addr learned my addr 172.21.15.151:0/2593363590 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:52.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d04eb24a70 con 0x55d04eb1d2d0 2024-09-10T14:29:52.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb24530 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb3b001ba40 tx=0x7fb3b003cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb2967fc640 1 -- 172.21.15.151:0/2593363590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b004ea70 con 0x55d04eb1d2d0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d04eb24a70 con 0x55d04eb1d2d0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb2967fc640 1 -- 172.21.15.151:0/2593363590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b004ec10 con 0x55d04eb1d2d0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb2967fc640 1 -- 172.21.15.151:0/2593363590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0015220 con 0x55d04eb1d2d0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.353+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d04eb24ee0 con 0x55d04eb1d2d0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb2967fc640 1 -- 172.21.15.151:0/2593363590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb3b00153c0 con 0x55d04eb1d2d0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb2967fc640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb28c034650 0x7fb28c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb2967fc640 1 -- 172.21.15.151:0/2593363590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb3b0067070 con 0x55d04eb1d2d0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb28c034650 0x7fb28c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04eb2f600 0x55d04eb31aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb321f0 con 0x55d04eb2f600 2024-09-10T14:29:52.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c16db640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04eb2f600 0x55d04eb31aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb28c034650 0x7fb28c036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4000c10 tx=0x7fb3b40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c16db640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04eb2f600 0x55d04eb31aa0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 realm 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb32600 con 0x55d04eb2f600 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb32ea0 con 0x55d04eb2f600 2024-09-10T14:29:52.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eb33fa0 0x55d04eb36390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb369e0 con 0x55d04eb33fa0 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eb33fa0 0x55d04eb36390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eb33fa0 0x55d04eb36390 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:52.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 20 searching for the correct realm 2024-09-10T14:29:52.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb38240 con 0x55d04eb33fa0 2024-09-10T14:29:52.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c0eda640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb3b003b870 0x7fb3b007e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb38240 con 0x7fb3b003b870 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.357+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb3b003b870 0x7fb3b007e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb3b003b870 0x7fb3b007e6f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c06d9640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb3b40e0040 0x7fb3b40e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb38240 con 0x7fb3b40e0040 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb3b40e0040 0x7fb3b40e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb3b40e0040 0x7fb3b40e0420 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b40e0040 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b40e0040 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b003b870 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.361+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb33fa0 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b40e0040 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b003b870 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb33fa0 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb33fa0 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b003b870 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb33fa0 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb33fa0 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b40e0040 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.365+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb33fa0 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b003b870 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b003b870 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb33fa0 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b40e0040 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b003b870 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb33fa0 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b40e0040 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x55d04eb2f600 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb33240 con 0x7fb3b003b870 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:52.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb37360 con 0x55d04eb2f600 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.369+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb37bb0 con 0x55d04eb2f600 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:52.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb37700 con 0x7fb3b40e0040 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 zone default found 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 4 Realm: () 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 zonegroup default 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb37b30 con 0x7fb3b003b870 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb38090 con 0x55d04eb33fa0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3a640 con 0x55d04eb33fa0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 started sync module instance, tier type = 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:52.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb399c0 con 0x7fb3b003b870 2024-09-10T14:29:52.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94353161952688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb39620 con 0x7fb3b003b870 2024-09-10T14:29:52.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.373+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3b570 con 0x55d04eb2f600 2024-09-10T14:29:52.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.377+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94353161952688] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.377+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.377+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94353161957568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3b990 con 0x55d04eb2f600 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.377+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3c240 con 0x55d04eb33fa0 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.377+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94353161957568] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.377+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.377+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94353161958928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3c630 con 0x55d04eb33fa0 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.377+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3cff0 con 0x7fb3b003b870 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.381+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.381+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94353161966560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3dcb0 con 0x7fb3b003b870 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.381+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3e670 con 0x55d04eb2f600 2024-09-10T14:29:52.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.381+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94353161958928] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.381+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94353161966560] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.381+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.381+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94353161967616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3dc20 con 0x55d04eb2f600 2024-09-10T14:29:52.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.381+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3eb20 con 0x7fb3b40e0040 2024-09-10T14:29:52.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.385+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94353161967616] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.385+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.385+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94353161970112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3ea90 con 0x7fb3b40e0040 2024-09-10T14:29:52.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.385+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3f450 con 0x7fb3b40e0040 2024-09-10T14:29:52.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.385+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94353161970112] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.385+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.385+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94353161971168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3f630 con 0x7fb3b40e0040 2024-09-10T14:29:52.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.385+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3fe80 con 0x7fb3b40e0040 2024-09-10T14:29:52.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94353161971168] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94353161974624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb3fcb0 con 0x7fb3b40e0040 2024-09-10T14:29:52.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 20 add_watcher() i=0 2024-09-10T14:29:52.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 20 add_watcher() i=1 2024-09-10T14:29:52.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 20 add_watcher() i=2 2024-09-10T14:29:52.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 20 add_watcher() i=3 2024-09-10T14:29:52.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 20 add_watcher() i=4 2024-09-10T14:29:52.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 20 add_watcher() i=5 2024-09-10T14:29:52.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 20 add_watcher() i=6 2024-09-10T14:29:52.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94353161974624] v36'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 20 add_watcher() i=7 2024-09-10T14:29:52.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:52.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.389+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb43220 con 0x55d04eb2f600 2024-09-10T14:29:52.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94353161975680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb40740 con 0x55d04eb2f600 2024-09-10T14:29:52.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94353161975680] v36'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb276fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:52.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 5 note: GC not initialized 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb275fe3640 20 reqs_thread_entry: start 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 20 Filter name: none 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb1e77fe640 20 reqs_thread_entry: start 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb66890 con 0x7fb3b40e0040 2024-09-10T14:29:52.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:29:52.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-10T14:29:52.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T14:29:52.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:52.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.393+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6aa50 con 0x7fb3b003b870 2024-09-10T14:29:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v36'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T14:29:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T14:29:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T14:29:52.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94353162147872 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6b6e0 con 0x7fb3b40e0040 2024-09-10T14:29:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== watch-notify(notify (1) cookie 94353161970112 notify 154618822674 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7fb3b802d060 con 0x7fb3b40e0040 2024-09-10T14:29:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb297fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822674 cookie 94353161970112 notifier 4729 bl.length()=382 2024-09-10T14:29:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb297fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T14:29:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb297fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T14:29:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(64 notify.5 [notify cookie 94353162147872 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb297fff640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb284003eb0 con 0x7fb3b40e0040 2024-09-10T14:29:52.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== watch-notify(notify_complete (2) cookie 94353162147872 notify 154618822674 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb3b801e040 con 0x7fb3b40e0040 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6b5a0 con 0x55d04eb2f600 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv5 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 : miss 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 20 rados->read ofs=0 len=0 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 8.1f 8:fc11d3ce:root::.bucket.meta.myfoo6%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb68f40 con 0x7fb3b003b870 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(67 .bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 info.flags=0x17 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 to cache LRU end 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:29:52.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 2024-09-10T14:29:52.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 8.1f 8:fc11d3ce:root::.bucket.meta.myfoo6%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb72890 con 0x7fb3b003b870 2024-09-10T14:29:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(68 .bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v36'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.397+0000 7fb3c33ca980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 info.flags=0x17 2024-09-10T14:29:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 to cache LRU end 2024-09-10T14:29:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T14:29:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9, ofs0, ns] 2024-09-10T14:29:52.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94353162145232 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb71560 con 0x7fb3b003b870 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== watch-notify(notify (1) cookie 94353161966560 notify 154618822693 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55d04eb69330 con 0x7fb3b003b870 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb2977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822693 cookie 94353161966560 notifier 4729 bl.length()=748 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb2977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 info.flags=0x17 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb2977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 to cache LRU end 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb2977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(69 notify.3 [notify cookie 94353162145232 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb2977fe640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb1f4003540 con 0x7fb3b003b870 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== watch-notify(notify_complete (2) cookie 94353162145232 notify 154618822693 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d04eb687e0 con 0x7fb3b003b870 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 20 handle_bi_update(): bucket=:myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]): orig_sources= new_sources= 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 20 handle_bi_update(): bucket=:myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]): potential sources added=[] removed=[] 2024-09-10T14:29:52.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 20 handle_bi_update(): bucket=:myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]): orig_dests= new_dests= 2024-09-10T14:29:52.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 20 handle_bi_update(): bucket=:myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]): potential dests added=[] removed=[] 2024-09-10T14:29:52.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb68dd0 con 0x55d04eb2f600 2024-09-10T14:29:52.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(71 bud.buckets [call] v36'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb68dd0 con 0x55d04eb2f600 2024-09-10T14:29:52.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(72 bud.buckets [call] v36'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.401+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb68dd0 con 0x55d04eb2f600 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v36'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94353162145232 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6bb10 con 0x7fb3b003b870 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== watch-notify(notify (1) cookie 94353161966560 notify 154618822694 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55d04ea08400 con 0x7fb3b003b870 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb2977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822694 cookie 94353161966560 notifier 4729 bl.length()=316 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb2977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb2977fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T14:29:52.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(74 notify.3 [notify cookie 94353162145232 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb2977fe640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb1f4003570 con 0x7fb3b003b870 2024-09-10T14:29:52.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== watch-notify(notify_complete (2) cookie 94353162145232 notify 154618822694 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb3b40e0e10 con 0x7fb3b003b870 2024-09-10T14:29:52.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-10T14:29:52.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 2024-09-10T14:29:52.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:76 8.1f 8:fc11d3ce:root::.bucket.meta.myfoo6%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6a050 con 0x7fb3b003b870 2024-09-10T14:29:52.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(76 .bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v36'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 info.flags=0x17 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 to cache LRU end 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9, ofs0, ns] 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94353162147440 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6a040 con 0x7fb3b003b870 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== watch-notify(notify (1) cookie 94353161966560 notify 154618822695 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fb3b40e0e10 con 0x7fb3b003b870 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb297fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822695 cookie 94353161966560 notifier 4729 bl.length()=748 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb297fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 info.flags=0x17 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb297fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 to cache LRU end 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb297fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(77 notify.3 [notify cookie 94353162147440 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb297fff640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb284003eb0 con 0x7fb3b003b870 2024-09-10T14:29:52.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== watch-notify(notify_complete (2) cookie 94353162147440 notify 154618822695 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb3b40d3850 con 0x7fb3b003b870 2024-09-10T14:29:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 20 handle_bi_update(): bucket=:myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]): orig_sources= new_sources= 2024-09-10T14:29:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 20 handle_bi_update(): bucket=:myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]): potential sources added=[] removed=[] 2024-09-10T14:29:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 20 handle_bi_update(): bucket=:myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]): orig_dests= new_dests= 2024-09-10T14:29:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 20 handle_bi_update(): bucket=:myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]): potential dests added=[] removed=[] 2024-09-10T14:29:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.405+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:79 4.1e 4:7b6b44a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x7fb3b40e0040 2024-09-10T14:29:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(79 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:80 4.33 4:cc35330c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x7fb3b40e0040 2024-09-10T14:29:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(80 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:81 4.24 4:260e58fe:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x7fb3b40e0040 2024-09-10T14:29:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(81 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:82 4.21 4:868c61aa:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x7fb3b40e0040 2024-09-10T14:29:52.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(82 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:83 4.2f 4:f62e23b0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x55d04eb2f600 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(83 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 4.1d 4:bbbbcedd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x55d04eb33fa0 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(84 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.409+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 4.5 4:a3b45173:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x55d04eb33fa0 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(85 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:86 4.3 4:c3157c80:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x55d04eb2f600 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(86 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 4.3a 4:5f19a615:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x55d04eb33fa0 2024-09-10T14:29:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(87 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:88 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x55d04eb33fa0 2024-09-10T14:29:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(88 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [call out=378b] v0'0 uv5 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 10 cls_bucket_list_unordered: got thirteen 2024-09-10T14:29:52.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:89 4.17 4:e8024f28:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x7fb3b40e0040 2024-09-10T14:29:52.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(89 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 get_obj_state: octx=0x7fb3b800ab00 obj=myfoo6:thirteen state=0x55d04eb71298 s->prefetch_data=0 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:90 3.1ds0 3:bb564b32:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb69670 con 0x55d04eb33fa0 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(90 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 10 manifest: total_size = 8 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 get_obj_state: setting s->obj_tag to 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11304041449097315749 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 Read xattr rgw_rados: user.rgw.acl 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 Read xattr rgw_rados: user.rgw.etag 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-10T14:29:52.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-10T14:29:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-10T14:29:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 get_obj_state: octx=0x7fb3b800ab00 obj=myfoo6:thirteen state=0x55d04eb71298 s->prefetch_data=0 2024-09-10T14:29:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-10T14:29:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 2024-09-10T14:29:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 2024-09-10T14:29:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb67ff0 con 0x55d04eb33fa0 2024-09-10T14:29:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(91 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.413+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:92 3.1ds0 3:bb564b32:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb73f60 con 0x55d04eb33fa0 2024-09-10T14:29:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(92 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v36'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:93 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb75550 con 0x55d04eb33fa0 2024-09-10T14:29:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:1 objects processed in :myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9]). Next marker thirteen 2024-09-10T14:29:52.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb75550 con 0x7fb3b003b870 2024-09-10T14:29:52.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v36'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c33ca980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T14:29:52.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c33ca980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T14:29:52.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c33ca980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T14:29:52.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(93 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94353162138992 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb75550 con 0x7fb3b40e0040 2024-09-10T14:29:52.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.417+0000 7fb2977fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T14:29:52.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== watch-notify(notify (1) cookie 94353161970112 notify 154618822675 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d04eb729d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb297fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822675 cookie 94353161970112 notifier 4729 bl.length()=556 2024-09-10T14:29:52.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb297fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T14:29:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb297fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T14:29:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(95 notify.5 [notify cookie 94353162138992 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb297fff640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb284003eb0 con 0x7fb3b40e0040 2024-09-10T14:29:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== watch-notify(notify_complete (2) cookie 94353162138992 notify 154618822675 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d04eb6fb50 con 0x7fb3b40e0040 2024-09-10T14:29:52.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6b0b0 con 0x55d04eb2f600 2024-09-10T14:29:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v36'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c33ca980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T14:29:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c33ca980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T14:29:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c33ca980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T14:29:52.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94353162138992 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6b0b0 con 0x7fb3b40e0040 2024-09-10T14:29:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== watch-notify(notify (1) cookie 94353161970112 notify 154618822676 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55d04eb6fb50 con 0x7fb3b40e0040 2024-09-10T14:29:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb297fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822676 cookie 94353161970112 notifier 4729 bl.length()=177 2024-09-10T14:29:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb297fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T14:29:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb297fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T14:29:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(98 notify.5 [notify cookie 94353162138992 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.421+0000 7fb297fff640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb284003eb0 con 0x7fb3b40e0040 2024-09-10T14:29:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== watch-notify(notify_complete (2) cookie 94353162138992 notify 154618822676 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb3b801e040 con 0x7fb3b40e0040 2024-09-10T14:29:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c33ca980 10 removing user index: bar 2024-09-10T14:29:52.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb6b0b0 con 0x7fb3b40e0040 2024-09-10T14:29:52.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(100 bar [delete] v36'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c33ca980 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-10T14:29:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c33ca980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T14:29:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94353162138992 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb710b0 con 0x7fb3b40e0040 2024-09-10T14:29:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== watch-notify(notify (1) cookie 94353161974624 notify 154618822677 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7fb3b801e040 con 0x7fb3b40e0040 2024-09-10T14:29:52.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb2977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822677 cookie 94353161974624 notifier 4729 bl.length()=152 2024-09-10T14:29:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb2977fe640 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb1f4003570 con 0x7fb3b40e0040 2024-09-10T14:29:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== osd_op_reply(101 notify.7 [notify cookie 94353162138992 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== watch-notify(notify_complete (2) cookie 94353162138992 notify 154618822677 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb3b8005040 con 0x7fb3b40e0040 2024-09-10T14:29:52.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.425+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.430 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T14:29:52.216548Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:29:52.216530Z","tags":[],"group_ids":[]} 2024-09-10T14:29:52.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.429+0000 7fb276fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:52.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.429+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94353161975680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x55d04eb2f600 2024-09-10T14:29:52.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.429+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94353161975680] v36'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.429+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94353161952688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x7fb3b003b870 2024-09-10T14:29:52.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.429+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94353161952688] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.429+0000 7fb3c33ca980 20 remove_watcher() i=0 2024-09-10T14:29:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.429+0000 7fb3c33ca980 2 removed watcher, disabling cache 2024-09-10T14:29:52.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.429+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94353161957568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x55d04eb2f600 2024-09-10T14:29:52.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.433+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94353161957568] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.433+0000 7fb3c33ca980 20 remove_watcher() i=1 2024-09-10T14:29:52.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.433+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94353161958928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x55d04eb33fa0 2024-09-10T14:29:52.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.433+0000 7fb3c0eda640 1 -- 172.21.15.151:0/2593363590 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94353161958928] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b007d040 con 0x55d04eb33fa0 2024-09-10T14:29:52.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.433+0000 7fb3c33ca980 20 remove_watcher() i=2 2024-09-10T14:29:52.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.433+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94353161966560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x7fb3b003b870 2024-09-10T14:29:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.437+0000 7fb3c06d9640 1 -- 172.21.15.151:0/2593363590 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94353161966560] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b40aaad0 con 0x7fb3b003b870 2024-09-10T14:29:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.437+0000 7fb3c33ca980 20 remove_watcher() i=3 2024-09-10T14:29:52.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.437+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94353161967616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x55d04eb2f600 2024-09-10T14:29:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.437+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94353161967616] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x55d04eb2f600 2024-09-10T14:29:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.437+0000 7fb3c33ca980 20 remove_watcher() i=4 2024-09-10T14:29:52.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.437+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94353161970112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x7fb3b40e0040 2024-09-10T14:29:52.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.441+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94353161970112] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.441+0000 7fb3c33ca980 20 remove_watcher() i=5 2024-09-10T14:29:52.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.441+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94353161971168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x7fb3b40e0040 2024-09-10T14:29:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.441+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94353161971168] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.441+0000 7fb3c33ca980 20 remove_watcher() i=6 2024-09-10T14:29:52.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.441+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94353161974624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d04eb646f0 con 0x7fb3b40e0040 2024-09-10T14:29:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94353161974624] v36'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4d0 con 0x7fb3b40e0040 2024-09-10T14:29:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 20 remove_watcher() i=7 2024-09-10T14:29:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb3b40e0040 msgr2=0x7fb3b40e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb3b40e0040 0x7fb3b40e0420 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04eb2f600 msgr2=0x55d04eb31aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04eb2f600 0x55d04eb31aa0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb3b003b870 msgr2=0x7fb3b007e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb3b003b870 0x7fb3b007e6f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eb33fa0 msgr2=0x55d04eb36390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eb33fa0 0x55d04eb36390 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb28c034650 msgr2=0x7fb28c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb28c034650 0x7fb28c036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4000c10 tx=0x7fb3b40c1040 comp rx=0 tx=0).stop 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 msgr2=0x55d04eb24530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/2593363590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb1d2d0 0x55d04eb24530 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb3b001ba40 tx=0x7fb3b003cf80 comp rx=0 tx=0).stop 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 reap_dead start 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c16db640 1 -- 172.21.15.151:0/2593363590 reap_dead start 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 shutdown_connections 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 >> 172.21.15.151:0/2593363590 conn(0x55d04eb19700 msgr2=0x55d04eb177d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 shutdown_connections 2024-09-10T14:29:52.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/2593363590 wait complete. 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3995319027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2980346a0 msgr2=0x7fb298036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/3995319027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2980346a0 0x7fb298036b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4017f50 tx=0x7fb3b4005ad0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3995319027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb10d70 msgr2=0x55d04eb11190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/3995319027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb10d70 0x55d04eb11190 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0048ee0 tx=0x7fb3b0019e70 comp rx=0 tx=0).stop 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3995319027 shutdown_connections 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/3995319027 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2980346a0 0x7fb298036b60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/3995319027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04eb10d70 0x55d04eb11190 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3995319027 >> 172.21.15.151:0/3995319027 conn(0x55d04eb05ec0 msgr2=0x55d04eb08940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3995319027 shutdown_connections 2024-09-10T14:29:52.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/3995319027 wait complete. 2024-09-10T14:29:52.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d04eb007a0 msgr2=0x55d04eb02b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d04eb007a0 0x55d04eb02b90 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04ea04940 msgr2=0x55d04eaf9ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d04ea04940 0x55d04eaf9ee0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eafc8a0 msgr2=0x55d04eafec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d04eafc8a0 0x55d04eafec90 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2a8034650 msgr2=0x7fb2a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb2a8034650 0x7fb2a8036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40ae000 tx=0x7fb3b40a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 msgr2=0x55d04eaf2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 --2- 172.21.15.151:0/473602727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d04ea00e00 0x55d04eaf2f50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0000c10 tx=0x7fb3b0000ee0 comp rx=0 tx=0).stop 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c16db640 1 -- 172.21.15.151:0/473602727 reap_dead start 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 shutdown_connections 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 >> 172.21.15.151:0/473602727 conn(0x55d04e974290 msgr2=0x55d04eae6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 shutdown_connections 2024-09-10T14:29:52.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:52.445+0000 7fb3c33ca980 1 -- 172.21.15.151:0/473602727 wait complete. 2024-09-10T14:29:52.459 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T14:29:52.216548Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:29:52.216530Z', 'tags': [], 'group_ids': []} 2024-09-10T14:29:57.473 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:57.474 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T14:29:57.474 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T14:29:57.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T14:29:57.474 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-10T14:29:57.522 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:57.522 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:57.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa699a86980 1 Processor -- start 2024-09-10T14:29:57.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa699a86980 1 -- start start 2024-09-10T14:29:57.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa699a86980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d9dc4cee90 0x55d9dc4d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa699a86980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d9dc350ae0 con 0x55d9dc43cb40 2024-09-10T14:29:57.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa699a86980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55d9dc374e30 con 0x55d9dc4cee90 2024-09-10T14:29:57.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa696d95640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55d9dc4cee90 0x55d9dc4d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa697596640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55d9dc43cb40 0x55d9dc4cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:56352/0 (socket says 172.21.15.151:56352) 2024-09-10T14:29:57.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa697596640 1 -- 172.21.15.151:0/4294857286 learned_addr learned my addr 172.21.15.151:0/4294857286 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:29:57.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa696d95640 1 -- 172.21.15.151:0/4294857286 >> v1:172.21.15.52:6789/0 conn(0x55d9dc43cb40 legacy=0x55d9dc4cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa696d95640 1 -- 172.21.15.151:0/4294857286 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9dc43cf20 con 0x55d9dc4cee90 2024-09-10T14:29:57.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.521+0000 7fa696d95640 1 --2- 172.21.15.151:0/4294857286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc4cee90 0x55d9dc4d1280 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00a480 tx=0x7fa68c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbdaa69dd08e65e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa696594640 1 -- 172.21.15.151:0/4294857286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa68c0b0070 con 0x55d9dc4cee90 2024-09-10T14:29:57.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa696594640 1 -- 172.21.15.151:0/4294857286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68c0ab540 con 0x55d9dc4cee90 2024-09-10T14:29:57.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa696594640 1 -- 172.21.15.151:0/4294857286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa68c0ab840 con 0x55d9dc4cee90 2024-09-10T14:29:57.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa699a86980 1 -- 172.21.15.151:0/4294857286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc4cee90 msgr2=0x55d9dc4d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa699a86980 1 --2- 172.21.15.151:0/4294857286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc4cee90 0x55d9dc4d1280 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00a480 tx=0x7fa68c01b280 comp rx=0 tx=0).stop 2024-09-10T14:29:57.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa699a86980 1 -- 172.21.15.151:0/4294857286 shutdown_connections 2024-09-10T14:29:57.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa699a86980 1 --2- 172.21.15.151:0/4294857286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc4cee90 0x55d9dc4d1280 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa699a86980 1 -- 172.21.15.151:0/4294857286 >> 172.21.15.151:0/4294857286 conn(0x55d9dc4c30a0 msgr2=0x55d9dc4c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa699a86980 1 -- 172.21.15.151:0/4294857286 shutdown_connections 2024-09-10T14:29:57.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.525+0000 7fa699a86980 1 -- 172.21.15.151:0/4294857286 wait complete. 2024-09-10T14:29:57.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 Processor -- start 2024-09-10T14:29:57.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- start start 2024-09-10T14:29:57.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc4cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d9dc376200 con 0x55d9dc43cb40 2024-09-10T14:29:57.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc4cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc4cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43212/0 (socket says 172.21.15.151:43212) 2024-09-10T14:29:57.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa697596640 1 -- 172.21.15.151:0/2845143946 learned_addr learned my addr 172.21.15.151:0/2845143946 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa697596640 1 -- 172.21.15.151:0/2845143946 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9dc4cd050 con 0x55d9dc43cb40 2024-09-10T14:29:57.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa697596640 1 --2- 172.21.15.151:0/2845143946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc4cca80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa6900017b0 tx=0x7fa690001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7f5b2dbe7a5a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa58560a640 1 -- 172.21.15.151:0/2845143946 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa690016070 con 0x55d9dc43cb40 2024-09-10T14:29:57.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa58560a640 1 -- 172.21.15.151:0/2845143946 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa690004530 con 0x55d9dc43cb40 2024-09-10T14:29:57.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa58560a640 1 -- 172.21.15.151:0/2845143946 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa690004870 con 0x55d9dc43cb40 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- 172.21.15.151:0/2845143946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 msgr2=0x55d9dc4cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 --2- 172.21.15.151:0/2845143946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc4cca80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa6900017b0 tx=0x7fa690001c70 comp rx=0 tx=0).stop 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- 172.21.15.151:0/2845143946 shutdown_connections 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 --2- 172.21.15.151:0/2845143946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc4cca80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- 172.21.15.151:0/2845143946 >> 172.21.15.151:0/2845143946 conn(0x55d9dc4c30a0 msgr2=0x55d9dc5b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- 172.21.15.151:0/2845143946 shutdown_connections 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- 172.21.15.151:0/2845143946 wait complete. 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 Processor -- start 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- start start 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc5c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.541+0000 7fa699a86980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d9dc4d4250 con 0x55d9dc43cb40 2024-09-10T14:29:57.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc5c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc5c1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43224/0 (socket says 172.21.15.151:43224) 2024-09-10T14:29:57.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa697596640 1 -- 172.21.15.151:0/2117755885 learned_addr learned my addr 172.21.15.151:0/2117755885 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa697596640 1 -- 172.21.15.151:0/2117755885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9dc5c1ab0 con 0x55d9dc43cb40 2024-09-10T14:29:57.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa697596640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc5c1570 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa690014040 tx=0x7fa690001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa583e07640 1 -- 172.21.15.151:0/2117755885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa690020070 con 0x55d9dc43cb40 2024-09-10T14:29:57.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa583e07640 1 -- 172.21.15.151:0/2117755885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa690011400 con 0x55d9dc43cb40 2024-09-10T14:29:57.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9dc5c1d40 con 0x55d9dc43cb40 2024-09-10T14:29:57.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa583e07640 1 -- 172.21.15.151:0/2117755885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa690016040 con 0x55d9dc43cb40 2024-09-10T14:29:57.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9dc5c4a20 con 0x55d9dc43cb40 2024-09-10T14:29:57.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa583e07640 1 -- 172.21.15.151:0/2117755885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa690023070 con 0x55d9dc43cb40 2024-09-10T14:29:57.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa583e07640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa57c034650 0x7fa57c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa583e07640 1 -- 172.21.15.151:0/2117755885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa690049230 con 0x55d9dc43cb40 2024-09-10T14:29:57.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa696d95640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa57c034650 0x7fa57c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa699a86980 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc4cee90 0x55d9dc5c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc5c8bb0 con 0x55d9dc4cee90 2024-09-10T14:29:57.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa697d97640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc4cee90 0x55d9dc5c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa696d95640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa57c034650 0x7fa57c036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0ad000 tx=0x7fa68c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.545+0000 7fa697d97640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc4cee90 0x55d9dc5c8670 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa697d97640 1 -- 172.21.15.151:0/2117755885 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc4cee90 2024-09-10T14:29:57.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc5c5c40 con 0x55d9dc4cee90 2024-09-10T14:29:57.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa697d97640 1 -- 172.21.15.151:0/2117755885 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc4cee90 2024-09-10T14:29:57.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa699a86980 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc5caef0 0x55d9dc5cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc5cd9b0 con 0x55d9dc5caef0 2024-09-10T14:29:57.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa697596640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc5caef0 0x55d9dc5cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa697596640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc5caef0 0x55d9dc5cd2e0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa697596640 1 -- 172.21.15.151:0/2117755885 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa69002c070 con 0x55d9dc5caef0 2024-09-10T14:29:57.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc5c9d60 con 0x55d9dc4cee90 2024-09-10T14:29:57.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa697d97640 1 -- 172.21.15.151:0/2117755885 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc4cee90 2024-09-10T14:29:57.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa699a86980 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d9dc5cee10 0x55d9dc5d1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc5d18f0 con 0x55d9dc5cee10 2024-09-10T14:29:57.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa696d95640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d9dc5cee10 0x55d9dc5d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa696d95640 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d9dc5cee10 0x55d9dc5d1200 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.549+0000 7fa696d95640 1 -- 172.21.15.151:0/2117755885 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa68c0b3040 con 0x55d9dc5cee10 2024-09-10T14:29:57.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa699a86980 1 Processor -- start 2024-09-10T14:29:57.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa699a86980 1 -- start start 2024-09-10T14:29:57.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa699a86980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5df340 0x55d9dc5df760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa699a86980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d9dc3cf800 con 0x55d9dc5df340 2024-09-10T14:29:57.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5df340 0x55d9dc5df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5df340 0x55d9dc5df760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43238/0 (socket says 172.21.15.151:43238) 2024-09-10T14:29:57.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa697596640 1 -- 172.21.15.151:0/3278381792 learned_addr learned my addr 172.21.15.151:0/3278381792 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa697596640 1 -- 172.21.15.151:0/3278381792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9dc5dfca0 con 0x55d9dc5df340 2024-09-10T14:29:57.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa697596640 1 --2- 172.21.15.151:0/3278381792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5df340 0x55d9dc5df760 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa690047520 tx=0x7fa690024fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa581602640 1 -- 172.21.15.151:0/3278381792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69003f070 con 0x55d9dc5df340 2024-09-10T14:29:57.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa581602640 1 -- 172.21.15.151:0/3278381792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69001ba10 con 0x55d9dc5df340 2024-09-10T14:29:57.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa699a86980 1 -- 172.21.15.151:0/3278381792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9dc5dff30 con 0x55d9dc5df340 2024-09-10T14:29:57.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa581602640 1 -- 172.21.15.151:0/3278381792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69001bcf0 con 0x55d9dc5df340 2024-09-10T14:29:57.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa699a86980 1 -- 172.21.15.151:0/3278381792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9dc5e2bb0 con 0x55d9dc5df340 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa581602640 1 -- 172.21.15.151:0/3278381792 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa690043040 con 0x55d9dc5df340 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.553+0000 7fa581602640 1 --2- 172.21.15.151:0/3278381792 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5700346f0 0x7fa570036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa581602640 1 -- 172.21.15.151:0/3278381792 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa690012150 con 0x55d9dc5df340 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa696d95640 1 --2- 172.21.15.151:0/3278381792 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5700346f0 0x7fa570036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 Processor -- start 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- start start 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa696d95640 1 --2- 172.21.15.151:0/3278381792 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5700346f0 0x7fa570036bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55d9dc5c94a0 tx=0x7fa68c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d9dc4cd3d0 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5ec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5ec0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43244/0 (socket says 172.21.15.151:43244) 2024-09-10T14:29:57.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa697596640 1 -- 172.21.15.151:0/1105284531 learned_addr learned my addr 172.21.15.151:0/1105284531 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa697596640 1 -- 172.21.15.151:0/1105284531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9dc5ec6a0 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa697596640 1 --2- 172.21.15.151:0/1105284531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5ec0d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa6900117c0 tx=0x7fa69002f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbe87fbf8ab9fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa57affd640 1 -- 172.21.15.151:0/1105284531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69002d690 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa57affd640 1 -- 172.21.15.151:0/1105284531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69004cc00 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa57affd640 1 -- 172.21.15.151:0/1105284531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69004c120 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- 172.21.15.151:0/1105284531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 msgr2=0x55d9dc5ec0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 --2- 172.21.15.151:0/1105284531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5ec0d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa6900117c0 tx=0x7fa69002f6f0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- 172.21.15.151:0/1105284531 shutdown_connections 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 --2- 172.21.15.151:0/1105284531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5ec0d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- 172.21.15.151:0/1105284531 >> 172.21.15.151:0/1105284531 conn(0x55d9dc5e8020 msgr2=0x55d9dc5e6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- 172.21.15.151:0/1105284531 shutdown_connections 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- 172.21.15.151:0/1105284531 wait complete. 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 Processor -- start 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- start start 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa699a86980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d9dc5eca30 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa697596640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5f2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43246/0 (socket says 172.21.15.151:43246) 2024-09-10T14:29:57.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.557+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 learned_addr learned my addr 172.21.15.151:0/3928523605 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9dc5f3300 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa697596640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5f2dc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa69001bfd0 tx=0x7fa690033e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa5797fa640 1 -- 172.21.15.151:0/3928523605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69002f810 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9dc5f3300 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa5797fa640 1 -- 172.21.15.151:0/3928523605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69006d070 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa5797fa640 1 -- 172.21.15.151:0/3928523605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69002d690 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9dc5f3300 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa5797fa640 1 -- 172.21.15.151:0/3928523605 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa69002dac0 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa5797fa640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa560034650 0x7fa560036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa5797fa640 1 -- 172.21.15.151:0/3928523605 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa690035150 con 0x55d9dc5ebcf0 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa696d95640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa560034650 0x7fa560036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc5fdd70 0x55d9dc600230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc600980 con 0x55d9dc5fdd70 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa697d97640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc5fdd70 0x55d9dc600230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa696d95640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa560034650 0x7fa560036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00a480 tx=0x7fa68c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.561+0000 7fa697d97640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc5fdd70 0x55d9dc600230 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 realm 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc600d90 con 0x55d9dc5fdd70 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc601630 con 0x55d9dc5fdd70 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:57.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc602730 0x55d9dc604b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6051c0 con 0x55d9dc602730 2024-09-10T14:29:57.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697596640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc602730 0x55d9dc604b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697596640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc602730 0x55d9dc604b20 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 20 searching for the correct realm 2024-09-10T14:29:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc606a20 con 0x55d9dc602730 2024-09-10T14:29:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697596640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa690054040 0x7fa690052660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc606a20 con 0x7fa690054040 2024-09-10T14:29:57.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa696d95640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa690054040 0x7fa690052660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa696d95640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa690054040 0x7fa690052660 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa696d95640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa68c0cd040 0x7fa68c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc606a20 con 0x7fa68c0cd040 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.565+0000 7fa697d97640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa68c0cd040 0x7fa68c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa68c0cd040 0x7fa68c0ce430 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa68c0cd040 2024-09-10T14:29:57.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa68c0cd040 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa690054040 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc602730 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.569+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa68c0cd040 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa690054040 2024-09-10T14:29:57.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc602730 2024-09-10T14:29:57.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc602730 2024-09-10T14:29:57.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa690054040 2024-09-10T14:29:57.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc602730 2024-09-10T14:29:57.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc602730 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa68c0cd040 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc602730 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.573+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa690054040 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa690054040 2024-09-10T14:29:57.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc602730 2024-09-10T14:29:57.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa68c0cd040 2024-09-10T14:29:57.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa690054040 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc602730 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa68c0cd040 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6019d0 con 0x7fa690054040 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:57.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc605b10 con 0x55d9dc5fdd70 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.577+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc606360 con 0x55d9dc5fdd70 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:57.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc605750 con 0x7fa68c0cd040 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 zone default found 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 4 Realm: () 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 zonegroup default 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6067b0 con 0x7fa690054040 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc608830 con 0x55d9dc602730 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc608c50 con 0x55d9dc602730 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 started sync module instance, tier type = 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc607cd0 con 0x7fa690054040 2024-09-10T14:29:57.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94394193576128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc609560 con 0x7fa690054040 2024-09-10T14:29:57.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.581+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc609db0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.585+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94394193576128] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.585+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.585+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94394193580208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc609db0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.585+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60a8b0 con 0x55d9dc602730 2024-09-10T14:29:57.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.585+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.585+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94394193585056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60b150 con 0x55d9dc602730 2024-09-10T14:29:57.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.585+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60bb50 con 0x7fa690054040 2024-09-10T14:29:57.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94394193580208] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94394193582336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60c3f0 con 0x7fa690054040 2024-09-10T14:29:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60cc40 con 0x55d9dc5fdd70 2024-09-10T14:29:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94394193585056] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94394193582336] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94394193587360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60cc40 con 0x55d9dc5fdd70 2024-09-10T14:29:57.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.589+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60d4e0 con 0x7fa68c0cd040 2024-09-10T14:29:57.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.593+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94394193587360] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.593+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.593+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94394193594528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60d210 con 0x7fa68c0cd040 2024-09-10T14:29:57.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.593+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60dd30 con 0x7fa68c0cd040 2024-09-10T14:29:57.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94394193594528] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94394193598464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60dcf0 con 0x7fa68c0cd040 2024-09-10T14:29:57.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60e730 con 0x7fa68c0cd040 2024-09-10T14:29:57.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94394193598464] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94394193601024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60e6f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 20 add_watcher() i=0 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 20 add_watcher() i=1 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 20 add_watcher() i=2 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 20 add_watcher() i=3 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 20 add_watcher() i=4 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 20 add_watcher() i=5 2024-09-10T14:29:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.597+0000 7fa699a86980 20 add_watcher() i=6 2024-09-10T14:29:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94394193601024] v36'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 20 add_watcher() i=7 2024-09-10T14:29:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc611b50 con 0x55d9dc5fdd70 2024-09-10T14:29:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94394193595584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60f040 con 0x55d9dc5fdd70 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94394193595584] v36'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa54dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 5 note: GC not initialized 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa54cfe1640 20 reqs_thread_entry: start 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 20 Filter name: none 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa4c67fc640 20 reqs_thread_entry: start 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:29:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.601+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc635290 con 0x7fa68c0cd040 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc633a30 con 0x7fa68c0cd040 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:29:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T14:29:57.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T14:29:57.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6342d0 con 0x7fa68c0cd040 2024-09-10T14:29:57.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v36'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T14:29:57.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:29:57.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T14:29:57.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94394193755680 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc638d30 con 0x7fa68c0cd040 2024-09-10T14:29:57.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== watch-notify(notify (1) cookie 94394193594528 notify 154618822678 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d9dc634670 con 0x7fa68c0cd040 2024-09-10T14:29:57.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa57affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822678 cookie 94394193594528 notifier 4736 bl.length()=556 2024-09-10T14:29:57.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(65 notify.5 [notify cookie 94394193755680 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa57affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T14:29:57.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa57affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:29:57.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.605+0000 7fa57affd640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa55c003eb0 con 0x7fa68c0cd040 2024-09-10T14:29:57.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== watch-notify(notify_complete (2) cookie 94394193755680 notify 154618822678 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d9dc634ce0 con 0x7fa68c0cd040 2024-09-10T14:29:57.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc633dd0 con 0x7fa68c0cd040 2024-09-10T14:29:57.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v36'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa699a86980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T14:29:57.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa699a86980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:29:57.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa699a86980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T14:29:57.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94394193755600 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc638d30 con 0x55d9dc602730 2024-09-10T14:29:57.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== watch-notify(notify (1) cookie 94394193585056 notify 154618822662 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55d9dc5dff30 con 0x55d9dc602730 2024-09-10T14:29:57.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa57affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822662 cookie 94394193585056 notifier 4736 bl.length()=177 2024-09-10T14:29:57.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa57affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T14:29:57.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(68 notify.2 [notify cookie 94394193755600 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa57affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T14:29:57.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa57affd640 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa55c003eb0 con 0x55d9dc602730 2024-09-10T14:29:57.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== watch-notify(notify_complete (2) cookie 94394193755600 notify 154618822662 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d9dc5dfca0 con 0x55d9dc602730 2024-09-10T14:29:57.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.609+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.616 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T14:29:57.608013Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:29:57.608000Z","tags":[],"group_ids":[]} 2024-09-10T14:29:57.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.613+0000 7fa54dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:57.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.613+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94394193595584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc633030 con 0x55d9dc5fdd70 2024-09-10T14:29:57.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.613+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94394193595584] v36'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.613+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94394193576128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc633030 con 0x7fa690054040 2024-09-10T14:29:57.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.613+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94394193576128] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.613+0000 7fa699a86980 20 remove_watcher() i=0 2024-09-10T14:29:57.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.613+0000 7fa699a86980 2 removed watcher, disabling cache 2024-09-10T14:29:57.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.613+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94394193580208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6080c0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.617+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94394193580208] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.617+0000 7fa699a86980 20 remove_watcher() i=1 2024-09-10T14:29:57.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.617+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94394193585056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc633030 con 0x55d9dc602730 2024-09-10T14:29:57.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.617+0000 7fa697596640 1 -- 172.21.15.151:0/3928523605 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94394193585056] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa690038070 con 0x55d9dc602730 2024-09-10T14:29:57.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.617+0000 7fa699a86980 20 remove_watcher() i=2 2024-09-10T14:29:57.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.617+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94394193582336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6090b0 con 0x7fa690054040 2024-09-10T14:29:57.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.621+0000 7fa696d95640 1 -- 172.21.15.151:0/3928523605 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94394193582336] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa68c0d8070 con 0x7fa690054040 2024-09-10T14:29:57.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.621+0000 7fa699a86980 20 remove_watcher() i=3 2024-09-10T14:29:57.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.621+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94394193587360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc60a3a0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.621+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94394193587360] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x55d9dc5fdd70 2024-09-10T14:29:57.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.621+0000 7fa699a86980 20 remove_watcher() i=4 2024-09-10T14:29:57.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.621+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94394193594528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc633030 con 0x7fa68c0cd040 2024-09-10T14:29:57.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.625+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94394193594528] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.625+0000 7fa699a86980 20 remove_watcher() i=5 2024-09-10T14:29:57.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.625+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94394193598464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc609900 con 0x7fa68c0cd040 2024-09-10T14:29:57.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.625+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94394193598464] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.625+0000 7fa699a86980 20 remove_watcher() i=6 2024-09-10T14:29:57.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.625+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94394193601024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55d9dc6090b0 con 0x7fa68c0cd040 2024-09-10T14:29:57.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94394193601024] v36'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6880083f0 con 0x7fa68c0cd040 2024-09-10T14:29:57.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 20 remove_watcher() i=7 2024-09-10T14:29:57.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa68c0cd040 msgr2=0x7fa68c0ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa68c0cd040 0x7fa68c0ce430 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc5fdd70 msgr2=0x55d9dc600230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc5fdd70 0x55d9dc600230 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa690054040 msgr2=0x7fa690052660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa690054040 0x7fa690052660 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc602730 msgr2=0x55d9dc604b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc602730 0x55d9dc604b20 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa560034650 msgr2=0x7fa560036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa560034650 0x7fa560036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00a480 tx=0x7fa68c0a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 msgr2=0x55d9dc5f2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5f2dc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa69001bfd0 tx=0x7fa690033e70 comp rx=0 tx=0).stop 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa697d97640 1 -- 172.21.15.151:0/3928523605 reap_dead start 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 shutdown_connections 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3928523605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5ebcf0 0x55d9dc5f2dc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 >> 172.21.15.151:0/3928523605 conn(0x55d9dc5e8020 msgr2=0x55d9dc5e60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 shutdown_connections 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3928523605 wait complete. 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3278381792 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5700346f0 msgr2=0x7fa570036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3278381792 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5700346f0 0x7fa570036bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55d9dc5c94a0 tx=0x7fa68c005a10 comp rx=0 tx=0).stop 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3278381792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5df340 msgr2=0x55d9dc5df760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3278381792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5df340 0x55d9dc5df760 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa690047520 tx=0x7fa690024fa0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3278381792 shutdown_connections 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3278381792 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa5700346f0 0x7fa570036bb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/3278381792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc5df340 0x55d9dc5df760 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3278381792 >> 172.21.15.151:0/3278381792 conn(0x55d9dc5d4490 msgr2=0x55d9dc5d6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3278381792 shutdown_connections 2024-09-10T14:29:57.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/3278381792 wait complete. 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d9dc5cee10 msgr2=0x55d9dc5d1200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55d9dc5cee10 0x55d9dc5d1200 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc4cee90 msgr2=0x55d9dc5c8670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55d9dc4cee90 0x55d9dc5c8670 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc5caef0 msgr2=0x55d9dc5cd2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55d9dc5caef0 0x55d9dc5cd2e0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa57c034650 msgr2=0x7fa57c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa57c034650 0x7fa57c036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0ad000 tx=0x7fa68c0a5040 comp rx=0 tx=0).stop 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 msgr2=0x55d9dc5c1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 --2- 172.21.15.151:0/2117755885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d9dc43cb40 0x55d9dc5c1570 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa690014040 tx=0x7fa690001260 comp rx=0 tx=0).stop 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa697d97640 1 -- 172.21.15.151:0/2117755885 reap_dead start 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 shutdown_connections 2024-09-10T14:29:57.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 >> 172.21.15.151:0/2117755885 conn(0x55d9dc4c30a0 msgr2=0x55d9dc5b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 shutdown_connections 2024-09-10T14:29:57.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.629+0000 7fa699a86980 1 -- 172.21.15.151:0/2117755885 wait complete. 2024-09-10T14:29:57.645 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T14:29:57.608013Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:29:57.608000Z', 'tags': [], 'group_ids': []} 2024-09-10T14:29:57.662 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:57.670 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-10T14:29:57.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T14:29:57.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T14:29:57.671 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-10T14:29:57.703 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:57.704 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:57.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b4bcf1980 1 Processor -- start 2024-09-10T14:29:57.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b4bcf1980 1 -- start start 2024-09-10T14:29:57.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b4bcf1980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5584e01052e0 0x5584e0193370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b4bcf1980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5584e0018ae0 con 0x5584e01938b0 2024-09-10T14:29:57.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b4bcf1980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5584e003ce30 con 0x5584e01052e0 2024-09-10T14:29:57.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b49801640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5584e01052e0 0x5584e0193370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b49801640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5584e01052e0 0x5584e0193370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43254/0 (socket says 172.21.15.151:43254) 2024-09-10T14:29:57.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b49801640 1 -- 172.21.15.151:0/2046107362 learned_addr learned my addr 172.21.15.151:0/2046107362 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b49000640 1 --1- 172.21.15.151:0/2046107362 >> v1:172.21.15.52:6789/0 conn(0x5584e01938b0 0x5584e0195ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:56360/0 (socket says 172.21.15.151:56360) 2024-09-10T14:29:57.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b49801640 1 -- 172.21.15.151:0/2046107362 >> v1:172.21.15.52:6789/0 conn(0x5584e01938b0 legacy=0x5584e0195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.701+0000 7f6b49801640 1 -- 172.21.15.151:0/2046107362 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e01983d0 con 0x5584e01052e0 2024-09-10T14:29:57.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b49801640 1 --2- 172.21.15.151:0/2046107362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e0193370 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00a5c0 tx=0x7f6b3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cb56fdee4d86ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b3bfff640 1 -- 172.21.15.151:0/2046107362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0a6070 con 0x5584e01052e0 2024-09-10T14:29:57.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b3bfff640 1 -- 172.21.15.151:0/2046107362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0af070 con 0x5584e01052e0 2024-09-10T14:29:57.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b3bfff640 1 -- 172.21.15.151:0/2046107362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0aa5c0 con 0x5584e01052e0 2024-09-10T14:29:57.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2046107362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 msgr2=0x5584e0193370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/2046107362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e0193370 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00a5c0 tx=0x7f6b3c01b340 comp rx=0 tx=0).stop 2024-09-10T14:29:57.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2046107362 shutdown_connections 2024-09-10T14:29:57.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/2046107362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e0193370 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2046107362 >> 172.21.15.151:0/2046107362 conn(0x5584e018b0a0 msgr2=0x5584e018d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2046107362 shutdown_connections 2024-09-10T14:29:57.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.705+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2046107362 wait complete. 2024-09-10T14:29:57.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b4bcf1980 1 Processor -- start 2024-09-10T14:29:57.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b4bcf1980 1 -- start start 2024-09-10T14:29:57.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b4bcf1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e027ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b4bcf1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5584e003e200 con 0x5584e01052e0 2024-09-10T14:29:57.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e027ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e027ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43264/0 (socket says 172.21.15.151:43264) 2024-09-10T14:29:57.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b49801640 1 -- 172.21.15.151:0/2047810911 learned_addr learned my addr 172.21.15.151:0/2047810911 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b49801640 1 -- 172.21.15.151:0/2047810911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e027bfd0 con 0x5584e01052e0 2024-09-10T14:29:57.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6b49801640 1 --2- 172.21.15.151:0/2047810911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e027ba00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0199f0 tx=0x7f6b3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5438dc2d711c4aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6a37606640 1 -- 172.21.15.151:0/2047810911 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0aaa00 con 0x5584e01052e0 2024-09-10T14:29:57.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6a37606640 1 -- 172.21.15.151:0/2047810911 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0aaba0 con 0x5584e01052e0 2024-09-10T14:29:57.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.721+0000 7f6a37606640 1 -- 172.21.15.151:0/2047810911 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0bd3f0 con 0x5584e01052e0 2024-09-10T14:29:57.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2047810911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 msgr2=0x5584e027ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/2047810911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e027ba00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0199f0 tx=0x7f6b3c003030 comp rx=0 tx=0).stop 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2047810911 shutdown_connections 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/2047810911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e027ba00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2047810911 >> 172.21.15.151:0/2047810911 conn(0x5584e018b0a0 msgr2=0x5584e0277630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2047810911 shutdown_connections 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/2047810911 wait complete. 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 Processor -- start 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- start start 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e0282c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5584e0197e40 con 0x5584e01052e0 2024-09-10T14:29:57.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e0282c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e0282c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43278/0 (socket says 172.21.15.151:43278) 2024-09-10T14:29:57.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b49801640 1 -- 172.21.15.151:0/424484121 learned_addr learned my addr 172.21.15.151:0/424484121 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b49801640 1 -- 172.21.15.151:0/424484121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e02831b0 con 0x5584e01052e0 2024-09-10T14:29:57.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b49801640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e0282c70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c01b380 tx=0x7f6b3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6a35e03640 1 -- 172.21.15.151:0/424484121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0bd7c0 con 0x5584e01052e0 2024-09-10T14:29:57.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584e0283440 con 0x5584e01052e0 2024-09-10T14:29:57.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6a35e03640 1 -- 172.21.15.151:0/424484121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0cc070 con 0x5584e01052e0 2024-09-10T14:29:57.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6a35e03640 1 -- 172.21.15.151:0/424484121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0bda90 con 0x5584e01052e0 2024-09-10T14:29:57.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.725+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584e0286120 con 0x5584e01052e0 2024-09-10T14:29:57.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6a35e03640 1 -- 172.21.15.151:0/424484121 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b3c0bdc30 con 0x5584e01052e0 2024-09-10T14:29:57.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6a35e03640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a30034650 0x7f6a30036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6a35e03640 1 -- 172.21.15.151:0/424484121 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6b3c0e5830 con 0x5584e01052e0 2024-09-10T14:29:57.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b49000640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a30034650 0x7f6a30036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e01938b0 0x5584e0289c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e028a250 con 0x5584e01938b0 2024-09-10T14:29:57.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4a002640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e01938b0 0x5584e0289c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b49000640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a30034650 0x7f6a30036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b40000f70 tx=0x7f6b40001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4a002640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e01938b0 0x5584e0289c00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4a002640 1 -- 172.21.15.151:0/424484121 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e01938b0 2024-09-10T14:29:57.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e0287340 con 0x5584e01938b0 2024-09-10T14:29:57.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4a002640 1 -- 172.21.15.151:0/424484121 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e01938b0 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e028c5b0 0x5584e028e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e028f070 con 0x5584e028c5b0 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b49801640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e028c5b0 0x5584e028e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b49801640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e028c5b0 0x5584e028e9a0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b49801640 1 -- 172.21.15.151:0/424484121 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e028c5b0 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e028b450 con 0x5584e01938b0 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4a002640 1 -- 172.21.15.151:0/424484121 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e01938b0 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5584e02904d0 0x5584e02928c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e0292fc0 con 0x5584e02904d0 2024-09-10T14:29:57.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.729+0000 7f6b49000640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5584e02904d0 0x5584e02928c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b49000640 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5584e02904d0 0x5584e02928c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b49000640 1 -- 172.21.15.151:0/424484121 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b4000f6a0 con 0x5584e02904d0 2024-09-10T14:29:57.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b4bcf1980 1 Processor -- start 2024-09-10T14:29:57.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b4bcf1980 1 -- start start 2024-09-10T14:29:57.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b4bcf1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e02a0a90 0x5584e02a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b4bcf1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5584e0097800 con 0x5584e02a0a90 2024-09-10T14:29:57.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e02a0a90 0x5584e02a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e02a0a90 0x5584e02a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43284/0 (socket says 172.21.15.151:43284) 2024-09-10T14:29:57.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b49801640 1 -- 172.21.15.151:0/556789142 learned_addr learned my addr 172.21.15.151:0/556789142 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b49801640 1 -- 172.21.15.151:0/556789142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e02a13f0 con 0x5584e02a0a90 2024-09-10T14:29:57.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b49801640 1 --2- 172.21.15.151:0/556789142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e02a0a90 0x5584e02a0eb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0d0b30 tx=0x7f6b3c0c56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6a2effd640 1 -- 172.21.15.151:0/556789142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0c5a40 con 0x5584e02a0a90 2024-09-10T14:29:57.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/556789142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584e02a1680 con 0x5584e02a0a90 2024-09-10T14:29:57.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6a2effd640 1 -- 172.21.15.151:0/556789142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0e50b0 con 0x5584e02a0a90 2024-09-10T14:29:57.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6a2effd640 1 -- 172.21.15.151:0/556789142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0e53b0 con 0x5584e02a0a90 2024-09-10T14:29:57.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.733+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/556789142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584e02a4300 con 0x5584e02a0a90 2024-09-10T14:29:57.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6a2effd640 1 -- 172.21.15.151:0/556789142 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b3c0c6480 con 0x5584e02a0a90 2024-09-10T14:29:57.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6a2effd640 1 --2- 172.21.15.151:0/556789142 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a20034650 0x7f6a20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6a2effd640 1 -- 172.21.15.151:0/556789142 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6b3c0a4a20 con 0x5584e02a0a90 2024-09-10T14:29:57.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b49000640 1 --2- 172.21.15.151:0/556789142 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a20034650 0x7f6a20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 Processor -- start 2024-09-10T14:29:57.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- start start 2024-09-10T14:29:57.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b49000640 1 --2- 172.21.15.151:0/556789142 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a20034650 0x7f6a20036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5584e028ab60 tx=0x7f6b4000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e018f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5584e027c290 con 0x5584e018f330 2024-09-10T14:29:57.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e018f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e018f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43290/0 (socket says 172.21.15.151:43290) 2024-09-10T14:29:57.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b49801640 1 -- 172.21.15.151:0/1126130684 learned_addr learned my addr 172.21.15.151:0/1126130684 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b49801640 1 -- 172.21.15.151:0/1126130684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e018fd00 con 0x5584e018f330 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b49801640 1 --2- 172.21.15.151:0/1126130684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e018f730 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0b3a60 tx=0x7f6b3c0f7ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39905d058393c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6a2cff9640 1 -- 172.21.15.151:0/1126130684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0eed40 con 0x5584e018f330 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6a2cff9640 1 -- 172.21.15.151:0/1126130684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c107070 con 0x5584e018f330 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6a2cff9640 1 -- 172.21.15.151:0/1126130684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0a4e70 con 0x5584e018f330 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/1126130684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 msgr2=0x5584e018f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/1126130684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e018f730 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0b3a60 tx=0x7f6b3c0f7ac0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/1126130684 shutdown_connections 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/1126130684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e018f730 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/1126130684 >> 172.21.15.151:0/1126130684 conn(0x5584e02a9790 msgr2=0x5584e02a7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/1126130684 shutdown_connections 2024-09-10T14:29:57.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/1126130684 wait complete. 2024-09-10T14:29:57.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 Processor -- start 2024-09-10T14:29:57.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- start start 2024-09-10T14:29:57.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e02b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.737+0000 7f6b4bcf1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5584e018fd00 con 0x5584e018f330 2024-09-10T14:29:57.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e02b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b49801640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e02b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43302/0 (socket says 172.21.15.151:43302) 2024-09-10T14:29:57.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 learned_addr learned my addr 172.21.15.151:0/108914330 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e02b6aa0 con 0x5584e018f330 2024-09-10T14:29:57.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b49801640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e02b6560 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0dc010 tx=0x7f6b3c0a46c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6a1effd640 1 -- 172.21.15.151:0/108914330 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0b9200 con 0x5584e018f330 2024-09-10T14:29:57.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6a1effd640 1 -- 172.21.15.151:0/108914330 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c112070 con 0x5584e018f330 2024-09-10T14:29:57.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6a1effd640 1 -- 172.21.15.151:0/108914330 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c0a89a0 con 0x5584e018f330 2024-09-10T14:29:57.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584e02b6aa0 con 0x5584e018f330 2024-09-10T14:29:57.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584e02b6aa0 con 0x5584e018f330 2024-09-10T14:29:57.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6a1effd640 1 -- 172.21.15.151:0/108914330 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b3c0a8b40 con 0x5584e018f330 2024-09-10T14:29:57.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6a1effd640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a140346f0 0x7f6a14036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6a1effd640 1 -- 172.21.15.151:0/108914330 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6b3c118d90 con 0x5584e018f330 2024-09-10T14:29:57.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e02c1560 0x5584e02c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c4100 con 0x5584e02c1560 2024-09-10T14:29:57.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b4a002640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e02c1560 0x5584e02c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.741+0000 7f6b4a002640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e02c1560 0x5584e02c39b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 realm 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c4510 con 0x5584e02c1560 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:57.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c4db0 con 0x5584e02c1560 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e02c5eb0 0x5584e02c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c88f0 con 0x5584e02c5eb0 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49801640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e02c5eb0 0x5584e02c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49801640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e02c5eb0 0x5584e02c82a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:57.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 20 searching for the correct realm 2024-09-10T14:29:57.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02ca150 con 0x5584e02c5eb0 2024-09-10T14:29:57.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49801640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6b3c10e040 0x7f6b3c1089d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02ca150 con 0x7f6b3c10e040 2024-09-10T14:29:57.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49000640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6b3c10e040 0x7f6b3c1089d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49000640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6b3c10e040 0x7f6b3c1089d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4000f6a0 con 0x7f6b3c10e040 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49000640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6b40030040 0x7f6b4001f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02ca150 con 0x7f6b40030040 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.745+0000 7f6b4a002640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6b40030040 0x7f6b4001f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6b40030040 0x7f6b4001f430 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b40030040 2024-09-10T14:29:57.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b40030040 2024-09-10T14:29:57.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b3c10e040 2024-09-10T14:29:57.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4000f6a0 con 0x7f6b3c10e040 2024-09-10T14:29:57.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c5eb0 2024-09-10T14:29:57.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.749+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b40030040 2024-09-10T14:29:57.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b3c10e040 2024-09-10T14:29:57.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6b4000f6a0 con 0x7f6b3c10e040 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c5eb0 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c5eb0 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b3c10e040 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4000f6a0 con 0x7f6b3c10e040 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c5eb0 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c5eb0 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b40030040 2024-09-10T14:29:57.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.753+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c5eb0 2024-09-10T14:29:57.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b3c10e040 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4000f6a0 con 0x7f6b3c10e040 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b3c10e040 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c5eb0 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b40030040 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b3c10e040 2024-09-10T14:29:57.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c5eb0 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b40030040 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x5584e02c1560 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c5150 con 0x7f6b3c10e040 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4bcf1980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4bcf1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4bcf1980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4bcf1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4bcf1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:57.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4bcf1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.757+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c9270 con 0x5584e02c1560 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b49000640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a140346f0 0x7f6a14036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c9ac0 con 0x5584e02c1560 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b49000640 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a140346f0 0x7f6a14036bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0dbe00 tx=0x7f6b40023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c9610 con 0x7f6b40030040 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 zone default found 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 4 Realm: () 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 zonegroup default 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02c9a40 con 0x7f6b3c10e040 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cbff0 con 0x5584e02c5eb0 2024-09-10T14:29:57.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cc4c0 con 0x5584e02c5eb0 2024-09-10T14:29:57.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 started sync module instance, tier type = 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cb400 con 0x7f6b3c10e040 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94029185068880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cc920 con 0x7f6b3c10e040 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.761+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cd170 con 0x5584e02c1560 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.765+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94029185068880] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.765+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.765+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94029185076416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cd590 con 0x5584e02c1560 2024-09-10T14:29:57.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.765+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cdde0 con 0x5584e02c5eb0 2024-09-10T14:29:57.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.765+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94029185076416] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94029185077744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cdc20 con 0x5584e02c5eb0 2024-09-10T14:29:57.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02ce7f0 con 0x7f6b3c10e040 2024-09-10T14:29:57.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94029185082176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cf090 con 0x7f6b3c10e040 2024-09-10T14:29:57.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cfa90 con 0x5584e02c1560 2024-09-10T14:29:57.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94029185077744] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94029185082176] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94029185084384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cf5a0 con 0x5584e02c1560 2024-09-10T14:29:57.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.769+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02d0330 con 0x7f6b40030040 2024-09-10T14:29:57.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.773+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.773+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94029185088976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02d06a0 con 0x7f6b40030040 2024-09-10T14:29:57.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.773+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02d1120 con 0x7f6b40030040 2024-09-10T14:29:57.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.773+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94029185084384] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94029185088976] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94029185092624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02d10e0 con 0x7f6b40030040 2024-09-10T14:29:57.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02d01f0 con 0x7f6b40030040 2024-09-10T14:29:57.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94029185092624] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94029185090032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02d15f0 con 0x7f6b40030040 2024-09-10T14:29:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 20 add_watcher() i=0 2024-09-10T14:29:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 20 add_watcher() i=1 2024-09-10T14:29:57.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 20 add_watcher() i=2 2024-09-10T14:29:57.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 20 add_watcher() i=3 2024-09-10T14:29:57.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 20 add_watcher() i=4 2024-09-10T14:29:57.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 20 add_watcher() i=5 2024-09-10T14:29:57.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.777+0000 7f6b4bcf1980 20 add_watcher() i=6 2024-09-10T14:29:57.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94029185090032] v36'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 20 add_watcher() i=7 2024-09-10T14:29:57.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:57.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02d4ad0 con 0x5584e02c1560 2024-09-10T14:29:57.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94029185095152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02d1ef0 con 0x5584e02c1560 2024-09-10T14:29:57.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94029185095152] v36'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f69ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 5 note: GC not initialized 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f69fe7e4640 20 reqs_thread_entry: start 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 20 Filter name: none 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f696ffff640 20 reqs_thread_entry: start 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.781+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5584e02f80b0 con 0x7f6b3c10e040 2024-09-10T14:29:57.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f6b4bcf1980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:29:57.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f6b4bcf1980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T14:29:57.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f6b4bcf1980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T14:29:57.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f6b4bcf1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:57.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02fc2d0 con 0x7f6b40030040 2024-09-10T14:29:57.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v36'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.789 INFO:teuthology.orchestra.run.smithi151.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-10T14:29:57.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f69ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:57.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.785+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94029185095152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02f5ee0 con 0x5584e02c1560 2024-09-10T14:29:57.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.789+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94029185095152] v36'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.789+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94029185068880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02f5ee0 con 0x7f6b3c10e040 2024-09-10T14:29:57.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.789+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94029185068880] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.789+0000 7f6b4bcf1980 20 remove_watcher() i=0 2024-09-10T14:29:57.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.789+0000 7f6b4bcf1980 2 removed watcher, disabling cache 2024-09-10T14:29:57.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.789+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94029185076416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02caf50 con 0x5584e02c1560 2024-09-10T14:29:57.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94029185076416] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b4bcf1980 20 remove_watcher() i=1 2024-09-10T14:29:57.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94029185077744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02f5ee0 con 0x5584e02c5eb0 2024-09-10T14:29:57.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b49801640 1 -- 172.21.15.151:0/108914330 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94029185077744] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b3c0c5d00 con 0x5584e02c5eb0 2024-09-10T14:29:57.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b4bcf1980 20 remove_watcher() i=2 2024-09-10T14:29:57.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94029185082176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cccc0 con 0x7f6b3c10e040 2024-09-10T14:29:57.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b49000640 1 -- 172.21.15.151:0/108914330 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94029185082176] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4003d040 con 0x7f6b3c10e040 2024-09-10T14:29:57.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b4bcf1980 20 remove_watcher() i=3 2024-09-10T14:29:57.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.793+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94029185084384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02caf50 con 0x5584e02c1560 2024-09-10T14:29:57.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.797+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94029185084384] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x5584e02c1560 2024-09-10T14:29:57.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.797+0000 7f6b4bcf1980 20 remove_watcher() i=4 2024-09-10T14:29:57.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.797+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94029185088976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cd1f0 con 0x7f6b40030040 2024-09-10T14:29:57.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.797+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94029185088976] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.797+0000 7f6b4bcf1980 20 remove_watcher() i=5 2024-09-10T14:29:57.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.797+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94029185092624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02f5ee0 con 0x7f6b40030040 2024-09-10T14:29:57.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.801+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94029185092624] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.801+0000 7f6b4bcf1980 20 remove_watcher() i=6 2024-09-10T14:29:57.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.801+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94029185090032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5584e02cccc0 con 0x7f6b40030040 2024-09-10T14:29:57.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.801+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94029185090032] v36'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b4400a4d0 con 0x7f6b40030040 2024-09-10T14:29:57.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.801+0000 7f6b4bcf1980 20 remove_watcher() i=7 2024-09-10T14:29:57.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6b40030040 msgr2=0x7f6b4001f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6b40030040 0x7f6b4001f430 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e02c1560 msgr2=0x5584e02c39b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e02c1560 0x5584e02c39b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6b3c10e040 msgr2=0x7f6b3c1089d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6b3c10e040 0x7f6b3c1089d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e02c5eb0 msgr2=0x5584e02c82a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e02c5eb0 0x5584e02c82a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a140346f0 msgr2=0x7f6a14036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a140346f0 0x7f6a14036bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0dbe00 tx=0x7f6b40023040 comp rx=0 tx=0).stop 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 msgr2=0x5584e02b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4a002640 1 -- 172.21.15.151:0/108914330 reap_dead start 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e02b6560 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0dc010 tx=0x7f6b3c0a46c0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 shutdown_connections 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/108914330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e018f330 0x5584e02b6560 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 >> 172.21.15.151:0/108914330 conn(0x5584e02a9790 msgr2=0x5584e02a7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 shutdown_connections 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/108914330 wait complete. 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/556789142 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a20034650 msgr2=0x7f6a20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/556789142 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a20034650 0x7f6a20036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5584e028ab60 tx=0x7f6b4000f000 comp rx=0 tx=0).stop 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/556789142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e02a0a90 msgr2=0x5584e02a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/556789142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e02a0a90 0x5584e02a0eb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0d0b30 tx=0x7f6b3c0c56b0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/556789142 shutdown_connections 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/556789142 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a20034650 0x7f6a20036b10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/556789142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e02a0a90 0x5584e02a0eb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/556789142 >> 172.21.15.151:0/556789142 conn(0x5584e0295be0 msgr2=0x5584e0298660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/556789142 shutdown_connections 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/556789142 wait complete. 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5584e02904d0 msgr2=0x5584e02928c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5584e02904d0 0x5584e02928c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e01938b0 msgr2=0x5584e0289c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5584e01938b0 0x5584e0289c00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e028c5b0 msgr2=0x5584e028e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5584e028c5b0 0x5584e028e9a0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a30034650 msgr2=0x7f6a30036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6a30034650 0x7f6a30036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b40000f70 tx=0x7f6b40001380 comp rx=0 tx=0).stop 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 msgr2=0x5584e0282c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 --2- 172.21.15.151:0/424484121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5584e01052e0 0x5584e0282c70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c01b380 tx=0x7f6b3c0180e0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4a002640 1 -- 172.21.15.151:0/424484121 reap_dead start 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 shutdown_connections 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 >> 172.21.15.151:0/424484121 conn(0x5584e018b0a0 msgr2=0x5584e02761b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 shutdown_connections 2024-09-10T14:29:57.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.805+0000 7f6b4bcf1980 1 -- 172.21.15.151:0/424484121 wait complete. 2024-09-10T14:29:57.819 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T14:29:57.865 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:57.865 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T14:29:57.871 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T14:29:57.871 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-10T14:29:57.872 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T14:29:57.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T14:29:57.872 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-10T14:29:57.906 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:57.906 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:57.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e9fe5980 1 Processor -- start 2024-09-10T14:29:57.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e9fe5980 1 -- start start 2024-09-10T14:29:57.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e9fe5980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555f02e13ea0 0x555f02e16290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e9fe5980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555f02c95ae0 con 0x555f02d81ad0 2024-09-10T14:29:57.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e9fe5980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x555f02cb9e30 con 0x555f02e13ea0 2024-09-10T14:29:57.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e72f4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555f02e13ea0 0x555f02e16290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e72f4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x555f02e13ea0 0x555f02e16290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43308/0 (socket says 172.21.15.151:43308) 2024-09-10T14:29:57.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e72f4640 1 -- 172.21.15.151:0/949921014 learned_addr learned my addr 172.21.15.151:0/949921014 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e72f4640 1 -- 172.21.15.151:0/949921014 >> v1:172.21.15.52:6789/0 conn(0x555f02d81ad0 legacy=0x555f02e12780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.905+0000 7fe8e72f4640 1 -- 172.21.15.151:0/949921014 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02d81eb0 con 0x555f02e13ea0 2024-09-10T14:29:57.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/949921014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02e13ea0 0x555f02e16290 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00a5c0 tx=0x7fe8dc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0348009acf29fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e6af3640 1 -- 172.21.15.151:0/949921014 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8dc0a6070 con 0x555f02e13ea0 2024-09-10T14:29:57.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e6af3640 1 -- 172.21.15.151:0/949921014 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8dc0af070 con 0x555f02e13ea0 2024-09-10T14:29:57.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e6af3640 1 -- 172.21.15.151:0/949921014 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8dc0aa5c0 con 0x555f02e13ea0 2024-09-10T14:29:57.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/949921014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02e13ea0 msgr2=0x555f02e16290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/949921014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02e13ea0 0x555f02e16290 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00a5c0 tx=0x7fe8dc01b340 comp rx=0 tx=0).stop 2024-09-10T14:29:57.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/949921014 shutdown_connections 2024-09-10T14:29:57.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/949921014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02e13ea0 0x555f02e16290 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/949921014 >> 172.21.15.151:0/949921014 conn(0x555f02e08070 msgr2=0x555f02e0a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/949921014 shutdown_connections 2024-09-10T14:29:57.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.909+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/949921014 wait complete. 2024-09-10T14:29:57.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e9fe5980 1 Processor -- start 2024-09-10T14:29:57.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e9fe5980 1 -- start start 2024-09-10T14:29:57.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e9fe5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02efac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e9fe5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f02cbb200 con 0x555f02d81ad0 2024-09-10T14:29:57.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02efac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02efac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43324/0 (socket says 172.21.15.151:43324) 2024-09-10T14:29:57.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e7af5640 1 -- 172.21.15.151:0/2716197789 learned_addr learned my addr 172.21.15.151:0/2716197789 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e7af5640 1 -- 172.21.15.151:0/2716197789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02efb200 con 0x555f02d81ad0 2024-09-10T14:29:57.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/2716197789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02efac30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00016c0 tx=0x7fe8e0001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166482a9e7eb1bc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe7d5e0b640 1 -- 172.21.15.151:0/2716197789 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e0016070 con 0x555f02d81ad0 2024-09-10T14:29:57.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe7d5e0b640 1 -- 172.21.15.151:0/2716197789 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e000f640 con 0x555f02d81ad0 2024-09-10T14:29:57.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.925+0000 7fe7d5e0b640 1 -- 172.21.15.151:0/2716197789 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e000f9a0 con 0x555f02d81ad0 2024-09-10T14:29:57.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2716197789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 msgr2=0x555f02efac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/2716197789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02efac30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00016c0 tx=0x7fe8e0001b80 comp rx=0 tx=0).stop 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2716197789 shutdown_connections 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/2716197789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02efac30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2716197789 >> 172.21.15.151:0/2716197789 conn(0x555f02e08070 msgr2=0x555f02ef6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2716197789 shutdown_connections 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2716197789 wait complete. 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 Processor -- start 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- start start 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02f01ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f02e19260 con 0x555f02d81ad0 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02f01ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02f01ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43338/0 (socket says 172.21.15.151:43338) 2024-09-10T14:29:57.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e7af5640 1 -- 172.21.15.151:0/3677072707 learned_addr learned my addr 172.21.15.151:0/3677072707 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e7af5640 1 -- 172.21.15.151:0/3677072707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02f02530 con 0x555f02d81ad0 2024-09-10T14:29:57.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02f01ff0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000f610 tx=0x7fe8e0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe7cffff640 1 -- 172.21.15.151:0/3677072707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e0021020 con 0x555f02d81ad0 2024-09-10T14:29:57.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f02f027c0 con 0x555f02d81ad0 2024-09-10T14:29:57.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe7cffff640 1 -- 172.21.15.151:0/3677072707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e0011770 con 0x555f02d81ad0 2024-09-10T14:29:57.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe7cffff640 1 -- 172.21.15.151:0/3677072707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e0016040 con 0x555f02d81ad0 2024-09-10T14:29:57.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f02f054a0 con 0x555f02d81ad0 2024-09-10T14:29:57.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.929+0000 7fe7cffff640 1 -- 172.21.15.151:0/3677072707 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8e0024020 con 0x555f02d81ad0 2024-09-10T14:29:57.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe7cffff640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7d0034650 0x7fe7d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe7cffff640 1 -- 172.21.15.151:0/3677072707 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe8e0049780 con 0x555f02d81ad0 2024-09-10T14:29:57.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7d0034650 0x7fe7d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02e13ea0 0x555f02f08fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f095e0 con 0x555f02e13ea0 2024-09-10T14:29:57.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e82f6640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02e13ea0 0x555f02f08fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7d0034650 0x7fe7d0036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0ae000 tx=0x7fe8dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e82f6640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02e13ea0 0x555f02f08fa0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e82f6640 1 -- 172.21.15.151:0/3677072707 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02e13ea0 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f066c0 con 0x555f02e13ea0 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e82f6640 1 -- 172.21.15.151:0/3677072707 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02e13ea0 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f0b910 0x555f02f0dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f0e3d0 con 0x555f02f0b910 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f0b910 0x555f02f0dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f0b910 0x555f02f0dd00 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e7af5640 1 -- 172.21.15.151:0/3677072707 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f0b910 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f0a7b0 con 0x555f02e13ea0 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e82f6640 1 -- 172.21.15.151:0/3677072707 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02e13ea0 2024-09-10T14:29:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555f02f0f810 0x555f02f11c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f12390 con 0x555f02f0f810 2024-09-10T14:29:57.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555f02f0f810 0x555f02f11c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.933+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555f02f0f810 0x555f02f11c00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e72f4640 1 -- 172.21.15.151:0/3677072707 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x555f02f0f810 2024-09-10T14:29:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e9fe5980 1 Processor -- start 2024-09-10T14:29:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e9fe5980 1 -- start start 2024-09-10T14:29:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e9fe5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f1fe20 0x555f02f20240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e9fe5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f02d14800 con 0x555f02f1fe20 2024-09-10T14:29:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f1fe20 0x555f02f20240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f1fe20 0x555f02f20240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43346/0 (socket says 172.21.15.151:43346) 2024-09-10T14:29:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e7af5640 1 -- 172.21.15.151:0/2042782643 learned_addr learned my addr 172.21.15.151:0/2042782643 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e7af5640 1 -- 172.21.15.151:0/2042782643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02f20780 con 0x555f02f1fe20 2024-09-10T14:29:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/2042782643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f1fe20 0x555f02f20240 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0047b30 tx=0x7fe8e0011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe7cd7fa640 1 -- 172.21.15.151:0/2042782643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e0010de0 con 0x555f02f1fe20 2024-09-10T14:29:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe7cd7fa640 1 -- 172.21.15.151:0/2042782643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e002d300 con 0x555f02f1fe20 2024-09-10T14:29:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2042782643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f02f20a10 con 0x555f02f1fe20 2024-09-10T14:29:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe7cd7fa640 1 -- 172.21.15.151:0/2042782643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e002d5e0 con 0x555f02f1fe20 2024-09-10T14:29:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.937+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2042782643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f02f23690 con 0x555f02f1fe20 2024-09-10T14:29:57.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe7cd7fa640 1 -- 172.21.15.151:0/2042782643 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8e0049b60 con 0x555f02f1fe20 2024-09-10T14:29:57.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe7cd7fa640 1 --2- 172.21.15.151:0/2042782643 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7c0034650 0x7fe7c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe7cd7fa640 1 -- 172.21.15.151:0/2042782643 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe8e0037070 con 0x555f02f1fe20 2024-09-10T14:29:57.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/2042782643 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7c0034650 0x7fe7c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 Processor -- start 2024-09-10T14:29:57.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- start start 2024-09-10T14:29:57.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f2cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/2042782643 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7c0034650 0x7fe7c0036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc017f50 tx=0x7fe8dc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f02efb580 con 0x555f02f2c790 2024-09-10T14:29:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f2cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f2cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43362/0 (socket says 172.21.15.151:43362) 2024-09-10T14:29:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e7af5640 1 -- 172.21.15.151:0/3874826523 learned_addr learned my addr 172.21.15.151:0/3874826523 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e7af5640 1 -- 172.21.15.151:0/3874826523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02f2d140 con 0x555f02f2c790 2024-09-10T14:29:57.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/3874826523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f2cb70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001cb50 tx=0x7fe8e004b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd7e1cf04f69e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe7c6ffd640 1 -- 172.21.15.151:0/3874826523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00104d0 con 0x555f02f2c790 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe7c6ffd640 1 -- 172.21.15.151:0/3874826523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e0030030 con 0x555f02f2c790 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe7c6ffd640 1 -- 172.21.15.151:0/3874826523 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e0041ae0 con 0x555f02f2c790 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3874826523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 msgr2=0x555f02f2cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3874826523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f2cb70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001cb50 tx=0x7fe8e004b1e0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3874826523 shutdown_connections 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3874826523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f2cb70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3874826523 >> 172.21.15.151:0/3874826523 conn(0x555f02f28b70 msgr2=0x555f02f26c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3874826523 shutdown_connections 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3874826523 wait complete. 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 Processor -- start 2024-09-10T14:29:57.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- start start 2024-09-10T14:29:57.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f33990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.941+0000 7fe8e9fe5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f02f2d5e0 con 0x555f02f2c790 2024-09-10T14:29:57.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f33990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e7af5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f33990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43366/0 (socket says 172.21.15.151:43366) 2024-09-10T14:29:57.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 learned_addr learned my addr 172.21.15.151:0/817634039 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02f33ed0 con 0x555f02f2c790 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f33990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe8e002dbe0 tx=0x7fe8e00303c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe7c57fa640 1 -- 172.21.15.151:0/817634039 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e00301e0 con 0x555f02f2c790 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f02f33ed0 con 0x555f02f2c790 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe7c57fa640 1 -- 172.21.15.151:0/817634039 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e0041510 con 0x555f02f2c790 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe7c57fa640 1 -- 172.21.15.151:0/817634039 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8e003ba80 con 0x555f02f2c790 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f02f34340 con 0x555f02f2c790 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe7c57fa640 1 -- 172.21.15.151:0/817634039 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8e006e020 con 0x555f02f2c790 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe7c57fa640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7b0034650 0x7fe7b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe7c57fa640 1 -- 172.21.15.151:0/817634039 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fe8e006c020 con 0x555f02f2c790 2024-09-10T14:29:57.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7b0034650 0x7fe7b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02f3e9e0 0x555f02f40ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f415f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e82f6640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02f3e9e0 0x555f02f40ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7b0034650 0x7fe7b0036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000c10 tx=0x7fe8dc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e82f6640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02f3e9e0 0x555f02f40ea0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.945+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 realm 2024-09-10T14:29:57.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f41a00 con 0x555f02f3e9e0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f422d0 con 0x555f02f3e9e0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f433d0 0x555f02f457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f45dd0 con 0x555f02f433d0 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f433d0 0x555f02f457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f433d0 0x555f02f457c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 20 searching for the correct realm 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f476a0 con 0x555f02f433d0 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e7af5640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fe8e0026020 0x7fe8e0033070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f476a0 con 0x7fe8e0026020 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fe8e0026020 0x7fe8e0033070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fe8e0026020 0x7fe8e0033070 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e72f4640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe8dc0e0040 0x7fe8dc0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f476a0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e82f6640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe8dc0e0040 0x7fe8dc0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.949+0000 7fe8e82f6640 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe8dc0e0040 0x7fe8dc0e0420 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8dc0e0040 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8dc0e0040 2024-09-10T14:29:57.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8e0026020 2024-09-10T14:29:57.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f433d0 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8dc0e0040 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.953+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8e0026020 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f433d0 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f433d0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8e0026020 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f433d0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f433d0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8dc0e0040 2024-09-10T14:29:57.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f433d0 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8e0026020 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.957+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8e0026020 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f433d0 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8dc0e0040 2024-09-10T14:29:57.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8e0026020 2024-09-10T14:29:57.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f433d0 2024-09-10T14:29:57.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8dc0e0040 2024-09-10T14:29:57.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x555f02f3e9e0 2024-09-10T14:29:57.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x555f02f42670 con 0x7fe8e0026020 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f467c0 con 0x555f02f3e9e0 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.961+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f46400 con 0x555f02f3e9e0 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f470e0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 zone default found 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 4 Realm: () 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 zonegroup default 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f47510 con 0x7fe8e0026020 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f494b0 con 0x555f02f433d0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f499b0 con 0x555f02f433d0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 started sync module instance, tier type = 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:57.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f48950 con 0x7fe8e0026020 2024-09-10T14:29:57.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93866559835456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f485b0 con 0x7fe8e0026020 2024-09-10T14:29:57.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.965+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4a7b0 con 0x555f02f3e9e0 2024-09-10T14:29:57.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.969+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93866559835456] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.969+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.969+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93866559839760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4aba0 con 0x555f02f3e9e0 2024-09-10T14:29:57.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.969+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4b560 con 0x555f02f433d0 2024-09-10T14:29:57.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.969+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93866559839760] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93866559844528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4b950 con 0x555f02f433d0 2024-09-10T14:29:57.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4c310 con 0x7fe8e0026020 2024-09-10T14:29:57.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93866559850160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4cf80 con 0x7fe8e0026020 2024-09-10T14:29:57.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4d940 con 0x555f02f3e9e0 2024-09-10T14:29:57.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93866559850160] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93866559844528] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93866559851216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4cef0 con 0x555f02f3e9e0 2024-09-10T14:29:57.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.973+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4ddf0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.977+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93866559851216] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.977+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.977+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93866559853712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4dd60 con 0x7fe8dc0e0040 2024-09-10T14:29:57.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.977+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4e800 con 0x7fe8dc0e0040 2024-09-10T14:29:57.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93866559853712] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93866559855040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4e800 con 0x7fe8dc0e0040 2024-09-10T14:29:57.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4f1c0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93866559855040] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93866559857968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4f1c0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 20 add_watcher() i=0 2024-09-10T14:29:57.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 20 add_watcher() i=1 2024-09-10T14:29:57.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 20 add_watcher() i=2 2024-09-10T14:29:57.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 20 add_watcher() i=3 2024-09-10T14:29:57.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 20 add_watcher() i=4 2024-09-10T14:29:57.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 20 add_watcher() i=5 2024-09-10T14:29:57.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.981+0000 7fe8e9fe5980 20 add_watcher() i=6 2024-09-10T14:29:57.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93866559857968] v36'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e9fe5980 20 add_watcher() i=7 2024-09-10T14:29:57.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e9fe5980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:57.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f52510 con 0x555f02f3e9e0 2024-09-10T14:29:57.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93866559872800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f4f330 con 0x555f02f3e9e0 2024-09-10T14:29:57.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93866559872800] v36'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe79dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:57.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e9fe5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:57.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e9fe5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:57.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.985+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f51890 con 0x555f02f3e9e0 2024-09-10T14:29:57.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.989+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.989+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5b650 con 0x7fe8dc0e0040 2024-09-10T14:29:57.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.989+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:57.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.993+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5ba50 con 0x555f02f433d0 2024-09-10T14:29:57.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.993+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:57.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.993+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5ba20 con 0x555f02f3e9e0 2024-09-10T14:29:57.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.993+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'220 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:57.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.993+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5bf90 con 0x7fe8e0026020 2024-09-10T14:29:57.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.993+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:57.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.993+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5c500 con 0x555f02f433d0 2024-09-10T14:29:58.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.997+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'46 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.997+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5c8c0 con 0x555f02f3e9e0 2024-09-10T14:29:58.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.997+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:57.997+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5c8c0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.001+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.001+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5c8c0 con 0x7fe8e0026020 2024-09-10T14:29:58.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.001+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.001+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5cd70 con 0x555f02f433d0 2024-09-10T14:29:58.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.005+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.005+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5cd70 con 0x7fe8e0026020 2024-09-10T14:29:58.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.005+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.005+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d330 con 0x7fe8dc0e0040 2024-09-10T14:29:58.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.005+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.005+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d330 con 0x7fe8e0026020 2024-09-10T14:29:58.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.009+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.009+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d1f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.009+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.009+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d1f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.013+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'221 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.013+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d1f0 con 0x555f02f433d0 2024-09-10T14:29:58.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.013+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.013+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d1f0 con 0x7fe8e0026020 2024-09-10T14:29:58.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.013+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.013+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d280 con 0x555f02f433d0 2024-09-10T14:29:58.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.017+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.017+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d450 con 0x555f02f3e9e0 2024-09-10T14:29:58.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.017+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.017+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x555f02f3e9e0 2024-09-10T14:29:58.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.021+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'222 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.021+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x555f02f433d0 2024-09-10T14:29:58.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.021+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.021+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x7fe8e0026020 2024-09-10T14:29:58.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.021+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.021+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x555f02f433d0 2024-09-10T14:29:58.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.025+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.025+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x555f02f433d0 2024-09-10T14:29:58.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.025+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.025+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x555f02f433d0 2024-09-10T14:29:58.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.025+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.025+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x555f02f433d0 2024-09-10T14:29:58.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.029+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.029+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.029+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.029+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x555f02f433d0 2024-09-10T14:29:58.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.029+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.029+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.033+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.033+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x555f02f433d0 2024-09-10T14:29:58.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.037+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.037+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.037+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.037+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5d8b0 con 0x7fe8e0026020 2024-09-10T14:29:58.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe79cfe1640 20 reqs_thread_entry: start 2024-09-10T14:29:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 20 Filter name: none 2024-09-10T14:29:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe7167fc640 20 reqs_thread_entry: start 2024-09-10T14:29:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T14:29:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5b1f0 con 0x7fe8e0026020 2024-09-10T14:29:58.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:29:58.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T14:29:58.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T14:29:58.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:58.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f5ad40 con 0x555f02f3e9e0 2024-09-10T14:29:58.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 : miss 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:96 8.1f 8:fc11d3ce:root::.bucket.meta.myfoo6%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f7afe0 con 0x7fe8e0026020 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(96 .bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 info.flags=0x17 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 to cache LRU end 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 2024-09-10T14:29:58.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.041+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:97 4.1e 4:7b6b44a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8190 con 0x7fe8dc0e0040 2024-09-10T14:29:58.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(97 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:98 4.33 4:cc35330c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8190 con 0x7fe8dc0e0040 2024-09-10T14:29:58.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(98 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:99 4.24 4:260e58fe:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8190 con 0x7fe8dc0e0040 2024-09-10T14:29:58.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(99 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 4.21 4:868c61aa:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8190 con 0x7fe8dc0e0040 2024-09-10T14:29:58.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(100 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:101 4.2f 4:f62e23b0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8150 con 0x555f02f3e9e0 2024-09-10T14:29:58.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(101 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.045+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:102 4.1d 4:bbbbcedd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8150 con 0x555f02f433d0 2024-09-10T14:29:58.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(102 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:103 4.5 4:a3b45173:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8150 con 0x555f02f433d0 2024-09-10T14:29:58.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(103 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:104 4.3 4:c3157c80:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8150 con 0x555f02f3e9e0 2024-09-10T14:29:58.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(104 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:105 4.3a 4:5f19a615:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8150 con 0x555f02f433d0 2024-09-10T14:29:58.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(105 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:106 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff8150 con 0x555f02f433d0 2024-09-10T14:29:58.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(106 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [call out=345b] v0'0 uv7 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 10 cls_bucket_list_unordered: got thirteen 2024-09-10T14:29:58.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:107 4.17 4:e8024f28:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02ff81d0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(107 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 20 get_obj_state: octx=0x555f02f2cb70 obj=myfoo6:thirteen state=0x555f02f7bc08 s->prefetch_data=0 2024-09-10T14:29:58.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:108 3.1ds0 3:bb564b32:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f7ca30 con 0x555f02f433d0 2024-09-10T14:29:58.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(108 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 10 manifest: total_size = 8 2024-09-10T14:29:58.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 20 get_obj_state: setting s->obj_tag to _MT3XUkm0V5Qz_CDbYsK-XKRQ93fb33t 2024-09-10T14:29:58.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 20 get_obj_state: octx=0x555f02f2cb70 obj=myfoo6:thirteen state=0x555f02f7bc08 s->prefetch_data=0 2024-09-10T14:29:58.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 20 prepare_atomic_modification: state is not atomic. state=0x555f02f7bc08 2024-09-10T14:29:58.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 2024-09-10T14:29:58.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.049+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:109 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81330 con 0x555f02f433d0 2024-09-10T14:29:58.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== osd_op_reply(109 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [stat,call,call] v36'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:110 3.1ds0 3:bb564b32:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f7f310 con 0x555f02f433d0 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(110 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9_thirteen [call] v36'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:111 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81dc0 con 0x555f02f433d0 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e9fe5980 20 list_objects_ordered: starting attempt 1 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e9fe5980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:112 4.1e 4:7b6b44a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81dc0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:113 4.33 4:cc35330c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f86090 con 0x7fe8dc0e0040 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.053+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:114 4.24 4:260e58fe:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f889b0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:115 4.21 4:868c61aa:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b220 con 0x7fe8dc0e0040 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:116 4.2f 4:f62e23b0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8db10 con 0x555f02f3e9e0 2024-09-10T14:29:58.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:117 4.1d 4:bbbbcedd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b220 con 0x555f02f433d0 2024-09-10T14:29:58.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:118 4.5 4:a3b45173:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f928d0 con 0x555f02f433d0 2024-09-10T14:29:58.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:119 4.3 4:c3157c80:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f956f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:120 4.3a 4:5f19a615:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f956f0 con 0x555f02f433d0 2024-09-10T14:29:58.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:121 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f9a550 con 0x555f02f433d0 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(116 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:122 4.17 4:e8024f28:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b640 con 0x7fe8dc0e0040 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(119 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== osd_op_reply(117 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(112 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(118 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(113 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(120 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(114 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(115 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(122 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 37 ==== osd_op_reply(111 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [stat,call,call] v36'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe7c6ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T14:29:58.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 38 ==== osd_op_reply(121 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T14:29:58.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T14:29:58.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T14:29:58.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T14:29:58.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9])"; uploads.size()=0; is_truncated=0 2024-09-10T14:29:58.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:123 4.1e 4:7b6b44a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81f60 con 0x7fe8dc0e0040 2024-09-10T14:29:58.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:124 4.33 4:cc35330c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f92970 con 0x7fe8dc0e0040 2024-09-10T14:29:58.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:125 4.24 4:260e58fe:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:126 4.21 4:868c61aa:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f89130 con 0x7fe8dc0e0040 2024-09-10T14:29:58.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:127 4.2f 4:f62e23b0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f7d2f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:128 4.1d 4:bbbbcedd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f82700 con 0x555f02f433d0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:129 4.5 4:a3b45173:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81f60 con 0x555f02f433d0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:130 4.3 4:c3157c80:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8f3b0 con 0x555f02f3e9e0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:131 4.3a 4:5f19a615:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f92970 con 0x555f02f433d0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:132 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f433d0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.057+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:133 4.17 4:e8024f28:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f9a080 con 0x7fe8dc0e0040 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(127 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(130 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 39 ==== osd_op_reply(128 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 40 ==== osd_op_reply(131 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 41 ==== osd_op_reply(132 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 42 ==== osd_op_reply(129 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== osd_op_reply(124 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(123 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== osd_op_reply(125 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== osd_op_reply(133 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== osd_op_reply(126 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(134 bud.buckets [call] v36'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 20 rados_obj.operate() r=0 bl.length=166 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 36 ==== osd_op_reply(136 myfoo6 [call,call,delete] v36'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.061+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93866560067696 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8e0026020 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== watch-notify(notify (1) cookie 93866559850160 notify 154618822697 ret 0) ==== 192+0+0 (crc 0 0 0) 0x555f02f7a290 con 0x7fe8e0026020 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe7c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822697 cookie 93866559850160 notifier 4750 bl.length()=150 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(137 notify.3 [notify cookie 93866560067696 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe7c67fc640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fe71c0032d0 con 0x7fe8e0026020 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== watch-notify(notify_complete (2) cookie 93866560067696 notify 154618822697 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f02f5bf90 con 0x7fe8e0026020 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:139 8.1f 8:fc11d3ce:root::.bucket.meta.myfoo6%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8e0026020 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(139 .bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 [call,call,delete] v36'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 from cache 2024-09-10T14:29:58.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9, ofs0, ns] 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 93866560067696 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8e0026020 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== watch-notify(notify (1) cookie 93866559850160 notify 154618822698 ret 0) ==== 249+0+0 (crc 0 0 0) 0x555f02f5bf90 con 0x7fe8e0026020 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe7c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822698 cookie 93866559850160 notifier 4750 bl.length()=207 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe7c6ffd640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fe7ac003d70 con 0x7fe8e0026020 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(140 notify.3 [notify cookie 93866560067696 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== watch-notify(notify_complete (2) cookie 93866560067696 notify 154618822698 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f02f5c610 con 0x7fe8e0026020 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:142 4.1e 4:7b6b44a4:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:143 4.33 4:cc35330c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81f60 con 0x7fe8dc0e0040 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:144 4.24 4:260e58fe:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f80480 con 0x7fe8dc0e0040 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:145 4.21 4:868c61aa:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:146 4.2f 4:f62e23b0:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81f60 con 0x555f02f3e9e0 2024-09-10T14:29:58.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:147 4.1d 4:bbbbcedd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f80480 con 0x555f02f433d0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:148 4.5 4:a3b45173:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f433d0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:149 4.3 4:c3157c80:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81f60 con 0x555f02f3e9e0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:150 4.3a 4:5f19a615:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f80480 con 0x555f02f433d0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:151 4.29 4:9694408e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f81f60 con 0x555f02f433d0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.065+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:152 4.17 4:e8024f28:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 37 ==== osd_op_reply(149 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.7 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 43 ==== osd_op_reply(151 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.9 [delete] v36'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 44 ==== osd_op_reply(147 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.5 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 45 ==== osd_op_reply(150 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.8 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== osd_op_reply(142 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.0 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 38 ==== osd_op_reply(146 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.4 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== osd_op_reply(144 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.2 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 46 ==== osd_op_reply(148 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.6 [delete] v36'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(143 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.1 [delete] v36'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(145 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.3 [delete] v36'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 41 ==== osd_op_reply(152 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9.10 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e9fe5980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 : miss 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e9fe5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:153 6.1 6:85dde7be:::pubsub..bucket.myfoo6%2f83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 39 ==== osd_op_reply(153 pubsub..bucket.myfoo6/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e9fe5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e9fe5980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 info.flags=0x0 2024-09-10T14:29:58.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e9fe5980 10 adding default.rgw.log++pubsub..bucket.myfoo6/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 to cache LRU end 2024-09-10T14:29:58.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.069+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:154 6.1 6:85dde7be:::pubsub..bucket.myfoo6%2f83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 40 ==== osd_op_reply(154 pubsub..bucket.myfoo6/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.9 [delete] v36'15 uv14 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 41 ==== osd_op_reply(155 bud.buckets [call] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e9fe5980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-10T14:29:58.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 42 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v36'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e9fe5980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T14:29:58.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 93866560035536 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 42 ==== watch-notify(notify (1) cookie 93866559853712 notify 154618822679 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555f02f5d450 con 0x7fe8dc0e0040 2024-09-10T14:29:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe7c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822679 cookie 93866559853712 notifier 4750 bl.length()=170 2024-09-10T14:29:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe7c67fc640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fe71c0032b0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.073+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 43 ==== osd_op_reply(157 notify.5 [notify cookie 93866560035536 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 44 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 45 ==== watch-notify(notify_complete (2) cookie 93866560035536 notify 154618822679 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f02f20a10 con 0x7fe8dc0e0040 2024-09-10T14:29:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e9fe5980 10 removing email index: 2024-09-10T14:29:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e9fe5980 10 removing user buckets index 2024-09-10T14:29:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 43 ==== osd_op_reply(159 bud.buckets [delete] v36'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e9fe5980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-10T14:29:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93866560035536 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 46 ==== watch-notify(notify (1) cookie 93866559855040 notify 154618822680 ret 0) ==== 202+0+0 (crc 0 0 0) 0x555f02f20a10 con 0x7fe8dc0e0040 2024-09-10T14:29:58.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe7c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822680 cookie 93866559855040 notifier 4750 bl.length()=160 2024-09-10T14:29:58.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 47 ==== osd_op_reply(160 notify.6 [notify cookie 93866560035536 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe7c6ffd640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fe7ac003d70 con 0x7fe8dc0e0040 2024-09-10T14:29:58.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 48 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 49 ==== watch-notify(notify_complete (2) cookie 93866560035536 notify 154618822680 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f02f51a60 con 0x7fe8dc0e0040 2024-09-10T14:29:58.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e9fe5980 10 removing user index: bud 2024-09-10T14:29:58.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.077+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8e0026020 2024-09-10T14:29:58.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== osd_op_reply(162 bud [call,call,delete] v36'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e9fe5980 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-10T14:29:58.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e9fe5980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T14:29:58.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93866560067696 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 50 ==== watch-notify(notify (1) cookie 93866559853712 notify 154618822681 ret 0) ==== 194+0+0 (crc 0 0 0) 0x555f02f51a60 con 0x7fe8dc0e0040 2024-09-10T14:29:58.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe7c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822681 cookie 93866559853712 notifier 4750 bl.length()=152 2024-09-10T14:29:58.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe7c67fc640 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fe71c0032b0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 51 ==== osd_op_reply(163 notify.5 [notify cookie 93866560067696 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 52 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 53 ==== watch-notify(notify_complete (2) cookie 93866560067696 notify 154618822681 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f02f51850 con 0x7fe8dc0e0040 2024-09-10T14:29:58.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe79dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:58.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.081+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93866559872800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.085+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 44 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93866559872800] v36'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.085+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93866559835456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8e0026020 2024-09-10T14:29:58.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.085+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 33 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93866559835456] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.085+0000 7fe8e9fe5980 20 remove_watcher() i=0 2024-09-10T14:29:58.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.085+0000 7fe8e9fe5980 2 removed watcher, disabling cache 2024-09-10T14:29:58.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.085+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93866559839760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.089+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 45 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93866559839760] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.089+0000 7fe8e9fe5980 20 remove_watcher() i=1 2024-09-10T14:29:58.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.089+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93866559844528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f433d0 2024-09-10T14:29:58.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.089+0000 7fe8e7af5640 1 -- 172.21.15.151:0/817634039 <== osd.3 v2:172.21.15.151:6803/3136276598 47 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93866559844528] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8e000f070 con 0x555f02f433d0 2024-09-10T14:29:58.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.089+0000 7fe8e9fe5980 20 remove_watcher() i=2 2024-09-10T14:29:58.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.089+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93866559850160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8e0026020 2024-09-10T14:29:58.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.093+0000 7fe8e72f4640 1 -- 172.21.15.151:0/817634039 <== osd.2 v2:172.21.15.151:6816/2885613778 34 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93866559850160] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8dc0aaad0 con 0x7fe8e0026020 2024-09-10T14:29:58.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.093+0000 7fe8e9fe5980 20 remove_watcher() i=3 2024-09-10T14:29:58.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.093+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93866559851216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x555f02f3e9e0 2024-09-10T14:29:58.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.093+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.1 v2:172.21.15.151:6800/103268966 46 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93866559851216] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x555f02f3e9e0 2024-09-10T14:29:58.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.093+0000 7fe8e9fe5980 20 remove_watcher() i=4 2024-09-10T14:29:58.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.093+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93866559853712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.097+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 54 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93866559853712] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.097+0000 7fe8e9fe5980 20 remove_watcher() i=5 2024-09-10T14:29:58.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.097+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93866559855040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.097+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 55 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93866559855040] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.097+0000 7fe8e9fe5980 20 remove_watcher() i=6 2024-09-10T14:29:58.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.097+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93866559857968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555f02f8b5e0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 <== osd.0 v2:172.21.15.52:6800/2968015226 56 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93866559857968] v36'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8d80083f0 con 0x7fe8dc0e0040 2024-09-10T14:29:58.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 20 remove_watcher() i=7 2024-09-10T14:29:58.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe8dc0e0040 msgr2=0x7fe8dc0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fe8dc0e0040 0x7fe8dc0e0420 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02f3e9e0 msgr2=0x555f02f40ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02f3e9e0 0x555f02f40ea0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fe8e0026020 msgr2=0x7fe8e0033070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fe8e0026020 0x7fe8e0033070 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f433d0 msgr2=0x555f02f457c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f433d0 0x555f02f457c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7b0034650 msgr2=0x7fe7b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7b0034650 0x7fe7b0036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc000c10 tx=0x7fe8dc0c1040 comp rx=0 tx=0).stop 2024-09-10T14:29:58.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 msgr2=0x555f02f33990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/817634039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f2c790 0x555f02f33990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe8e002dbe0 tx=0x7fe8e00303c0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 reap_dead start 2024-09-10T14:29:58.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e82f6640 1 -- 172.21.15.151:0/817634039 reap_dead start 2024-09-10T14:29:58.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 shutdown_connections 2024-09-10T14:29:58.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 >> 172.21.15.151:0/817634039 conn(0x555f02f28b70 msgr2=0x555f02f26c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 shutdown_connections 2024-09-10T14:29:58.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/817634039 wait complete. 2024-09-10T14:29:58.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2042782643 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7c0034650 msgr2=0x7fe7c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/2042782643 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7c0034650 0x7fe7c0036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc017f50 tx=0x7fe8dc005ad0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2042782643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f1fe20 msgr2=0x555f02f20240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/2042782643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f1fe20 0x555f02f20240 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0047b30 tx=0x7fe8e0011f40 comp rx=0 tx=0).stop 2024-09-10T14:29:58.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2042782643 shutdown_connections 2024-09-10T14:29:58.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/2042782643 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7c0034650 0x7fe7c0036b10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/2042782643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02f1fe20 0x555f02f20240 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2042782643 >> 172.21.15.151:0/2042782643 conn(0x555f02f14f70 msgr2=0x555f02f179f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2042782643 shutdown_connections 2024-09-10T14:29:58.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/2042782643 wait complete. 2024-09-10T14:29:58.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555f02f0f810 msgr2=0x555f02f11c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x555f02f0f810 0x555f02f11c00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02e13ea0 msgr2=0x555f02f08fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x555f02e13ea0 0x555f02f08fa0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f0b910 msgr2=0x555f02f0dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x555f02f0b910 0x555f02f0dd00 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7d0034650 msgr2=0x7fe7d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fe7d0034650 0x7fe7d0036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0ae000 tx=0x7fe8dc0a6000 comp rx=0 tx=0).stop 2024-09-10T14:29:58.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 msgr2=0x555f02f01ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 --2- 172.21.15.151:0/3677072707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f02d81ad0 0x555f02f01ff0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000f610 tx=0x7fe8e0001260 comp rx=0 tx=0).stop 2024-09-10T14:29:58.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e82f6640 1 -- 172.21.15.151:0/3677072707 reap_dead start 2024-09-10T14:29:58.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 shutdown_connections 2024-09-10T14:29:58.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 >> 172.21.15.151:0/3677072707 conn(0x555f02e08070 msgr2=0x555f02ef53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 shutdown_connections 2024-09-10T14:29:58.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.101+0000 7fe8e9fe5980 1 -- 172.21.15.151:0/3677072707 wait complete. 2024-09-10T14:29:58.118 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T14:29:58.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T14:29:58.118 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-10T14:29:58.195 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:29:58.195 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:29:58.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb1523f5980 1 Processor -- start 2024-09-10T14:29:58.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb1523f5980 1 -- start start 2024-09-10T14:29:58.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb1523f5980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556e36e178f0 0x556e36e17cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb1523f5980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e36c9dae0 con 0x556e36e18240 2024-09-10T14:29:58.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb1523f5980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x556e36cc1e30 con 0x556e36e178f0 2024-09-10T14:29:58.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb14ff05640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556e36e178f0 0x556e36e17cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb14ff05640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x556e36e178f0 0x556e36e17cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43370/0 (socket says 172.21.15.151:43370) 2024-09-10T14:29:58.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb14ff05640 1 -- 172.21.15.151:0/134192858 learned_addr learned my addr 172.21.15.151:0/134192858 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:58.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb14f704640 1 --1- 172.21.15.151:0/134192858 >> v1:172.21.15.52:6789/0 conn(0x556e36e18240 0x556e36e1cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:56384/0 (socket says 172.21.15.151:56384) 2024-09-10T14:29:58.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb14ff05640 1 -- 172.21.15.151:0/134192858 >> v1:172.21.15.52:6789/0 conn(0x556e36e18240 legacy=0x556e36e1cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.193+0000 7fb14ff05640 1 -- 172.21.15.151:0/134192858 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e36e1f4c0 con 0x556e36e178f0 2024-09-10T14:29:58.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb14ff05640 1 --2- 172.21.15.151:0/134192858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36e17cd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb14000a4e0 tx=0x7fb14001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7af1dd9b4e8ff37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb14ef03640 1 -- 172.21.15.151:0/134192858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400aa540 con 0x556e36e178f0 2024-09-10T14:29:58.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb14ef03640 1 -- 172.21.15.151:0/134192858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400aa6e0 con 0x556e36e178f0 2024-09-10T14:29:58.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb14ef03640 1 -- 172.21.15.151:0/134192858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400aaa40 con 0x556e36e178f0 2024-09-10T14:29:58.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb1523f5980 1 -- 172.21.15.151:0/134192858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 msgr2=0x556e36e17cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb1523f5980 1 --2- 172.21.15.151:0/134192858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36e17cd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb14000a4e0 tx=0x7fb14001b090 comp rx=0 tx=0).stop 2024-09-10T14:29:58.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb1523f5980 1 -- 172.21.15.151:0/134192858 shutdown_connections 2024-09-10T14:29:58.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb1523f5980 1 --2- 172.21.15.151:0/134192858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36e17cd0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb1523f5980 1 -- 172.21.15.151:0/134192858 >> 172.21.15.151:0/134192858 conn(0x556e36d8b240 msgr2=0x556e36d8b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb1523f5980 1 -- 172.21.15.151:0/134192858 shutdown_connections 2024-09-10T14:29:58.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.197+0000 7fb1523f5980 1 -- 172.21.15.151:0/134192858 wait complete. 2024-09-10T14:29:58.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb1523f5980 1 Processor -- start 2024-09-10T14:29:58.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb1523f5980 1 -- start start 2024-09-10T14:29:58.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb1523f5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f02be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb1523f5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556e36cc3200 con 0x556e36e178f0 2024-09-10T14:29:58.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f02be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f02be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43376/0 (socket says 172.21.15.151:43376) 2024-09-10T14:29:58.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb14ff05640 1 -- 172.21.15.151:0/2234456932 learned_addr learned my addr 172.21.15.151:0/2234456932 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:58.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb14ff05640 1 -- 172.21.15.151:0/2234456932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e36f031b0 con 0x556e36e178f0 2024-09-10T14:29:58.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb14ff05640 1 --2- 172.21.15.151:0/2234456932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f02be0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb140017ca0 tx=0x7fb1400033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb83bb089ce59ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb03de0b640 1 -- 172.21.15.151:0/2234456932 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400b9070 con 0x556e36e178f0 2024-09-10T14:29:58.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb03de0b640 1 -- 172.21.15.151:0/2234456932 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400aaa80 con 0x556e36e178f0 2024-09-10T14:29:58.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.213+0000 7fb03de0b640 1 -- 172.21.15.151:0/2234456932 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400aad60 con 0x556e36e178f0 2024-09-10T14:29:58.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- 172.21.15.151:0/2234456932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 msgr2=0x556e36f02be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 --2- 172.21.15.151:0/2234456932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f02be0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb140017ca0 tx=0x7fb1400033b0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- 172.21.15.151:0/2234456932 shutdown_connections 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 --2- 172.21.15.151:0/2234456932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f02be0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- 172.21.15.151:0/2234456932 >> 172.21.15.151:0/2234456932 conn(0x556e36d8b240 msgr2=0x556e36efe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- 172.21.15.151:0/2234456932 shutdown_connections 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- 172.21.15.151:0/2234456932 wait complete. 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 Processor -- start 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- start start 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f09e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556e36e1ef00 con 0x556e36e178f0 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f09e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f09e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43384/0 (socket says 172.21.15.151:43384) 2024-09-10T14:29:58.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb14ff05640 1 -- 172.21.15.151:0/1028069639 learned_addr learned my addr 172.21.15.151:0/1028069639 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:58.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb14ff05640 1 -- 172.21.15.151:0/1028069639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e36f0a390 con 0x556e36e178f0 2024-09-10T14:29:58.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb14ff05640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f09e50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb14001aec0 tx=0x7fb140017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb037fff640 1 -- 172.21.15.151:0/1028069639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400cc070 con 0x556e36e178f0 2024-09-10T14:29:58.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb037fff640 1 -- 172.21.15.151:0/1028069639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400c7410 con 0x556e36e178f0 2024-09-10T14:29:58.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e36f0a620 con 0x556e36e178f0 2024-09-10T14:29:58.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb037fff640 1 -- 172.21.15.151:0/1028069639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400b9070 con 0x556e36e178f0 2024-09-10T14:29:58.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.217+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e36f0d300 con 0x556e36e178f0 2024-09-10T14:29:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb037fff640 1 -- 172.21.15.151:0/1028069639 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb1400b3040 con 0x556e36e178f0 2024-09-10T14:29:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb037fff640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 0x7fb038036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb037fff640 1 -- 172.21.15.151:0/1028069639 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb1400c4070 con 0x556e36e178f0 2024-09-10T14:29:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb14f704640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 0x7fb038036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36e18240 0x556e36f10f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f11520 con 0x556e36e18240 2024-09-10T14:29:58.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb150706640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36e18240 0x556e36f10f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb14f704640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 0x7fb038036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb138000f70 tx=0x7fb138001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb150706640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36e18240 0x556e36f10f50 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb150706640 1 -- 172.21.15.151:0/1028069639 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36e18240 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f0e520 con 0x556e36e18240 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb150706640 1 -- 172.21.15.151:0/1028069639 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36e18240 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f13830 0x556e36f15c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f162f0 con 0x556e36f13830 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb14ff05640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f13830 0x556e36f15c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb14ff05640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f13830 0x556e36f15c20 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb14ff05640 1 -- 172.21.15.151:0/1028069639 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb1400ce310 con 0x556e36f13830 2024-09-10T14:29:58.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f126d0 con 0x556e36e18240 2024-09-10T14:29:58.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb150706640 1 -- 172.21.15.151:0/1028069639 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36e18240 2024-09-10T14:29:58.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x556e36f17750 0x556e36f19b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f1a240 con 0x556e36f17750 2024-09-10T14:29:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.221+0000 7fb14f704640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x556e36f17750 0x556e36f19b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb14f704640 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x556e36f17750 0x556e36f19b40 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb14f704640 1 -- 172.21.15.151:0/1028069639 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb13800f6a0 con 0x556e36f17750 2024-09-10T14:29:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb1523f5980 1 Processor -- start 2024-09-10T14:29:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb1523f5980 1 -- start start 2024-09-10T14:29:58.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb1523f5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f27d10 0x556e36f28130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb1523f5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556e36d1c800 con 0x556e36f27d10 2024-09-10T14:29:58.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f27d10 0x556e36f28130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f27d10 0x556e36f28130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43398/0 (socket says 172.21.15.151:43398) 2024-09-10T14:29:58.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb14ff05640 1 -- 172.21.15.151:0/3277681194 learned_addr learned my addr 172.21.15.151:0/3277681194 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb14ff05640 1 -- 172.21.15.151:0/3277681194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e36f28670 con 0x556e36f27d10 2024-09-10T14:29:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb14ff05640 1 --2- 172.21.15.151:0/3277681194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f27d10 0x556e36f28130 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb1400e2e90 tx=0x7fb1400c6f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb0357fa640 1 -- 172.21.15.151:0/3277681194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400e9070 con 0x556e36f27d10 2024-09-10T14:29:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.225+0000 7fb0357fa640 1 -- 172.21.15.151:0/3277681194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400cf6a0 con 0x556e36f27d10 2024-09-10T14:29:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 -- 172.21.15.151:0/3277681194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e36f28900 con 0x556e36f27d10 2024-09-10T14:29:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb0357fa640 1 -- 172.21.15.151:0/3277681194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400e1410 con 0x556e36f27d10 2024-09-10T14:29:58.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 -- 172.21.15.151:0/3277681194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e36f2b580 con 0x556e36f27d10 2024-09-10T14:29:58.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb0357fa640 1 -- 172.21.15.151:0/3277681194 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb1400ec070 con 0x556e36f27d10 2024-09-10T14:29:58.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb0357fa640 1 --2- 172.21.15.151:0/3277681194 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb028034690 0x7fb028036b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb0357fa640 1 -- 172.21.15.151:0/3277681194 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb1400de070 con 0x556e36f27d10 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb14f704640 1 --2- 172.21.15.151:0/3277681194 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb028034690 0x7fb028036b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 Processor -- start 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 -- start start 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb14f704640 1 --2- 172.21.15.151:0/3277681194 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb028034690 0x7fb028036b50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x556e36f11de0 tx=0x7fb13800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f34a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556e36f03470 con 0x556e36f34680 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f34a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f34a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43414/0 (socket says 172.21.15.151:43414) 2024-09-10T14:29:58.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb14ff05640 1 -- 172.21.15.151:0/239099284 learned_addr learned my addr 172.21.15.151:0/239099284 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb14ff05640 1 -- 172.21.15.151:0/239099284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e36f35050 con 0x556e36f34680 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb14ff05640 1 --2- 172.21.15.151:0/239099284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f34a80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb1400c7040 tx=0x7fb1400e15b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d320d9fb570e1e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb02effd640 1 -- 172.21.15.151:0/239099284 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400bd580 con 0x556e36f34680 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb02effd640 1 -- 172.21.15.151:0/239099284 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400dc130 con 0x556e36f34680 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb02effd640 1 -- 172.21.15.151:0/239099284 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400a9590 con 0x556e36f34680 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 -- 172.21.15.151:0/239099284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 msgr2=0x556e36f34a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 --2- 172.21.15.151:0/239099284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f34a80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb1400c7040 tx=0x7fb1400e15b0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 -- 172.21.15.151:0/239099284 shutdown_connections 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 --2- 172.21.15.151:0/239099284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f34a80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.229+0000 7fb1523f5980 1 -- 172.21.15.151:0/239099284 >> 172.21.15.151:0/239099284 conn(0x556e36f30a00 msgr2=0x556e36f2eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb1523f5980 1 -- 172.21.15.151:0/239099284 shutdown_connections 2024-09-10T14:29:58.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb1523f5980 1 -- 172.21.15.151:0/239099284 wait complete. 2024-09-10T14:29:58.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb1523f5980 1 Processor -- start 2024-09-10T14:29:58.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb1523f5980 1 -- start start 2024-09-10T14:29:58.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb1523f5980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f3b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb1523f5980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556e36f35410 con 0x556e36f34680 2024-09-10T14:29:58.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f3b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb14ff05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f3b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:43428/0 (socket says 172.21.15.151:43428) 2024-09-10T14:29:58.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 learned_addr learned my addr 172.21.15.151:0/1250892620 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:29:58.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e36f3bcf0 con 0x556e36f34680 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb14ff05640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f3b7b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb1400e15f0 tx=0x7fb1400abd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb02d7fa640 1 -- 172.21.15.151:0/1250892620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400bd580 con 0x556e36f34680 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e36f3bcf0 con 0x556e36f34680 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e36f3bcf0 con 0x556e36f34680 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb02d7fa640 1 -- 172.21.15.151:0/1250892620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400d78a0 con 0x556e36f34680 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb02d7fa640 1 -- 172.21.15.151:0/1250892620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1400d7b80 con 0x556e36f34680 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb02d7fa640 1 -- 172.21.15.151:0/1250892620 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb14010d020 con 0x556e36f34680 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb02d7fa640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0180346a0 0x7fb018036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb02d7fa640 1 -- 172.21.15.151:0/1250892620 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb140100020 con 0x556e36f34680 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.233+0000 7fb14f704640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0180346a0 0x7fb018036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36f46860 0x556e36f48d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f49470 con 0x556e36f46860 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb150706640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36f46860 0x556e36f48d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14f704640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0180346a0 0x7fb018036b60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c010 tx=0x7fb138010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb150706640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36f46860 0x556e36f48d20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 realm 2024-09-10T14:29:58.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f49880 con 0x556e36f46860 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a150 con 0x556e36f46860 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f4b250 0x556e36f4d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4dc50 con 0x556e36f4b250 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14ff05640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f4b250 0x556e36f4d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14ff05640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f4b250 0x556e36f4d640 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 20 searching for the correct realm 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4f520 con 0x556e36f4b250 2024-09-10T14:29:58.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14ff05640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb140105040 0x7fb1400d1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4f520 con 0x7fb140105040 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14f704640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb140105040 0x7fb1400d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14f704640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb140105040 0x7fb1400d1570 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14f704640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb13801fbe0 0x7fb13803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.237+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4f520 con 0x7fb13801fbe0 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb13801fbe0 0x7fb13803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:29:58.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb13801fbe0 0x7fb13803a3c0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:29:58.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.241+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb140105040 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f4b250 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb140105040 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f4b250 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f4b250 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb140105040 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f4b250 2024-09-10T14:29:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f4b250 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.245+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f4b250 2024-09-10T14:29:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb140105040 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb140105040 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f4b250 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb140105040 2024-09-10T14:29:58.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f4b250 2024-09-10T14:29:58.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.249+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x556e36f46860 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4a4f0 con 0x7fb140105040 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:29:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4e640 con 0x556e36f46860 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4e280 con 0x556e36f46860 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:29:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4ef60 con 0x7fb13801fbe0 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 zone default found 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 4 Realm: () 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 zonegroup default 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f4f390 con 0x7fb140105040 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f51330 con 0x556e36f4b250 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.253+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f51880 con 0x556e36f4b250 2024-09-10T14:29:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb1523f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb1523f5980 20 started sync module instance, tier type = 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb1523f5980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f507d0 con 0x7fb140105040 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93931856792512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f50430 con 0x7fb140105040 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f52680 con 0x556e36f46860 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93931856792512] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93931856796896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f52a70 con 0x556e36f46860 2024-09-10T14:29:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.257+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f53430 con 0x556e36f4b250 2024-09-10T14:29:58.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.261+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.261+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93931856801664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f533a0 con 0x556e36f4b250 2024-09-10T14:29:58.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.261+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f54370 con 0x7fb140105040 2024-09-10T14:29:58.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.261+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93931856796896] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.261+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.261+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93931856805440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f54760 con 0x7fb140105040 2024-09-10T14:29:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.261+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f55120 con 0x556e36f46860 2024-09-10T14:29:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.261+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93931856801664] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.265+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93931856805440] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.265+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.265+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93931856803872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f55120 con 0x556e36f46860 2024-09-10T14:29:58.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.265+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f55970 con 0x7fb13801fbe0 2024-09-10T14:29:58.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.265+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93931856803872] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.269+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.269+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93931856809344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f55710 con 0x7fb13801fbe0 2024-09-10T14:29:58.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.269+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f56230 con 0x7fb13801fbe0 2024-09-10T14:29:58.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.269+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93931856809344] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.269+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.269+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93931856813312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f561f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.269+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f56c10 con 0x7fb13801fbe0 2024-09-10T14:29:58.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93931856813312] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93931856815872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f56bd0 con 0x7fb13801fbe0 2024-09-10T14:29:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb1523f5980 20 add_watcher() i=0 2024-09-10T14:29:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb1523f5980 20 add_watcher() i=1 2024-09-10T14:29:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb1523f5980 20 add_watcher() i=2 2024-09-10T14:29:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb1523f5980 20 add_watcher() i=3 2024-09-10T14:29:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb1523f5980 20 add_watcher() i=4 2024-09-10T14:29:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb1523f5980 20 add_watcher() i=5 2024-09-10T14:29:58.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb1523f5980 20 add_watcher() i=6 2024-09-10T14:29:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.273+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93931856815872] v36'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb1523f5980 20 add_watcher() i=7 2024-09-10T14:29:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb1523f5980 2 all 8 watchers are set, enabling cache 2024-09-10T14:29:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f5a030 con 0x556e36f46860 2024-09-10T14:29:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93931856810400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f57550 con 0x556e36f46860 2024-09-10T14:29:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93931856810400] v36'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb1523f5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:29:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb1523f5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:29:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.277+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f59d10 con 0x556e36f46860 2024-09-10T14:29:58.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.281+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.281+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f630a0 con 0x7fb13801fbe0 2024-09-10T14:29:58.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.281+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.281+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f630a0 con 0x556e36f4b250 2024-09-10T14:29:58.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.281+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.281+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f63550 con 0x556e36f46860 2024-09-10T14:29:58.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.285+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'225 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.285+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f63ac0 con 0x7fb140105040 2024-09-10T14:29:58.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.285+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.285+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f63f70 con 0x556e36f4b250 2024-09-10T14:29:58.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.285+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'48 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.285+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f63f70 con 0x556e36f46860 2024-09-10T14:29:58.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.289+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.289+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f61700 con 0x7fb13801fbe0 2024-09-10T14:29:58.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.289+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.289+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f61700 con 0x7fb140105040 2024-09-10T14:29:58.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.293+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.293+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f61700 con 0x556e36f4b250 2024-09-10T14:29:58.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.293+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.293+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64b50 con 0x7fb140105040 2024-09-10T14:29:58.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.297+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.297+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64ad0 con 0x7fb13801fbe0 2024-09-10T14:29:58.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.297+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.297+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64ad0 con 0x7fb140105040 2024-09-10T14:29:58.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.301+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.301+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64db0 con 0x7fb13801fbe0 2024-09-10T14:29:58.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.301+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.301+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64db0 con 0x556e36f46860 2024-09-10T14:29:58.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.305+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'226 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.305+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64db0 con 0x556e36f4b250 2024-09-10T14:29:58.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.305+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.305+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64db0 con 0x7fb140105040 2024-09-10T14:29:58.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.305+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.305+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64db0 con 0x556e36f4b250 2024-09-10T14:29:58.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.309+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.309+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64db0 con 0x556e36f46860 2024-09-10T14:29:58.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.309+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.309+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f64db0 con 0x556e36f46860 2024-09-10T14:29:58.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.313+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'227 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.313+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x556e36f4b250 2024-09-10T14:29:58.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.313+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.313+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x7fb140105040 2024-09-10T14:29:58.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.317+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.317+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x556e36f4b250 2024-09-10T14:29:58.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.317+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.317+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x556e36f4b250 2024-09-10T14:29:58.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.321+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.321+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x556e36f4b250 2024-09-10T14:29:58.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.321+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.321+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x556e36f4b250 2024-09-10T14:29:58.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.321+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'49 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.321+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x7fb13801fbe0 2024-09-10T14:29:58.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.325+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.325+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x556e36f4b250 2024-09-10T14:29:58.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.329+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.329+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x7fb13801fbe0 2024-09-10T14:29:58.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.329+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.329+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x556e36f4b250 2024-09-10T14:29:58.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.333+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.333+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x7fb13801fbe0 2024-09-10T14:29:58.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f65170 con 0x7fb140105040 2024-09-10T14:29:58.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb004fe1640 20 reqs_thread_entry: start 2024-09-10T14:29:58.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb1523f5980 20 init_complete bucket index max shards: 11 2024-09-10T14:29:58.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb1523f5980 20 Filter name: none 2024-09-10T14:29:58.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7faf7e7fc640 20 reqs_thread_entry: start 2024-09-10T14:29:58.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb1523f5980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T14:29:58.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.337+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f801a0 con 0x7fb13801fbe0 2024-09-10T14:29:58.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T14:29:58.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T14:29:58.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T14:29:58.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:58.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f82a60 con 0x7fb13801fbe0 2024-09-10T14:29:58.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 : miss 2024-09-10T14:29:58.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:96 8.0 8:01299958:root::.bucket.meta.myfoo7%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f82740 con 0x556e36f4b250 2024-09-10T14:29:58.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(96 .bucket.meta.myfoo7:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 20 rados_obj.operate() r=0 bl.length=382 2024-09-10T14:29:58.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 info.flags=0x17 2024-09-10T14:29:58.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 to cache LRU end 2024-09-10T14:29:58.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:29:58.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:29:58.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 2024-09-10T14:29:58.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.341+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:97 4.33 4:cd3a7f20:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffc20 con 0x7fb13801fbe0 2024-09-10T14:29:58.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(97 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:98 4.d 4:b26e988c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffc20 con 0x556e36f4b250 2024-09-10T14:29:58.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(98 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:99 4.29 4:948cd835:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffc20 con 0x556e36f4b250 2024-09-10T14:29:58.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(99 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.2 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:100 4.f 4:f39f21ff:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffc20 con 0x556e36f46860 2024-09-10T14:29:58.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(100 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:101 4.6 4:61b69fa8:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffc20 con 0x556e36f4b250 2024-09-10T14:29:58.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(101 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 4.1c 4:38b04c3a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffba0 con 0x7fb13801fbe0 2024-09-10T14:29:58.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(102 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5 [call out=378b] v0'0 uv5 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb1523f5980 10 cls_bucket_list_unordered: got fourteen 2024-09-10T14:29:58.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.345+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:103 4.d 4:b194ecdd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffba0 con 0x556e36f4b250 2024-09-10T14:29:58.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(103 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:104 4.34 4:2dd7f438:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffba0 con 0x7fb140105040 2024-09-10T14:29:58.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(104 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:105 4.3e 4:7fcdbb1f:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffba0 con 0x7fb140105040 2024-09-10T14:29:58.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(105 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:106 4.32 4:4dacde9a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffba0 con 0x556e36f46860 2024-09-10T14:29:58.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(106 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:107 4.1 4:8197d226:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36fffba0 con 0x7fb140105040 2024-09-10T14:29:58.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(107 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 20 get_obj_state: octx=0x556e36f34a60 obj=myfoo7:fourteen state=0x556e36ffdca8 s->prefetch_data=0 2024-09-10T14:29:58.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:108 3.22s0 3:468f2925:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36ffead0 con 0x556e36f4b250 2024-09-10T14:29:58.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== osd_op_reply(108 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 10 manifest: total_size = 8 2024-09-10T14:29:58.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 20 get_obj_state: setting s->obj_tag to 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.12417006002459965188 2024-09-10T14:29:58.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 20 get_obj_state: octx=0x556e36f34a60 obj=myfoo7:fourteen state=0x556e36ffdca8 s->prefetch_data=0 2024-09-10T14:29:58.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 20 prepare_atomic_modification: state is not atomic. state=0x556e36ffdca8 2024-09-10T14:29:58.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5 2024-09-10T14:29:58.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.349+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:109 4.1c 4:38b04c3a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36fff390 con 0x7fb13801fbe0 2024-09-10T14:29:58.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(109 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:110 3.22s0 3:468f2925:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36fff390 con 0x556e36f4b250 2024-09-10T14:29:58.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(110 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10_fourteen [call] v36'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:111 4.1c 4:38b04c3a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f872f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 20 list_objects_ordered: starting attempt 1 2024-09-10T14:29:58.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T14:29:58.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:112 4.33 4:cd3a7f20:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f89b70 con 0x7fb13801fbe0 2024-09-10T14:29:58.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:113 4.d 4:b26e988c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c420 con 0x556e36f4b250 2024-09-10T14:29:58.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:114 4.29 4:948cd835:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f89b70 con 0x556e36f4b250 2024-09-10T14:29:58.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:115 4.f 4:f39f21ff:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f911e0 con 0x556e36f46860 2024-09-10T14:29:58.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.353+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:116 4.6 4:61b69fa8:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f93b40 con 0x556e36f4b250 2024-09-10T14:29:58.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:117 4.1c 4:38b04c3a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f93b40 con 0x7fb13801fbe0 2024-09-10T14:29:58.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:118 4.d 4:b194ecdd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f98970 con 0x556e36f4b250 2024-09-10T14:29:58.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:119 4.34 4:2dd7f438:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9b6c0 con 0x7fb140105040 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(115 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:120 4.3e 4:7fcdbb1f:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9e540 con 0x7fb140105040 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== osd_op_reply(113 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:121 4.32 4:4dacde9a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8b410 con 0x556e36f46860 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(114 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.2 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:122 4.1 4:8197d226:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9e540 con 0x7fb140105040 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(112 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(119 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(120 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== osd_op_reply(122 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(121 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(116 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 37 ==== osd_op_reply(118 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(111 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb02effd640 20 handle_completion(): completion ok for obj=fourteen 2024-09-10T14:29:58.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(117 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10])"; uploads.size()=0; is_truncated=0 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:123 4.33 4:cd3a7f20:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9def0 con 0x7fb13801fbe0 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:124 4.d 4:b26e988c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8f270 con 0x556e36f4b250 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:125 4.29 4:948cd835:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f90b10 con 0x556e36f4b250 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:126 4.f 4:f39f21ff:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8b410 con 0x556e36f46860 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:127 4.6 4:61b69fa8:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8b890 con 0x556e36f4b250 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:128 4.1c 4:38b04c3a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9def0 con 0x7fb13801fbe0 2024-09-10T14:29:58.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:129 4.d 4:b194ecdd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8f270 con 0x556e36f4b250 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:130 4.34 4:2dd7f438:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f90b10 con 0x7fb140105040 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:131 4.3e 4:7fcdbb1f:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8f270 con 0x7fb140105040 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:132 4.32 4:4dacde9a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8b410 con 0x556e36f46860 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:133 4.1 4:8197d226:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9def0 con 0x7fb140105040 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(130 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(126 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 38 ==== osd_op_reply(124 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 39 ==== osd_op_reply(125 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.2 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== osd_op_reply(131 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.8 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 40 ==== osd_op_reply(127 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(123 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 41 ==== osd_op_reply(129 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(128 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.357+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(132 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(133 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f90b10 con 0x7fb13801fbe0 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== osd_op_reply(134 fud.buckets [call] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb1523f5980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9afc0 con 0x7fb140105040 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb1523f5980 20 rados_obj.operate() r=0 bl.length=168 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb1523f5980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb1523f5980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-10T14:29:58.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.361+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x7fb140105040 2024-09-10T14:29:58.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== osd_op_reply(136 myfoo7 [call,call,delete] v36'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb1523f5980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-10T14:29:58.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb1523f5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-10T14:29:58.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93931857035744 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9afc0 con 0x7fb140105040 2024-09-10T14:29:58.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== watch-notify(notify (1) cookie 93931856805440 notify 154618822699 ret 0) ==== 192+0+0 (crc 0 0 0) 0x556e36f61120 con 0x7fb140105040 2024-09-10T14:29:58.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb02e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822699 cookie 93931856805440 notifier 4757 bl.length()=150 2024-09-10T14:29:58.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 33 ==== osd_op_reply(137 notify.3 [notify cookie 93931857035744 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb02e7fc640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7faf840032d0 con 0x7fb140105040 2024-09-10T14:29:58.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 34 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 35 ==== watch-notify(notify_complete (2) cookie 93931857035744 notify 154618822699 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e36f61aa0 con 0x7fb140105040 2024-09-10T14:29:58.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.365+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:139 8.0 8:01299958:root::.bucket.meta.myfoo7%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x556e36f4b250 2024-09-10T14:29:58.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 42 ==== osd_op_reply(139 .bucket.meta.myfoo7:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 [call,call,delete] v36'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 from cache 2024-09-10T14:29:58.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10, ofs0, ns] 2024-09-10T14:29:58.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 93931857035744 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9b120 con 0x556e36f4b250 2024-09-10T14:29:58.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 43 ==== watch-notify(notify (1) cookie 93931856801664 notify 154618822664 ret 0) ==== 250+0+0 (crc 0 0 0) 0x556e36f81c60 con 0x556e36f4b250 2024-09-10T14:29:58.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb02effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822664 cookie 93931856801664 notifier 4757 bl.length()=208 2024-09-10T14:29:58.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 44 ==== osd_op_reply(140 notify.2 [notify cookie 93931857035744 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb02effd640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb014003d70 con 0x556e36f4b250 2024-09-10T14:29:58.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 45 ==== watch-notify(notify_complete (2) cookie 93931857035744 notify 154618822664 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e36f28670 con 0x556e36f4b250 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 46 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:142 4.33 4:cd3a7f20:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x7fb13801fbe0 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:143 4.d 4:b26e988c:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9dde0 con 0x556e36f4b250 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:144 4.29 4:948cd835:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8bd40 con 0x556e36f4b250 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:145 4.f 4:f39f21ff:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9c090 con 0x556e36f46860 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:146 4.6 4:61b69fa8:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f80bf0 con 0x556e36f4b250 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:147 4.1c 4:38b04c3a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f81500 con 0x7fb13801fbe0 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:148 4.d 4:b194ecdd:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x556e36f4b250 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:149 4.34 4:2dd7f438:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9dde0 con 0x7fb140105040 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:150 4.3e 4:7fcdbb1f:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8bd40 con 0x7fb140105040 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:151 4.32 4:4dacde9a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f9c090 con 0x556e36f46860 2024-09-10T14:29:58.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.369+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:152 4.1 4:8197d226:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f80bf0 con 0x7fb140105040 2024-09-10T14:29:58.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 47 ==== osd_op_reply(144 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.2 [delete] v36'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(147 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.5 [delete] v36'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 48 ==== osd_op_reply(143 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.1 [delete] v36'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 36 ==== osd_op_reply(149 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.7 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 49 ==== osd_op_reply(148 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.6 [delete] v36'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== osd_op_reply(142 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.0 [delete] v36'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 50 ==== osd_op_reply(146 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.4 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 37 ==== osd_op_reply(150 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.8 [delete] v36'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 38 ==== osd_op_reply(152 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.10 [delete] v36'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.373+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(151 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.9 [delete] v36'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(145 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10.3 [delete] v36'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb1523f5980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 : miss 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb1523f5980 20 rados->read ofs=0 len=0 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:153 6.19 6:9e19c932:::pubsub..bucket.myfoo7%2f83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f80bf0 con 0x556e36f46860 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(153 pubsub..bucket.myfoo7/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb1523f5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb1523f5980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 info.flags=0x0 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb1523f5980 10 adding default.rgw.log++pubsub..bucket.myfoo7/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 to cache LRU end 2024-09-10T14:29:58.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.377+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:154 6.19 6:9e19c932:::pubsub..bucket.myfoo7%2f83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x556e36f46860 2024-09-10T14:29:58.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.381+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 36 ==== osd_op_reply(154 pubsub..bucket.myfoo7/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.10 [delete] v36'35 uv28 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.381+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x7fb13801fbe0 2024-09-10T14:29:58.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.381+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== osd_op_reply(155 fud.buckets [call] v36'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.381+0000 7fb1523f5980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T14:29:58.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x7fb13801fbe0 2024-09-10T14:29:58.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v36'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb1523f5980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T14:29:58.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 93931857108448 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x556e36f4b250 2024-09-10T14:29:58.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 51 ==== watch-notify(notify (1) cookie 93931856801664 notify 154618822665 ret 0) ==== 212+0+0 (crc 0 0 0) 0x556e36f28670 con 0x556e36f4b250 2024-09-10T14:29:58.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb02e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822665 cookie 93931856801664 notifier 4757 bl.length()=170 2024-09-10T14:29:58.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 52 ==== osd_op_reply(157 notify.2 [notify cookie 93931857108448 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb02e7fc640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7faf840032d0 con 0x556e36f4b250 2024-09-10T14:29:58.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 53 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 54 ==== watch-notify(notify_complete (2) cookie 93931857108448 notify 154618822665 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e36f0d300 con 0x556e36f4b250 2024-09-10T14:29:58.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb1523f5980 10 removing email index: 2024-09-10T14:29:58.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb1523f5980 10 removing user buckets index 2024-09-10T14:29:58.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.385+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x7fb13801fbe0 2024-09-10T14:29:58.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.389+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== osd_op_reply(159 fud.buckets [delete] v36'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.389+0000 7fb1523f5980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T14:29:58.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.389+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93931857108448 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x7fb13801fbe0 2024-09-10T14:29:58.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.389+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== watch-notify(notify (1) cookie 93931856813312 notify 154618822682 ret 0) ==== 202+0+0 (crc 0 0 0) 0x556e36f614f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.389+0000 7fb02effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822682 cookie 93931856813312 notifier 4757 bl.length()=160 2024-09-10T14:29:58.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.389+0000 7fb02effd640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb014003d70 con 0x7fb13801fbe0 2024-09-10T14:29:58.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.389+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(160 notify.6 [notify cookie 93931857108448 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.389+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 41 ==== watch-notify(notify_complete (2) cookie 93931857108448 notify 154618822682 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e36f28900 con 0x7fb13801fbe0 2024-09-10T14:29:58.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb1523f5980 10 removing user index: fud 2024-09-10T14:29:58.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x7fb13801fbe0 2024-09-10T14:29:58.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 42 ==== osd_op_reply(162 fud [call,call,delete] v36'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb1523f5980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T14:29:58.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb1523f5980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T14:29:58.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93931857108448 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x7fb13801fbe0 2024-09-10T14:29:58.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 43 ==== watch-notify(notify (1) cookie 93931856809344 notify 154618822683 ret 0) ==== 194+0+0 (crc 0 0 0) 0x556e36f28900 con 0x7fb13801fbe0 2024-09-10T14:29:58.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb02e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 93931856809344 notifier 4757 bl.length()=152 2024-09-10T14:29:58.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb02e7fc640 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7faf840032d0 con 0x7fb13801fbe0 2024-09-10T14:29:58.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.393+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 44 ==== osd_op_reply(163 notify.5 [notify cookie 93931857108448 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.397+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.397+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 46 ==== watch-notify(notify_complete (2) cookie 93931857108448 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556e36f59ea0 con 0x7fb13801fbe0 2024-09-10T14:29:58.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.397+0000 7fb005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:29:58.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.397+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93931856810400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f8c1e0 con 0x556e36f46860 2024-09-10T14:29:58.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.397+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 37 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93931856810400] v36'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.397+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93931856792512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f62ee0 con 0x7fb140105040 2024-09-10T14:29:58.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.401+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 39 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93931856792512] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.401+0000 7fb1523f5980 20 remove_watcher() i=0 2024-09-10T14:29:58.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.401+0000 7fb1523f5980 2 removed watcher, disabling cache 2024-09-10T14:29:58.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.401+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93931856796896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f62ee0 con 0x556e36f46860 2024-09-10T14:29:58.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.401+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 38 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93931856796896] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.401+0000 7fb1523f5980 20 remove_watcher() i=1 2024-09-10T14:29:58.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.401+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93931856801664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f62ee0 con 0x556e36f4b250 2024-09-10T14:29:58.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.405+0000 7fb14ff05640 1 -- 172.21.15.151:0/1250892620 <== osd.3 v2:172.21.15.151:6803/3136276598 55 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93931856801664] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1400f9030 con 0x556e36f4b250 2024-09-10T14:29:58.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.405+0000 7fb1523f5980 20 remove_watcher() i=2 2024-09-10T14:29:58.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.405+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93931856805440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f62ee0 con 0x7fb140105040 2024-09-10T14:29:58.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.405+0000 7fb14f704640 1 -- 172.21.15.151:0/1250892620 <== osd.2 v2:172.21.15.151:6816/2885613778 40 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93931856805440] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138037040 con 0x7fb140105040 2024-09-10T14:29:58.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.405+0000 7fb1523f5980 20 remove_watcher() i=3 2024-09-10T14:29:58.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.405+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93931856803872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f62ee0 con 0x556e36f46860 2024-09-10T14:29:58.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.409+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.1 v2:172.21.15.151:6800/103268966 39 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93931856803872] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x556e36f46860 2024-09-10T14:29:58.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.409+0000 7fb1523f5980 20 remove_watcher() i=4 2024-09-10T14:29:58.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.409+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93931856809344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f62ee0 con 0x7fb13801fbe0 2024-09-10T14:29:58.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.413+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 47 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93931856809344] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.413+0000 7fb1523f5980 20 remove_watcher() i=5 2024-09-10T14:29:58.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.413+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93931856813312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f62ee0 con 0x7fb13801fbe0 2024-09-10T14:29:58.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.413+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 48 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93931856813312] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.413+0000 7fb1523f5980 20 remove_watcher() i=6 2024-09-10T14:29:58.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.413+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93931856815872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556e36f62ee0 con 0x7fb13801fbe0 2024-09-10T14:29:58.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 <== osd.0 v2:172.21.15.52:6800/2968015226 49 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93931856815872] v36'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1480083f0 con 0x7fb13801fbe0 2024-09-10T14:29:58.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 20 remove_watcher() i=7 2024-09-10T14:29:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb13801fbe0 msgr2=0x7fb13803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fb13801fbe0 0x7fb13803a3c0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36f46860 msgr2=0x556e36f48d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36f46860 0x556e36f48d20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb140105040 msgr2=0x7fb1400d1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fb140105040 0x7fb1400d1570 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f4b250 msgr2=0x556e36f4d640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f4b250 0x556e36f4d640 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0180346a0 msgr2=0x7fb018036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb0180346a0 0x7fb018036b60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c010 tx=0x7fb138010000 comp rx=0 tx=0).stop 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb150706640 1 -- 172.21.15.151:0/1250892620 reap_dead start 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 msgr2=0x556e36f3b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f3b7b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb1400e15f0 tx=0x7fb1400abd20 comp rx=0 tx=0).stop 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 shutdown_connections 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1250892620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f34680 0x556e36f3b7b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 >> 172.21.15.151:0/1250892620 conn(0x556e36f30a00 msgr2=0x556e36f2ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 shutdown_connections 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/1250892620 wait complete. 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/3277681194 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb028034690 msgr2=0x7fb028036b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/3277681194 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb028034690 0x7fb028036b50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x556e36f11de0 tx=0x7fb13800f000 comp rx=0 tx=0).stop 2024-09-10T14:29:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/3277681194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f27d10 msgr2=0x556e36f28130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/3277681194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f27d10 0x556e36f28130 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb1400e2e90 tx=0x7fb1400c6f50 comp rx=0 tx=0).stop 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/3277681194 shutdown_connections 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/3277681194 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb028034690 0x7fb028036b50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 --2- 172.21.15.151:0/3277681194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36f27d10 0x556e36f28130 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/3277681194 >> 172.21.15.151:0/3277681194 conn(0x556e36f1ce60 msgr2=0x556e36f1f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/3277681194 shutdown_connections 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.417+0000 7fb1523f5980 1 -- 172.21.15.151:0/3277681194 wait complete. 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x556e36f17750 msgr2=0x556e36f19b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x556e36f17750 0x556e36f19b40 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36e18240 msgr2=0x556e36f10f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556e36e18240 0x556e36f10f50 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f13830 msgr2=0x556e36f15c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x556e36f13830 0x556e36f15c20 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 msgr2=0x7fb038036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb038034650 0x7fb038036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb138000f70 tx=0x7fb138001380 comp rx=0 tx=0).stop 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 msgr2=0x556e36f09e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 --2- 172.21.15.151:0/1028069639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556e36e178f0 0x556e36f09e50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb14001aec0 tx=0x7fb140017e30 comp rx=0 tx=0).stop 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb150706640 1 -- 172.21.15.151:0/1028069639 reap_dead start 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 shutdown_connections 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 >> 172.21.15.151:0/1028069639 conn(0x556e36d8b240 msgr2=0x556e36efd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 shutdown_connections 2024-09-10T14:29:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:29:58.421+0000 7fb1523f5980 1 -- 172.21.15.151:0/1028069639 wait complete. 2024-09-10T14:30:38.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-10T14:30:38.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-10T14:30:38.440 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-10T14:30:38.479 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e11b94980 1 Processor -- start 2024-09-10T14:30:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e11b94980 1 -- start start 2024-09-10T14:30:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e11b94980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c0ecc32650 0x55c0ecc32a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e11b94980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0ecabaae0 con 0x55c0ecc32fa0 2024-09-10T14:30:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e11b94980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55c0ecadee30 con 0x55c0ecc32650 2024-09-10T14:30:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e0f6a4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c0ecc32650 0x55c0ecc32a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e0f6a4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c0ecc32650 0x55c0ecc32a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50388/0 (socket says 172.21.15.151:50388) 2024-09-10T14:30:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/1447821652 learned_addr learned my addr 172.21.15.151:0/1447821652 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/1447821652 >> v1:172.21.15.52:6789/0 conn(0x55c0ecc32fa0 legacy=0x55c0ecc379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/1447821652 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ecc3a220 con 0x55c0ecc32650 2024-09-10T14:30:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.476+0000 7f6e0e6a2640 1 -- 172.21.15.151:0/1447821652 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290433346 0 0) 0x55c0ecabaae0 con 0x55c0ecc32fa0 2024-09-10T14:30:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/1447821652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecc32a30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000a4e0 tx=0x7f6e0001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb60e958416e8a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e0e6a2640 1 -- 172.21.15.151:0/1447821652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000aa540 con 0x55c0ecc32650 2024-09-10T14:30:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e0e6a2640 1 -- 172.21.15.151:0/1447821652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e000aa6e0 con 0x55c0ecc32650 2024-09-10T14:30:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e0e6a2640 1 -- 172.21.15.151:0/1447821652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000aaa00 con 0x55c0ecc32650 2024-09-10T14:30:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e11b94980 1 -- 172.21.15.151:0/1447821652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 msgr2=0x55c0ecc32a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e11b94980 1 --2- 172.21.15.151:0/1447821652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecc32a30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000a4e0 tx=0x7f6e0001b090 comp rx=0 tx=0).stop 2024-09-10T14:30:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e11b94980 1 -- 172.21.15.151:0/1447821652 shutdown_connections 2024-09-10T14:30:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e11b94980 1 --2- 172.21.15.151:0/1447821652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecc32a30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e11b94980 1 -- 172.21.15.151:0/1447821652 >> 172.21.15.151:0/1447821652 conn(0x55c0ecc2e170 msgr2=0x55c0ecc30590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e11b94980 1 -- 172.21.15.151:0/1447821652 shutdown_connections 2024-09-10T14:30:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.480+0000 7f6e11b94980 1 -- 172.21.15.151:0/1447821652 wait complete. 2024-09-10T14:30:38.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.496+0000 7f6e11b94980 1 Processor -- start 2024-09-10T14:30:38.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.496+0000 7f6e11b94980 1 -- start start 2024-09-10T14:30:38.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.496+0000 7f6e11b94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd1d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.496+0000 7f6e11b94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c0ecae0200 con 0x55c0ecc32650 2024-09-10T14:30:38.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.496+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd1d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.496+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd1d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50390/0 (socket says 172.21.15.151:50390) 2024-09-10T14:30:38.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.496+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3379257318 learned_addr learned my addr 172.21.15.151:0/3379257318 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.496+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3379257318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ecd1dda0 con 0x55c0ecc32650 2024-09-10T14:30:38.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/3379257318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd1d7d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6e00017ca0 tx=0x7f6e000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a1511e15258144 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6cfd60a640 1 -- 172.21.15.151:0/3379257318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000b9030 con 0x55c0ecc32650 2024-09-10T14:30:38.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6cfd60a640 1 -- 172.21.15.151:0/3379257318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e000aaac0 con 0x55c0ecc32650 2024-09-10T14:30:38.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6cfd60a640 1 -- 172.21.15.151:0/3379257318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000aada0 con 0x55c0ecc32650 2024-09-10T14:30:38.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 -- 172.21.15.151:0/3379257318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 msgr2=0x55c0ecd1d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3379257318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd1d7d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6e00017ca0 tx=0x7f6e000033b0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 -- 172.21.15.151:0/3379257318 shutdown_connections 2024-09-10T14:30:38.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3379257318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd1d7d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 -- 172.21.15.151:0/3379257318 >> 172.21.15.151:0/3379257318 conn(0x55c0ecc2e170 msgr2=0x55c0ecd19400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 -- 172.21.15.151:0/3379257318 shutdown_connections 2024-09-10T14:30:38.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 -- 172.21.15.151:0/3379257318 wait complete. 2024-09-10T14:30:38.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 Processor -- start 2024-09-10T14:30:38.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 -- start start 2024-09-10T14:30:38.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd24a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e11b94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c0ecc39c60 con 0x55c0ecc32650 2024-09-10T14:30:38.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd24a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd24a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50396/0 (socket says 172.21.15.151:50396) 2024-09-10T14:30:38.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/457916584 learned_addr learned my addr 172.21.15.151:0/457916584 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/457916584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ecd24fa0 con 0x55c0ecc32650 2024-09-10T14:30:38.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd24a60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6e00005cc0 tx=0x7f6e00017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6cfbe07640 1 -- 172.21.15.151:0/457916584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000b9030 con 0x55c0ecc32650 2024-09-10T14:30:38.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6cfbe07640 1 -- 172.21.15.151:0/457916584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e000c3070 con 0x55c0ecc32650 2024-09-10T14:30:38.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.500+0000 7f6cfbe07640 1 -- 172.21.15.151:0/457916584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000bf750 con 0x55c0ecc32650 2024-09-10T14:30:38.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0ecd25230 con 0x55c0ecc32650 2024-09-10T14:30:38.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ecd27f10 con 0x55c0ecc32650 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6cfbe07640 1 -- 172.21.15.151:0/457916584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e000c5030 con 0x55c0ecc32650 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6cfbe07640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cf40346a0 0x7f6cf4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6cfbe07640 1 -- 172.21.15.151:0/457916584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6e000ba070 con 0x55c0ecc32650 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cf40346a0 0x7f6cf4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e11b94980 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecc32fa0 0x55c0ecd2b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd2c040 con 0x55c0ecc32fa0 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0fea5640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecc32fa0 0x55c0ecd2b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cf40346a0 0x7f6cf4036b60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e04000f70 tx=0x7f6e04001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0fea5640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecc32fa0 0x55c0ecd2b9f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0fea5640 1 -- 172.21.15.151:0/457916584 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecc32fa0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd29110 con 0x55c0ecc32fa0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0fea5640 1 -- 172.21.15.151:0/457916584 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecc32fa0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e11b94980 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd2e3c0 0x55c0ecd307b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd30e80 con 0x55c0ecd2e3c0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd2e3c0 0x55c0ecd307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd2e3c0 0x55c0ecd307b0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/457916584 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd2e3c0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.504+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd2d260 con 0x55c0ecc32fa0 2024-09-10T14:30:38.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e0fea5640 1 -- 172.21.15.151:0/457916584 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecc32fa0 2024-09-10T14:30:38.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e11b94980 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c0ecd322e0 0x55c0ecd346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd34dd0 con 0x55c0ecd322e0 2024-09-10T14:30:38.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c0ecd322e0 0x55c0ecd346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c0ecd322e0 0x55c0ecd346d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e0eea3640 1 -- 172.21.15.151:0/457916584 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e04010690 con 0x55c0ecd322e0 2024-09-10T14:30:38.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e11b94980 1 Processor -- start 2024-09-10T14:30:38.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e11b94980 1 -- start start 2024-09-10T14:30:38.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e11b94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd428a0 0x55c0ecd42cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e11b94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c0ecb39800 con 0x55c0ecd428a0 2024-09-10T14:30:38.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd428a0 0x55c0ecd42cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd428a0 0x55c0ecd42cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50402/0 (socket says 172.21.15.151:50402) 2024-09-10T14:30:38.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3131325502 learned_addr learned my addr 172.21.15.151:0/3131325502 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.508+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3131325502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ecd43200 con 0x55c0ecd428a0 2024-09-10T14:30:38.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/3131325502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd428a0 0x55c0ecd42cc0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6e000b7010 tx=0x7f6e000b4d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6cf9602640 1 -- 172.21.15.151:0/3131325502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000c65d0 con 0x55c0ecd428a0 2024-09-10T14:30:38.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6cf9602640 1 -- 172.21.15.151:0/3131325502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e000c6770 con 0x55c0ecd428a0 2024-09-10T14:30:38.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e11b94980 1 -- 172.21.15.151:0/3131325502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0ecd43490 con 0x55c0ecd428a0 2024-09-10T14:30:38.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6cf9602640 1 -- 172.21.15.151:0/3131325502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000bfb30 con 0x55c0ecd428a0 2024-09-10T14:30:38.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e11b94980 1 -- 172.21.15.151:0/3131325502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ecd46110 con 0x55c0ecd428a0 2024-09-10T14:30:38.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6cf9602640 1 -- 172.21.15.151:0/3131325502 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e000b3040 con 0x55c0ecd428a0 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6cf9602640 1 --2- 172.21.15.151:0/3131325502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6ce8034650 0x7f6ce8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6cf9602640 1 -- 172.21.15.151:0/3131325502 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6e000d7070 con 0x55c0ecd428a0 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/3131325502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6ce8034650 0x7f6ce8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e11b94980 1 Processor -- start 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e11b94980 1 -- start start 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e11b94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd4f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e11b94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c0ecd1e060 con 0x55c0ecd4f200 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/3131325502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6ce8034650 0x7f6ce8036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c010 tx=0x7f6e04006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd4f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd4f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50412/0 (socket says 172.21.15.151:50412) 2024-09-10T14:30:38.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/2845466338 learned_addr learned my addr 172.21.15.151:0/2845466338 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/2845466338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ecd4fbb0 con 0x55c0ecd4f200 2024-09-10T14:30:38.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.512+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/2845466338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd4f5e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6e000e8fd0 tx=0x7f6e000d1f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802d4c46bb226ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6cf2ffd640 1 -- 172.21.15.151:0/2845466338 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000dc0c0 con 0x55c0ecd4f200 2024-09-10T14:30:38.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6cf2ffd640 1 -- 172.21.15.151:0/2845466338 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e000dc280 con 0x55c0ecd4f200 2024-09-10T14:30:38.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6cf2ffd640 1 -- 172.21.15.151:0/2845466338 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000bfcd0 con 0x55c0ecd4f200 2024-09-10T14:30:38.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- 172.21.15.151:0/2845466338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 msgr2=0x55c0ecd4f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 --2- 172.21.15.151:0/2845466338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd4f5e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6e000e8fd0 tx=0x7f6e000d1f30 comp rx=0 tx=0).stop 2024-09-10T14:30:38.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- 172.21.15.151:0/2845466338 shutdown_connections 2024-09-10T14:30:38.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 --2- 172.21.15.151:0/2845466338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd4f5e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- 172.21.15.151:0/2845466338 >> 172.21.15.151:0/2845466338 conn(0x55c0ecd4b5e0 msgr2=0x55c0ecd496e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- 172.21.15.151:0/2845466338 shutdown_connections 2024-09-10T14:30:38.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- 172.21.15.151:0/2845466338 wait complete. 2024-09-10T14:30:38.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 Processor -- start 2024-09-10T14:30:38.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- start start 2024-09-10T14:30:38.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c0ecd50050 con 0x55c0ecd4f200 2024-09-10T14:30:38.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e0f6a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50414/0 (socket says 172.21.15.151:50414) 2024-09-10T14:30:38.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 learned_addr learned my addr 172.21.15.151:0/3454014161 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ecd56900 con 0x55c0ecd4f200 2024-09-10T14:30:38.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd563c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6e00004fd0 tx=0x7f6e000c3f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6cf17fa640 1 -- 172.21.15.151:0/3454014161 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000ff040 con 0x55c0ecd4f200 2024-09-10T14:30:38.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0ecd56900 con 0x55c0ecd4f200 2024-09-10T14:30:38.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6cf17fa640 1 -- 172.21.15.151:0/3454014161 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0010a070 con 0x55c0ecd4f200 2024-09-10T14:30:38.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6cf17fa640 1 -- 172.21.15.151:0/3454014161 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e000bfe20 con 0x55c0ecd4f200 2024-09-10T14:30:38.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.516+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ecd56900 con 0x55c0ecd4f200 2024-09-10T14:30:38.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6cf17fa640 1 -- 172.21.15.151:0/3454014161 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e000dceb0 con 0x55c0ecd4f200 2024-09-10T14:30:38.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6cf17fa640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cd8034600 0x7f6cd8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6cf17fa640 1 -- 172.21.15.151:0/3454014161 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6e000ae220 con 0x55c0ecd4f200 2024-09-10T14:30:38.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cd8034600 0x7f6cd8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecd61340 0x55c0ecd63800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd63f50 con 0x55c0ecd61340 2024-09-10T14:30:38.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0fea5640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecd61340 0x55c0ecd63800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cd8034600 0x7f6cd8036ac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6e04010fd0 tx=0x7f6e04022040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0fea5640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecd61340 0x55c0ecd63800 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 realm 2024-09-10T14:30:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64360 con 0x55c0ecd61340 2024-09-10T14:30:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:38.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64c30 con 0x55c0ecd61340 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd65d30 0x55c0ecd68120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd68730 con 0x55c0ecd65d30 2024-09-10T14:30:38.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd65d30 0x55c0ecd68120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd65d30 0x55c0ecd68120 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 20 searching for the correct realm 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6a000 con 0x55c0ecd65d30 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0f6a4640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6e000f1040 0x7f6e000df750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.520+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6a000 con 0x7f6e000f1040 2024-09-10T14:30:38.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6e000f1040 0x7f6e000df750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6e000f1040 0x7f6e000df750 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0eea3640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6e04010070 0x7f6e040393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6a000 con 0x7f6e04010070 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6e04010070 0x7f6e040393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6e04010070 0x7f6e040393c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e04010070 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.524+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e04010070 2024-09-10T14:30:38.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e000f1040 2024-09-10T14:30:38.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd65d30 2024-09-10T14:30:38.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e04010070 2024-09-10T14:30:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e000f1040 2024-09-10T14:30:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd65d30 2024-09-10T14:30:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd65d30 2024-09-10T14:30:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e000f1040 2024-09-10T14:30:38.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd65d30 2024-09-10T14:30:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.528+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd65d30 2024-09-10T14:30:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e04010070 2024-09-10T14:30:38.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd65d30 2024-09-10T14:30:38.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e000f1040 2024-09-10T14:30:38.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e000f1040 2024-09-10T14:30:38.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd65d30 2024-09-10T14:30:38.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e04010070 2024-09-10T14:30:38.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.532+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e000f1040 2024-09-10T14:30:38.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd65d30 2024-09-10T14:30:38.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e04010070 2024-09-10T14:30:38.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x55c0ecd61340 2024-09-10T14:30:38.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd64fd0 con 0x7f6e000f1040 2024-09-10T14:30:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:38.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd69120 con 0x55c0ecd61340 2024-09-10T14:30:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd68d60 con 0x55c0ecd61340 2024-09-10T14:30:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:38.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd69a40 con 0x7f6e04010070 2024-09-10T14:30:38.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:38.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 zone default found 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 4 Realm: () 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 zonegroup default 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.536+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd69e70 con 0x7f6e000f1040 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6be10 con 0x55c0ecd65d30 2024-09-10T14:30:38.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6c290 con 0x55c0ecd65d30 2024-09-10T14:30:38.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 20 started sync module instance, tier type = 2024-09-10T14:30:38.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:38.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6b2b0 con 0x7f6e000f1040 2024-09-10T14:30:38.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94287095576224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6cba0 con 0x7f6e000f1040 2024-09-10T14:30:38.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6d3f0 con 0x55c0ecd61340 2024-09-10T14:30:38.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.540+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94287095576224] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.544+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.544+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94287095580400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6d3f0 con 0x55c0ecd61340 2024-09-10T14:30:38.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.544+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6ded0 con 0x55c0ecd65d30 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.544+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.544+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94287095585248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6e770 con 0x55c0ecd65d30 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.544+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6f190 con 0x7f6e000f1040 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.544+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94287095580400] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.548+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.548+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94287095582528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6fa30 con 0x7f6e000f1040 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.548+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd70280 con 0x55c0ecd61340 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.548+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94287095585248] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.548+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94287095582528] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.548+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.548+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94287095592320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6fe50 con 0x55c0ecd61340 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.548+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd706a0 con 0x7f6e04010070 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.552+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94287095592320] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.552+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.552+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94287095593648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd704a0 con 0x7f6e04010070 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.552+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd710b0 con 0x7f6e04010070 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.552+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94287095593648] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.552+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.552+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94287095594768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd710b0 con 0x7f6e04010070 2024-09-10T14:30:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.552+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd71a70 con 0x7f6e04010070 2024-09-10T14:30:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94287095594768] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94287095598080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd71c50 con 0x7f6e04010070 2024-09-10T14:30:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e11b94980 20 add_watcher() i=0 2024-09-10T14:30:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e11b94980 20 add_watcher() i=1 2024-09-10T14:30:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e11b94980 20 add_watcher() i=2 2024-09-10T14:30:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e11b94980 20 add_watcher() i=3 2024-09-10T14:30:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e11b94980 20 add_watcher() i=4 2024-09-10T14:30:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e11b94980 20 add_watcher() i=5 2024-09-10T14:30:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.556+0000 7f6e11b94980 20 add_watcher() i=6 2024-09-10T14:30:38.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94287095598080] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 20 add_watcher() i=7 2024-09-10T14:30:38.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:38.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd74e30 con 0x55c0ecd61340 2024-09-10T14:30:38.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94287095613472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd71bf0 con 0x55c0ecd61340 2024-09-10T14:30:38.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94287095613472] v36'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6cc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:38.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 5 note: GC not initialized 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6cc4fe1640 20 reqs_thread_entry: start 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 20 Filter name: none 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6c3e7fc640 20 reqs_thread_entry: start 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.560+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd98550 con 0x55c0ecd61340 2024-09-10T14:30:38.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.564+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.564+0000 7f6e11b94980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:30:38.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.564+0000 7f6e11b94980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:30:38.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.564+0000 7f6e11b94980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:30:38.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.564+0000 7f6e11b94980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:38.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.564+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd9afe0 con 0x7f6e04010070 2024-09-10T14:30:38.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.564+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 usage.10 [call] v36'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.564+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd9afe0 con 0x7f6e04010070 2024-09-10T14:30:38.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.568+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(64 usage.10 [call] v36'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.568+0000 7f6cc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:38.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.568+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94287095613472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd5b4a0 con 0x55c0ecd61340 2024-09-10T14:30:38.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.572+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94287095613472] v36'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.572+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94287095576224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd74820 con 0x7f6e000f1040 2024-09-10T14:30:38.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.572+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94287095576224] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.572+0000 7f6e11b94980 20 remove_watcher() i=0 2024-09-10T14:30:38.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.572+0000 7f6e11b94980 2 removed watcher, disabling cache 2024-09-10T14:30:38.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.572+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94287095580400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd980f0 con 0x55c0ecd61340 2024-09-10T14:30:38.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94287095580400] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e11b94980 20 remove_watcher() i=1 2024-09-10T14:30:38.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94287095585248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd980f0 con 0x55c0ecd65d30 2024-09-10T14:30:38.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e0f6a4640 1 -- 172.21.15.151:0/3454014161 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94287095585248] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e000ce070 con 0x55c0ecd65d30 2024-09-10T14:30:38.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e11b94980 20 remove_watcher() i=2 2024-09-10T14:30:38.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94287095582528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6d9e0 con 0x7f6e000f1040 2024-09-10T14:30:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e0eea3640 1 -- 172.21.15.151:0/3454014161 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94287095582528] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e04036040 con 0x7f6e000f1040 2024-09-10T14:30:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e11b94980 20 remove_watcher() i=3 2024-09-10T14:30:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.576+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94287095592320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6cf40 con 0x55c0ecd61340 2024-09-10T14:30:38.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.580+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94287095592320] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x55c0ecd61340 2024-09-10T14:30:38.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.580+0000 7f6e11b94980 20 remove_watcher() i=4 2024-09-10T14:30:38.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.580+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94287095593648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6d9e0 con 0x7f6e04010070 2024-09-10T14:30:38.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.584+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94287095593648] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.584+0000 7f6e11b94980 20 remove_watcher() i=5 2024-09-10T14:30:38.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.584+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94287095594768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6f580 con 0x7f6e04010070 2024-09-10T14:30:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.584+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94287095594768] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.584+0000 7f6e11b94980 20 remove_watcher() i=6 2024-09-10T14:30:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.584+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94287095598080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c0ecd6d9e0 con 0x7f6e04010070 2024-09-10T14:30:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94287095598080] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e080083f0 con 0x7f6e04010070 2024-09-10T14:30:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 20 remove_watcher() i=7 2024-09-10T14:30:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6e04010070 msgr2=0x7f6e040393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6e04010070 0x7f6e040393c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecd61340 msgr2=0x55c0ecd63800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecd61340 0x55c0ecd63800 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6e000f1040 msgr2=0x7f6e000df750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6e000f1040 0x7f6e000df750 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd65d30 msgr2=0x55c0ecd68120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd65d30 0x55c0ecd68120 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cd8034600 msgr2=0x7f6cd8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cd8034600 0x7f6cd8036ac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6e04010fd0 tx=0x7f6e04022040 comp rx=0 tx=0).stop 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 msgr2=0x55c0ecd563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd563c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6e00004fd0 tx=0x7f6e000c3f10 comp rx=0 tx=0).stop 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e0fea5640 1 -- 172.21.15.151:0/3454014161 reap_dead start 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 shutdown_connections 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3454014161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd4f200 0x55c0ecd563c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 >> 172.21.15.151:0/3454014161 conn(0x55c0ecd4b5e0 msgr2=0x55c0ecd496b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 shutdown_connections 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3454014161 wait complete. 2024-09-10T14:30:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3131325502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6ce8034650 msgr2=0x7f6ce8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3131325502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6ce8034650 0x7f6ce8036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c010 tx=0x7f6e04006000 comp rx=0 tx=0).stop 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3131325502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd428a0 msgr2=0x55c0ecd42cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3131325502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd428a0 0x55c0ecd42cc0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6e000b7010 tx=0x7f6e000b4d10 comp rx=0 tx=0).stop 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3131325502 shutdown_connections 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3131325502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6ce8034650 0x7f6ce8036b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/3131325502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecd428a0 0x55c0ecd42cc0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3131325502 >> 172.21.15.151:0/3131325502 conn(0x55c0ecd379f0 msgr2=0x55c0ecd3a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3131325502 shutdown_connections 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/3131325502 wait complete. 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c0ecd322e0 msgr2=0x55c0ecd346d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c0ecd322e0 0x55c0ecd346d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecc32fa0 msgr2=0x55c0ecd2b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c0ecc32fa0 0x55c0ecd2b9f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd2e3c0 msgr2=0x55c0ecd307b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c0ecd2e3c0 0x55c0ecd307b0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cf40346a0 msgr2=0x7f6cf4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6cf40346a0 0x7f6cf4036b60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e04000f70 tx=0x7f6e04001400 comp rx=0 tx=0).stop 2024-09-10T14:30:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 msgr2=0x55c0ecd24a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 --2- 172.21.15.151:0/457916584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c0ecc32650 0x55c0ecd24a60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6e00005cc0 tx=0x7f6e00017e30 comp rx=0 tx=0).stop 2024-09-10T14:30:38.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e0fea5640 1 -- 172.21.15.151:0/457916584 reap_dead start 2024-09-10T14:30:38.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 shutdown_connections 2024-09-10T14:30:38.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 >> 172.21.15.151:0/457916584 conn(0x55c0ecc2e170 msgr2=0x55c0ecd17f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 shutdown_connections 2024-09-10T14:30:38.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.588+0000 7f6e11b94980 1 -- 172.21.15.151:0/457916584 wait complete. 2024-09-10T14:30:38.606 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T14:30:38.606 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T14:30:38.606 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T14:30:38.682 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:38.682 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:38.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53ec754980 1 Processor -- start 2024-09-10T14:30:38.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53ec754980 1 -- start start 2024-09-10T14:30:38.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53ec754980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56484b7527c0 0x56484b751280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53ec754980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56484b663ae0 con 0x56484b7523b0 2024-09-10T14:30:38.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53ec754980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56484b687e30 con 0x56484b7527c0 2024-09-10T14:30:38.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53e3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56484b7527c0 0x56484b751280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53ea264640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x56484b7523b0 0x56484b750b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33258/0 (socket says 172.21.15.151:33258) 2024-09-10T14:30:38.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53ea264640 1 -- 172.21.15.151:0/4203486659 learned_addr learned my addr 172.21.15.151:0/4203486659 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:30:38.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53e3fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56484b7527c0 0x56484b751280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50430/0 (socket says 172.21.15.151:50430) 2024-09-10T14:30:38.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53e3fff640 1 -- 172.21.15.151:0/4203486659 >> v1:172.21.15.52:6789/0 conn(0x56484b7523b0 legacy=0x56484b750b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.680+0000 7f53e3fff640 1 -- 172.21.15.151:0/4203486659 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484b7518e0 con 0x56484b7527c0 2024-09-10T14:30:38.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53e3fff640 1 --2- 172.21.15.151:0/4203486659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7527c0 0x56484b751280 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f53d400a480 tx=0x7f53d401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b16d244623328ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53e9a63640 1 -- 172.21.15.151:0/4203486659 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d40b0070 con 0x56484b7527c0 2024-09-10T14:30:38.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53e9a63640 1 -- 172.21.15.151:0/4203486659 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d40ab540 con 0x56484b7527c0 2024-09-10T14:30:38.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53e9a63640 1 -- 172.21.15.151:0/4203486659 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53d40ab840 con 0x56484b7527c0 2024-09-10T14:30:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53ec754980 1 -- 172.21.15.151:0/4203486659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7527c0 msgr2=0x56484b751280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53ec754980 1 --2- 172.21.15.151:0/4203486659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7527c0 0x56484b751280 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f53d400a480 tx=0x7f53d401b280 comp rx=0 tx=0).stop 2024-09-10T14:30:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53ec754980 1 -- 172.21.15.151:0/4203486659 shutdown_connections 2024-09-10T14:30:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53ec754980 1 --2- 172.21.15.151:0/4203486659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7527c0 0x56484b751280 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53ec754980 1 -- 172.21.15.151:0/4203486659 >> 172.21.15.151:0/4203486659 conn(0x56484b7d71b0 msgr2=0x56484b7d95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53ec754980 1 -- 172.21.15.151:0/4203486659 shutdown_connections 2024-09-10T14:30:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.684+0000 7f53ec754980 1 -- 172.21.15.151:0/4203486659 wait complete. 2024-09-10T14:30:38.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 Processor -- start 2024-09-10T14:30:38.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 -- start start 2024-09-10T14:30:38.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56484b689200 con 0x56484b7523b0 2024-09-10T14:30:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50432/0 (socket says 172.21.15.151:50432) 2024-09-10T14:30:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ea264640 1 -- 172.21.15.151:0/2778408941 learned_addr learned my addr 172.21.15.151:0/2778408941 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ea264640 1 -- 172.21.15.151:0/2778408941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484b8c9170 con 0x56484b7523b0 2024-09-10T14:30:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ea264640 1 --2- 172.21.15.151:0/2778408941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8c8ba0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001d90 tx=0x7f53dc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0549efa4623ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f52d8608640 1 -- 172.21.15.151:0/2778408941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc013030 con 0x56484b7523b0 2024-09-10T14:30:38.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f52d8608640 1 -- 172.21.15.151:0/2778408941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc00e690 con 0x56484b7523b0 2024-09-10T14:30:38.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f52d8608640 1 -- 172.21.15.151:0/2778408941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc00ea10 con 0x56484b7523b0 2024-09-10T14:30:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 -- 172.21.15.151:0/2778408941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 msgr2=0x56484b8c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 --2- 172.21.15.151:0/2778408941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8c8ba0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001d90 tx=0x7f53dc001e80 comp rx=0 tx=0).stop 2024-09-10T14:30:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 -- 172.21.15.151:0/2778408941 shutdown_connections 2024-09-10T14:30:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 --2- 172.21.15.151:0/2778408941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8c8ba0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 -- 172.21.15.151:0/2778408941 >> 172.21.15.151:0/2778408941 conn(0x56484b7d71b0 msgr2=0x56484b8c47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 -- 172.21.15.151:0/2778408941 shutdown_connections 2024-09-10T14:30:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.700+0000 7f53ec754980 1 -- 172.21.15.151:0/2778408941 wait complete. 2024-09-10T14:30:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ec754980 1 Processor -- start 2024-09-10T14:30:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ec754980 1 -- start start 2024-09-10T14:30:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ec754980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8cff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ec754980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56484b7e7200 con 0x56484b7523b0 2024-09-10T14:30:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50438/0 (socket says 172.21.15.151:50438) 2024-09-10T14:30:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ea264640 1 -- 172.21.15.151:0/3693212815 learned_addr learned my addr 172.21.15.151:0/3693212815 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ea264640 1 -- 172.21.15.151:0/3693212815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484b8d0450 con 0x56484b7523b0 2024-09-10T14:30:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ea264640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8cff10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x56484b8c9d80 tx=0x7f53dc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f52d6e05640 1 -- 172.21.15.151:0/3693212815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc027070 con 0x56484b7523b0 2024-09-10T14:30:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f52d6e05640 1 -- 172.21.15.151:0/3693212815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc019900 con 0x56484b7523b0 2024-09-10T14:30:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56484b8d06e0 con 0x56484b7523b0 2024-09-10T14:30:38.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f52d6e05640 1 -- 172.21.15.151:0/3693212815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc019c20 con 0x56484b7523b0 2024-09-10T14:30:38.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484b8d33c0 con 0x56484b7523b0 2024-09-10T14:30:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f52d6e05640 1 -- 172.21.15.151:0/3693212815 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53dc02a070 con 0x56484b7523b0 2024-09-10T14:30:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f52d6e05640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52d0034650 0x7f52d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f52d6e05640 1 -- 172.21.15.151:0/3693212815 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f53dc01f070 con 0x56484b7523b0 2024-09-10T14:30:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53e3fff640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52d0034650 0x7f52d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ec754980 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b7527c0 0x56484b8d6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.704+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b8d7550 con 0x56484b7527c0 2024-09-10T14:30:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53eaa65640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b7527c0 0x56484b8d6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53e3fff640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52d0034650 0x7f52d0036b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53d40ad000 tx=0x7f53d40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53eaa65640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b7527c0 0x56484b8d6ee0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53eaa65640 1 -- 172.21.15.151:0/3693212815 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b7527c0 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b8d45e0 con 0x56484b7527c0 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53eaa65640 1 -- 172.21.15.151:0/3693212815 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b7527c0 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ec754980 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b8d9880 0x56484b8dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b8dc340 con 0x56484b8d9880 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ea264640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b8d9880 0x56484b8dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ea264640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b8d9880 0x56484b8dbc70 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ea264640 1 -- 172.21.15.151:0/3693212815 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f53dc029030 con 0x56484b8d9880 2024-09-10T14:30:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b8d8720 con 0x56484b7527c0 2024-09-10T14:30:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53eaa65640 1 -- 172.21.15.151:0/3693212815 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b7527c0 2024-09-10T14:30:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ec754980 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56484b8dd7a0 0x56484b8dfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b8e0290 con 0x56484b8dd7a0 2024-09-10T14:30:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53e3fff640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56484b8dd7a0 0x56484b8dfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.708+0000 7f53e3fff640 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56484b8dd7a0 0x56484b8dfb90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53e3fff640 1 -- 172.21.15.151:0/3693212815 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f53d40b3040 con 0x56484b8dd7a0 2024-09-10T14:30:38.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ec754980 1 Processor -- start 2024-09-10T14:30:38.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ec754980 1 -- start start 2024-09-10T14:30:38.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ec754980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8edd80 0x56484b8ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ec754980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56484b6e2800 con 0x56484b8edd80 2024-09-10T14:30:38.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8edd80 0x56484b8ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8edd80 0x56484b8ee1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50452/0 (socket says 172.21.15.151:50452) 2024-09-10T14:30:38.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ea264640 1 -- 172.21.15.151:0/4066045854 learned_addr learned my addr 172.21.15.151:0/4066045854 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ea264640 1 -- 172.21.15.151:0/4066045854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484b8ee6e0 con 0x56484b8edd80 2024-09-10T14:30:38.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ea264640 1 --2- 172.21.15.151:0/4066045854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8edd80 0x56484b8ee1a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f53dc048430 tx=0x7f53dc0485a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f52cffff640 1 -- 172.21.15.151:0/4066045854 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc048b10 con 0x56484b8edd80 2024-09-10T14:30:38.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f52cffff640 1 -- 172.21.15.151:0/4066045854 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc048cb0 con 0x56484b8edd80 2024-09-10T14:30:38.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ec754980 1 -- 172.21.15.151:0/4066045854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56484b8ee970 con 0x56484b8edd80 2024-09-10T14:30:38.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f52cffff640 1 -- 172.21.15.151:0/4066045854 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc02a580 con 0x56484b8edd80 2024-09-10T14:30:38.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53ec754980 1 -- 172.21.15.151:0/4066045854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484b8f15f0 con 0x56484b8edd80 2024-09-10T14:30:38.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f52cffff640 1 -- 172.21.15.151:0/4066045854 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53dc036040 con 0x56484b8edd80 2024-09-10T14:30:38.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f52cffff640 1 --2- 172.21.15.151:0/4066045854 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52c4034650 0x7f52c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f52cffff640 1 -- 172.21.15.151:0/4066045854 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f53dc014070 con 0x56484b8edd80 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.712+0000 7f53e3fff640 1 --2- 172.21.15.151:0/4066045854 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52c4034650 0x7f52c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 Processor -- start 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- start start 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53e3fff640 1 --2- 172.21.15.151:0/4066045854 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52c4034650 0x7f52c4036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x56484b8d7e30 tx=0x7f53d4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b8fab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56484b8c94f0 con 0x56484b8fa720 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b8fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b8fab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50458/0 (socket says 172.21.15.151:50458) 2024-09-10T14:30:38.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 -- 172.21.15.151:0/3941224749 learned_addr learned my addr 172.21.15.151:0/3941224749 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 -- 172.21.15.151:0/3941224749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484b8fb0d0 con 0x56484b8fa720 2024-09-10T14:30:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 --2- 172.21.15.151:0/3941224749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b8fab00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00d010 tx=0x7f53dc02c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db27f6aeccf44f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f52cdffb640 1 -- 172.21.15.151:0/3941224749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc058040 con 0x56484b8fa720 2024-09-10T14:30:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f52cdffb640 1 -- 172.21.15.151:0/3941224749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc0191b0 con 0x56484b8fa720 2024-09-10T14:30:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f52cdffb640 1 -- 172.21.15.151:0/3941224749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc02aaa0 con 0x56484b8fa720 2024-09-10T14:30:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- 172.21.15.151:0/3941224749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 msgr2=0x56484b8fab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 --2- 172.21.15.151:0/3941224749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b8fab00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00d010 tx=0x7f53dc02c6e0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- 172.21.15.151:0/3941224749 shutdown_connections 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 --2- 172.21.15.151:0/3941224749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b8fab00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- 172.21.15.151:0/3941224749 >> 172.21.15.151:0/3941224749 conn(0x56484b8f6b00 msgr2=0x56484b8f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- 172.21.15.151:0/3941224749 shutdown_connections 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- 172.21.15.151:0/3941224749 wait complete. 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 Processor -- start 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- start start 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b901940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ec754980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56484b8fb570 con 0x56484b8fa720 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b901940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b901940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50470/0 (socket says 172.21.15.151:50470) 2024-09-10T14:30:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 learned_addr learned my addr 172.21.15.151:0/607871345 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.716+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484b901e80 con 0x56484b8fa720 2024-09-10T14:30:38.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ea264640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b901940 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f53dc019380 tx=0x7f53dc03ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f52bbfff640 1 -- 172.21.15.151:0/607871345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc06a070 con 0x56484b8fa720 2024-09-10T14:30:38.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f52bbfff640 1 -- 172.21.15.151:0/607871345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc058040 con 0x56484b8fa720 2024-09-10T14:30:38.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f52bbfff640 1 -- 172.21.15.151:0/607871345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc057070 con 0x56484b8fa720 2024-09-10T14:30:38.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56484b901e80 con 0x56484b8fa720 2024-09-10T14:30:38.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484b901e80 con 0x56484b8fa720 2024-09-10T14:30:38.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f52bbfff640 1 -- 172.21.15.151:0/607871345 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53dc06d070 con 0x56484b8fa720 2024-09-10T14:30:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f52bbfff640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52b4034650 0x7f52b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f52bbfff640 1 -- 172.21.15.151:0/607871345 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f53dc005050 con 0x56484b8fa720 2024-09-10T14:30:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53e3fff640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52b4034650 0x7f52b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b90c990 0x56484b90ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b90f5a0 con 0x56484b90c990 2024-09-10T14:30:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53eaa65640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b90c990 0x56484b90ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53e3fff640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52b4034650 0x7f52b4036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f53d4018eb0 tx=0x7f53d40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53eaa65640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b90c990 0x56484b90ee50 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 20 realm 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b90f9b0 con 0x56484b90c990 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b910250 con 0x56484b90c990 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.720+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x56484b90c990 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ec754980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b911350 0x56484b913740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b913cc0 con 0x56484b911350 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ea264640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b911350 0x56484b913740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ea264640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b911350 0x56484b913740 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ec754980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:38.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ec754980 20 searching for the correct realm 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b915520 con 0x56484b911350 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ea264640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f53dc06f070 0x7f53dc066440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b915520 con 0x7f53dc06f070 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53e3fff640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f53dc06f070 0x7f53dc066440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53e3fff640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f53dc06f070 0x7f53dc066440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53e3fff640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53d40cd040 0x7f53d40da920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b915520 con 0x7f53d40cd040 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53eaa65640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53d40cd040 0x7f53d40da920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.724+0000 7f53eaa65640 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53d40cd040 0x7f53d40da920 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x56484b90c990 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x56484b90c990 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x7f53d40cd040 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x7f53d40cd040 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x7f53dc06f070 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x56484b911350 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x56484b90c990 2024-09-10T14:30:38.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x7f53d40cd040 2024-09-10T14:30:38.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.728+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x56484b90c990 2024-09-10T14:30:38.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56484b9105f0 con 0x7f53dc06f070 2024-09-10T14:30:38.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b911350 2024-09-10T14:30:38.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b911350 2024-09-10T14:30:38.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x7f53dc06f070 2024-09-10T14:30:38.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b911350 2024-09-10T14:30:38.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b911350 2024-09-10T14:30:38.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b90c990 2024-09-10T14:30:38.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b90c990 2024-09-10T14:30:38.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x7f53d40cd040 2024-09-10T14:30:38.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b911350 2024-09-10T14:30:38.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x7f53dc06f070 2024-09-10T14:30:38.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.732+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b90c990 2024-09-10T14:30:38.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x7f53dc06f070 2024-09-10T14:30:38.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b911350 2024-09-10T14:30:38.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x7f53d40cd040 2024-09-10T14:30:38.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x7f53dc06f070 2024-09-10T14:30:38.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b911350 2024-09-10T14:30:38.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x7f53d40cd040 2024-09-10T14:30:38.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x56484b90c990 2024-09-10T14:30:38.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f53d40e7060 con 0x7f53dc06f070 2024-09-10T14:30:38.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:38.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:38.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:38.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:38.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:38.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:38.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b914640 con 0x56484b90c990 2024-09-10T14:30:38.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.736+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b914ee0 con 0x56484b90c990 2024-09-10T14:30:38.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:38.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b914280 con 0x7f53d40cd040 2024-09-10T14:30:38.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:38.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 zone default found 2024-09-10T14:30:38.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 4 Realm: () 2024-09-10T14:30:38.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:38.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:38.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:38.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 zonegroup default 2024-09-10T14:30:38.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b914a30 con 0x7f53dc06f070 2024-09-10T14:30:38.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b9173d0 con 0x56484b911350 2024-09-10T14:30:38.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b917770 con 0x56484b911350 2024-09-10T14:30:38.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 started sync module instance, tier type = 2024-09-10T14:30:38.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:38.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b916870 con 0x7f53dc06f070 2024-09-10T14:30:38.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94868505455632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b917030 con 0x7f53dc06f070 2024-09-10T14:30:38.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.740+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b918630 con 0x56484b90c990 2024-09-10T14:30:38.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.744+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94868505455632] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.744+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.744+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94868505461120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b918a50 con 0x56484b90c990 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.744+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b919300 con 0x56484b911350 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94868505463680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b919ba0 con 0x56484b911350 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91a5a0 con 0x7f53dc06f070 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94868505461120] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94868505462176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91a9c0 con 0x7f53dc06f070 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91b290 con 0x56484b90c990 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94868505463680] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94868505462176] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94868505469104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91a9c0 con 0x56484b90c990 2024-09-10T14:30:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.748+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91bb30 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.752+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94868505469104] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.752+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.752+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94868505466608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91a9c0 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.752+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91c050 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.752+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94868505475904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91c4c0 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91cfb0 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94868505466608] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94868505475904] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94868505479808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91c010 con 0x7f53d40cd040 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 20 add_watcher() i=0 2024-09-10T14:30:38.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 20 add_watcher() i=1 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 20 add_watcher() i=2 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 20 add_watcher() i=3 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 20 add_watcher() i=4 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 20 add_watcher() i=5 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.756+0000 7f53ec754980 20 add_watcher() i=6 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94868505479808] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 20 add_watcher() i=7 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b9200b0 con 0x56484b90c990 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94868505474208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91d530 con 0x56484b90c990 2024-09-10T14:30:38.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94868505474208] v36'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f52a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 5 note: GC not initialized 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f521b7fe640 20 reqs_thread_entry: start 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 20 Filter name: none 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f52197fa640 20 reqs_thread_entry: start 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b943010 con 0x56484b90c990 2024-09-10T14:30:38.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:30:38.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.760+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56484b944560 con 0x7f53d40cd040 2024-09-10T14:30:38.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.764+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.764+0000 7f52a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:38.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.764+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94868505474208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b921f60 con 0x56484b90c990 2024-09-10T14:30:38.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.764+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94868505474208] v36'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.764+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94868505455632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91b4a0 con 0x7f53dc06f070 2024-09-10T14:30:38.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.768+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94868505455632] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.768+0000 7f53ec754980 20 remove_watcher() i=0 2024-09-10T14:30:38.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.768+0000 7f53ec754980 2 removed watcher, disabling cache 2024-09-10T14:30:38.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.768+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94868505461120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91b4a0 con 0x56484b90c990 2024-09-10T14:30:38.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.768+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94868505461120] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.768+0000 7f53ec754980 20 remove_watcher() i=1 2024-09-10T14:30:38.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.768+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94868505463680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b918180 con 0x56484b911350 2024-09-10T14:30:38.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.772+0000 7f53ea264640 1 -- 172.21.15.151:0/607871345 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94868505463680] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53dc076070 con 0x56484b911350 2024-09-10T14:30:38.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.772+0000 7f53ec754980 20 remove_watcher() i=2 2024-09-10T14:30:38.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.772+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94868505462176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91b4a0 con 0x7f53dc06f070 2024-09-10T14:30:38.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.772+0000 7f53e3fff640 1 -- 172.21.15.151:0/607871345 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94868505462176] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d40d8070 con 0x7f53dc06f070 2024-09-10T14:30:38.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.772+0000 7f53ec754980 20 remove_watcher() i=3 2024-09-10T14:30:38.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.772+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94868505469104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91b4a0 con 0x56484b90c990 2024-09-10T14:30:38.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.776+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94868505469104] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x56484b90c990 2024-09-10T14:30:38.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.776+0000 7f53ec754980 20 remove_watcher() i=4 2024-09-10T14:30:38.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.776+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94868505466608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b91b4a0 con 0x7f53d40cd040 2024-09-10T14:30:38.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.776+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94868505466608] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.776+0000 7f53ec754980 20 remove_watcher() i=5 2024-09-10T14:30:38.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.776+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94868505475904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b9196f0 con 0x7f53d40cd040 2024-09-10T14:30:38.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94868505475904] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e400a4d0 con 0x7f53d40cd040 2024-09-10T14:30:38.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 20 remove_watcher() i=6 2024-09-10T14:30:38.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94868505479808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56484b9196f0 con 0x7f53d40cd040 2024-09-10T14:30:38.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94868505479808] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53e403e040 con 0x7f53d40cd040 2024-09-10T14:30:38.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 20 remove_watcher() i=7 2024-09-10T14:30:38.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53d40cd040 msgr2=0x7f53d40da920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f53d40cd040 0x7f53d40da920 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b90c990 msgr2=0x56484b90ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b90c990 0x56484b90ee50 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f53dc06f070 msgr2=0x7f53dc066440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f53dc06f070 0x7f53dc066440 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b911350 msgr2=0x56484b913740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b911350 0x56484b913740 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52b4034650 msgr2=0x7f52b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52b4034650 0x7f52b4036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f53d4018eb0 tx=0x7f53d40a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:38.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 msgr2=0x56484b901940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53eaa65640 1 -- 172.21.15.151:0/607871345 reap_dead start 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b901940 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f53dc019380 tx=0x7f53dc03ef00 comp rx=0 tx=0).stop 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 shutdown_connections 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/607871345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8fa720 0x56484b901940 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 >> 172.21.15.151:0/607871345 conn(0x56484b8f6b00 msgr2=0x56484b8f4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 shutdown_connections 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/607871345 wait complete. 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/4066045854 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52c4034650 msgr2=0x7f52c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/4066045854 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52c4034650 0x7f52c4036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x56484b8d7e30 tx=0x7f53d4005a10 comp rx=0 tx=0).stop 2024-09-10T14:30:38.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/4066045854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8edd80 msgr2=0x56484b8ee1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/4066045854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8edd80 0x56484b8ee1a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f53dc048430 tx=0x7f53dc0485a0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/4066045854 shutdown_connections 2024-09-10T14:30:38.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/4066045854 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52c4034650 0x7f52c4036b10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 --2- 172.21.15.151:0/4066045854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b8edd80 0x56484b8ee1a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.780+0000 7f53ec754980 1 -- 172.21.15.151:0/4066045854 >> 172.21.15.151:0/4066045854 conn(0x56484b8e2ed0 msgr2=0x56484b8e5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/4066045854 shutdown_connections 2024-09-10T14:30:38.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/4066045854 wait complete. 2024-09-10T14:30:38.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56484b8dd7a0 msgr2=0x56484b8dfb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56484b8dd7a0 0x56484b8dfb90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b7527c0 msgr2=0x56484b8d6ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56484b7527c0 0x56484b8d6ee0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b8d9880 msgr2=0x56484b8dbc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56484b8d9880 0x56484b8dbc70 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52d0034650 msgr2=0x7f52d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f52d0034650 0x7f52d0036b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53d40ad000 tx=0x7f53d40a5040 comp rx=0 tx=0).stop 2024-09-10T14:30:38.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 msgr2=0x56484b8cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 --2- 172.21.15.151:0/3693212815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56484b7523b0 0x56484b8cff10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x56484b8c9d80 tx=0x7f53dc000bd0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53eaa65640 1 -- 172.21.15.151:0/3693212815 reap_dead start 2024-09-10T14:30:38.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 shutdown_connections 2024-09-10T14:30:38.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 >> 172.21.15.151:0/3693212815 conn(0x56484b7d71b0 msgr2=0x56484b8c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 shutdown_connections 2024-09-10T14:30:38.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.784+0000 7f53ec754980 1 -- 172.21.15.151:0/3693212815 wait complete. 2024-09-10T14:30:38.798 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[],"summary":[]} 2024-09-10T14:30:38.798 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T14:30:38.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T14:30:38.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T14:30:38.799 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-10T14:30:38.871 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:38.872 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e8889f980 1 Processor -- start 2024-09-10T14:30:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e8889f980 1 -- start start 2024-09-10T14:30:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e8889f980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5641c6ec36a0 0x5641c6ec3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e8889f980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641c6d4bae0 con 0x5641c6ec3ff0 2024-09-10T14:30:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e8889f980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5641c6d6fe30 con 0x5641c6ec36a0 2024-09-10T14:30:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e863af640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5641c6ec36a0 0x5641c6ec3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e863af640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5641c6ec36a0 0x5641c6ec3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50482/0 (socket says 172.21.15.151:50482) 2024-09-10T14:30:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e85bae640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5641c6ec3ff0 0x5641c6ec8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33266/0 (socket says 172.21.15.151:33266) 2024-09-10T14:30:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e863af640 1 -- 172.21.15.151:0/3381209174 learned_addr learned my addr 172.21.15.151:0/3381209174 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e863af640 1 -- 172.21.15.151:0/3381209174 >> v1:172.21.15.52:6789/0 conn(0x5641c6ec3ff0 legacy=0x5641c6ec8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.868+0000 7f7e863af640 1 -- 172.21.15.151:0/3381209174 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6ecb270 con 0x5641c6ec36a0 2024-09-10T14:30:38.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e863af640 1 --2- 172.21.15.151:0/3381209174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6ec3a80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800a5c0 tx=0x7f7e7801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369c4961c2bda83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e853ad640 1 -- 172.21.15.151:0/3381209174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780a6070 con 0x5641c6ec36a0 2024-09-10T14:30:38.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e853ad640 1 -- 172.21.15.151:0/3381209174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e780af070 con 0x5641c6ec36a0 2024-09-10T14:30:38.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e853ad640 1 -- 172.21.15.151:0/3381209174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780aa5c0 con 0x5641c6ec36a0 2024-09-10T14:30:38.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e8889f980 1 -- 172.21.15.151:0/3381209174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 msgr2=0x5641c6ec3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e8889f980 1 --2- 172.21.15.151:0/3381209174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6ec3a80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800a5c0 tx=0x7f7e7801b340 comp rx=0 tx=0).stop 2024-09-10T14:30:38.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e8889f980 1 -- 172.21.15.151:0/3381209174 shutdown_connections 2024-09-10T14:30:38.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e8889f980 1 --2- 172.21.15.151:0/3381209174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6ec3a80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e8889f980 1 -- 172.21.15.151:0/3381209174 >> 172.21.15.151:0/3381209174 conn(0x5641c6ebf1c0 msgr2=0x5641c6ec15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e8889f980 1 -- 172.21.15.151:0/3381209174 shutdown_connections 2024-09-10T14:30:38.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.872+0000 7f7e8889f980 1 -- 172.21.15.151:0/3381209174 wait complete. 2024-09-10T14:30:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 Processor -- start 2024-09-10T14:30:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- start start 2024-09-10T14:30:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6faea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5641c6d71200 con 0x5641c6ec36a0 2024-09-10T14:30:38.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6faea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6faea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50494/0 (socket says 172.21.15.151:50494) 2024-09-10T14:30:38.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e863af640 1 -- 172.21.15.151:0/133694173 learned_addr learned my addr 172.21.15.151:0/133694173 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e863af640 1 -- 172.21.15.151:0/133694173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6faf020 con 0x5641c6ec36a0 2024-09-10T14:30:38.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e863af640 1 --2- 172.21.15.151:0/133694173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6faea50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7e780199f0 tx=0x7f7e78003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cc035fdcb63482 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7d74608640 1 -- 172.21.15.151:0/133694173 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780aaa00 con 0x5641c6ec36a0 2024-09-10T14:30:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7d74608640 1 -- 172.21.15.151:0/133694173 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e780aaba0 con 0x5641c6ec36a0 2024-09-10T14:30:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7d74608640 1 -- 172.21.15.151:0/133694173 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780bd3f0 con 0x5641c6ec36a0 2024-09-10T14:30:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- 172.21.15.151:0/133694173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 msgr2=0x5641c6faea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 --2- 172.21.15.151:0/133694173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6faea50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7e780199f0 tx=0x7f7e78003030 comp rx=0 tx=0).stop 2024-09-10T14:30:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- 172.21.15.151:0/133694173 shutdown_connections 2024-09-10T14:30:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 --2- 172.21.15.151:0/133694173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6faea50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- 172.21.15.151:0/133694173 >> 172.21.15.151:0/133694173 conn(0x5641c6ebf1c0 msgr2=0x5641c6faa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- 172.21.15.151:0/133694173 shutdown_connections 2024-09-10T14:30:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- 172.21.15.151:0/133694173 wait complete. 2024-09-10T14:30:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 Processor -- start 2024-09-10T14:30:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- start start 2024-09-10T14:30:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6fb5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e8889f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5641c6ecacb0 con 0x5641c6ec36a0 2024-09-10T14:30:38.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6fb5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6fb5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50506/0 (socket says 172.21.15.151:50506) 2024-09-10T14:30:38.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.892+0000 7f7e863af640 1 -- 172.21.15.151:0/1167111069 learned_addr learned my addr 172.21.15.151:0/1167111069 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e863af640 1 -- 172.21.15.151:0/1167111069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6fb6190 con 0x5641c6ec36a0 2024-09-10T14:30:38.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e863af640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6fb5c50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7e780199f0 tx=0x7f7e780180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7d72e05640 1 -- 172.21.15.151:0/1167111069 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780bd7c0 con 0x5641c6ec36a0 2024-09-10T14:30:38.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641c6fb6420 con 0x5641c6ec36a0 2024-09-10T14:30:38.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7d72e05640 1 -- 172.21.15.151:0/1167111069 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e780bd960 con 0x5641c6ec36a0 2024-09-10T14:30:38.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7d72e05640 1 -- 172.21.15.151:0/1167111069 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780bdc40 con 0x5641c6ec36a0 2024-09-10T14:30:38.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c6fb9100 con 0x5641c6ec36a0 2024-09-10T14:30:38.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7d72e05640 1 -- 172.21.15.151:0/1167111069 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7e780ce020 con 0x5641c6ec36a0 2024-09-10T14:30:38.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7d72e05640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d6c0346a0 0x7f7d6c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7d72e05640 1 -- 172.21.15.151:0/1167111069 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7e780cc020 con 0x5641c6ec36a0 2024-09-10T14:30:38.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d6c0346a0 0x7f7d6c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ec3ff0 0x5641c6fbcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6fbd290 con 0x5641c6ec3ff0 2024-09-10T14:30:38.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e86bb0640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ec3ff0 0x5641c6fbcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d6c0346a0 0x7f7d6c036b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c000f70 tx=0x7f7e7c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e86bb0640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ec3ff0 0x5641c6fbcd50 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1167111069 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ec3ff0 2024-09-10T14:30:38.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6fba300 con 0x5641c6ec3ff0 2024-09-10T14:30:38.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1167111069 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ec3ff0 2024-09-10T14:30:38.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.896+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6fbf5c0 0x5641c6fc19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6fc20a0 con 0x5641c6fbf5c0 2024-09-10T14:30:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e863af640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6fbf5c0 0x5641c6fc19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e863af640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6fbf5c0 0x5641c6fc19b0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e863af640 1 -- 172.21.15.151:0/1167111069 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6fbf5c0 2024-09-10T14:30:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6fbe430 con 0x5641c6ec3ff0 2024-09-10T14:30:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1167111069 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ec3ff0 2024-09-10T14:30:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5641c6fc3500 0x5641c6fc58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6fc5ff0 con 0x5641c6fc3500 2024-09-10T14:30:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5641c6fc3500 0x5641c6fc58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5641c6fc3500 0x5641c6fc58f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e85bae640 1 -- 172.21.15.151:0/1167111069 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e7c00f6a0 con 0x5641c6fc3500 2024-09-10T14:30:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e8889f980 1 Processor -- start 2024-09-10T14:30:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e8889f980 1 -- start start 2024-09-10T14:30:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e8889f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6e3a5a0 0x5641c6e38c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e8889f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5641c6dca800 con 0x5641c6e3a5a0 2024-09-10T14:30:38.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6e3a5a0 0x5641c6e38c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6e3a5a0 0x5641c6e38c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50520/0 (socket says 172.21.15.151:50520) 2024-09-10T14:30:38.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.900+0000 7f7e863af640 1 -- 172.21.15.151:0/3234680471 learned_addr learned my addr 172.21.15.151:0/3234680471 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e863af640 1 -- 172.21.15.151:0/3234680471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6e3a9c0 con 0x5641c6e3a5a0 2024-09-10T14:30:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e863af640 1 --2- 172.21.15.151:0/3234680471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6e3a5a0 0x5641c6e38c20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7e780e37a0 tx=0x7f7e780c5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7d6bfff640 1 -- 172.21.15.151:0/3234680471 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780e9070 con 0x5641c6e3a5a0 2024-09-10T14:30:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7d6bfff640 1 -- 172.21.15.151:0/3234680471 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e780e3430 con 0x5641c6e3a5a0 2024-09-10T14:30:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e8889f980 1 -- 172.21.15.151:0/3234680471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641c6e391c0 con 0x5641c6e3a5a0 2024-09-10T14:30:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7d6bfff640 1 -- 172.21.15.151:0/3234680471 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780c6480 con 0x5641c6e3a5a0 2024-09-10T14:30:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e8889f980 1 -- 172.21.15.151:0/3234680471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c6e39690 con 0x5641c6e3a5a0 2024-09-10T14:30:38.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7d6bfff640 1 -- 172.21.15.151:0/3234680471 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7e780c6620 con 0x5641c6e3a5a0 2024-09-10T14:30:38.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7d6bfff640 1 --2- 172.21.15.151:0/3234680471 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d600346a0 0x7f7d60036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7d6bfff640 1 -- 172.21.15.151:0/3234680471 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7e780efd80 con 0x5641c6e3a5a0 2024-09-10T14:30:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e85bae640 1 --2- 172.21.15.151:0/3234680471 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d600346a0 0x7f7d60036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e8889f980 1 Processor -- start 2024-09-10T14:30:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e8889f980 1 -- start start 2024-09-10T14:30:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e85bae640 1 --2- 172.21.15.151:0/3234680471 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d600346a0 0x7f7d60036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5641c6fbd760 tx=0x7f7e7c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e8889f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fd3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e8889f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5641c6faf2e0 con 0x5641c6fd3a30 2024-09-10T14:30:38.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fd3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fd3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50534/0 (socket says 172.21.15.151:50534) 2024-09-10T14:30:38.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.904+0000 7f7e863af640 1 -- 172.21.15.151:0/2526038404 learned_addr learned my addr 172.21.15.151:0/2526038404 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e863af640 1 -- 172.21.15.151:0/2526038404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6fd4350 con 0x5641c6fd3a30 2024-09-10T14:30:38.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e863af640 1 --2- 172.21.15.151:0/2526038404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fd3e10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7e780aab20 tx=0x7f7e780e48c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4769f4abde1511 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7d69ffb640 1 -- 172.21.15.151:0/2526038404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e78106070 con 0x5641c6fd3a30 2024-09-10T14:30:38.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7d69ffb640 1 -- 172.21.15.151:0/2526038404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e780dc450 con 0x5641c6fd3a30 2024-09-10T14:30:38.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7d69ffb640 1 -- 172.21.15.151:0/2526038404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e780cae10 con 0x5641c6fd3a30 2024-09-10T14:30:38.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 -- 172.21.15.151:0/2526038404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 msgr2=0x5641c6fd3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:38.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 --2- 172.21.15.151:0/2526038404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fd3e10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7e780aab20 tx=0x7f7e780e48c0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 -- 172.21.15.151:0/2526038404 shutdown_connections 2024-09-10T14:30:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 --2- 172.21.15.151:0/2526038404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fd3e10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 -- 172.21.15.151:0/2526038404 >> 172.21.15.151:0/2526038404 conn(0x5641c6fde9f0 msgr2=0x5641c6fdcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 -- 172.21.15.151:0/2526038404 shutdown_connections 2024-09-10T14:30:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 -- 172.21.15.151:0/2526038404 wait complete. 2024-09-10T14:30:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 Processor -- start 2024-09-10T14:30:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 -- start start 2024-09-10T14:30:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fedb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e8889f980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5641c6fd4770 con 0x5641c6fd3a30 2024-09-10T14:30:38.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fedb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e863af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fedb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50544/0 (socket says 172.21.15.151:50544) 2024-09-10T14:30:38.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 learned_addr learned my addr 172.21.15.151:0/1187500488 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:38.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6fee050 con 0x5641c6fd3a30 2024-09-10T14:30:38.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.908+0000 7f7e863af640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fedb10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7e780cad40 tx=0x7f7e780edf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7d57fff640 1 -- 172.21.15.151:0/1187500488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e78111020 con 0x5641c6fd3a30 2024-09-10T14:30:38.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641c6fee050 con 0x5641c6fd3a30 2024-09-10T14:30:38.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c6fee4c0 con 0x5641c6fd3a30 2024-09-10T14:30:38.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7d57fff640 1 -- 172.21.15.151:0/1187500488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e78107040 con 0x5641c6fd3a30 2024-09-10T14:30:38.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7d57fff640 1 -- 172.21.15.151:0/1187500488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e78106070 con 0x5641c6fd3a30 2024-09-10T14:30:38.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7d57fff640 1 -- 172.21.15.151:0/1187500488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7e78114020 con 0x5641c6fd3a30 2024-09-10T14:30:38.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7d57fff640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d500345d0 0x7f7d50036a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7d57fff640 1 -- 172.21.15.151:0/1187500488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7e780fe070 con 0x5641c6fd3a30 2024-09-10T14:30:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d500345d0 0x7f7d50036a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d500345d0 0x7f7d50036a90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c010 tx=0x7f7e7c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ff8c10 0x5641c6ffb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffb820 con 0x5641c6ff8c10 2024-09-10T14:30:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e86bb0640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ff8c10 0x5641c6ffb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e86bb0640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ff8c10 0x5641c6ffb0d0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 20 realm 2024-09-10T14:30:38.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffbc30 con 0x5641c6ff8c10 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc050 con 0x5641c6ff8c10 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.912+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e8889f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6ffd310 0x5641c6fff700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e863af640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6ffd310 0x5641c6fff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c6fffdf0 con 0x5641c6ffd310 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e863af640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6ffd310 0x5641c6fff700 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e8889f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e8889f980 20 searching for the correct realm 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c70016c0 con 0x5641c6ffd310 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e863af640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7e78116020 0x7f7e7810d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c70016c0 con 0x7f7e78116020 2024-09-10T14:30:38.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7e78116020 0x7f7e7810d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7e78116020 0x7f7e7810d900 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e85bae640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f7e7c01fbe0 0x7f7e7c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c70016c0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e86bb0640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f7e7c01fbe0 0x7f7e7c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.916+0000 7f7e86bb0640 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f7e7c01fbe0 0x7f7e7c03a3c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e78116020 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ffd310 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.920+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e78116020 2024-09-10T14:30:38.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ffd310 2024-09-10T14:30:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ffd310 2024-09-10T14:30:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e78116020 2024-09-10T14:30:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ffd310 2024-09-10T14:30:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ffd310 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ffd310 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e78116020 2024-09-10T14:30:38.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.924+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e78116020 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ffd310 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e78116020 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ffd310 2024-09-10T14:30:38.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x5641c6ff8c10 2024-09-10T14:30:38.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5641c6ffc8f0 con 0x7f7e78116020 2024-09-10T14:30:38.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:38.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:38.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:38.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:38.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:38.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:38.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70007e0 con 0x5641c6ff8c10 2024-09-10T14:30:38.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.928+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7001080 con 0x5641c6ff8c10 2024-09-10T14:30:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7000420 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 zone default found 2024-09-10T14:30:38.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 4 Realm: () 2024-09-10T14:30:38.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:38.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:38.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:38.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 zonegroup default 2024-09-10T14:30:38.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7001080 con 0x7f7e78116020 2024-09-10T14:30:38.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7003500 con 0x5641c6ffd310 2024-09-10T14:30:38.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:38.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7003990 con 0x5641c6ffd310 2024-09-10T14:30:38.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:38.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 started sync module instance, tier type = 2024-09-10T14:30:38.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7002970 con 0x7f7e78116020 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94840511540576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70042a0 con 0x7f7e78116020 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.932+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7004af0 con 0x5641c6ff8c10 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.936+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94840511540576] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.936+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.936+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94840511544816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7004af0 con 0x5641c6ff8c10 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.936+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7005530 con 0x5641c6ffd310 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.936+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94840511544816] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94840511546944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7004a60 con 0x5641c6ffd310 2024-09-10T14:30:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70062c0 con 0x7f7e78116020 2024-09-10T14:30:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94840511552976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7006b10 con 0x7f7e78116020 2024-09-10T14:30:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7007510 con 0x5641c6ff8c10 2024-09-10T14:30:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94840511546944] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94840511552976] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94840511555168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7007020 con 0x5641c6ff8c10 2024-09-10T14:30:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.940+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7007de0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.944+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94840511555168] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.944+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.944+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94840511551776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7007d40 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.944+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7008630 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.944+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94840511551776] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94840511559824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7008810 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7009060 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94840511559824] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94840511563792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70090e0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 20 add_watcher() i=0 2024-09-10T14:30:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 20 add_watcher() i=1 2024-09-10T14:30:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 20 add_watcher() i=2 2024-09-10T14:30:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 20 add_watcher() i=3 2024-09-10T14:30:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 20 add_watcher() i=4 2024-09-10T14:30:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 20 add_watcher() i=5 2024-09-10T14:30:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.948+0000 7f7e8889f980 20 add_watcher() i=6 2024-09-10T14:30:38.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94840511563792] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e8889f980 20 add_watcher() i=7 2024-09-10T14:30:38.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e8889f980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:38.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c700c3b0 con 0x5641c6ff8c10 2024-09-10T14:30:38.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94840511565216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7009670 con 0x5641c6ff8c10 2024-09-10T14:30:38.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94840511565216] v36'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7d3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:38.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e8889f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:38.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e8889f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:38.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.952+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c700bbb0 con 0x5641c6ff8c10 2024-09-10T14:30:38.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.956+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.956+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7015470 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.956+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.956+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7015470 con 0x5641c6ffd310 2024-09-10T14:30:38.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.960+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.960+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7015470 con 0x5641c6ff8c10 2024-09-10T14:30:38.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.960+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'234 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.960+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7015eb0 con 0x7f7e78116020 2024-09-10T14:30:38.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.960+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.960+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016420 con 0x5641c6ffd310 2024-09-10T14:30:38.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.964+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'50 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.964+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016420 con 0x5641c6ff8c10 2024-09-10T14:30:38.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.964+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.964+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70168d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.968+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.968+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70168d0 con 0x7f7e78116020 2024-09-10T14:30:38.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.968+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.968+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016e40 con 0x5641c6ffd310 2024-09-10T14:30:38.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.972+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.972+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016e40 con 0x7f7e78116020 2024-09-10T14:30:38.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.972+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.972+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016ed0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.972+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.972+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016f60 con 0x7f7e78116020 2024-09-10T14:30:38.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.976+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.976+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016ff0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.976+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:38.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.976+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016ff0 con 0x5641c6ff8c10 2024-09-10T14:30:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.980+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'235 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.980+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016ff0 con 0x5641c6ffd310 2024-09-10T14:30:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.980+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.980+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7016ff0 con 0x7f7e78116020 2024-09-10T14:30:38.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.980+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.980+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017080 con 0x5641c6ffd310 2024-09-10T14:30:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.984+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.984+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017080 con 0x5641c6ff8c10 2024-09-10T14:30:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.984+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.984+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017080 con 0x5641c6ff8c10 2024-09-10T14:30:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.988+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'236 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.988+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017080 con 0x5641c6ffd310 2024-09-10T14:30:38.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.988+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.988+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017080 con 0x7f7e78116020 2024-09-10T14:30:38.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.988+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:38.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.988+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017110 con 0x5641c6ffd310 2024-09-10T14:30:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.992+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.992+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017110 con 0x5641c6ffd310 2024-09-10T14:30:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.992+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.992+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017110 con 0x5641c6ffd310 2024-09-10T14:30:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.992+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.992+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017110 con 0x5641c6ffd310 2024-09-10T14:30:38.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.996+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'51 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:38.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.996+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7017110 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.996+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:38.996+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70172e0 con 0x5641c6ffd310 2024-09-10T14:30:39.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.000+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:39.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.000+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70172e0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.000+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.000+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70168d0 con 0x5641c6ffd310 2024-09-10T14:30:39.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.004+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:39.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.004+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70168d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70168d0 con 0x7f7e78116020 2024-09-10T14:30:39.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7cb77fe640 20 reqs_thread_entry: start 2024-09-10T14:30:39.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7e8889f980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:39.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7e8889f980 20 Filter name: none 2024-09-10T14:30:39.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7cb57fa640 20 reqs_thread_entry: start 2024-09-10T14:30:39.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7e8889f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T14:30:39.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.008+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7014010 con 0x5641c6ff8c10 2024-09-10T14:30:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T14:30:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T14:30:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T14:30:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:39.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7013b10 con 0x7f7e78116020 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 : miss 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:96 8.2 8:47498e91:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70349d0 con 0x7f7e78116020 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(96 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 20 rados_obj.operate() r=0 bl.length=379 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 info.flags=0x17 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 to cache LRU end 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 2024-09-10T14:30:39.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:97 4.37 4:edd56fb1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1f00 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(97 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:98 4.20 4:041da416:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1f00 con 0x5641c6ff8c10 2024-09-10T14:30:39.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(98 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:39.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:99 4.5 4:a1dd7930:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1f00 con 0x5641c6ffd310 2024-09-10T14:30:39.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(99 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:39.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:100 4.18 4:19c58fad:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1f00 con 0x7f7e78116020 2024-09-10T14:30:39.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.012+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(100 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:101 4.13 4:cb6ff1b5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1f00 con 0x7f7e78116020 2024-09-10T14:30:39.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(101 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4 [call out=424b] v0'0 uv5 ondisk = 0) ==== 194+0+424 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T14:30:39.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:102 4.25 4:a4d72656:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1f00 con 0x5641c6ffd310 2024-09-10T14:30:39.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(102 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:39.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:103 4.35 4:af1e383e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1e80 con 0x5641c6ff8c10 2024-09-10T14:30:39.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(103 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e8000a4d0 con 0x5641c6ff8c10 2024-09-10T14:30:39.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:104 4.21 4:861e4b8a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1e80 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(104 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e8000a4d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:105 4.3b 4:dcf8d062:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1e80 con 0x5641c6ffd310 2024-09-10T14:30:39.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(105 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:39.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:106 4.19 4:9b00fe8f:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1e80 con 0x5641c6ffd310 2024-09-10T14:30:39.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(106 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e780c6d20 con 0x5641c6ffd310 2024-09-10T14:30:39.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:107 4.b 4:d27fa8e1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1e80 con 0x7f7e78116020 2024-09-10T14:30:39.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(107 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.016+0000 7f7e8889f980 20 get_obj_state: octx=0x5641c6fd4610 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5641c70aff88 s->prefetch_data=0 2024-09-10T14:30:39.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:108 3.20s0 3:0703d28f:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b0e70 con 0x7f7e78116020 2024-09-10T14:30:39.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== osd_op_reply(108 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e8889f980 10 manifest: total_size = 6 2024-09-10T14:30:39.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e8889f980 20 get_obj_state: setting s->obj_tag to 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.774038640152874803 2024-09-10T14:30:39.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e8889f980 20 get_obj_state: octx=0x5641c6fd4610 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5641c70aff88 s->prefetch_data=0 2024-09-10T14:30:39.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e8889f980 20 prepare_atomic_modification: state is not atomic. state=0x5641c70aff88 2024-09-10T14:30:39.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e8889f980 20 bucket index object: :.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4 2024-09-10T14:30:39.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:109 4.13 4:cb6ff1b5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1930 con 0x7f7e78116020 2024-09-10T14:30:39.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(109 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4 [stat,call,call] v36'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.020+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:110 3.20s0 3:0703d28f:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c70b1930 con 0x7f7e78116020 2024-09-10T14:30:39.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== osd_op_reply(110 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7_15f6f8dc036519d7fe15b39338f6e5db [call] v36'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:111 4.13 4:cb6ff1b5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7039780 con 0x7f7e78116020 2024-09-10T14:30:39.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 20 list_objects_ordered: starting attempt 1 2024-09-10T14:30:39.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T14:30:39.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:112 4.37 4:edd56fb1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7039780 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:113 4.20 4:041da416:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c703d700 con 0x5641c6ff8c10 2024-09-10T14:30:39.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:114 4.5 4:a1dd7930:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7040000 con 0x5641c6ffd310 2024-09-10T14:30:39.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:115 4.18 4:19c58fad:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7042960 con 0x7f7e78116020 2024-09-10T14:30:39.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:116 4.13 4:cb6ff1b5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7040000 con 0x7f7e78116020 2024-09-10T14:30:39.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:117 4.25 4:a4d72656:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7042960 con 0x5641c6ffd310 2024-09-10T14:30:39.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:118 4.35 4:af1e383e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7049fa0 con 0x5641c6ff8c10 2024-09-10T14:30:39.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:119 4.21 4:861e4b8a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7049fa0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:120 4.3b 4:dcf8d062:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c704eed0 con 0x5641c6ffd310 2024-09-10T14:30:39.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:121 4.19 4:9b00fe8f:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7051d20 con 0x5641c6ffd310 2024-09-10T14:30:39.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:122 4.b 4:d27fa8e1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7054ba0 con 0x7f7e78116020 2024-09-10T14:30:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(115 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(113 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(112 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(122 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(114 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(118 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== osd_op_reply(117 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(119 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(120 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== osd_op_reply(121 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== osd_op_reply(111 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4 [stat,call,call] v36'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7d697fa640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== osd_op_reply(116 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T14:30:39.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7])"; uploads.size()=0; is_truncated=0 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:123 4.37 4:edd56fb1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c704a000 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:124 4.20 4:041da416:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c704eed0 con 0x5641c6ff8c10 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:125 4.5 4:a1dd7930:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7054ba0 con 0x5641c6ffd310 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:126 4.18 4:19c58fad:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7051590 con 0x7f7e78116020 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:127 4.13 4:cb6ff1b5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c704a000 con 0x7f7e78116020 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:128 4.25 4:a4d72656:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7051970 con 0x5641c6ffd310 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:129 4.35 4:af1e383e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7054ba0 con 0x5641c6ff8c10 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:130 4.21 4:861e4b8a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7051d70 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:131 4.3b 4:dcf8d062:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c704eed0 con 0x5641c6ffd310 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:132 4.19 4:9b00fe8f:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c703d420 con 0x5641c6ffd310 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.024+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:133 4.b 4:d27fa8e1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7045ac0 con 0x7f7e78116020 2024-09-10T14:30:39.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(124 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 33 ==== osd_op_reply(126 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 34 ==== osd_op_reply(127 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(125 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(128 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 35 ==== osd_op_reply(133 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(129 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(130 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(123 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 37 ==== osd_op_reply(131 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 38 ==== osd_op_reply(132 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c703d420 con 0x7f7e78116020 2024-09-10T14:30:39.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 36 ==== osd_op_reply(134 foo.buckets [call] v36'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e8889f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c703d420 con 0x7f7e78116020 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 37 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e8889f980 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e8889f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e8889f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.028+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c703d420 con 0x7f7e78116020 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 38 ==== osd_op_reply(136 myfoo [call,call,delete] v36'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e8889f980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e8889f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T14:30:39.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94840511852240 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c703d420 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== watch-notify(notify (1) cookie 94840511559824 notify 154618822684 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5641c7017110 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7d69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 94840511559824 notifier 4778 bl.length()=149 2024-09-10T14:30:39.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(137 notify.6 [notify cookie 94840511852240 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7d69ffb640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f7d4c003d70 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== watch-notify(notify_complete (2) cookie 94840511852240 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641c6e391c0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.032+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:139 8.2 8:47498e91:root::.bucket.meta.myfoo%3a83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c703d420 con 0x7f7e78116020 2024-09-10T14:30:39.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 39 ==== osd_op_reply(139 .bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 [call,call,delete] v36'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 from cache 2024-09-10T14:30:39.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7, ofs0, ns] 2024-09-10T14:30:39.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94840511852240 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c703d420 con 0x7f7e78116020 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 40 ==== watch-notify(notify (1) cookie 94840511540576 notify 154618822700 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5641c7033f10 con 0x7f7e78116020 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7d697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822700 cookie 94840511540576 notifier 4778 bl.length()=206 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 41 ==== osd_op_reply(140 notify.0 [notify cookie 94840511852240 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7d697fa640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f7cbc0032d0 con 0x7f7e78116020 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 42 ==== watch-notify(notify_complete (2) cookie 94840511852240 notify 154618822700 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641c7016c70 con 0x7f7e78116020 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 43 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:142 4.37 4:edd56fb1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c704eed0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:143 4.20 4:041da416:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7045470 con 0x5641c6ff8c10 2024-09-10T14:30:39.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:144 4.5 4:a1dd7930:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7052240 con 0x5641c6ffd310 2024-09-10T14:30:39.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:145 4.18 4:19c58fad:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7052b50 con 0x7f7e78116020 2024-09-10T14:30:39.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:146 4.13 4:cb6ff1b5:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c704eed0 con 0x7f7e78116020 2024-09-10T14:30:39.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:147 4.25 4:a4d72656:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7033860 con 0x5641c6ffd310 2024-09-10T14:30:39.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:148 4.35 4:af1e383e:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7045470 con 0x5641c6ff8c10 2024-09-10T14:30:39.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:149 4.21 4:861e4b8a:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7052240 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:150 4.3b 4:dcf8d062:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7052b50 con 0x5641c6ffd310 2024-09-10T14:30:39.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:151 4.19 4:9b00fe8f:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c704eed0 con 0x5641c6ffd310 2024-09-10T14:30:39.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.036+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:152 4.b 4:d27fa8e1:::.dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7045470 con 0x7f7e78116020 2024-09-10T14:30:39.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 39 ==== osd_op_reply(144 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.2 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 44 ==== osd_op_reply(146 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.4 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== osd_op_reply(142 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.0 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(149 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.7 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 40 ==== osd_op_reply(150 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.8 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 41 ==== osd_op_reply(147 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.5 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 42 ==== osd_op_reply(151 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.9 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(143 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.1 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(148 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.6 [delete] v36'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 45 ==== osd_op_reply(145 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.3 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 46 ==== osd_op_reply(152 .dir.83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7.10 [delete] v36'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e8889f980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 : miss 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e8889f980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:153 6.3 6:c1e30afb:::pubsub..bucket.myfoo%2f83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7033860 con 0x7f7e78116020 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 47 ==== osd_op_reply(153 pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e8889f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e8889f980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 info.flags=0x0 2024-09-10T14:30:39.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e8889f980 10 adding default.rgw.log++pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 to cache LRU end 2024-09-10T14:30:39.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.040+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:154 6.3 6:c1e30afb:::pubsub..bucket.myfoo%2f83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7052240 con 0x7f7e78116020 2024-09-10T14:30:39.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.044+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 48 ==== osd_op_reply(154 pubsub..bucket.myfoo/83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.7 [delete] v36'77 uv55 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.044+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7052240 con 0x7f7e78116020 2024-09-10T14:30:39.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.044+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 49 ==== osd_op_reply(155 foo.buckets [call] v36'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.044+0000 7f7e8889f980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-10T14:30:39.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.044+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7045470 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v36'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e8889f980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T14:30:39.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94840511812720 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7034940 con 0x7f7e78116020 2024-09-10T14:30:39.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 50 ==== watch-notify(notify (1) cookie 94840511552976 notify 154618822701 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5641c7016c70 con 0x7f7e78116020 2024-09-10T14:30:39.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7d697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822701 cookie 94840511552976 notifier 4778 bl.length()=170 2024-09-10T14:30:39.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 51 ==== osd_op_reply(157 notify.3 [notify cookie 94840511812720 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7d697fa640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f7cbc0032d0 con 0x7f7e78116020 2024-09-10T14:30:39.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 52 ==== watch-notify(notify_complete (2) cookie 94840511812720 notify 154618822701 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641c700b630 con 0x7f7e78116020 2024-09-10T14:30:39.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e8889f980 10 removing email index: foo@foo.com 2024-09-10T14:30:39.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 53 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.048+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7045470 con 0x5641c6ff8c10 2024-09-10T14:30:39.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 36 ==== osd_op_reply(159 foo@foo.com [delete] v36'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e8889f980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T14:30:39.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94840511812720 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7034940 con 0x7f7e78116020 2024-09-10T14:30:39.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 54 ==== watch-notify(notify (1) cookie 94840511552976 notify 154618822702 ret 0) ==== 204+0+0 (crc 0 0 0) 0x5641c700b630 con 0x7f7e78116020 2024-09-10T14:30:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7d69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822702 cookie 94840511552976 notifier 4778 bl.length()=162 2024-09-10T14:30:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 55 ==== osd_op_reply(160 notify.3 [notify cookie 94840511812720 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7d69ffb640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f7d4c003d70 con 0x7f7e78116020 2024-09-10T14:30:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 56 ==== watch-notify(notify_complete (2) cookie 94840511812720 notify 154618822702 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641c7016250 con 0x7f7e78116020 2024-09-10T14:30:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 57 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e8889f980 10 removing user buckets index 2024-09-10T14:30:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7045470 con 0x7f7e78116020 2024-09-10T14:30:39.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 58 ==== osd_op_reply(162 foo.buckets [delete] v36'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e8889f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-10T14:30:39.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.052+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94840511812720 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7034940 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== watch-notify(notify (1) cookie 94840511551776 notify 154618822685 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5641c6e391c0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7d697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94840511551776 notifier 4778 bl.length()=160 2024-09-10T14:30:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== osd_op_reply(163 notify.5 [notify cookie 94840511812720 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7d697fa640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f7cbc0032d0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== watch-notify(notify_complete (2) cookie 94840511812720 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641c700bd40 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e8889f980 10 removing user index: foo 2024-09-10T14:30:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7045470 con 0x5641c6ff8c10 2024-09-10T14:30:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 37 ==== osd_op_reply(165 foo [call,call,delete] v36'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e8889f980 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-10T14:30:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e8889f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T14:30:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.056+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94840511812720 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5641c7039230 con 0x5641c6ff8c10 2024-09-10T14:30:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 38 ==== watch-notify(notify (1) cookie 94840511555168 notify 154618822674 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5641c700bd40 con 0x5641c6ff8c10 2024-09-10T14:30:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7d69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822674 cookie 94840511555168 notifier 4778 bl.length()=152 2024-09-10T14:30:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 39 ==== osd_op_reply(166 notify.4 [notify cookie 94840511812720 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7d69ffb640 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f7d4c003d70 con 0x5641c6ff8c10 2024-09-10T14:30:39.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 40 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 41 ==== watch-notify(notify_complete (2) cookie 94840511812720 notify 154618822674 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641c700bb70 con 0x5641c6ff8c10 2024-09-10T14:30:39.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7d3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:39.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94840511565216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7014aa0 con 0x5641c6ff8c10 2024-09-10T14:30:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 42 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94840511565216] v36'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.060+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94840511540576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7014aa0 con 0x7f7e78116020 2024-09-10T14:30:39.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.064+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 59 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94840511540576] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.064+0000 7f7e8889f980 20 remove_watcher() i=0 2024-09-10T14:30:39.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.064+0000 7f7e8889f980 2 removed watcher, disabling cache 2024-09-10T14:30:39.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.064+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94840511544816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7002d60 con 0x5641c6ff8c10 2024-09-10T14:30:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.064+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 43 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94840511544816] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.064+0000 7f7e8889f980 20 remove_watcher() i=1 2024-09-10T14:30:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.064+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94840511546944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7014aa0 con 0x5641c6ffd310 2024-09-10T14:30:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.068+0000 7f7e863af640 1 -- 172.21.15.151:0/1187500488 <== osd.3 v2:172.21.15.151:6803/3136276598 43 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94840511546944] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e78136040 con 0x5641c6ffd310 2024-09-10T14:30:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.068+0000 7f7e8889f980 20 remove_watcher() i=2 2024-09-10T14:30:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.068+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94840511552976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7003df0 con 0x7f7e78116020 2024-09-10T14:30:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.068+0000 7f7e85bae640 1 -- 172.21.15.151:0/1187500488 <== osd.2 v2:172.21.15.151:6816/2885613778 60 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94840511552976] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c037040 con 0x7f7e78116020 2024-09-10T14:30:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.068+0000 7f7e8889f980 20 remove_watcher() i=3 2024-09-10T14:30:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.068+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94840511555168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7002d60 con 0x5641c6ff8c10 2024-09-10T14:30:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.072+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.1 v2:172.21.15.151:6800/103268966 44 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94840511555168] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x5641c6ff8c10 2024-09-10T14:30:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.072+0000 7f7e8889f980 20 remove_watcher() i=4 2024-09-10T14:30:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.072+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94840511551776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7004640 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.072+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94840511551776] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.072+0000 7f7e8889f980 20 remove_watcher() i=5 2024-09-10T14:30:39.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.072+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94840511559824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7014aa0 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.076+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94840511559824] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.076+0000 7f7e8889f980 20 remove_watcher() i=6 2024-09-10T14:30:39.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.076+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94840511563792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5641c7002d60 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 <== osd.0 v2:172.21.15.52:6800/2968015226 41 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94840511563792] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e80040040 con 0x7f7e7c01fbe0 2024-09-10T14:30:39.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 20 remove_watcher() i=7 2024-09-10T14:30:39.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f7e7c01fbe0 msgr2=0x7f7e7c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f7e7c01fbe0 0x7f7e7c03a3c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ff8c10 msgr2=0x5641c6ffb0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ff8c10 0x5641c6ffb0d0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7e78116020 msgr2=0x7f7e7810d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f7e78116020 0x7f7e7810d900 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6ffd310 msgr2=0x5641c6fff700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6ffd310 0x5641c6fff700 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d500345d0 msgr2=0x7f7d50036a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d500345d0 0x7f7d50036a90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c010 tx=0x7f7e7c010000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 msgr2=0x5641c6fedb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1187500488 reap_dead start 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fedb10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7e780cad40 tx=0x7f7e780edf60 comp rx=0 tx=0).stop 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 shutdown_connections 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1187500488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6fd3a30 0x5641c6fedb10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 >> 172.21.15.151:0/1187500488 conn(0x5641c6fde9f0 msgr2=0x5641c6fdcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 shutdown_connections 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1187500488 wait complete. 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/3234680471 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d600346a0 msgr2=0x7f7d60036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/3234680471 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d600346a0 0x7f7d60036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5641c6fbd760 tx=0x7f7e7c00f000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/3234680471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6e3a5a0 msgr2=0x5641c6e38c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/3234680471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6e3a5a0 0x5641c6e38c20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7e780e37a0 tx=0x7f7e780c5890 comp rx=0 tx=0).stop 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/3234680471 shutdown_connections 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/3234680471 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d600346a0 0x7f7d60036b60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/3234680471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6e3a5a0 0x5641c6e38c20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/3234680471 >> 172.21.15.151:0/3234680471 conn(0x5641c6fc8c10 msgr2=0x5641c6fcb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/3234680471 shutdown_connections 2024-09-10T14:30:39.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/3234680471 wait complete. 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5641c6fc3500 msgr2=0x5641c6fc58f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5641c6fc3500 0x5641c6fc58f0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ec3ff0 msgr2=0x5641c6fbcd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5641c6ec3ff0 0x5641c6fbcd50 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6fbf5c0 msgr2=0x5641c6fc19b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5641c6fbf5c0 0x5641c6fc19b0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d6c0346a0 msgr2=0x7f7d6c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7d6c0346a0 0x7f7d6c036b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c000f70 tx=0x7f7e7c001380 comp rx=0 tx=0).stop 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 msgr2=0x5641c6fb5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 --2- 172.21.15.151:0/1167111069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641c6ec36a0 0x5641c6fb5c50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7e780199f0 tx=0x7f7e780180e0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e86bb0640 1 -- 172.21.15.151:0/1167111069 reap_dead start 2024-09-10T14:30:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 shutdown_connections 2024-09-10T14:30:39.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 >> 172.21.15.151:0/1167111069 conn(0x5641c6ebf1c0 msgr2=0x5641c6fa9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 shutdown_connections 2024-09-10T14:30:39.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.080+0000 7f7e8889f980 1 -- 172.21.15.151:0/1167111069 wait complete. 2024-09-10T14:30:39.097 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T14:30:39.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T14:30:39.097 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T14:30:39.175 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:39.175 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:39.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67acf94980 1 Processor -- start 2024-09-10T14:30:39.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67acf94980 1 -- start start 2024-09-10T14:30:39.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67acf94980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5557902162d0 0x5557902a6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67acf94980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555790129ae0 con 0x5557902a6ca0 2024-09-10T14:30:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67acf94980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55579014de30 con 0x5557902162d0 2024-09-10T14:30:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67aaaa4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5557902162d0 0x5557902a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67aaaa4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5557902162d0 0x5557902a6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50554/0 (socket says 172.21.15.151:50554) 2024-09-10T14:30:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67aaaa4640 1 -- 172.21.15.151:0/706705908 learned_addr learned my addr 172.21.15.151:0/706705908 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67aaaa4640 1 -- 172.21.15.151:0/706705908 >> v1:172.21.15.52:6789/0 conn(0x5557902a6ca0 legacy=0x5557902a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.172+0000 7f67aaaa4640 1 -- 172.21.15.151:0/706705908 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557902166b0 con 0x5557902162d0 2024-09-10T14:30:39.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/706705908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x5557902a6760 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f679c00a5c0 tx=0x7f679c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff13d538e1dba542 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67a9aa2640 1 -- 172.21.15.151:0/706705908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0a6070 con 0x5557902162d0 2024-09-10T14:30:39.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67a9aa2640 1 -- 172.21.15.151:0/706705908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0af070 con 0x5557902162d0 2024-09-10T14:30:39.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67a9aa2640 1 -- 172.21.15.151:0/706705908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0aa5c0 con 0x5557902162d0 2024-09-10T14:30:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67acf94980 1 -- 172.21.15.151:0/706705908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 msgr2=0x5557902a6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67acf94980 1 --2- 172.21.15.151:0/706705908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x5557902a6760 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f679c00a5c0 tx=0x7f679c01b340 comp rx=0 tx=0).stop 2024-09-10T14:30:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67acf94980 1 -- 172.21.15.151:0/706705908 shutdown_connections 2024-09-10T14:30:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67acf94980 1 --2- 172.21.15.151:0/706705908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x5557902a6760 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67acf94980 1 -- 172.21.15.151:0/706705908 >> 172.21.15.151:0/706705908 conn(0x55579029c090 msgr2=0x55579029e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67acf94980 1 -- 172.21.15.151:0/706705908 shutdown_connections 2024-09-10T14:30:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.176+0000 7f67acf94980 1 -- 172.21.15.151:0/706705908 wait complete. 2024-09-10T14:30:39.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67acf94980 1 Processor -- start 2024-09-10T14:30:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67acf94980 1 -- start start 2024-09-10T14:30:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67acf94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x55579038eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67acf94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55579014f200 con 0x5557902162d0 2024-09-10T14:30:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x55579038eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x55579038eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50566/0 (socket says 172.21.15.151:50566) 2024-09-10T14:30:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1670402080 learned_addr learned my addr 172.21.15.151:0/1670402080 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1670402080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579038f130 con 0x5557902162d0 2024-09-10T14:30:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.192+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/1670402080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x55579038eb60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f679c018f70 tx=0x7f679c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f866d15ceadeecd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f6698e09640 1 -- 172.21.15.151:0/1670402080 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0aaa00 con 0x5557902162d0 2024-09-10T14:30:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f6698e09640 1 -- 172.21.15.151:0/1670402080 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0aaba0 con 0x5557902162d0 2024-09-10T14:30:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f6698e09640 1 -- 172.21.15.151:0/1670402080 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0bd3f0 con 0x5557902162d0 2024-09-10T14:30:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- 172.21.15.151:0/1670402080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 msgr2=0x55579038eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 --2- 172.21.15.151:0/1670402080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x55579038eb60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f679c018f70 tx=0x7f679c003030 comp rx=0 tx=0).stop 2024-09-10T14:30:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- 172.21.15.151:0/1670402080 shutdown_connections 2024-09-10T14:30:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 --2- 172.21.15.151:0/1670402080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x55579038eb60 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- 172.21.15.151:0/1670402080 >> 172.21.15.151:0/1670402080 conn(0x55579029c090 msgr2=0x55579038a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- 172.21.15.151:0/1670402080 shutdown_connections 2024-09-10T14:30:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- 172.21.15.151:0/1670402080 wait complete. 2024-09-10T14:30:39.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 Processor -- start 2024-09-10T14:30:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- start start 2024-09-10T14:30:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x555790395d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5557902ad210 con 0x5557902162d0 2024-09-10T14:30:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x555790395d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x555790395d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50582/0 (socket says 172.21.15.151:50582) 2024-09-10T14:30:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67aaaa4640 1 -- 172.21.15.151:0/151182768 learned_addr learned my addr 172.21.15.151:0/151182768 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67aaaa4640 1 -- 172.21.15.151:0/151182768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557903962d0 con 0x5557902162d0 2024-09-10T14:30:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x555790395d90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f679c01b170 tx=0x7f679c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f6697606640 1 -- 172.21.15.151:0/151182768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0bd790 con 0x5557902162d0 2024-09-10T14:30:39.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555790396560 con 0x5557902162d0 2024-09-10T14:30:39.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f6697606640 1 -- 172.21.15.151:0/151182768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0bd930 con 0x5557902162d0 2024-09-10T14:30:39.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f6697606640 1 -- 172.21.15.151:0/151182768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0bdc10 con 0x5557902162d0 2024-09-10T14:30:39.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.196+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555790399240 con 0x5557902162d0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f6697606640 1 -- 172.21.15.151:0/151182768 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f679c0ce030 con 0x5557902162d0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f6697606640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f66900346a0 0x7f6690036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f6697606640 1 -- 172.21.15.151:0/151182768 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f679c0cc020 con 0x5557902162d0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f66900346a0 0x7f6690036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67acf94980 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557902a6ca0 0x55579039cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55579039d360 con 0x5557902a6ca0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67ab2a5640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557902a6ca0 0x55579039cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f66900346a0 0x7f6690036b60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f67940012f0 tx=0x7f67940066b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67ab2a5640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557902a6ca0 0x55579039cd20 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67ab2a5640 1 -- 172.21.15.151:0/151182768 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557902a6ca0 2024-09-10T14:30:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55579039dc20 con 0x5557902a6ca0 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67ab2a5640 1 -- 172.21.15.151:0/151182768 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67a40083f0 con 0x5557902a6ca0 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67acf94980 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55579039f530 0x5557903a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903a2160 con 0x55579039f530 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55579039f530 0x5557903a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55579039f530 0x5557903a19d0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67aaaa4640 1 -- 172.21.15.151:0/151182768 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f679c0c6d20 con 0x55579039f530 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55579039e470 con 0x5557902a6ca0 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67ab2a5640 1 -- 172.21.15.151:0/151182768 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67a40083f0 con 0x5557902a6ca0 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67acf94980 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5557903a35c0 0x5557903a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903a6120 con 0x5557903a35c0 2024-09-10T14:30:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.200+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5557903a35c0 0x5557903a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5557903a35c0 0x5557903a59b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67aa2a3640 1 -- 172.21.15.151:0/151182768 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f679400f030 con 0x5557903a35c0 2024-09-10T14:30:39.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67acf94980 1 Processor -- start 2024-09-10T14:30:39.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67acf94980 1 -- start start 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67acf94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903b3bc0 0x5557903b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67acf94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5557901a8800 con 0x5557903b3bc0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903b3bc0 0x5557903b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903b3bc0 0x5557903b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50586/0 (socket says 172.21.15.151:50586) 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1269903779 learned_addr learned my addr 172.21.15.151:0/1269903779 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1269903779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557903b4520 con 0x5557903b3bc0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/1269903779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903b3bc0 0x5557903b3fe0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f679c0d0f70 tx=0x7f679c0cf4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f6694e01640 1 -- 172.21.15.151:0/1269903779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0e3130 con 0x5557903b3bc0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67acf94980 1 -- 172.21.15.151:0/1269903779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557903b47b0 con 0x5557903b3bc0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f6694e01640 1 -- 172.21.15.151:0/1269903779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0e32d0 con 0x5557903b3bc0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f67acf94980 1 -- 172.21.15.151:0/1269903779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557903b7430 con 0x5557903b3bc0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.204+0000 7f6694e01640 1 -- 172.21.15.151:0/1269903779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0cf9e0 con 0x5557903b3bc0 2024-09-10T14:30:39.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f6694e01640 1 -- 172.21.15.151:0/1269903779 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f679c0cfb80 con 0x5557903b3bc0 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f6694e01640 1 --2- 172.21.15.151:0/1269903779 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6684034650 0x7f6684036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f6694e01640 1 -- 172.21.15.151:0/1269903779 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f679c0f4ac0 con 0x5557903b3bc0 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/1269903779 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6684034650 0x7f6684036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 Processor -- start 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 -- start start 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55579038f3f0 con 0x5557903c0500 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/1269903779 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6684034650 0x7f6684036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5557903a2500 tx=0x7f6794011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50592/0 (socket says 172.21.15.151:50592) 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1190464731 learned_addr learned my addr 172.21.15.151:0/1190464731 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1190464731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557903c0eb0 con 0x5557903c0500 2024-09-10T14:30:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/1190464731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c08e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f679c0cfff0 tx=0x7f679c0ddc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3274cd5bdada27a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f668e7fc640 1 -- 172.21.15.151:0/1190464731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0a7b20 con 0x5557903c0500 2024-09-10T14:30:39.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f668e7fc640 1 -- 172.21.15.151:0/1190464731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c104070 con 0x5557903c0500 2024-09-10T14:30:39.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f668e7fc640 1 -- 172.21.15.151:0/1190464731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c0097a0 con 0x5557903c0500 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 -- 172.21.15.151:0/1190464731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 msgr2=0x5557903c08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 --2- 172.21.15.151:0/1190464731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c08e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f679c0cfff0 tx=0x7f679c0ddc40 comp rx=0 tx=0).stop 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 -- 172.21.15.151:0/1190464731 shutdown_connections 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 --2- 172.21.15.151:0/1190464731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c08e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 -- 172.21.15.151:0/1190464731 >> 172.21.15.151:0/1190464731 conn(0x5557903bc8e0 msgr2=0x5557903ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 -- 172.21.15.151:0/1190464731 shutdown_connections 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.208+0000 7f67acf94980 1 -- 172.21.15.151:0/1190464731 wait complete. 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 1 Processor -- start 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 1 -- start start 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5557903c1350 con 0x5557903c0500 2024-09-10T14:30:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67aaaa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50596/0 (socket says 172.21.15.151:50596) 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 learned_addr learned my addr 172.21.15.151:0/1827620158 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557903c7c40 con 0x5557903c0500 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c7700 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f679c0ddd40 tx=0x7f679c0bae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f668cff9640 1 -- 172.21.15.151:0/1827620158 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c112070 con 0x5557903c0500 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557903c7c40 con 0x5557903c0500 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557903c7c40 con 0x5557903c0500 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f668cff9640 1 -- 172.21.15.151:0/1827620158 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c0dd490 con 0x5557903c0500 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f668cff9640 1 -- 172.21.15.151:0/1827620158 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679c11c060 con 0x5557903c0500 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f668cff9640 1 -- 172.21.15.151:0/1827620158 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f679c115070 con 0x5557903c0500 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f668cff9640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6674034650 0x7f6674036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f668cff9640 1 -- 172.21.15.151:0/1827620158 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f679c0fa040 con 0x5557903c0500 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6674034650 0x7f6674036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557903d2620 0x5557903d4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903d5230 con 0x5557903d2620 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.212+0000 7f67ab2a5640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557903d2620 0x5557903d4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6674034650 0x7f6674036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5557903a6500 tx=0x7f6794012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67ab2a5640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557903d2620 0x5557903d4ae0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 realm 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903d5640 con 0x5557903d2620 2024-09-10T14:30:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903d5ee0 con 0x5557903d2620 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5557903d6fe0 0x5557903d93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903d9950 con 0x5557903d6fe0 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5557903d6fe0 0x5557903d93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5557903d6fe0 0x5557903d93d0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 20 searching for the correct realm 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903db1b0 con 0x5557903d6fe0 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aaaa4640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f679c117070 0x7f679c0f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903db1b0 con 0x7f679c117070 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f679c117070 0x7f679c0f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f679c117070 0x7f679c0f44b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6794021040 con 0x7f679c117070 2024-09-10T14:30:39.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aa2a3640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6794013040 0x7f67940243c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903db1b0 con 0x7f6794013040 2024-09-10T14:30:39.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.216+0000 7f67ab2a5640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6794013040 0x7f67940243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6794013040 0x7f67940243c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f6794013040 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f6794013040 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f679c117070 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6794021040 con 0x7f679c117070 2024-09-10T14:30:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d6fe0 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.220+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f6794013040 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f679c117070 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d6fe0 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d6fe0 2024-09-10T14:30:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f679c117070 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d6fe0 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d6fe0 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f6794013040 2024-09-10T14:30:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d6fe0 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.224+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f679c117070 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f679c117070 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d6fe0 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f6794013040 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f679c117070 2024-09-10T14:30:39.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d6fe0 2024-09-10T14:30:39.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f6794013040 2024-09-10T14:30:39.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x5557903d2620 2024-09-10T14:30:39.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557903d6280 con 0x7f679c117070 2024-09-10T14:30:39.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903da2d0 con 0x5557903d2620 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.228+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903dab70 con 0x5557903d2620 2024-09-10T14:30:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903d9f10 con 0x7f6794013040 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 zone default found 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 4 Realm: () 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 zonegroup default 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903da6c0 con 0x7f679c117070 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903dd030 con 0x5557903d6fe0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903dd3d0 con 0x5557903d6fe0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 started sync module instance, tier type = 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903dc4d0 con 0x7f679c117070 2024-09-10T14:30:39.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93834570483904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903dc130 con 0x7f679c117070 2024-09-10T14:30:39.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.232+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903de240 con 0x5557903d2620 2024-09-10T14:30:39.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.236+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93834570483904] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.236+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.236+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93834570489232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903de660 con 0x5557903d2620 2024-09-10T14:30:39.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.236+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903deef0 con 0x5557903d6fe0 2024-09-10T14:30:39.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.236+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93834570489232] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.240+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.240+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93834570490560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903df2e0 con 0x5557903d6fe0 2024-09-10T14:30:39.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.240+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903dfca0 con 0x7f679c117070 2024-09-10T14:30:39.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.240+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.240+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93834570498192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e0960 con 0x7f679c117070 2024-09-10T14:30:39.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.240+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e1320 con 0x5557903d2620 2024-09-10T14:30:39.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.240+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93834570490560] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.240+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93834570498192] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.244+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.244+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93834570491808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e1320 con 0x5557903d2620 2024-09-10T14:30:39.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.244+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e1b70 con 0x7f6794013040 2024-09-10T14:30:39.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.244+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93834570491808] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.244+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.244+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93834570502016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e1930 con 0x7f6794013040 2024-09-10T14:30:39.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.244+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e23f0 con 0x7f6794013040 2024-09-10T14:30:39.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93834570502016] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93834570505920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e23b0 con 0x7f6794013040 2024-09-10T14:30:39.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e2dd0 con 0x7f6794013040 2024-09-10T14:30:39.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93834570505920] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93834570508480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e2d90 con 0x7f6794013040 2024-09-10T14:30:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 20 add_watcher() i=0 2024-09-10T14:30:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 20 add_watcher() i=1 2024-09-10T14:30:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 20 add_watcher() i=2 2024-09-10T14:30:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 20 add_watcher() i=3 2024-09-10T14:30:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 20 add_watcher() i=4 2024-09-10T14:30:39.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 20 add_watcher() i=5 2024-09-10T14:30:39.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.248+0000 7f67acf94980 20 add_watcher() i=6 2024-09-10T14:30:39.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93834570508480] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 20 add_watcher() i=7 2024-09-10T14:30:39.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:39.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557903e6250 con 0x5557903d2620 2024-09-10T14:30:39.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93834570503072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557903e3740 con 0x5557903d2620 2024-09-10T14:30:39.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93834570503072] v36'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f66617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 5 note: GC not initialized 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f65dbfff640 20 reqs_thread_entry: start 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 20 Filter name: none 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f65d9ffb640 20 reqs_thread_entry: start 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 20 rados->read ofs=0 len=0 2024-09-10T14:30:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.252+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557904093e0 con 0x5557903d2620 2024-09-10T14:30:39.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67acf94980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:39.260 INFO:teuthology.orchestra.run.smithi151.stderr:could not fetch user info: no user info saved 2024-09-10T14:30:39.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f66617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:39.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93834570503072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904093a0 con 0x5557903d2620 2024-09-10T14:30:39.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93834570503072] v36'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93834570483904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904093a0 con 0x7f679c117070 2024-09-10T14:30:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93834570483904] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67acf94980 20 remove_watcher() i=0 2024-09-10T14:30:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67acf94980 2 removed watcher, disabling cache 2024-09-10T14:30:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.256+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93834570489232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904093a0 con 0x5557903d2620 2024-09-10T14:30:39.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.260+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93834570489232] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.260+0000 7f67acf94980 20 remove_watcher() i=1 2024-09-10T14:30:39.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.260+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93834570490560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904093a0 con 0x5557903d6fe0 2024-09-10T14:30:39.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.260+0000 7f67aaaa4640 1 -- 172.21.15.151:0/1827620158 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93834570490560] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f679c114030 con 0x5557903d6fe0 2024-09-10T14:30:39.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.264+0000 7f67acf94980 20 remove_watcher() i=2 2024-09-10T14:30:39.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.264+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93834570498192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904072c0 con 0x7f679c117070 2024-09-10T14:30:39.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.264+0000 7f67aa2a3640 1 -- 172.21.15.151:0/1827620158 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93834570498192] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6794041040 con 0x7f679c117070 2024-09-10T14:30:39.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.264+0000 7f67acf94980 20 remove_watcher() i=3 2024-09-10T14:30:39.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.264+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93834570491808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904072c0 con 0x5557903d2620 2024-09-10T14:30:39.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.264+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93834570491808] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x5557903d2620 2024-09-10T14:30:39.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.264+0000 7f67acf94980 20 remove_watcher() i=4 2024-09-10T14:30:39.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.264+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93834570502016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904072c0 con 0x7f6794013040 2024-09-10T14:30:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.268+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93834570502016] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.268+0000 7f67acf94980 20 remove_watcher() i=5 2024-09-10T14:30:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.268+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93834570505920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904072c0 con 0x7f6794013040 2024-09-10T14:30:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.268+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93834570505920] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.268+0000 7f67acf94980 20 remove_watcher() i=6 2024-09-10T14:30:39.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.268+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93834570508480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557904072c0 con 0x7f6794013040 2024-09-10T14:30:39.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93834570508480] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a40083f0 con 0x7f6794013040 2024-09-10T14:30:39.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 20 remove_watcher() i=7 2024-09-10T14:30:39.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6794013040 msgr2=0x7f67940243c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f6794013040 0x7f67940243c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557903d2620 msgr2=0x5557903d4ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557903d2620 0x5557903d4ae0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f679c117070 msgr2=0x7f679c0f44b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f679c117070 0x7f679c0f44b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5557903d6fe0 msgr2=0x5557903d93d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5557903d6fe0 0x5557903d93d0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6674034650 msgr2=0x7f6674036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6674034650 0x7f6674036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5557903a6500 tx=0x7f6794012000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 msgr2=0x5557903c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67ab2a5640 1 -- 172.21.15.151:0/1827620158 reap_dead start 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c7700 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f679c0ddd40 tx=0x7f679c0bae80 comp rx=0 tx=0).stop 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 shutdown_connections 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1827620158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903c0500 0x5557903c7700 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 >> 172.21.15.151:0/1827620158 conn(0x5557903bc8e0 msgr2=0x5557903ba9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 shutdown_connections 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1827620158 wait complete. 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1269903779 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6684034650 msgr2=0x7f6684036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1269903779 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6684034650 0x7f6684036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5557903a2500 tx=0x7f6794011000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1269903779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903b3bc0 msgr2=0x5557903b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1269903779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903b3bc0 0x5557903b3fe0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f679c0d0f70 tx=0x7f679c0cf4e0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1269903779 shutdown_connections 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1269903779 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6684034650 0x7f6684036b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/1269903779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557903b3bc0 0x5557903b3fe0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1269903779 >> 172.21.15.151:0/1269903779 conn(0x5557903a8d10 msgr2=0x5557903ab790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1269903779 shutdown_connections 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/1269903779 wait complete. 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5557903a35c0 msgr2=0x5557903a59b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5557903a35c0 0x5557903a59b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557902a6ca0 msgr2=0x55579039cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5557902a6ca0 0x55579039cd20 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55579039f530 msgr2=0x5557903a19d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55579039f530 0x5557903a19d0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f66900346a0 msgr2=0x7f6690036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f66900346a0 0x7f6690036b60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f67940012f0 tx=0x7f67940066b0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 msgr2=0x555790395d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 --2- 172.21.15.151:0/151182768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557902162d0 0x555790395d90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f679c01b170 tx=0x7f679c0180e0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67ab2a5640 1 -- 172.21.15.151:0/151182768 reap_dead start 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 shutdown_connections 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 >> 172.21.15.151:0/151182768 conn(0x55579029c090 msgr2=0x555790389310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 shutdown_connections 2024-09-10T14:30:39.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.272+0000 7f67acf94980 1 -- 172.21.15.151:0/151182768 wait complete. 2024-09-10T14:30:39.289 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T14:30:39.290 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-10T14:30:39.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-10T14:30:39.290 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-10T14:30:39.358 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:39.358 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:39.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f898133e980 1 Processor -- start 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f898133e980 1 -- start start 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f898133e980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ddb56963e0 0x55ddb57243c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f898133e980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ddb55a9ae0 con 0x55ddb5724900 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f898133e980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55ddb55cde30 con 0x55ddb56963e0 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897ee4e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ddb56963e0 0x55ddb57243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897ee4e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ddb56963e0 0x55ddb57243c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50612/0 (socket says 172.21.15.151:50612) 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897ee4e640 1 -- 172.21.15.151:0/1775689799 learned_addr learned my addr 172.21.15.151:0/1775689799 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897e64d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55ddb5724900 0x55ddb5726cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33288/0 (socket says 172.21.15.151:33288) 2024-09-10T14:30:39.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897ee4e640 1 -- 172.21.15.151:0/1775689799 >> v1:172.21.15.52:6789/0 conn(0x55ddb5724900 legacy=0x55ddb5726cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897ee4e640 1 -- 172.21.15.151:0/1775689799 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddb5696970 con 0x55ddb56963e0 2024-09-10T14:30:39.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897ee4e640 1 --2- 172.21.15.151:0/1775689799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb57243c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f897800a4e0 tx=0x7f897801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58be650714bd2aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897de4c640 1 -- 172.21.15.151:0/1775689799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89780aa540 con 0x55ddb56963e0 2024-09-10T14:30:39.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.356+0000 7f897de4c640 1 -- 172.21.15.151:0/1775689799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89780aa6e0 con 0x55ddb56963e0 2024-09-10T14:30:39.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.360+0000 7f897de4c640 1 -- 172.21.15.151:0/1775689799 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89780aaa40 con 0x55ddb56963e0 2024-09-10T14:30:39.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.360+0000 7f898133e980 1 -- 172.21.15.151:0/1775689799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 msgr2=0x55ddb57243c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.360+0000 7f898133e980 1 --2- 172.21.15.151:0/1775689799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb57243c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f897800a4e0 tx=0x7f897801b090 comp rx=0 tx=0).stop 2024-09-10T14:30:39.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.360+0000 7f898133e980 1 -- 172.21.15.151:0/1775689799 shutdown_connections 2024-09-10T14:30:39.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.360+0000 7f898133e980 1 --2- 172.21.15.151:0/1775689799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb57243c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.360+0000 7f898133e980 1 -- 172.21.15.151:0/1775689799 >> 172.21.15.151:0/1775689799 conn(0x55ddb571c0b0 msgr2=0x55ddb571e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.360+0000 7f898133e980 1 -- 172.21.15.151:0/1775689799 shutdown_connections 2024-09-10T14:30:39.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.360+0000 7f898133e980 1 -- 172.21.15.151:0/1775689799 wait complete. 2024-09-10T14:30:39.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.372+0000 7f898133e980 1 Processor -- start 2024-09-10T14:30:39.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.372+0000 7f898133e980 1 -- start start 2024-09-10T14:30:39.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.372+0000 7f898133e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb580ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.372+0000 7f898133e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ddb55cf200 con 0x55ddb56963e0 2024-09-10T14:30:39.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.372+0000 7f897ee4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb580ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.372+0000 7f897ee4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb580ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50620/0 (socket says 172.21.15.151:50620) 2024-09-10T14:30:39.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.372+0000 7f897ee4e640 1 -- 172.21.15.151:0/2915743689 learned_addr learned my addr 172.21.15.151:0/2915743689 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f897ee4e640 1 -- 172.21.15.151:0/2915743689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddb580d030 con 0x55ddb56963e0 2024-09-10T14:30:39.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f897ee4e640 1 --2- 172.21.15.151:0/2915743689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb580ca60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8978017ca0 tx=0x7f89780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c14757a9641f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f886ce09640 1 -- 172.21.15.151:0/2915743689 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89780b9030 con 0x55ddb56963e0 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f886ce09640 1 -- 172.21.15.151:0/2915743689 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89780aaac0 con 0x55ddb56963e0 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f886ce09640 1 -- 172.21.15.151:0/2915743689 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89780aada0 con 0x55ddb56963e0 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- 172.21.15.151:0/2915743689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 msgr2=0x55ddb580ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 --2- 172.21.15.151:0/2915743689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb580ca60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8978017ca0 tx=0x7f89780033b0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- 172.21.15.151:0/2915743689 shutdown_connections 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 --2- 172.21.15.151:0/2915743689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb580ca60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- 172.21.15.151:0/2915743689 >> 172.21.15.151:0/2915743689 conn(0x55ddb571c0b0 msgr2=0x55ddb5808690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- 172.21.15.151:0/2915743689 shutdown_connections 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- 172.21.15.151:0/2915743689 wait complete. 2024-09-10T14:30:39.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 Processor -- start 2024-09-10T14:30:39.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- start start 2024-09-10T14:30:39.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb5813d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ddb5728f20 con 0x55ddb56963e0 2024-09-10T14:30:39.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f897ee4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb5813d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f897ee4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb5813d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50634/0 (socket says 172.21.15.151:50634) 2024-09-10T14:30:39.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f897ee4e640 1 -- 172.21.15.151:0/990261480 learned_addr learned my addr 172.21.15.151:0/990261480 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f897ee4e640 1 -- 172.21.15.151:0/990261480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddb5814250 con 0x55ddb56963e0 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f897ee4e640 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb5813d10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8978005cc0 tx=0x7f8978017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f886b606640 1 -- 172.21.15.151:0/990261480 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89780b9030 con 0x55ddb56963e0 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddb58144e0 con 0x55ddb56963e0 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddb58171c0 con 0x55ddb56963e0 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f886b606640 1 -- 172.21.15.151:0/990261480 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89780c3070 con 0x55ddb56963e0 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.376+0000 7f886b606640 1 -- 172.21.15.151:0/990261480 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89780cc060 con 0x55ddb56963e0 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 Processor -- start 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- start start 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb5720390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ddb5628800 con 0x55ddb5721e10 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f886b606640 1 -- 172.21.15.151:0/990261480 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89780c5030 con 0x55ddb56963e0 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897f64f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb5720390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897f64f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb5720390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50636/0 (socket says 172.21.15.151:50636) 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897f64f640 1 -- 172.21.15.151:0/303911478 learned_addr learned my addr 172.21.15.151:0/303911478 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f886b606640 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8864034650 0x7f8864036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f886b606640 1 -- 172.21.15.151:0/990261480 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f89780ba070 con 0x55ddb56963e0 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897ee4e640 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8864034650 0x7f8864036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897f64f640 1 -- 172.21.15.151:0/303911478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddb57208d0 con 0x55ddb5721e10 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897ee4e640 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8864034650 0x7f8864036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f89780b7010 tx=0x7f89780d3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897f64f640 1 --2- 172.21.15.151:0/303911478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb5720390 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f897000a440 tx=0x7f897000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6033f93e67922f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f8869602640 1 -- 172.21.15.151:0/303911478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8970008850 con 0x55ddb5721e10 2024-09-10T14:30:39.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f8869602640 1 -- 172.21.15.151:0/303911478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8970008a10 con 0x55ddb5721e10 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f8869602640 1 -- 172.21.15.151:0/303911478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8970008d30 con 0x55ddb5721e10 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- 172.21.15.151:0/303911478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 msgr2=0x55ddb5720390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 --2- 172.21.15.151:0/303911478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb5720390 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f897000a440 tx=0x7f897000a900 comp rx=0 tx=0).stop 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- 172.21.15.151:0/303911478 shutdown_connections 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 --2- 172.21.15.151:0/303911478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb5720390 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- 172.21.15.151:0/303911478 >> 172.21.15.151:0/303911478 conn(0x55ddb5724900 msgr2=0x55ddb581c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- 172.21.15.151:0/303911478 shutdown_connections 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- 172.21.15.151:0/303911478 wait complete. 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 Processor -- start 2024-09-10T14:30:39.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- start start 2024-09-10T14:30:39.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb582a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f898133e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ddb5720b90 con 0x55ddb5721e10 2024-09-10T14:30:39.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897f64f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb582a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897f64f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb582a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50646/0 (socket says 172.21.15.151:50646) 2024-09-10T14:30:39.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.380+0000 7f897f64f640 1 -- 172.21.15.151:0/3167392666 learned_addr learned my addr 172.21.15.151:0/3167392666 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f897f64f640 1 -- 172.21.15.151:0/3167392666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddb582a550 con 0x55ddb5721e10 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f897f64f640 1 --2- 172.21.15.151:0/3167392666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb582a010 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8970010000 tx=0x7f8970003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f88637fe640 1 -- 172.21.15.151:0/3167392666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8970013a70 con 0x55ddb5721e10 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f88637fe640 1 -- 172.21.15.151:0/3167392666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8970023070 con 0x55ddb5721e10 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f898133e980 1 -- 172.21.15.151:0/3167392666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddb582a7e0 con 0x55ddb5721e10 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f88637fe640 1 -- 172.21.15.151:0/3167392666 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8970013d40 con 0x55ddb5721e10 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f898133e980 1 -- 172.21.15.151:0/3167392666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddb582d4c0 con 0x55ddb5721e10 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f88637fe640 1 -- 172.21.15.151:0/3167392666 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8970028460 con 0x55ddb5721e10 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f898133e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f898133e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f88637fe640 1 --2- 172.21.15.151:0/3167392666 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8858034650 0x7f8858036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f88637fe640 1 -- 172.21.15.151:0/3167392666 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f897004a0b0 con 0x55ddb5721e10 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f897e64d640 1 --2- 172.21.15.151:0/3167392666 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8858034650 0x7f8858036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f898133e980 1 Processor -- start 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f898133e980 1 -- start start 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f898133e980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5843820 0x55ddb5843c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f898133e980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ddb580d2f0 con 0x55ddb5843820 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f897e64d640 1 --2- 172.21.15.151:0/3167392666 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8858034650 0x7f8858036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8974000f70 tx=0x7f8974001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f897ee4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5843820 0x55ddb5843c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f897ee4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5843820 0x55ddb5843c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50656/0 (socket says 172.21.15.151:50656) 2024-09-10T14:30:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.384+0000 7f897ee4e640 1 -- 172.21.15.151:0/3959640729 learned_addr learned my addr 172.21.15.151:0/3959640729 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897ee4e640 1 -- 172.21.15.151:0/3959640729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddb5844210 con 0x55ddb5843820 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897ee4e640 1 --2- 172.21.15.151:0/3959640729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5843820 0x55ddb5843c40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f897801aec0 tx=0x7f89780b1ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f883effd640 1 -- 172.21.15.151:0/3959640729 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89780ea070 con 0x55ddb5843820 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f898133e980 1 -- 172.21.15.151:0/3959640729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddb5846e90 con 0x55ddb5843820 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f883effd640 1 -- 172.21.15.151:0/3959640729 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89780b4820 con 0x55ddb5843820 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f883effd640 1 -- 172.21.15.151:0/3959640729 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89780b43a0 con 0x55ddb5843820 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f898133e980 1 -- 172.21.15.151:0/3959640729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddb5847240 con 0x55ddb5843820 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f883effd640 1 -- 172.21.15.151:0/3959640729 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89780ed070 con 0x55ddb5843820 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f883effd640 1 --2- 172.21.15.151:0/3959640729 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87b80345b0 0x7f87b8036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f883effd640 1 -- 172.21.15.151:0/3959640729 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f89780f0d60 con 0x55ddb5843820 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897e64d640 1 --2- 172.21.15.151:0/3959640729 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87b80345b0 0x7f87b8036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f883cff9640 20 reqs_thread_entry: start 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ddb5849460 0x55ddb584b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ddb584bed0 con 0x55ddb5849460 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897e64d640 1 --2- 172.21.15.151:0/3959640729 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87b80345b0 0x7f87b8036a70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8974001ee0 tx=0x7f897400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897f64f640 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ddb5849460 0x55ddb584b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897f64f640 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ddb5849460 0x55ddb584b850 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897f64f640 1 -- 172.21.15.151:0/990261480 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f897001e7a0 con 0x55ddb5849460 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ddb584dcf0 0x55ddb58500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:2 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ddb5850730 con 0x55ddb584dcf0 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897ee4e640 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ddb584dcf0 0x55ddb58500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.388+0000 7f897ee4e640 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ddb584dcf0 0x55ddb58500e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f897ee4e640 1 -- 172.21.15.151:0/990261480 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(2 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89780ec030 con 0x55ddb584dcf0 2024-09-10T14:30:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3167392666 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8858034650 msgr2=0x7f8858036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/3167392666 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8858034650 0x7f8858036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8974000f70 tx=0x7f8974001300 comp rx=0 tx=0).stop 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3167392666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 msgr2=0x55ddb582a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/3167392666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb582a010 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8970010000 tx=0x7f8970003000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3167392666 shutdown_connections 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/3167392666 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8858034650 0x7f8858036b10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/3167392666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5721e10 0x55ddb582a010 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3167392666 >> 172.21.15.151:0/3167392666 conn(0x55ddb5724900 msgr2=0x55ddb581f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3167392666 shutdown_connections 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3167392666 wait complete. 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3959640729 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87b80345b0 msgr2=0x7f87b8036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/3959640729 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87b80345b0 0x7f87b8036a70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8974001ee0 tx=0x7f897400f000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3959640729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5843820 msgr2=0x55ddb5843c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/3959640729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5843820 0x55ddb5843c40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f897801aec0 tx=0x7f89780b1ec0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3959640729 shutdown_connections 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/3959640729 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f87b80345b0 0x7f87b8036a70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/3959640729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb5843820 0x55ddb5843c40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3959640729 >> 172.21.15.151:0/3959640729 conn(0x55ddb58388d0 msgr2=0x55ddb583b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3959640729 shutdown_connections 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/3959640729 wait complete. 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ddb5849460 msgr2=0x55ddb584b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ddb5849460 0x55ddb584b850 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ddb584dcf0 msgr2=0x55ddb58500e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ddb584dcf0 0x55ddb58500e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8864034650 msgr2=0x7f8864036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8864034650 0x7f8864036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f89780b7010 tx=0x7f89780d3040 comp rx=0 tx=0).stop 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 msgr2=0x55ddb5813d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb5813d10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8978005cc0 tx=0x7f8978017e30 comp rx=0 tx=0).stop 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 shutdown_connections 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ddb584dcf0 0x55ddb58500e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ddb5849460 0x55ddb584b850 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8864034650 0x7f8864036b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 --2- 172.21.15.151:0/990261480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddb56963e0 0x55ddb5813d10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 >> 172.21.15.151:0/990261480 conn(0x55ddb571c0b0 msgr2=0x55ddb5807210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 shutdown_connections 2024-09-10T14:30:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.392+0000 7f898133e980 1 -- 172.21.15.151:0/990261480 wait complete. 2024-09-10T14:30:39.406 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T14:30:39.407 DEBUG:tasks.util.rgw: json result: {'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T14:30:39.407 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-10T14:30:39.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-10T14:30:39.407 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-10T14:30:39.478 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:39.479 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:39.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f3944fd3980 1 Processor -- start 2024-09-10T14:30:39.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f3944fd3980 1 -- start start 2024-09-10T14:30:39.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f3944fd3980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be446c2ab0 0x55be446c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f3944fd3980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be44546ae0 con 0x55be44633280 2024-09-10T14:30:39.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f3944fd3980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55be4456ae30 con 0x55be446c2ab0 2024-09-10T14:30:39.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f39422e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be446c2ab0 0x55be446c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f39422e2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55be446c2ab0 0x55be446c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50666/0 (socket says 172.21.15.151:50666) 2024-09-10T14:30:39.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f39422e2640 1 -- 172.21.15.151:0/4122245371 learned_addr learned my addr 172.21.15.151:0/4122245371 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f3942ae3640 1 --1- 172.21.15.151:0/4122245371 >> v1:172.21.15.52:6789/0 conn(0x55be44633280 0x55be446c1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33290/0 (socket says 172.21.15.151:33290) 2024-09-10T14:30:39.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f39422e2640 1 -- 172.21.15.151:0/4122245371 >> v1:172.21.15.52:6789/0 conn(0x55be44633280 legacy=0x55be446c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f39422e2640 1 -- 172.21.15.151:0/4122245371 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be44633810 con 0x55be446c2ab0 2024-09-10T14:30:39.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.476+0000 7f39422e2640 1 --2- 172.21.15.151:0/4122245371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be446c2ab0 0x55be446c4ea0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f392c00a5c0 tx=0x7f392c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b313d33ee95cef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3941ae1640 1 -- 172.21.15.151:0/4122245371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f392c0a6070 con 0x55be446c2ab0 2024-09-10T14:30:39.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3941ae1640 1 -- 172.21.15.151:0/4122245371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c0af070 con 0x55be446c2ab0 2024-09-10T14:30:39.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3941ae1640 1 -- 172.21.15.151:0/4122245371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f392c0aa5c0 con 0x55be446c2ab0 2024-09-10T14:30:39.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3944fd3980 1 -- 172.21.15.151:0/4122245371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be446c2ab0 msgr2=0x55be446c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4122245371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be446c2ab0 0x55be446c4ea0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f392c00a5c0 tx=0x7f392c01b340 comp rx=0 tx=0).stop 2024-09-10T14:30:39.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3944fd3980 1 -- 172.21.15.151:0/4122245371 shutdown_connections 2024-09-10T14:30:39.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4122245371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be446c2ab0 0x55be446c4ea0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3944fd3980 1 -- 172.21.15.151:0/4122245371 >> 172.21.15.151:0/4122245371 conn(0x55be446b9080 msgr2=0x55be446bb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3944fd3980 1 -- 172.21.15.151:0/4122245371 shutdown_connections 2024-09-10T14:30:39.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.480+0000 7f3944fd3980 1 -- 172.21.15.151:0/4122245371 wait complete. 2024-09-10T14:30:39.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3944fd3980 1 Processor -- start 2024-09-10T14:30:39.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3944fd3980 1 -- start start 2024-09-10T14:30:39.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3944fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3944fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55be4456c200 con 0x55be44633280 2024-09-10T14:30:39.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3942ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3942ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447a99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50674/0 (socket says 172.21.15.151:50674) 2024-09-10T14:30:39.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3942ae3640 1 -- 172.21.15.151:0/403313208 learned_addr learned my addr 172.21.15.151:0/403313208 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3942ae3640 1 -- 172.21.15.151:0/403313208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be447a9fc0 con 0x55be44633280 2024-09-10T14:30:39.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.492+0000 7f3942ae3640 1 --2- 172.21.15.151:0/403313208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447a99f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f39340015f0 tx=0x7f3934001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2900996328d3b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3830e09640 1 -- 172.21.15.151:0/403313208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934013420 con 0x55be44633280 2024-09-10T14:30:39.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3830e09640 1 -- 172.21.15.151:0/403313208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39340135e0 con 0x55be44633280 2024-09-10T14:30:39.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3830e09640 1 -- 172.21.15.151:0/403313208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934013940 con 0x55be44633280 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- 172.21.15.151:0/403313208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 msgr2=0x55be447a99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 --2- 172.21.15.151:0/403313208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447a99f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f39340015f0 tx=0x7f3934001ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- 172.21.15.151:0/403313208 shutdown_connections 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 --2- 172.21.15.151:0/403313208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447a99f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- 172.21.15.151:0/403313208 >> 172.21.15.151:0/403313208 conn(0x55be446b9080 msgr2=0x55be447a5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- 172.21.15.151:0/403313208 shutdown_connections 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- 172.21.15.151:0/403313208 wait complete. 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 Processor -- start 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- start start 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55be446c5ef0 con 0x55be44633280 2024-09-10T14:30:39.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3942ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3942ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50682/0 (socket says 172.21.15.151:50682) 2024-09-10T14:30:39.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 learned_addr learned my addr 172.21.15.151:0/4220109900 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be447b1280 con 0x55be44633280 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3942ae3640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447b0d40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3934006640 tx=0x7f3934000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f382f606640 1 -- 172.21.15.151:0/4220109900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934022020 con 0x55be44633280 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be447b1510 con 0x55be44633280 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be447b41f0 con 0x55be44633280 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f382f606640 1 -- 172.21.15.151:0/4220109900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934006320 con 0x55be44633280 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f382f606640 1 -- 172.21.15.151:0/4220109900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934004ab0 con 0x55be44633280 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.496+0000 7f3944fd3980 1 Processor -- start 2024-09-10T14:30:39.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- start start 2024-09-10T14:30:39.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55be445c5800 con 0x55be447bdb00 2024-09-10T14:30:39.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f382f606640 1 -- 172.21.15.151:0/4220109900 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3934025020 con 0x55be44633280 2024-09-10T14:30:39.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447bdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50690/0 (socket says 172.21.15.151:50690) 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 -- 172.21.15.151:0/904377277 learned_addr learned my addr 172.21.15.151:0/904377277 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f382f606640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3828034650 0x7f3828036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f382f606640 1 -- 172.21.15.151:0/4220109900 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3934018030 con 0x55be44633280 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3942ae3640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3828034650 0x7f3828036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 -- 172.21.15.151:0/904377277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be447be440 con 0x55be447bdb00 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3942ae3640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3828034650 0x7f3828036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f393401efd0 tx=0x7f393401ef60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 --2- 172.21.15.151:0/904377277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447bdf00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f393c00a440 tx=0x7f393c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a3be4901b72295 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f382d602640 1 -- 172.21.15.151:0/904377277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c008850 con 0x55be447bdb00 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f382d602640 1 -- 172.21.15.151:0/904377277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c008a10 con 0x55be447bdb00 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f382d602640 1 -- 172.21.15.151:0/904377277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c008d30 con 0x55be447bdb00 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- 172.21.15.151:0/904377277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 msgr2=0x55be447bdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 --2- 172.21.15.151:0/904377277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447bdf00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f393c00a440 tx=0x7f393c00a900 comp rx=0 tx=0).stop 2024-09-10T14:30:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- 172.21.15.151:0/904377277 shutdown_connections 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 --2- 172.21.15.151:0/904377277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447bdf00 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- 172.21.15.151:0/904377277 >> 172.21.15.151:0/904377277 conn(0x55be446c2ab0 msgr2=0x55be447b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- 172.21.15.151:0/904377277 shutdown_connections 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- 172.21.15.151:0/904377277 wait complete. 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 Processor -- start 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- start start 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f3944fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55be447bee20 con 0x55be447bdb00 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50694/0 (socket says 172.21.15.151:50694) 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 -- 172.21.15.151:0/2710642274 learned_addr learned my addr 172.21.15.151:0/2710642274 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 -- 172.21.15.151:0/2710642274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be447c5360 con 0x55be447bdb00 2024-09-10T14:30:39.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.500+0000 7f39432e4640 1 --2- 172.21.15.151:0/2710642274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447c4e20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55be447be8b0 tx=0x7f393c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f38277fe640 1 -- 172.21.15.151:0/2710642274 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c013a70 con 0x55be447bdb00 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 1 -- 172.21.15.151:0/2710642274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be447c55f0 con 0x55be447bdb00 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 1 -- 172.21.15.151:0/2710642274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be447c82d0 con 0x55be447bdb00 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f38277fe640 1 -- 172.21.15.151:0/2710642274 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c023070 con 0x55be447bdb00 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f38277fe640 1 -- 172.21.15.151:0/2710642274 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f393c013d40 con 0x55be447bdb00 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f38277fe640 1 -- 172.21.15.151:0/2710642274 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f393c028460 con 0x55be447bdb00 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f38277fe640 1 --2- 172.21.15.151:0/2710642274 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f381c034650 0x7f381c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 1 Processor -- start 2024-09-10T14:30:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f38277fe640 1 -- 172.21.15.151:0/2710642274 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f393c04a050 con 0x55be447bdb00 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f39432e4640 1 --2- 172.21.15.151:0/2710642274 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f381c034650 0x7f381c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 1 -- start start 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447de6e0 0x55be447deb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55be447aa340 con 0x55be447de6e0 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f39432e4640 1 --2- 172.21.15.151:0/2710642274 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f381c034650 0x7f381c036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f393c013730 tx=0x7f393c01e500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3942ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447de6e0 0x55be447deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3942ae3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447de6e0 0x55be447deb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50696/0 (socket says 172.21.15.151:50696) 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3942ae3640 1 -- 172.21.15.151:0/574700138 learned_addr learned my addr 172.21.15.151:0/574700138 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3942ae3640 1 -- 172.21.15.151:0/574700138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be447df0d0 con 0x55be447de6e0 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3942ae3640 1 --2- 172.21.15.151:0/574700138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447de6e0 0x55be447deb00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3934029040 tx=0x7f3934010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3802ffd640 1 -- 172.21.15.151:0/574700138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934012a40 con 0x55be447de6e0 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 1 -- 172.21.15.151:0/574700138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be447e1ca0 con 0x55be447de6e0 2024-09-10T14:30:39.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3802ffd640 1 -- 172.21.15.151:0/574700138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934049e50 con 0x55be447de6e0 2024-09-10T14:30:39.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3802ffd640 1 -- 172.21.15.151:0/574700138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3934012c80 con 0x55be447de6e0 2024-09-10T14:30:39.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.504+0000 7f3944fd3980 1 -- 172.21.15.151:0/574700138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be447e2050 con 0x55be447de6e0 2024-09-10T14:30:39.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3802ffd640 1 -- 172.21.15.151:0/574700138 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3934010070 con 0x55be447de6e0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3802ffd640 1 --2- 172.21.15.151:0/574700138 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f377c034600 0x7f377c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3802ffd640 1 -- 172.21.15.151:0/574700138 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f3934033070 con 0x55be447de6e0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f39422e2640 1 --2- 172.21.15.151:0/574700138 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f377c034600 0x7f377c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3800ff9640 20 reqs_thread_entry: start 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f39422e2640 1 --2- 172.21.15.151:0/574700138 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f377c034600 0x7f377c036ac0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f392c0ae000 tx=0x7f392c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55be447e41c0 0x55be447e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55be447e6c70 con 0x55be447e41c0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f39432e4640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55be447e41c0 0x55be447e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f39432e4640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55be447e41c0 0x55be447e65f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55be447e7520 con 0x55be447e41c0 2024-09-10T14:30:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55be447e8e30 0x55be447eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55be447eb990 con 0x55be447e8e30 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3942ae3640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55be447e8e30 0x55be447eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3942ae3640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55be447e8e30 0x55be447eb2a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55be447f24d0 con 0x55be447e41c0 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:NOTICE: set zone's realm_id= 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(5 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3942ae3640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f393403e040 0x7f3934029830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.508+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f393403e040 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39422e2640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f393403e040 0x7f3934029830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39422e2640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f393403e040 0x7f3934029830 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f392c0aaa60 con 0x7f393403e040 2024-09-10T14:30:39.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39422e2640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f392c009040 0x7f392c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f392c009040 2024-09-10T14:30:39.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f392c009040 0x7f392c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f392c009040 0x7f392c0b33f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x7f392c009040 2024-09-10T14:30:39.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e41c0 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e41c0 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f392c009040 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x7f392c009040 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f392c009040 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x7f392c009040 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.512+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f393403e040 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f392c0aaa60 con 0x7f393403e040 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e41c0 2024-09-10T14:30:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f392c009040 2024-09-10T14:30:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(15 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f393c01e7a0 con 0x7f392c009040 2024-09-10T14:30:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e41c0 2024-09-10T14:30:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f393403e040 2024-09-10T14:30:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(17 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f392c0aaa60 con 0x7f393403e040 2024-09-10T14:30:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(18 [pgnls start_epoch 36 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f393403e040 2024-09-10T14:30:39.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f392c0aaa60 con 0x7f393403e040 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e41c0 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e41c0 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.516+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f392c009040 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(25 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x7f392c009040 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f393403e040 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f392c0aaa60 con 0x7f393403e040 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e41c0 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f393403e040 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f392c0aaa60 con 0x7f393403e040 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f392c009040 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x7f392c009040 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f393403e040 2024-09-10T14:30:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f392c0aaa60 con 0x7f393403e040 2024-09-10T14:30:39.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e8e30 2024-09-10T14:30:39.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f392c009040 2024-09-10T14:30:39.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f393c01e7a0 con 0x7f392c009040 2024-09-10T14:30:39.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x55be447e41c0 2024-09-10T14:30:39.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(35 [pgnls start_epoch 36 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55be447f6530 con 0x7f393403e040 2024-09-10T14:30:39.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f39422e2640 1 -- 172.21.15.151:0/4220109900 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(36 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f392c0aaa60 con 0x7f393403e040 2024-09-10T14:30:39.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.520+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55be447f4eb0 con 0x55be447e41c0 2024-09-10T14:30:39.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.524+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.524+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:38 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55be447f2950 con 0x55be447e8e30 2024-09-10T14:30:39.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.524+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(38 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.524+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:39 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55be447f1d60 con 0x55be447e8e30 2024-09-10T14:30:39.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.524+0000 7f3942ae3640 1 -- 172.21.15.151:0/4220109900 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(39 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [create,call,writefull 0~1155] v36'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f393401b070 con 0x55be447e8e30 2024-09-10T14:30:39.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.524+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55be447f3b00 con 0x55be447e41c0 2024-09-10T14:30:39.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v36'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55be447f4380 con 0x55be447e41c0 2024-09-10T14:30:39.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v36'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f393c01e7a0 con 0x55be447e41c0 2024-09-10T14:30:39.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/2710642274 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f381c034650 msgr2=0x7f381c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/2710642274 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f381c034650 0x7f381c036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f393c013730 tx=0x7f393c01e500 comp rx=0 tx=0).stop 2024-09-10T14:30:39.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/2710642274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 msgr2=0x55be447c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/2710642274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447c4e20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55be447be8b0 tx=0x7f393c003000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/2710642274 shutdown_connections 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/2710642274 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f381c034650 0x7f381c036b10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/2710642274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447bdb00 0x55be447c4e20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/2710642274 >> 172.21.15.151:0/2710642274 conn(0x55be446c2ab0 msgr2=0x55be447b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/2710642274 shutdown_connections 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/2710642274 wait complete. 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/574700138 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f377c034600 msgr2=0x7f377c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/574700138 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f377c034600 0x7f377c036ac0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f392c0ae000 tx=0x7f392c0a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/574700138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447de6e0 msgr2=0x55be447deb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/574700138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447de6e0 0x55be447deb00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3934029040 tx=0x7f3934010b40 comp rx=0 tx=0).stop 2024-09-10T14:30:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/574700138 shutdown_connections 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/574700138 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f377c034600 0x7f377c036ac0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/574700138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be447de6e0 0x55be447deb00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/574700138 >> 172.21.15.151:0/574700138 conn(0x55be447d3710 msgr2=0x55be447d6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/574700138 shutdown_connections 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/574700138 wait complete. 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f392c009040 msgr2=0x7f392c0b33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f392c009040 0x7f392c0b33f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55be447e41c0 msgr2=0x55be447e65f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55be447e41c0 0x55be447e65f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f393403e040 msgr2=0x7f3934029830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f393403e040 0x7f3934029830 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55be447e8e30 msgr2=0x55be447eb2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55be447e8e30 0x55be447eb2a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3828034650 msgr2=0x7f3828036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f3828034650 0x7f3828036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f393401efd0 tx=0x7f393401ef60 comp rx=0 tx=0).stop 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f39432e4640 1 -- 172.21.15.151:0/4220109900 reap_dead start 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 msgr2=0x55be447b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447b0d40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3934006640 tx=0x7f3934000f50 comp rx=0 tx=0).stop 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 shutdown_connections 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 --2- 172.21.15.151:0/4220109900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be44633280 0x55be447b0d40 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 >> 172.21.15.151:0/4220109900 conn(0x55be446b9080 msgr2=0x55be447a41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.528+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 shutdown_connections 2024-09-10T14:30:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.532+0000 7f3944fd3980 1 -- 172.21.15.151:0/4220109900 wait complete. 2024-09-10T14:30:39.544 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T14:30:39.544 DEBUG:tasks.util.rgw: json result: {'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T14:30:39.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-10T14:30:39.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-10T14:30:39.545 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-10T14:30:39.613 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:39.614 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:39.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.608+0000 7f7fd317a980 1 Processor -- start 2024-09-10T14:30:39.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.608+0000 7f7fd317a980 1 -- start start 2024-09-10T14:30:39.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.608+0000 7f7fd317a980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55836b320c50 0x55836b323040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.608+0000 7f7fd317a980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55836b1a2ae0 con 0x55836b31c8d0 2024-09-10T14:30:39.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.608+0000 7f7fd317a980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55836b1c6e30 con 0x55836b320c50 2024-09-10T14:30:39.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd0489640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55836b320c50 0x55836b323040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd0c8a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55836b31c8d0 0x55836b31ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33296/0 (socket says 172.21.15.151:33296) 2024-09-10T14:30:39.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd0489640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55836b320c50 0x55836b323040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50698/0 (socket says 172.21.15.151:50698) 2024-09-10T14:30:39.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd0c8a640 1 -- 172.21.15.151:0/2437812805 learned_addr learned my addr 172.21.15.151:0/2437812805 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:30:39.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd0489640 1 -- 172.21.15.151:0/2437812805 >> v1:172.21.15.52:6789/0 conn(0x55836b31c8d0 legacy=0x55836b31ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd0489640 1 -- 172.21.15.151:0/2437812805 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836b324590 con 0x55836b320c50 2024-09-10T14:30:39.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd0489640 1 --2- 172.21.15.151:0/2437812805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b320c50 0x55836b323040 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000a480 tx=0x7f7fc001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a06880adda5790 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fcfc88640 1 -- 172.21.15.151:0/2437812805 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00b0070 con 0x55836b320c50 2024-09-10T14:30:39.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fcfc88640 1 -- 172.21.15.151:0/2437812805 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc00ab540 con 0x55836b320c50 2024-09-10T14:30:39.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fcfc88640 1 -- 172.21.15.151:0/2437812805 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00ab840 con 0x55836b320c50 2024-09-10T14:30:39.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd317a980 1 -- 172.21.15.151:0/2437812805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b320c50 msgr2=0x55836b323040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd317a980 1 --2- 172.21.15.151:0/2437812805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b320c50 0x55836b323040 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000a480 tx=0x7f7fc001b280 comp rx=0 tx=0).stop 2024-09-10T14:30:39.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd317a980 1 -- 172.21.15.151:0/2437812805 shutdown_connections 2024-09-10T14:30:39.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd317a980 1 --2- 172.21.15.151:0/2437812805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b320c50 0x55836b323040 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd317a980 1 -- 172.21.15.151:0/2437812805 >> 172.21.15.151:0/2437812805 conn(0x55836b290220 msgr2=0x55836b290630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd317a980 1 -- 172.21.15.151:0/2437812805 shutdown_connections 2024-09-10T14:30:39.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.612+0000 7f7fd317a980 1 -- 172.21.15.151:0/2437812805 wait complete. 2024-09-10T14:30:39.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 Processor -- start 2024-09-10T14:30:39.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 -- start start 2024-09-10T14:30:39.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b407c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55836b1c8200 con 0x55836b31c8d0 2024-09-10T14:30:39.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd0c8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b407c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd0c8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b407c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50706/0 (socket says 172.21.15.151:50706) 2024-09-10T14:30:39.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd0c8a640 1 -- 172.21.15.151:0/4141121855 learned_addr learned my addr 172.21.15.151:0/4141121855 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd0c8a640 1 -- 172.21.15.151:0/4141121855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836b4081f0 con 0x55836b31c8d0 2024-09-10T14:30:39.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd0c8a640 1 --2- 172.21.15.151:0/4141121855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b407c20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8001d90 tx=0x7f7fb8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f245c07fbb56d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7ebee0d640 1 -- 172.21.15.151:0/4141121855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8013030 con 0x55836b31c8d0 2024-09-10T14:30:39.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7ebee0d640 1 -- 172.21.15.151:0/4141121855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb800e690 con 0x55836b31c8d0 2024-09-10T14:30:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7ebee0d640 1 -- 172.21.15.151:0/4141121855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb800ea10 con 0x55836b31c8d0 2024-09-10T14:30:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 -- 172.21.15.151:0/4141121855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 msgr2=0x55836b407c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 --2- 172.21.15.151:0/4141121855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b407c20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8001d90 tx=0x7f7fb8001e80 comp rx=0 tx=0).stop 2024-09-10T14:30:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 -- 172.21.15.151:0/4141121855 shutdown_connections 2024-09-10T14:30:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 --2- 172.21.15.151:0/4141121855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b407c20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 -- 172.21.15.151:0/4141121855 >> 172.21.15.151:0/4141121855 conn(0x55836b290220 msgr2=0x55836b403850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 -- 172.21.15.151:0/4141121855 shutdown_connections 2024-09-10T14:30:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 -- 172.21.15.151:0/4141121855 wait complete. 2024-09-10T14:30:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 Processor -- start 2024-09-10T14:30:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.628+0000 7f7fd317a980 1 -- start start 2024-09-10T14:30:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd317a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b40ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd317a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55836b324090 con 0x55836b31c8d0 2024-09-10T14:30:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd0c8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b40ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd0c8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b40ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50716/0 (socket says 172.21.15.151:50716) 2024-09-10T14:30:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd0c8a640 1 -- 172.21.15.151:0/3116699056 learned_addr learned my addr 172.21.15.151:0/3116699056 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd0c8a640 1 -- 172.21.15.151:0/3116699056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836b40f4d0 con 0x55836b31c8d0 2024-09-10T14:30:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd0c8a640 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b40ef90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55836b408e00 tx=0x7f7fb8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7ebd60a640 1 -- 172.21.15.151:0/3116699056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8027070 con 0x55836b31c8d0 2024-09-10T14:30:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7ebd60a640 1 -- 172.21.15.151:0/3116699056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8019900 con 0x55836b31c8d0 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55836b40f760 con 0x55836b31c8d0 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7ebd60a640 1 -- 172.21.15.151:0/3116699056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8019c20 con 0x55836b31c8d0 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55836b412440 con 0x55836b31c8d0 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd317a980 1 Processor -- start 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd317a980 1 -- start start 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd317a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b41c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd317a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55836b221800 con 0x55836b41bd50 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd148b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b41c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd148b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b41c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50718/0 (socket says 172.21.15.151:50718) 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd148b640 1 -- 172.21.15.151:0/2372107556 learned_addr learned my addr 172.21.15.151:0/2372107556 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7ebd60a640 1 -- 172.21.15.151:0/3116699056 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fb802a070 con 0x55836b31c8d0 2024-09-10T14:30:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7ebd60a640 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7eb8034650 0x7f7eb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7ebd60a640 1 -- 172.21.15.151:0/3116699056 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7fb801f070 con 0x55836b31c8d0 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd148b640 1 -- 172.21.15.151:0/2372107556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836b41c690 con 0x55836b41bd50 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd0c8a640 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7eb8034650 0x7f7eb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd148b640 1 --2- 172.21.15.151:0/2372107556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b41c150 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800a430 tx=0x7f7fc800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3207ab50e2e2af08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.632+0000 7f7fd0c8a640 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7eb8034650 0x7f7eb8036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800d550 tx=0x7f7fb800d460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7eb6ffd640 1 -- 172.21.15.151:0/2372107556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc800f6e0 con 0x55836b41bd50 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7eb6ffd640 1 -- 172.21.15.151:0/2372107556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc8015070 con 0x55836b41bd50 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7eb6ffd640 1 -- 172.21.15.151:0/2372107556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc800fa10 con 0x55836b41bd50 2024-09-10T14:30:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- 172.21.15.151:0/2372107556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 msgr2=0x55836b41c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 --2- 172.21.15.151:0/2372107556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b41c150 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800a430 tx=0x7f7fc800a8f0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- 172.21.15.151:0/2372107556 shutdown_connections 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 --2- 172.21.15.151:0/2372107556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b41c150 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- 172.21.15.151:0/2372107556 >> 172.21.15.151:0/2372107556 conn(0x55836b320c50 msgr2=0x55836b417660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- 172.21.15.151:0/2372107556 shutdown_connections 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- 172.21.15.151:0/2372107556 wait complete. 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 Processor -- start 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- start start 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b423110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55836b41d070 con 0x55836b41bd50 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd148b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b423110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd148b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b423110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50734/0 (socket says 172.21.15.151:50734) 2024-09-10T14:30:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd148b640 1 -- 172.21.15.151:0/1714922448 learned_addr learned my addr 172.21.15.151:0/1714922448 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd148b640 1 -- 172.21.15.151:0/1714922448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836b423650 con 0x55836b41bd50 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd148b640 1 --2- 172.21.15.151:0/1714922448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b423110 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55836b41cb00 tx=0x7f7fc8003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7eb57fa640 1 -- 172.21.15.151:0/1714922448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc800fe00 con 0x55836b41bd50 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- 172.21.15.151:0/1714922448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55836b4238e0 con 0x55836b41bd50 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7eb57fa640 1 -- 172.21.15.151:0/1714922448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc8010a20 con 0x55836b41bd50 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 1 -- 172.21.15.151:0/1714922448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55836b4265c0 con 0x55836b41bd50 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7eb57fa640 1 -- 172.21.15.151:0/1714922448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc8010d80 con 0x55836b41bd50 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7fd317a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.636+0000 7f7eb57fa640 1 -- 172.21.15.151:0/1714922448 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fc801a480 con 0x55836b41bd50 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd317a980 1 Processor -- start 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7eb57fa640 1 --2- 172.21.15.151:0/1714922448 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7ea8034650 0x7f7ea8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd317a980 1 -- start start 2024-09-10T14:30:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7eb57fa640 1 -- 172.21.15.151:0/1714922448 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7fc804a4a0 con 0x55836b41bd50 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd148b640 1 --2- 172.21.15.151:0/1714922448 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7ea8034650 0x7f7ea8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd317a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b43c9a0 0x55836b43cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd317a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55836b408570 con 0x55836b43c9a0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd148b640 1 --2- 172.21.15.151:0/1714922448 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7ea8034650 0x7f7ea8036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8019580 tx=0x7f7fc8025540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd0c8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b43c9a0 0x55836b43cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd0c8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b43c9a0 0x55836b43cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50748/0 (socket says 172.21.15.151:50748) 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd0c8a640 1 -- 172.21.15.151:0/2276519966 learned_addr learned my addr 172.21.15.151:0/2276519966 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd0c8a640 1 -- 172.21.15.151:0/2276519966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55836b43d390 con 0x55836b43c9a0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd0c8a640 1 --2- 172.21.15.151:0/2276519966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b43c9a0 0x55836b43cdc0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8048460 tx=0x7f7fb800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7e957e2640 1 -- 172.21.15.151:0/2276519966 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8016360 con 0x55836b43c9a0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd317a980 1 -- 172.21.15.151:0/2276519966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55836b43ff70 con 0x55836b43c9a0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7e957e2640 1 -- 172.21.15.151:0/2276519966 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8047070 con 0x55836b43c9a0 2024-09-10T14:30:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7e957e2640 1 -- 172.21.15.151:0/2276519966 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb800dc80 con 0x55836b43c9a0 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd317a980 1 -- 172.21.15.151:0/2276519966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55836b440320 con 0x55836b43c9a0 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7e957e2640 1 -- 172.21.15.151:0/2276519966 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fb8016070 con 0x55836b43c9a0 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7e957e2640 1 --2- 172.21.15.151:0/2276519966 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7e0c034650 0x7f7e0c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7e957e2640 1 -- 172.21.15.151:0/2276519966 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7fb8014070 con 0x55836b43c9a0 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd0489640 1 --2- 172.21.15.151:0/2276519966 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7e0c034650 0x7f7e0c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7e16ffd640 20 reqs_thread_entry: start 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55836b442540 0x55836b444930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55836b444f40 con 0x55836b442540 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd0489640 1 --2- 172.21.15.151:0/2276519966 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7e0c034650 0x7f7e0c036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00ad000 tx=0x7f7fc00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.640+0000 7f7fd148b640 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55836b442540 0x55836b444930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd148b640 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55836b442540 0x55836b444930 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd148b640 1 -- 172.21.15.151:0/3116699056 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fc800e070 con 0x55836b442540 2024-09-10T14:30:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55836b4457f0 con 0x55836b442540 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd148b640 1 -- 172.21.15.151:0/3116699056 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fc800e070 con 0x55836b442540 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55836b447100 0x55836b449570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55836b449c60 con 0x55836b447100 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd0c8a640 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55836b447100 0x55836b449570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd0c8a640 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55836b447100 0x55836b449570 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd0c8a640 1 -- 172.21.15.151:0/3116699056 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f7fb8029030 con 0x55836b447100 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/1714922448 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7ea8034650 msgr2=0x7f7ea8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/1714922448 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7ea8034650 0x7f7ea8036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8019580 tx=0x7f7fc8025540 comp rx=0 tx=0).stop 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/1714922448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 msgr2=0x55836b423110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/1714922448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b423110 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x55836b41cb00 tx=0x7f7fc8003380 comp rx=0 tx=0).stop 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/1714922448 shutdown_connections 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/1714922448 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7ea8034650 0x7f7ea8036b10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/1714922448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b41bd50 0x55836b423110 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/1714922448 >> 172.21.15.151:0/1714922448 conn(0x55836b320c50 msgr2=0x55836b417230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/1714922448 shutdown_connections 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/1714922448 wait complete. 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/2276519966 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7e0c034650 msgr2=0x7f7e0c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/2276519966 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7e0c034650 0x7f7e0c036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00ad000 tx=0x7f7fc00a5040 comp rx=0 tx=0).stop 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/2276519966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b43c9a0 msgr2=0x55836b43cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/2276519966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b43c9a0 0x55836b43cdc0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8048460 tx=0x7f7fb800c970 comp rx=0 tx=0).stop 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/2276519966 shutdown_connections 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/2276519966 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7e0c034650 0x7f7e0c036b10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/2276519966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b43c9a0 0x55836b43cdc0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/2276519966 >> 172.21.15.151:0/2276519966 conn(0x55836b431970 msgr2=0x55836b434260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/2276519966 shutdown_connections 2024-09-10T14:30:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/2276519966 wait complete. 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55836b442540 msgr2=0x55836b444930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55836b442540 0x55836b444930 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55836b447100 msgr2=0x55836b449570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55836b447100 0x55836b449570 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7eb8034650 msgr2=0x7f7eb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7eb8034650 0x7f7eb8036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800d550 tx=0x7f7fb800d460 comp rx=0 tx=0).stop 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 msgr2=0x55836b40ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b40ef90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x55836b408e00 tx=0x7f7fb8000bd0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 shutdown_connections 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55836b447100 0x55836b449570 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55836b442540 0x55836b444930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7eb8034650 0x7f7eb8036b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 --2- 172.21.15.151:0/3116699056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55836b31c8d0 0x55836b40ef90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 >> 172.21.15.151:0/3116699056 conn(0x55836b290220 msgr2=0x55836b4023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 shutdown_connections 2024-09-10T14:30:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.644+0000 7f7fd317a980 1 -- 172.21.15.151:0/3116699056 wait complete. 2024-09-10T14:30:39.673 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T14:30:39.674 DEBUG:tasks.util.rgw: json result: {'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T14:30:39.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T14:30:39.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T14:30:39.674 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T14:30:39.750 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:39.750 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:39.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.744+0000 7f798c1ac980 1 Processor -- start 2024-09-10T14:30:39.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.744+0000 7f798c1ac980 1 -- start start 2024-09-10T14:30:39.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.748+0000 7f798c1ac980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55edbc878930 0x55edbc878d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.748+0000 7f798c1ac980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55edbc6feae0 con 0x55edbc879280 2024-09-10T14:30:39.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.748+0000 7f798c1ac980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55edbc722e30 con 0x55edbc878930 2024-09-10T14:30:39.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.748+0000 7f7989cbc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55edbc878930 0x55edbc878d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.748+0000 7f79894bb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55edbc879280 0x55edbc87dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33304/0 (socket says 172.21.15.151:33304) 2024-09-10T14:30:39.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.748+0000 7f79894bb640 1 -- 172.21.15.151:0/1002234163 learned_addr learned my addr 172.21.15.151:0/1002234163 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:30:39.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.748+0000 7f7989cbc640 1 -- 172.21.15.151:0/1002234163 >> v1:172.21.15.52:6789/0 conn(0x55edbc879280 legacy=0x55edbc87dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.748+0000 7f7989cbc640 1 -- 172.21.15.151:0/1002234163 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbc880430 con 0x55edbc878930 2024-09-10T14:30:39.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f7989cbc640 1 --2- 172.21.15.151:0/1002234163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc878d10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f798400a420 tx=0x7f798401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157f8f0efd145f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f7988cba640 1 -- 172.21.15.151:0/1002234163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840af070 con 0x55edbc878930 2024-09-10T14:30:39.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f7988cba640 1 -- 172.21.15.151:0/1002234163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79840aa530 con 0x55edbc878930 2024-09-10T14:30:39.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f7988cba640 1 -- 172.21.15.151:0/1002234163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840aa850 con 0x55edbc878930 2024-09-10T14:30:39.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f798c1ac980 1 -- 172.21.15.151:0/1002234163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 msgr2=0x55edbc878d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f798c1ac980 1 --2- 172.21.15.151:0/1002234163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc878d10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f798400a420 tx=0x7f798401afd0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f798c1ac980 1 -- 172.21.15.151:0/1002234163 shutdown_connections 2024-09-10T14:30:39.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f798c1ac980 1 --2- 172.21.15.151:0/1002234163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc878d10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f798c1ac980 1 -- 172.21.15.151:0/1002234163 >> 172.21.15.151:0/1002234163 conn(0x55edbc7ec1e0 msgr2=0x55edbc7ec5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f798c1ac980 1 -- 172.21.15.151:0/1002234163 shutdown_connections 2024-09-10T14:30:39.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.752+0000 7f798c1ac980 1 -- 172.21.15.151:0/1002234163 wait complete. 2024-09-10T14:30:39.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.764+0000 7f798c1ac980 1 Processor -- start 2024-09-10T14:30:39.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.764+0000 7f798c1ac980 1 -- start start 2024-09-10T14:30:39.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.764+0000 7f798c1ac980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc963ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.764+0000 7f798c1ac980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55edbc724200 con 0x55edbc878930 2024-09-10T14:30:39.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc963ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc963ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50764/0 (socket says 172.21.15.151:50764) 2024-09-10T14:30:39.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 -- 172.21.15.151:0/3239129302 learned_addr learned my addr 172.21.15.151:0/3239129302 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 -- 172.21.15.151:0/3239129302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbc964270 con 0x55edbc878930 2024-09-10T14:30:39.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 --2- 172.21.15.151:0/3239129302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc963ca0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f79840ad040 tx=0x7f79840033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8ec59d64651906 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7877e07640 1 -- 172.21.15.151:0/3239129302 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840af050 con 0x55edbc878930 2024-09-10T14:30:39.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7877e07640 1 -- 172.21.15.151:0/3239129302 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79840b0040 con 0x55edbc878930 2024-09-10T14:30:39.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7877e07640 1 -- 172.21.15.151:0/3239129302 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840aaca0 con 0x55edbc878930 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 -- 172.21.15.151:0/3239129302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 msgr2=0x55edbc963ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 --2- 172.21.15.151:0/3239129302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc963ca0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f79840ad040 tx=0x7f79840033b0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 -- 172.21.15.151:0/3239129302 shutdown_connections 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 --2- 172.21.15.151:0/3239129302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc963ca0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 -- 172.21.15.151:0/3239129302 >> 172.21.15.151:0/3239129302 conn(0x55edbc7ec1e0 msgr2=0x55edbc95f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 -- 172.21.15.151:0/3239129302 shutdown_connections 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 -- 172.21.15.151:0/3239129302 wait complete. 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 Processor -- start 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 -- start start 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc96af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f798c1ac980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55edbc87fe70 con 0x55edbc878930 2024-09-10T14:30:39.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc96af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc96af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50766/0 (socket says 172.21.15.151:50766) 2024-09-10T14:30:39.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 -- 172.21.15.151:0/2626505011 learned_addr learned my addr 172.21.15.151:0/2626505011 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 -- 172.21.15.151:0/2626505011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbc96b4d0 con 0x55edbc878930 2024-09-10T14:30:39.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7989cbc640 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc96af90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7984019680 tx=0x7f7984019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.768+0000 7f7876604640 1 -- 172.21.15.151:0/2626505011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840c5070 con 0x55edbc878930 2024-09-10T14:30:39.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edbc96b760 con 0x55edbc878930 2024-09-10T14:30:39.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edbc96e440 con 0x55edbc878930 2024-09-10T14:30:39.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f7876604640 1 -- 172.21.15.151:0/2626505011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79840b6d60 con 0x55edbc878930 2024-09-10T14:30:39.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f7876604640 1 -- 172.21.15.151:0/2626505011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840c15f0 con 0x55edbc878930 2024-09-10T14:30:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 Processor -- start 2024-09-10T14:30:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- start start 2024-09-10T14:30:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc978130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55edbc77d800 con 0x55edbc977d30 2024-09-10T14:30:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798a4bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc978130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f7876604640 1 -- 172.21.15.151:0/2626505011 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79840c8070 con 0x55edbc878930 2024-09-10T14:30:39.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798a4bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc978130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50776/0 (socket says 172.21.15.151:50776) 2024-09-10T14:30:39.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798a4bd640 1 -- 172.21.15.151:0/1132735504 learned_addr learned my addr 172.21.15.151:0/1132735504 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f7876604640 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7870034650 0x7f7870036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f7876604640 1 -- 172.21.15.151:0/2626505011 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f79840bb070 con 0x55edbc878930 2024-09-10T14:30:39.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f7989cbc640 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7870034650 0x7f7870036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798a4bd640 1 -- 172.21.15.151:0/1132735504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbc978670 con 0x55edbc977d30 2024-09-10T14:30:39.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f7989cbc640 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7870034650 0x7f7870036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f79840a3c50 tx=0x7f79840cc040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798a4bd640 1 --2- 172.21.15.151:0/1132735504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc978130 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f797c00a440 tx=0x7f797c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8ee6440d25219d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f786ffff640 1 -- 172.21.15.151:0/1132735504 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f797c008850 con 0x55edbc977d30 2024-09-10T14:30:39.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f786ffff640 1 -- 172.21.15.151:0/1132735504 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797c008a10 con 0x55edbc977d30 2024-09-10T14:30:39.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f786ffff640 1 -- 172.21.15.151:0/1132735504 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f797c008d30 con 0x55edbc977d30 2024-09-10T14:30:39.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- 172.21.15.151:0/1132735504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 msgr2=0x55edbc978130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 --2- 172.21.15.151:0/1132735504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc978130 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f797c00a440 tx=0x7f797c00a900 comp rx=0 tx=0).stop 2024-09-10T14:30:39.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- 172.21.15.151:0/1132735504 shutdown_connections 2024-09-10T14:30:39.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 --2- 172.21.15.151:0/1132735504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc978130 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- 172.21.15.151:0/1132735504 >> 172.21.15.151:0/1132735504 conn(0x55edbc879280 msgr2=0x55edbc973640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- 172.21.15.151:0/1132735504 shutdown_connections 2024-09-10T14:30:39.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- 172.21.15.151:0/1132735504 wait complete. 2024-09-10T14:30:39.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 Processor -- start 2024-09-10T14:30:39.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- start start 2024-09-10T14:30:39.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc97f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798c1ac980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55edbc978900 con 0x55edbc977d30 2024-09-10T14:30:39.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798a4bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc97f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798a4bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc97f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50784/0 (socket says 172.21.15.151:50784) 2024-09-10T14:30:39.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.772+0000 7f798a4bd640 1 -- 172.21.15.151:0/1944804423 learned_addr learned my addr 172.21.15.151:0/1944804423 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798a4bd640 1 -- 172.21.15.151:0/1944804423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbc97f5b0 con 0x55edbc977d30 2024-09-10T14:30:39.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798a4bd640 1 --2- 172.21.15.151:0/1944804423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc97f070 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55edbc978ae0 tx=0x7f797c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f786e7fc640 1 -- 172.21.15.151:0/1944804423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f797c013a70 con 0x55edbc977d30 2024-09-10T14:30:39.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798c1ac980 1 -- 172.21.15.151:0/1944804423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edbc97f840 con 0x55edbc977d30 2024-09-10T14:30:39.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f786e7fc640 1 -- 172.21.15.151:0/1944804423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797c023070 con 0x55edbc977d30 2024-09-10T14:30:39.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798c1ac980 1 -- 172.21.15.151:0/1944804423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edbc982520 con 0x55edbc977d30 2024-09-10T14:30:39.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f786e7fc640 1 -- 172.21.15.151:0/1944804423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f797c013d40 con 0x55edbc977d30 2024-09-10T14:30:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798c1ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798c1ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f786e7fc640 1 -- 172.21.15.151:0/1944804423 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f797c028460 con 0x55edbc977d30 2024-09-10T14:30:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f786e7fc640 1 --2- 172.21.15.151:0/1944804423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7864034650 0x7f7864036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798c1ac980 1 Processor -- start 2024-09-10T14:30:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f786e7fc640 1 -- 172.21.15.151:0/1944804423 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f797c04a110 con 0x55edbc977d30 2024-09-10T14:30:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798a4bd640 1 --2- 172.21.15.151:0/1944804423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7864034650 0x7f7864036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798c1ac980 1 -- start start 2024-09-10T14:30:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798c1ac980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc998930 0x55edbc998d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798c1ac980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55edbc964530 con 0x55edbc998930 2024-09-10T14:30:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f798a4bd640 1 --2- 172.21.15.151:0/1944804423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7864034650 0x7f7864036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f797c011ac0 tx=0x7f797c011950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f7989cbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc998930 0x55edbc998d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f7989cbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc998930 0x55edbc998d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50798/0 (socket says 172.21.15.151:50798) 2024-09-10T14:30:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f7989cbc640 1 -- 172.21.15.151:0/2343307247 learned_addr learned my addr 172.21.15.151:0/2343307247 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f7989cbc640 1 -- 172.21.15.151:0/2343307247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbc999320 con 0x55edbc998930 2024-09-10T14:30:39.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.776+0000 7f7989cbc640 1 --2- 172.21.15.151:0/2343307247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc998930 0x55edbc998d50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f798401ae00 tx=0x7f79840a3b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f784e7e4640 1 -- 172.21.15.151:0/2343307247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840da070 con 0x55edbc998930 2024-09-10T14:30:39.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798c1ac980 1 -- 172.21.15.151:0/2343307247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edbc99be80 con 0x55edbc998930 2024-09-10T14:30:39.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798c1ac980 1 -- 172.21.15.151:0/2343307247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edbc99c280 con 0x55edbc998930 2024-09-10T14:30:39.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f784e7e4640 1 -- 172.21.15.151:0/2343307247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79840e3370 con 0x55edbc998930 2024-09-10T14:30:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f784e7e4640 1 -- 172.21.15.151:0/2343307247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840f2060 con 0x55edbc998930 2024-09-10T14:30:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f784e7e4640 1 -- 172.21.15.151:0/2343307247 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f79840c0720 con 0x55edbc998930 2024-09-10T14:30:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f784e7e4640 1 --2- 172.21.15.151:0/2343307247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f77cc034650 0x7f77cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f784e7e4640 1 -- 172.21.15.151:0/2343307247 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f79840d60e0 con 0x55edbc998930 2024-09-10T14:30:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f79894bb640 1 --2- 172.21.15.151:0/2343307247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f77cc034650 0x7f77cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f77bffff640 20 reqs_thread_entry: start 2024-09-10T14:30:39.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55edbc99e440 0x55edbc9a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55edbc9a0f00 con 0x55edbc99e440 2024-09-10T14:30:39.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798a4bd640 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55edbc99e440 0x55edbc9a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f79894bb640 1 --2- 172.21.15.151:0/2343307247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f77cc034650 0x7f77cc036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7980000f70 tx=0x7f7980001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798a4bd640 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55edbc99e440 0x55edbc9a0830 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798a4bd640 1 -- 172.21.15.151:0/2626505011 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f797c01e4a0 con 0x55edbc99e440 2024-09-10T14:30:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55edbc9a2cd0 0x55edbc9a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:2 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55edbc9a5710 con 0x55edbc9a2cd0 2024-09-10T14:30:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f7989cbc640 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55edbc9a2cd0 0x55edbc9a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f7989cbc640 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55edbc9a2cd0 0x55edbc9a50c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f7989cbc640 1 -- 172.21.15.151:0/2626505011 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(2 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f79840eb070 con 0x55edbc9a2cd0 2024-09-10T14:30:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.780+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55edbc9aa540 con 0x55edbc9a2cd0 2024-09-10T14:30:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f7989cbc640 1 -- 172.21.15.151:0/2626505011 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [stat,call,call,writefull 0~993] v36'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f79840eb070 con 0x55edbc9a2cd0 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/1944804423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7864034650 msgr2=0x7f7864036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/1944804423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7864034650 0x7f7864036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f797c011ac0 tx=0x7f797c011950 comp rx=0 tx=0).stop 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/1944804423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 msgr2=0x55edbc97f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/1944804423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc97f070 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55edbc978ae0 tx=0x7f797c003000 comp rx=0 tx=0).stop 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/1944804423 shutdown_connections 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/1944804423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7864034650 0x7f7864036b10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/1944804423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc977d30 0x55edbc97f070 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/1944804423 >> 172.21.15.151:0/1944804423 conn(0x55edbc879280 msgr2=0x55edbc9731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/1944804423 shutdown_connections 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/1944804423 wait complete. 2024-09-10T14:30:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2343307247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f77cc034650 msgr2=0x7f77cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2343307247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f77cc034650 0x7f77cc036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7980000f70 tx=0x7f7980001240 comp rx=0 tx=0).stop 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2343307247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc998930 msgr2=0x55edbc998d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2343307247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc998930 0x55edbc998d50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f798401ae00 tx=0x7f79840a3b00 comp rx=0 tx=0).stop 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2343307247 shutdown_connections 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2343307247 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f77cc034650 0x7f77cc036b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2343307247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc998930 0x55edbc998d50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2343307247 >> 172.21.15.151:0/2343307247 conn(0x55edbc98d960 msgr2=0x55edbc990250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2343307247 shutdown_connections 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2343307247 wait complete. 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55edbc99e440 msgr2=0x55edbc9a0830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55edbc99e440 0x55edbc9a0830 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55edbc9a2cd0 msgr2=0x55edbc9a50c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55edbc9a2cd0 0x55edbc9a50c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7870034650 msgr2=0x7f7870036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7870034650 0x7f7870036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f79840a3c50 tx=0x7f79840cc040 comp rx=0 tx=0).stop 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 msgr2=0x55edbc96af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc96af90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7984019680 tx=0x7f7984019810 comp rx=0 tx=0).stop 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 shutdown_connections 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55edbc9a2cd0 0x55edbc9a50c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55edbc99e440 0x55edbc9a0830 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7870034650 0x7f7870036b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 --2- 172.21.15.151:0/2626505011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edbc878930 0x55edbc96af90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 >> 172.21.15.151:0/2626505011 conn(0x55edbc7ec1e0 msgr2=0x55edbc95e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 shutdown_connections 2024-09-10T14:30:39.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.784+0000 7f798c1ac980 1 -- 172.21.15.151:0/2626505011 wait complete. 2024-09-10T14:30:39.809 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T14:30:39.810 DEBUG:tasks.util.rgw: json result: {'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T14:30:39.810 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-10T14:30:39.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-10T14:30:39.810 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-10T14:30:39.876 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:39.876 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:39.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f718a1f7980 1 Processor -- start 2024-09-10T14:30:39.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f718a1f7980 1 -- start start 2024-09-10T14:30:39.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f718a1f7980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c953592530 0x55c953592910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f718a1f7980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c95341bae0 con 0x55c953592e80 2024-09-10T14:30:39.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f718a1f7980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55c95343fe30 con 0x55c953592530 2024-09-10T14:30:39.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f7187d07640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c953592530 0x55c953592910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f7187d07640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c953592530 0x55c953592910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50806/0 (socket says 172.21.15.151:50806) 2024-09-10T14:30:39.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f7187d07640 1 -- 172.21.15.151:0/907428639 learned_addr learned my addr 172.21.15.151:0/907428639 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f7187d07640 1 -- 172.21.15.151:0/907428639 >> v1:172.21.15.52:6789/0 conn(0x55c953592e80 legacy=0x55c953597900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.872+0000 7f7187d07640 1 -- 172.21.15.151:0/907428639 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95359a150 con 0x55c953592530 2024-09-10T14:30:39.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f7187d07640 1 --2- 172.21.15.151:0/907428639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953592910 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f717800a5c0 tx=0x7f717801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9793ff600c7858c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f7187506640 1 -- 172.21.15.151:0/907428639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71780a6070 con 0x55c953592530 2024-09-10T14:30:39.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f7187506640 1 -- 172.21.15.151:0/907428639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71780af070 con 0x55c953592530 2024-09-10T14:30:39.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f7187506640 1 -- 172.21.15.151:0/907428639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71780aa5c0 con 0x55c953592530 2024-09-10T14:30:39.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f718a1f7980 1 -- 172.21.15.151:0/907428639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 msgr2=0x55c953592910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f718a1f7980 1 --2- 172.21.15.151:0/907428639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953592910 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f717800a5c0 tx=0x7f717801b340 comp rx=0 tx=0).stop 2024-09-10T14:30:39.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f718a1f7980 1 -- 172.21.15.151:0/907428639 shutdown_connections 2024-09-10T14:30:39.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f718a1f7980 1 --2- 172.21.15.151:0/907428639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953592910 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f718a1f7980 1 -- 172.21.15.151:0/907428639 >> 172.21.15.151:0/907428639 conn(0x55c95358e050 msgr2=0x55c953590470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f718a1f7980 1 -- 172.21.15.151:0/907428639 shutdown_connections 2024-09-10T14:30:39.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.876+0000 7f718a1f7980 1 -- 172.21.15.151:0/907428639 wait complete. 2024-09-10T14:30:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.888+0000 7f718a1f7980 1 Processor -- start 2024-09-10T14:30:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.888+0000 7f718a1f7980 1 -- start start 2024-09-10T14:30:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.888+0000 7f718a1f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c9535073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.888+0000 7f718a1f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c953441200 con 0x55c953592530 2024-09-10T14:30:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c9535073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c9535073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50814/0 (socket says 172.21.15.151:50814) 2024-09-10T14:30:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 -- 172.21.15.151:0/2926094400 learned_addr learned my addr 172.21.15.151:0/2926094400 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 -- 172.21.15.151:0/2926094400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9535079a0 con 0x55c953592530 2024-09-10T14:30:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 --2- 172.21.15.151:0/2926094400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c9535073d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f717800a5c0 tx=0x7f7178003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29fbe9960b86949 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7075e0b640 1 -- 172.21.15.151:0/2926094400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71780aa9b0 con 0x55c953592530 2024-09-10T14:30:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7075e0b640 1 -- 172.21.15.151:0/2926094400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71780aab50 con 0x55c953592530 2024-09-10T14:30:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7075e0b640 1 -- 172.21.15.151:0/2926094400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71780aae50 con 0x55c953592530 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- 172.21.15.151:0/2926094400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 msgr2=0x55c9535073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 --2- 172.21.15.151:0/2926094400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c9535073d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f717800a5c0 tx=0x7f7178003030 comp rx=0 tx=0).stop 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- 172.21.15.151:0/2926094400 shutdown_connections 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 --2- 172.21.15.151:0/2926094400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c9535073d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- 172.21.15.151:0/2926094400 >> 172.21.15.151:0/2926094400 conn(0x55c95358e050 msgr2=0x55c9536795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- 172.21.15.151:0/2926094400 shutdown_connections 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- 172.21.15.151:0/2926094400 wait complete. 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 Processor -- start 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- start start 2024-09-10T14:30:39.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953687e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c953599b90 con 0x55c953592530 2024-09-10T14:30:39.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953687e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953687e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50826/0 (socket says 172.21.15.151:50826) 2024-09-10T14:30:39.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 -- 172.21.15.151:0/754734205 learned_addr learned my addr 172.21.15.151:0/754734205 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 -- 172.21.15.151:0/754734205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9536883c0 con 0x55c953592530 2024-09-10T14:30:39.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f7187d07640 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953687e80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f717801bbe0 tx=0x7f71780180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f706ffff640 1 -- 172.21.15.151:0/754734205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71780c6750 con 0x55c953592530 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c953688650 con 0x55c953592530 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f706ffff640 1 -- 172.21.15.151:0/754734205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71780c68f0 con 0x55c953592530 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c95368b330 con 0x55c953592530 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.892+0000 7f706ffff640 1 -- 172.21.15.151:0/754734205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71780c6bd0 con 0x55c953592530 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 Processor -- start 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- start start 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c953695040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c95349a800 con 0x55c953694c40 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c953695040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c953695040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50832/0 (socket says 172.21.15.151:50832) 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 -- 172.21.15.151:0/1351683373 learned_addr learned my addr 172.21.15.151:0/1351683373 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f706ffff640 1 -- 172.21.15.151:0/754734205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f71780ce020 con 0x55c953592530 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f706ffff640 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f70700346a0 0x7f7070036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f706ffff640 1 -- 172.21.15.151:0/754734205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f71780cc020 con 0x55c953592530 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 -- 172.21.15.151:0/1351683373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c953695580 con 0x55c953694c40 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7187d07640 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f70700346a0 0x7f7070036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 --2- 172.21.15.151:0/1351683373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c953695040 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f718000a430 tx=0x7f718000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e86db4dd536bcb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7187d07640 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f70700346a0 0x7f7070036b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f71780abfb0 tx=0x7f71780c7e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f706dffb640 1 -- 172.21.15.151:0/1351683373 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f718000f6e0 con 0x55c953694c40 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f706dffb640 1 -- 172.21.15.151:0/1351683373 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7180015070 con 0x55c953694c40 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f706dffb640 1 -- 172.21.15.151:0/1351683373 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f718000fa10 con 0x55c953694c40 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- 172.21.15.151:0/1351683373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 msgr2=0x55c953695040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 --2- 172.21.15.151:0/1351683373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c953695040 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f718000a430 tx=0x7f718000a8f0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- 172.21.15.151:0/1351683373 shutdown_connections 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 --2- 172.21.15.151:0/1351683373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c953695040 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- 172.21.15.151:0/1351683373 >> 172.21.15.151:0/1351683373 conn(0x55c953592e80 msgr2=0x55c953690550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- 172.21.15.151:0/1351683373 shutdown_connections 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- 172.21.15.151:0/1351683373 wait complete. 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 Processor -- start 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- start start 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c95369c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f718a1f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c953695f60 con 0x55c953694c40 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c95369c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c95369c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50844/0 (socket says 172.21.15.151:50844) 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 -- 172.21.15.151:0/2110675289 learned_addr learned my addr 172.21.15.151:0/2110675289 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.896+0000 7f7188508640 1 -- 172.21.15.151:0/2110675289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95369c580 con 0x55c953694c40 2024-09-10T14:30:39.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7188508640 1 --2- 172.21.15.151:0/2110675289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c95369c040 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55c9536959f0 tx=0x7f7180003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7067fff640 1 -- 172.21.15.151:0/2110675289 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f718000fe00 con 0x55c953694c40 2024-09-10T14:30:39.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f718a1f7980 1 -- 172.21.15.151:0/2110675289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c95369c810 con 0x55c953694c40 2024-09-10T14:30:39.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7067fff640 1 -- 172.21.15.151:0/2110675289 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7180010a20 con 0x55c953694c40 2024-09-10T14:30:39.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7067fff640 1 -- 172.21.15.151:0/2110675289 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7180010d80 con 0x55c953694c40 2024-09-10T14:30:39.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f718a1f7980 1 -- 172.21.15.151:0/2110675289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c95369f4f0 con 0x55c953694c40 2024-09-10T14:30:39.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f718a1f7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f718a1f7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7067fff640 1 -- 172.21.15.151:0/2110675289 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f718001a480 con 0x55c953694c40 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7067fff640 1 --2- 172.21.15.151:0/2110675289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7060034650 0x7f7060036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f718a1f7980 1 Processor -- start 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7067fff640 1 -- 172.21.15.151:0/2110675289 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f718004a500 con 0x55c953694c40 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7188508640 1 --2- 172.21.15.151:0/2110675289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7060034650 0x7f7060036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f718a1f7980 1 -- start start 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f718a1f7980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9536b58c0 0x55c9536b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f718a1f7980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c953507c60 con 0x55c9536b58c0 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7188508640 1 --2- 172.21.15.151:0/2110675289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7060034650 0x7f7060036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f718002efd0 tx=0x7f718001be90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7187d07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9536b58c0 0x55c9536b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7187d07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9536b58c0 0x55c9536b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50860/0 (socket says 172.21.15.151:50860) 2024-09-10T14:30:39.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7187d07640 1 -- 172.21.15.151:0/987541923 learned_addr learned my addr 172.21.15.151:0/987541923 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7187d07640 1 -- 172.21.15.151:0/987541923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9536b62b0 con 0x55c9536b58c0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f7187d07640 1 --2- 172.21.15.151:0/987541923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9536b58c0 0x55c9536b5ce0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f71780e37f0 tx=0x7f71780e3780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.900+0000 7f6fdffff640 1 -- 172.21.15.151:0/987541923 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71780f5070 con 0x55c9536b58c0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f718a1f7980 1 -- 172.21.15.151:0/987541923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9536b8eb0 con 0x55c9536b58c0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f6fdffff640 1 -- 172.21.15.151:0/987541923 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71780e0040 con 0x55c9536b58c0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f6fdffff640 1 -- 172.21.15.151:0/987541923 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71780b3650 con 0x55c9536b58c0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f718a1f7980 1 -- 172.21.15.151:0/987541923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9536b9260 con 0x55c9536b58c0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f6fdffff640 1 -- 172.21.15.151:0/987541923 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f71780f8070 con 0x55c9536b58c0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f6fdffff640 1 --2- 172.21.15.151:0/987541923 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6fc0034650 0x7f6fc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f6fdffff640 1 -- 172.21.15.151:0/987541923 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f71780ec030 con 0x55c9536b58c0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f717f506640 1 --2- 172.21.15.151:0/987541923 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6fc0034650 0x7f6fc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f6fddffb640 20 reqs_thread_entry: start 2024-09-10T14:30:39.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9536bb480 0x55c9536bd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9536bded0 con 0x55c9536bb480 2024-09-10T14:30:39.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f717f506640 1 --2- 172.21.15.151:0/987541923 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6fc0034650 0x7f6fc0036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7170000f70 tx=0x7f71700013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f7188508640 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9536bb480 0x55c9536bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f7188508640 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9536bb480 0x55c9536bd870 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f7188508640 1 -- 172.21.15.151:0/754734205 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f718000e070 con 0x55c9536bb480 2024-09-10T14:30:39.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9536be780 con 0x55c9536bb480 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f7188508640 1 -- 172.21.15.151:0/754734205 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f718000e070 con 0x55c9536bb480 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9536c0040 0x55c9536c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:3 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c9536c2bf0 con 0x55c9536c0040 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f7187d07640 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9536c0040 0x55c9536c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.904+0000 7f7187d07640 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9536c0040 0x55c9536c2500 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f7187d07640 1 -- 172.21.15.151:0/754734205 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(3 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f71780f7030 con 0x55c9536c0040 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/2110675289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7060034650 msgr2=0x7f7060036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/2110675289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7060034650 0x7f7060036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f718002efd0 tx=0x7f718001be90 comp rx=0 tx=0).stop 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/2110675289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 msgr2=0x55c95369c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/2110675289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c95369c040 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55c9536959f0 tx=0x7f7180003380 comp rx=0 tx=0).stop 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/2110675289 shutdown_connections 2024-09-10T14:30:39.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/2110675289 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7060034650 0x7f7060036b10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/2110675289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953694c40 0x55c95369c040 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/2110675289 >> 172.21.15.151:0/2110675289 conn(0x55c953592e80 msgr2=0x55c953690120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/2110675289 shutdown_connections 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/2110675289 wait complete. 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/987541923 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6fc0034650 msgr2=0x7f6fc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/987541923 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6fc0034650 0x7f6fc0036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7170000f70 tx=0x7f71700013a0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/987541923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9536b58c0 msgr2=0x55c9536b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/987541923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9536b58c0 0x55c9536b5ce0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f71780e37f0 tx=0x7f71780e3780 comp rx=0 tx=0).stop 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/987541923 shutdown_connections 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/987541923 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6fc0034650 0x7f6fc0036b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/987541923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9536b58c0 0x55c9536b5ce0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/987541923 >> 172.21.15.151:0/987541923 conn(0x55c9536aa890 msgr2=0x55c9536ad180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/987541923 shutdown_connections 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/987541923 wait complete. 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9536c0040 msgr2=0x55c9536c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9536c0040 0x55c9536c2500 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9536bb480 msgr2=0x55c9536bd870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9536bb480 0x55c9536bd870 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f70700346a0 msgr2=0x7f7070036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f70700346a0 0x7f7070036b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f71780abfb0 tx=0x7f71780c7e70 comp rx=0 tx=0).stop 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 msgr2=0x55c953687e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953687e80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f717801bbe0 tx=0x7f71780180e0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 shutdown_connections 2024-09-10T14:30:39.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c9536c0040 0x55c9536c2500 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c9536bb480 0x55c9536bd870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f70700346a0 0x7f7070036b60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 --2- 172.21.15.151:0/754734205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c953592530 0x55c953687e80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:39.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 >> 172.21.15.151:0/754734205 conn(0x55c95358e050 msgr2=0x55c953678120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:39.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 shutdown_connections 2024-09-10T14:30:39.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.908+0000 7f718a1f7980 1 -- 172.21.15.151:0/754734205 wait complete. 2024-09-10T14:30:39.922 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"58a4d2fa-bc9c-4537-a4ac-e71f7240f583","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"83ac83e0-59cd-4326-be92-5c5921f5e4a6","zones":[{"id":"83ac83e0-59cd-4326-be92-5c5921f5e4a6","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-10T14:30:39.922 DEBUG:tasks.util.rgw: json result: {'id': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '83ac83e0-59cd-4326-be92-5c5921f5e4a6', 'zones': [{'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-10T14:30:39.925 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-10T14:30:39.944 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T14:30:39.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T14:30:39.945 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-10T14:30:40.000 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:40.000 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:40.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0703746980 1 Processor -- start 2024-09-10T14:30:40.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0703746980 1 -- start start 2024-09-10T14:30:40.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0703746980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a98c1c6c00 0x55a98c1c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0703746980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a98c048ae0 con 0x55a98c1c2880 2024-09-10T14:30:40.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0703746980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55a98c06ce30 con 0x55a98c1c6c00 2024-09-10T14:30:40.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0700a55640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55a98c1c6c00 0x55a98c1c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0701256640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55a98c1c2880 0x55a98c1c2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33334/0 (socket says 172.21.15.151:33334) 2024-09-10T14:30:40.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0701256640 1 -- 172.21.15.151:0/2804084242 learned_addr learned my addr 172.21.15.151:0/2804084242 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:30:40.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0700a55640 1 --2- 172.21.15.151:0/2804084242 >> v2:172.21.15.52:3300/0 conn(0x55a98c1c6c00 0x55a98c1c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50868/0 (socket says 172.21.15.151:50868) 2024-09-10T14:30:40.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0700a55640 1 -- 172.21.15.151:0/2804084242 >> v1:172.21.15.52:6789/0 conn(0x55a98c1c2880 legacy=0x55a98c1c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:39.996+0000 7f0700a55640 1 -- 172.21.15.151:0/2804084242 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98c1ca540 con 0x55a98c1c6c00 2024-09-10T14:30:40.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f0700a55640 1 --2- 172.21.15.151:0/2804084242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c6c00 0x55a98c1c8ff0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f06f800a480 tx=0x7f06f801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5490d87590a40fce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f06f3fff640 1 -- 172.21.15.151:0/2804084242 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f80b0070 con 0x55a98c1c6c00 2024-09-10T14:30:40.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f06f3fff640 1 -- 172.21.15.151:0/2804084242 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f80ab540 con 0x55a98c1c6c00 2024-09-10T14:30:40.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f06f3fff640 1 -- 172.21.15.151:0/2804084242 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f80ab840 con 0x55a98c1c6c00 2024-09-10T14:30:40.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f0703746980 1 -- 172.21.15.151:0/2804084242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c6c00 msgr2=0x55a98c1c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f0703746980 1 --2- 172.21.15.151:0/2804084242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c6c00 0x55a98c1c8ff0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f06f800a480 tx=0x7f06f801b280 comp rx=0 tx=0).stop 2024-09-10T14:30:40.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f0703746980 1 -- 172.21.15.151:0/2804084242 shutdown_connections 2024-09-10T14:30:40.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f0703746980 1 --2- 172.21.15.151:0/2804084242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c6c00 0x55a98c1c8ff0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f0703746980 1 -- 172.21.15.151:0/2804084242 >> 172.21.15.151:0/2804084242 conn(0x55a98c1361d0 msgr2=0x55a98c1365e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f0703746980 1 -- 172.21.15.151:0/2804084242 shutdown_connections 2024-09-10T14:30:40.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.000+0000 7f0703746980 1 -- 172.21.15.151:0/2804084242 wait complete. 2024-09-10T14:30:40.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.012+0000 7f0703746980 1 Processor -- start 2024-09-10T14:30:40.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.012+0000 7f0703746980 1 -- start start 2024-09-10T14:30:40.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.012+0000 7f0703746980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.012+0000 7f0703746980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a98c06e200 con 0x55a98c1c2880 2024-09-10T14:30:40.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.012+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.012+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50874/0 (socket says 172.21.15.151:50874) 2024-09-10T14:30:40.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.012+0000 7f0701256640 1 -- 172.21.15.151:0/1823617925 learned_addr learned my addr 172.21.15.151:0/1823617925 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0701256640 1 -- 172.21.15.151:0/1823617925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98c2ae2c0 con 0x55a98c1c2880 2024-09-10T14:30:40.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0701256640 1 --2- 172.21.15.151:0/1823617925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2adcf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f06f4001d90 tx=0x7f06f4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e7a78c2db6dbb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f05ef606640 1 -- 172.21.15.151:0/1823617925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4013030 con 0x55a98c1c2880 2024-09-10T14:30:40.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f05ef606640 1 -- 172.21.15.151:0/1823617925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f400e690 con 0x55a98c1c2880 2024-09-10T14:30:40.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f05ef606640 1 -- 172.21.15.151:0/1823617925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f400ea10 con 0x55a98c1c2880 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- 172.21.15.151:0/1823617925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 msgr2=0x55a98c2adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 --2- 172.21.15.151:0/1823617925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2adcf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f06f4001d90 tx=0x7f06f4001e80 comp rx=0 tx=0).stop 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- 172.21.15.151:0/1823617925 shutdown_connections 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 --2- 172.21.15.151:0/1823617925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2adcf0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- 172.21.15.151:0/1823617925 >> 172.21.15.151:0/1823617925 conn(0x55a98c1361d0 msgr2=0x55a98c2a9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- 172.21.15.151:0/1823617925 shutdown_connections 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- 172.21.15.151:0/1823617925 wait complete. 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 Processor -- start 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- start start 2024-09-10T14:30:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a98c1ca040 con 0x55a98c1c2880 2024-09-10T14:30:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50882/0 (socket says 172.21.15.151:50882) 2024-09-10T14:30:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0701256640 1 -- 172.21.15.151:0/3201953279 learned_addr learned my addr 172.21.15.151:0/3201953279 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0701256640 1 -- 172.21.15.151:0/3201953279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98c2b5600 con 0x55a98c1c2880 2024-09-10T14:30:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0701256640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2b50c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55a98c2aeed0 tx=0x7f06f4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f05ede03640 1 -- 172.21.15.151:0/3201953279 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4027070 con 0x55a98c1c2880 2024-09-10T14:30:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a98c2b5890 con 0x55a98c1c2880 2024-09-10T14:30:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f05ede03640 1 -- 172.21.15.151:0/3201953279 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f4019900 con 0x55a98c1c2880 2024-09-10T14:30:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a98c2b8570 con 0x55a98c1c2880 2024-09-10T14:30:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.016+0000 7f05ede03640 1 -- 172.21.15.151:0/3201953279 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4019be0 con 0x55a98c1c2880 2024-09-10T14:30:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f05ede03640 1 -- 172.21.15.151:0/3201953279 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06f402a070 con 0x55a98c1c2880 2024-09-10T14:30:40.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f05ede03640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05e8034650 0x7f05e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f05ede03640 1 -- 172.21.15.151:0/3201953279 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f06f401f070 con 0x55a98c1c2880 2024-09-10T14:30:40.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0700a55640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05e8034650 0x7f05e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0703746980 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c1c6c00 0x55a98c2bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2bc6f0 con 0x55a98c1c6c00 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0701a57640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c1c6c00 0x55a98c2bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0700a55640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05e8034650 0x7f05e8036b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f06f80ad000 tx=0x7f06f80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0701a57640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c1c6c00 0x55a98c2bc0b0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0701a57640 1 -- 172.21.15.151:0/3201953279 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c1c6c00 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2b9790 con 0x55a98c1c6c00 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0701a57640 1 -- 172.21.15.151:0/3201953279 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c1c6c00 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0703746980 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2bea70 0x55a98c2c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2c1530 con 0x55a98c2bea70 2024-09-10T14:30:40.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0701256640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2bea70 0x55a98c2c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0701256640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2bea70 0x55a98c2c0e60 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0701256640 1 -- 172.21.15.151:0/3201953279 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06f4029030 con 0x55a98c2bea70 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2bd910 con 0x55a98c1c6c00 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0701a57640 1 -- 172.21.15.151:0/3201953279 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c1c6c00 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0703746980 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a98c2c2970 0x55a98c2c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2c54f0 con 0x55a98c2c2970 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.020+0000 7f0700a55640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a98c2c2970 0x55a98c2c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0700a55640 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a98c2c2970 0x55a98c2c4d60 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0700a55640 1 -- 172.21.15.151:0/3201953279 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06f80b3040 con 0x55a98c2c2970 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0703746980 1 Processor -- start 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0703746980 1 -- start start 2024-09-10T14:30:40.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0703746980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2d2f40 0x55a98c2d3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0703746980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a98c0c7800 con 0x55a98c2d2f40 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2d2f40 0x55a98c2d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2d2f40 0x55a98c2d3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50886/0 (socket says 172.21.15.151:50886) 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0701256640 1 -- 172.21.15.151:0/1070748646 learned_addr learned my addr 172.21.15.151:0/1070748646 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0701256640 1 -- 172.21.15.151:0/1070748646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98c2d38a0 con 0x55a98c2d2f40 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0701256640 1 --2- 172.21.15.151:0/1070748646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2d2f40 0x55a98c2d3360 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f06f4001400 tx=0x7f06f4041e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f05e6ffd640 1 -- 172.21.15.151:0/1070748646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4017900 con 0x55a98c2d2f40 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0703746980 1 -- 172.21.15.151:0/1070748646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a98c2d3b30 con 0x55a98c2d2f40 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f0703746980 1 -- 172.21.15.151:0/1070748646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a98c2d67b0 con 0x55a98c2d2f40 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f05e6ffd640 1 -- 172.21.15.151:0/1070748646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f4022410 con 0x55a98c2d2f40 2024-09-10T14:30:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.024+0000 7f05e6ffd640 1 -- 172.21.15.151:0/1070748646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4041350 con 0x55a98c2d2f40 2024-09-10T14:30:40.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f05e6ffd640 1 -- 172.21.15.151:0/1070748646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06f404c030 con 0x55a98c2d2f40 2024-09-10T14:30:40.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f05e6ffd640 1 --2- 172.21.15.151:0/1070748646 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05d8034650 0x7f05d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f05e6ffd640 1 -- 172.21.15.151:0/1070748646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f06f4037040 con 0x55a98c2d2f40 2024-09-10T14:30:40.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0700a55640 1 --2- 172.21.15.151:0/1070748646 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05d8034650 0x7f05d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 Processor -- start 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- start start 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0700a55640 1 --2- 172.21.15.151:0/1070748646 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05d8034650 0x7f05d8036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f06f801b2c0 tx=0x7f06f8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a98c2ae640 con 0x55a98c2df810 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2dfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50894/0 (socket says 172.21.15.151:50894) 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0701256640 1 -- 172.21.15.151:0/679991558 learned_addr learned my addr 172.21.15.151:0/679991558 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0701256640 1 -- 172.21.15.151:0/679991558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98c2e01c0 con 0x55a98c2df810 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0701256640 1 --2- 172.21.15.151:0/679991558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2dfbf0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f06f4017bf0 tx=0x7f06f402c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cc01a713d4ba75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f05e4ff9640 1 -- 172.21.15.151:0/679991558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f402c600 con 0x55a98c2df810 2024-09-10T14:30:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f05e4ff9640 1 -- 172.21.15.151:0/679991558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f402c860 con 0x55a98c2df810 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f05e4ff9640 1 -- 172.21.15.151:0/679991558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f402e080 con 0x55a98c2df810 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- 172.21.15.151:0/679991558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 msgr2=0x55a98c2dfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 --2- 172.21.15.151:0/679991558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2dfbf0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f06f4017bf0 tx=0x7f06f402c440 comp rx=0 tx=0).stop 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- 172.21.15.151:0/679991558 shutdown_connections 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 --2- 172.21.15.151:0/679991558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2dfbf0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- 172.21.15.151:0/679991558 >> 172.21.15.151:0/679991558 conn(0x55a98c2dbbf0 msgr2=0x55a98c2d9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- 172.21.15.151:0/679991558 shutdown_connections 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- 172.21.15.151:0/679991558 wait complete. 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 Processor -- start 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- start start 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0703746980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a98c2e0660 con 0x55a98c2df810 2024-09-10T14:30:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0701256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2e6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50910/0 (socket says 172.21.15.151:50910) 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.028+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 learned_addr learned my addr 172.21.15.151:0/2621981177 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98c2e6f50 con 0x55a98c2df810 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701256640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2e6a10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f06f402c480 tx=0x7f06f402e310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f05d6ffd640 1 -- 172.21.15.151:0/2621981177 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4071070 con 0x55a98c2df810 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a98c2e6f50 con 0x55a98c2df810 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a98c2e6f50 con 0x55a98c2df810 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f05d6ffd640 1 -- 172.21.15.151:0/2621981177 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f403a3f0 con 0x55a98c2df810 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f05d6ffd640 1 -- 172.21.15.151:0/2621981177 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f40416d0 con 0x55a98c2df810 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f05d6ffd640 1 -- 172.21.15.151:0/2621981177 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06f4074070 con 0x55a98c2df810 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f05d6ffd640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05cc034650 0x7f05cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f05d6ffd640 1 -- 172.21.15.151:0/2621981177 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f06f4014070 con 0x55a98c2df810 2024-09-10T14:30:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0700a55640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05cc034650 0x7f05cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c2f1ab0 0x55a98c2f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f46c0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701a57640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c2f1ab0 0x55a98c2f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0700a55640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05cc034650 0x7f05cc036b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f06f80abaa0 tx=0x7f06f80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701a57640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c2f1ab0 0x55a98c2f3f70 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 realm 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f4ad0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f53a0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2f64a0 0x55a98c2f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f8e60 con 0x55a98c2f64a0 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.032+0000 7f0701256640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2f64a0 0x55a98c2f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701256640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2f64a0 0x55a98c2f8890 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0703746980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0703746980 20 searching for the correct realm 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fa730 con 0x55a98c2f64a0 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701256640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f06f4076060 0x7f06f403e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fa730 con 0x7f06f4076060 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0700a55640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f06f4076060 0x7f06f403e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0700a55640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f06f4076060 0x7f06f403e1c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0700a55640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f06f80dc040 0x7f06f80ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fa730 con 0x7f06f80dc040 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701a57640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f06f80dc040 0x7f06f80ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701a57640 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f06f80dc040 0x7f06f80ce430 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.036+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f80dc040 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f80dc040 2024-09-10T14:30:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f4076060 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f64a0 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f80dc040 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f4076060 2024-09-10T14:30:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f64a0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f64a0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f4076060 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f64a0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f64a0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.040+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f80dc040 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f64a0 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f4076060 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f4076060 2024-09-10T14:30:40.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f64a0 2024-09-10T14:30:40.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f80dc040 2024-09-10T14:30:40.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f4076060 2024-09-10T14:30:40.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f64a0 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.044+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f80dc040 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x55a98c2f1ab0 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f5740 con 0x7f06f4076060 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f9820 con 0x55a98c2f1ab0 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fa0c0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2f9460 con 0x7f06f80dc040 2024-09-10T14:30:40.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 zone default found 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 4 Realm: () 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 zonegroup default 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fa0c0 con 0x7f06f4076060 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fc540 con 0x55a98c2f64a0 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fc960 con 0x55a98c2f64a0 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 started sync module instance, tier type = 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.048+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fb9e0 con 0x7f06f4076060 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.052+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.052+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94186689773008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fd250 con 0x7f06f4076060 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.052+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fdaa0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.052+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94186689773008] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.052+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.052+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94186689777056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fdaa0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.052+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fe530 con 0x55a98c2f64a0 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94186689777056] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94186689779184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fda10 con 0x55a98c2f64a0 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2ff3f0 con 0x7f06f4076060 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94186689785664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2ffc40 con 0x7f06f4076060 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c300600 con 0x55a98c2f1ab0 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94186689779184] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.056+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94186689785664] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.060+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.060+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94186689787792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2ffbb0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.060+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c300ab0 con 0x7f06f80dc040 2024-09-10T14:30:40.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.060+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94186689787792] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.060+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.060+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94186689790288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c300a20 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.060+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c3013e0 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94186689790288] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94186689791616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c3013e0 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c301da0 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94186689791616] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94186689794112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c301da0 con 0x7f06f80dc040 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 20 add_watcher() i=0 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 20 add_watcher() i=1 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 20 add_watcher() i=2 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 20 add_watcher() i=3 2024-09-10T14:30:40.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 20 add_watcher() i=4 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 20 add_watcher() i=5 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.064+0000 7f0703746980 20 add_watcher() i=6 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94186689794112] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0703746980 20 add_watcher() i=7 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0703746980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c3050f0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94186689809152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c301f10 con 0x55a98c2f1ab0 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94186689809152] v36'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f05b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0703746980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0703746980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0703746980 5 note: GC not initialized 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f05b67e4640 20 reqs_thread_entry: start 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.068+0000 7f0703746980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 20 Filter name: none 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0527fff640 20 reqs_thread_entry: start 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c328960 con 0x7f06f80dc040 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-10T14:30:40.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c327100 con 0x55a98c2f1ab0 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c327a30 con 0x7f06f80dc040 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v36'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.072+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94186689951504 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c32c400 con 0x55a98c2f1ab0 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== watch-notify(notify (1) cookie 94186689787792 notify 154618822675 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55a98c327dd0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822675 cookie 94186689787792 notifier 4827 bl.length()=649 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify cookie 94186689951504 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05e4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05e4ff9640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f05c4003eb0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== watch-notify(notify_complete (2) cookie 94186689951504 notify 154618822675 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a98c328530 con 0x55a98c2f1ab0 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c3276e0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v36'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0703746980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0703746980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0703746980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94186689951456 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a98c32c830 con 0x55a98c2f64a0 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== watch-notify(notify (1) cookie 94186689779184 notify 154618822666 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55a98c2d3b30 con 0x55a98c2f64a0 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822666 cookie 94186689779184 notifier 4827 bl.length()=177 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(68 notify.2 [notify cookie 94186689951456 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05e4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05e4ff9640 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f05c4003eb0 con 0x55a98c2f64a0 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== watch-notify(notify_complete (2) cookie 94186689951456 notify 154618822666 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a98c2d38a0 con 0x55a98c2f64a0 2024-09-10T14:30:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.093 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f05b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.076+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94186689809152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c326700 con 0x55a98c2f1ab0 2024-09-10T14:30:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94186689809152] v36'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94186689773008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c326700 con 0x7f06f4076060 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94186689773008] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0703746980 20 remove_watcher() i=0 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0703746980 2 removed watcher, disabling cache 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94186689777056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c326700 con 0x55a98c2f1ab0 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94186689777056] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0703746980 20 remove_watcher() i=1 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.080+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94186689779184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fcda0 con 0x55a98c2f64a0 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.084+0000 7f0701256640 1 -- 172.21.15.151:0/2621981177 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94186689779184] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f4073030 con 0x55a98c2f64a0 2024-09-10T14:30:40.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.084+0000 7f0703746980 20 remove_watcher() i=2 2024-09-10T14:30:40.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.084+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94186689785664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c326700 con 0x7f06f4076060 2024-09-10T14:30:40.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.084+0000 7f0700a55640 1 -- 172.21.15.151:0/2621981177 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94186689785664] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f80c9030 con 0x7f06f4076060 2024-09-10T14:30:40.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.084+0000 7f0703746980 20 remove_watcher() i=3 2024-09-10T14:30:40.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.084+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94186689787792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fd5f0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.088+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94186689787792] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x55a98c2f1ab0 2024-09-10T14:30:40.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.088+0000 7f0703746980 20 remove_watcher() i=4 2024-09-10T14:30:40.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.088+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94186689790288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2fcda0 con 0x7f06f80dc040 2024-09-10T14:30:40.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.088+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94186689790288] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.088+0000 7f0703746980 20 remove_watcher() i=5 2024-09-10T14:30:40.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.088+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94186689791616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c326700 con 0x7f06f80dc040 2024-09-10T14:30:40.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94186689791616] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 20 remove_watcher() i=6 2024-09-10T14:30:40.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94186689794112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a98c2ff790 con 0x7f06f80dc040 2024-09-10T14:30:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94186689794112] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06fc00a4d0 con 0x7f06f80dc040 2024-09-10T14:30:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 20 remove_watcher() i=7 2024-09-10T14:30:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f06f80dc040 msgr2=0x7f06f80ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f06f80dc040 0x7f06f80ce430 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c2f1ab0 msgr2=0x55a98c2f3f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c2f1ab0 0x55a98c2f3f70 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f06f4076060 msgr2=0x7f06f403e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f06f4076060 0x7f06f403e1c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2f64a0 msgr2=0x55a98c2f8890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2f64a0 0x55a98c2f8890 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05cc034650 msgr2=0x7f05cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05cc034650 0x7f05cc036b10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f06f80abaa0 tx=0x7f06f80b9040 comp rx=0 tx=0).stop 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 msgr2=0x55a98c2e6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0701a57640 1 -- 172.21.15.151:0/2621981177 reap_dead start 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2e6a10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f06f402c480 tx=0x7f06f402e310 comp rx=0 tx=0).stop 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 shutdown_connections 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/2621981177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2df810 0x55a98c2e6a10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 >> 172.21.15.151:0/2621981177 conn(0x55a98c2dbbf0 msgr2=0x55a98c2d9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 shutdown_connections 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/2621981177 wait complete. 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/1070748646 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05d8034650 msgr2=0x7f05d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/1070748646 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05d8034650 0x7f05d8036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f06f801b2c0 tx=0x7f06f8005a10 comp rx=0 tx=0).stop 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/1070748646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2d2f40 msgr2=0x55a98c2d3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/1070748646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2d2f40 0x55a98c2d3360 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f06f4001400 tx=0x7f06f4041e40 comp rx=0 tx=0).stop 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/1070748646 shutdown_connections 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/1070748646 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05d8034650 0x7f05d8036b10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/1070748646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c2d2f40 0x55a98c2d3360 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/1070748646 >> 172.21.15.151:0/1070748646 conn(0x55a98c2c8090 msgr2=0x55a98c2cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/1070748646 shutdown_connections 2024-09-10T14:30:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/1070748646 wait complete. 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a98c2c2970 msgr2=0x55a98c2c4d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55a98c2c2970 0x55a98c2c4d60 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c1c6c00 msgr2=0x55a98c2bc0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55a98c1c6c00 0x55a98c2bc0b0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2bea70 msgr2=0x55a98c2c0e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55a98c2bea70 0x55a98c2c0e60 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05e8034650 msgr2=0x7f05e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f05e8034650 0x7f05e8036b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f06f80ad000 tx=0x7f06f80a5040 comp rx=0 tx=0).stop 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 msgr2=0x55a98c2b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 --2- 172.21.15.151:0/3201953279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a98c1c2880 0x55a98c2b50c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55a98c2aeed0 tx=0x7f06f4000bd0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0701a57640 1 -- 172.21.15.151:0/3201953279 reap_dead start 2024-09-10T14:30:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 shutdown_connections 2024-09-10T14:30:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 >> 172.21.15.151:0/3201953279 conn(0x55a98c1361d0 msgr2=0x55a98c2a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 shutdown_connections 2024-09-10T14:30:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.092+0000 7f0703746980 1 -- 172.21.15.151:0/3201953279 wait complete. 2024-09-10T14:30:40.108 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:40.108 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:40.108 ERROR:root:0 2024-09-10T14:30:40.109 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:40.118 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000c92a68e759f3e69a-0066e05810-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:30:40.118 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-10T14:30:40.132 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:40.133 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-10T14:30:40.149 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-10T14:30:40.149 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-10T14:30:40.174 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T14:30:40.174 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T14:30:40.187 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-10T14:30:40.187 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:40.192 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:40.192 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-10T14:30:40.197 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:40.197 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T14:30:40.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T14:30:40.198 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-10T14:30:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:40.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19c736b980 1 Processor -- start 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19c736b980 1 -- start start 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19c736b980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560b3d48bc70 0x560b3d48e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19c736b980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b3d30dae0 con 0x560b3d4878f0 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19c736b980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x560b3d331e30 con 0x560b3d48bc70 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19bffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560b3d48bc70 0x560b3d48e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19bffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560b3d48bc70 0x560b3d48e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50924/0 (socket says 172.21.15.151:50924) 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19bffff640 1 -- 172.21.15.151:0/3803043215 learned_addr learned my addr 172.21.15.151:0/3803043215 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19c4e7b640 1 --1- 172.21.15.151:0/3803043215 >> v1:172.21.15.52:6789/0 conn(0x560b3d4878f0 0x560b3d487cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33346/0 (socket says 172.21.15.151:33346) 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19bffff640 1 -- 172.21.15.151:0/3803043215 >> v1:172.21.15.52:6789/0 conn(0x560b3d4878f0 legacy=0x560b3d487cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.224+0000 7f19bffff640 1 -- 172.21.15.151:0/3803043215 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d48f5b0 con 0x560b3d48bc70 2024-09-10T14:30:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19bffff640 1 --2- 172.21.15.151:0/3803043215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d48bc70 0x560b3d48e060 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f19b000a5c0 tx=0x7f19b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b027c715466cd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19bf7fe640 1 -- 172.21.15.151:0/3803043215 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b00a6070 con 0x560b3d48bc70 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19bf7fe640 1 -- 172.21.15.151:0/3803043215 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b00af070 con 0x560b3d48bc70 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19bf7fe640 1 -- 172.21.15.151:0/3803043215 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b00aa5c0 con 0x560b3d48bc70 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19c736b980 1 -- 172.21.15.151:0/3803043215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d48bc70 msgr2=0x560b3d48e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19c736b980 1 --2- 172.21.15.151:0/3803043215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d48bc70 0x560b3d48e060 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f19b000a5c0 tx=0x7f19b001b340 comp rx=0 tx=0).stop 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19c736b980 1 -- 172.21.15.151:0/3803043215 shutdown_connections 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19c736b980 1 --2- 172.21.15.151:0/3803043215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d48bc70 0x560b3d48e060 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19c736b980 1 -- 172.21.15.151:0/3803043215 >> 172.21.15.151:0/3803043215 conn(0x560b3d3fb240 msgr2=0x560b3d3fb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19c736b980 1 -- 172.21.15.151:0/3803043215 shutdown_connections 2024-09-10T14:30:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.228+0000 7f19c736b980 1 -- 172.21.15.151:0/3803043215 wait complete. 2024-09-10T14:30:40.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 Processor -- start 2024-09-10T14:30:40.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- start start 2024-09-10T14:30:40.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d572ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b3d333200 con 0x560b3d4878f0 2024-09-10T14:30:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d572ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d572ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50936/0 (socket says 172.21.15.151:50936) 2024-09-10T14:30:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1555736286 learned_addr learned my addr 172.21.15.151:0/1555736286 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1555736286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d573270 con 0x560b3d4878f0 2024-09-10T14:30:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1555736286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d572ca0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f19b8001e50 tx=0x7f19b8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52719d887875be1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f18b2e05640 1 -- 172.21.15.151:0/1555736286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b800e5d0 con 0x560b3d4878f0 2024-09-10T14:30:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f18b2e05640 1 -- 172.21.15.151:0/1555736286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b800e770 con 0x560b3d4878f0 2024-09-10T14:30:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f18b2e05640 1 -- 172.21.15.151:0/1555736286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b800eab0 con 0x560b3d4878f0 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- 172.21.15.151:0/1555736286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 msgr2=0x560b3d572ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 --2- 172.21.15.151:0/1555736286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d572ca0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f19b8001e50 tx=0x7f19b8001e80 comp rx=0 tx=0).stop 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- 172.21.15.151:0/1555736286 shutdown_connections 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 --2- 172.21.15.151:0/1555736286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d572ca0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- 172.21.15.151:0/1555736286 >> 172.21.15.151:0/1555736286 conn(0x560b3d3fb240 msgr2=0x560b3d56e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- 172.21.15.151:0/1555736286 shutdown_connections 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- 172.21.15.151:0/1555736286 wait complete. 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 Processor -- start 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- start start 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d57a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c736b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b3d48f0b0 con 0x560b3d4878f0 2024-09-10T14:30:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d57a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d57a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50948/0 (socket says 172.21.15.151:50948) 2024-09-10T14:30:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.244+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1718310721 learned_addr learned my addr 172.21.15.151:0/1718310721 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1718310721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d57a550 con 0x560b3d4878f0 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d57a010 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x560b3d573e80 tx=0x7f19b8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f18b1602640 1 -- 172.21.15.151:0/1718310721 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b8001260 con 0x560b3d4878f0 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b3d57a7e0 con 0x560b3d4878f0 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f18b1602640 1 -- 172.21.15.151:0/1718310721 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b800fa40 con 0x560b3d4878f0 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f18b1602640 1 -- 172.21.15.151:0/1718310721 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b802c060 con 0x560b3d4878f0 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3d57d4c0 con 0x560b3d4878f0 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f18b1602640 1 -- 172.21.15.151:0/1718310721 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f19b8017070 con 0x560b3d4878f0 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f18b1602640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f18ac034650 0x7f18ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f18b1602640 1 -- 172.21.15.151:0/1718310721 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f19b8015020 con 0x560b3d4878f0 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19bffff640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f18ac034650 0x7f18ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c736b980 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d48bc70 0x560b3d581000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d581670 con 0x560b3d48bc70 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c567c640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d48bc70 0x560b3d581000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19bffff640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f18ac034650 0x7f18ac036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f19b00ae000 tx=0x7f19b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c567c640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d48bc70 0x560b3d581000 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c567c640 1 -- 172.21.15.151:0/1718310721 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d48bc70 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d57e6c0 con 0x560b3d48bc70 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c567c640 1 -- 172.21.15.151:0/1718310721 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d48bc70 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c736b980 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5839a0 0x560b3d585d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d586480 con 0x560b3d5839a0 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.248+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5839a0 0x560b3d585d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5839a0 0x560b3d585d90 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1718310721 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f19b802e070 con 0x560b3d5839a0 2024-09-10T14:30:40.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d582840 con 0x560b3d48bc70 2024-09-10T14:30:40.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c567c640 1 -- 172.21.15.151:0/1718310721 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d48bc70 2024-09-10T14:30:40.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c736b980 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560b3d5878e0 0x560b3d589cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d58a410 con 0x560b3d5878e0 2024-09-10T14:30:40.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19bffff640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560b3d5878e0 0x560b3d589cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19bffff640 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560b3d5878e0 0x560b3d589cd0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19bffff640 1 -- 172.21.15.151:0/1718310721 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f19b00aaae0 con 0x560b3d5878e0 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c736b980 1 Processor -- start 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c736b980 1 -- start start 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c736b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d597ee0 0x560b3d598300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c736b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b3d38c800 con 0x560b3d597ee0 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d597ee0 0x560b3d598300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d597ee0 0x560b3d598300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50956/0 (socket says 172.21.15.151:50956) 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c4e7b640 1 -- 172.21.15.151:0/3137847714 learned_addr learned my addr 172.21.15.151:0/3137847714 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.252+0000 7f19c4e7b640 1 -- 172.21.15.151:0/3137847714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d598840 con 0x560b3d597ee0 2024-09-10T14:30:40.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/3137847714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d597ee0 0x560b3d598300 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f19b8048ea0 tx=0x7f19b8019970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f18aa7fc640 1 -- 172.21.15.151:0/3137847714 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b8042070 con 0x560b3d597ee0 2024-09-10T14:30:40.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f18aa7fc640 1 -- 172.21.15.151:0/3137847714 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b8036070 con 0x560b3d597ee0 2024-09-10T14:30:40.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c736b980 1 -- 172.21.15.151:0/3137847714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b3d598ad0 con 0x560b3d597ee0 2024-09-10T14:30:40.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f18aa7fc640 1 -- 172.21.15.151:0/3137847714 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b801bbd0 con 0x560b3d597ee0 2024-09-10T14:30:40.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c736b980 1 -- 172.21.15.151:0/3137847714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3d598ad0 con 0x560b3d597ee0 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f18aa7fc640 1 -- 172.21.15.151:0/3137847714 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f19b801a480 con 0x560b3d597ee0 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f18aa7fc640 1 --2- 172.21.15.151:0/3137847714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f189c034650 0x7f189c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f18aa7fc640 1 -- 172.21.15.151:0/3137847714 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f19b80293a0 con 0x560b3d597ee0 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19bffff640 1 --2- 172.21.15.151:0/3137847714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f189c034650 0x7f189c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c736b980 1 Processor -- start 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c736b980 1 -- start start 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19bffff640 1 --2- 172.21.15.151:0/3137847714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f189c034650 0x7f189c036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x560b3d581b40 tx=0x7f19b0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c736b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5a4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c736b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b3d5735f0 con 0x560b3d5a4550 2024-09-10T14:30:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5a4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50960/0 (socket says 172.21.15.151:50960) 2024-09-10T14:30:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1913570917 learned_addr learned my addr 172.21.15.151:0/1913570917 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1913570917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d5a4f20 con 0x560b3d5a4550 2024-09-10T14:30:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1913570917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5a4950 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f19b800f700 tx=0x7f19b803d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5a3a2727da7976 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f189bfff640 1 -- 172.21.15.151:0/1913570917 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b804f040 con 0x560b3d5a4550 2024-09-10T14:30:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.256+0000 7f189bfff640 1 -- 172.21.15.151:0/1913570917 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b801a8a0 con 0x560b3d5a4550 2024-09-10T14:30:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f189bfff640 1 -- 172.21.15.151:0/1913570917 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b8047220 con 0x560b3d5a4550 2024-09-10T14:30:40.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- 172.21.15.151:0/1913570917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 msgr2=0x560b3d5a4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 --2- 172.21.15.151:0/1913570917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5a4950 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f19b800f700 tx=0x7f19b803d940 comp rx=0 tx=0).stop 2024-09-10T14:30:40.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- 172.21.15.151:0/1913570917 shutdown_connections 2024-09-10T14:30:40.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 --2- 172.21.15.151:0/1913570917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5a4950 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- 172.21.15.151:0/1913570917 >> 172.21.15.151:0/1913570917 conn(0x560b3d5a09c0 msgr2=0x560b3d59eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- 172.21.15.151:0/1913570917 shutdown_connections 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- 172.21.15.151:0/1913570917 wait complete. 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 Processor -- start 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- start start 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b3d5a5430 con 0x560b3d5a4550 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c4e7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5ab7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50962/0 (socket says 172.21.15.151:50962) 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 learned_addr learned my addr 172.21.15.151:0/1132206778 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d5abd00 con 0x560b3d5a4550 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5ab7c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f19b803dad0 tx=0x7f19b8035f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f189a7fc640 1 -- 172.21.15.151:0/1132206778 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b806e070 con 0x560b3d5a4550 2024-09-10T14:30:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b3d5abd00 con 0x560b3d5a4550 2024-09-10T14:30:40.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f189a7fc640 1 -- 172.21.15.151:0/1132206778 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b8065070 con 0x560b3d5a4550 2024-09-10T14:30:40.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f189a7fc640 1 -- 172.21.15.151:0/1132206778 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b804f040 con 0x560b3d5a4550 2024-09-10T14:30:40.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3d5abd00 con 0x560b3d5a4550 2024-09-10T14:30:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.260+0000 7f189a7fc640 1 -- 172.21.15.151:0/1132206778 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f19b8071070 con 0x560b3d5a4550 2024-09-10T14:30:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f189a7fc640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1890034650 0x7f1890036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f189a7fc640 1 -- 172.21.15.151:0/1132206778 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f19b805c070 con 0x560b3d5a4550 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19bffff640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1890034650 0x7f1890036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d5b6900 0x560b3d5b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5b94e0 con 0x560b3d5b6900 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c567c640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d5b6900 0x560b3d5b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19bffff640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1890034650 0x7f1890036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f19b0000c10 tx=0x7f19b00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c567c640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d5b6900 0x560b3d5b8d90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 realm 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5b98f0 con 0x560b3d5b6900 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba190 con 0x560b3d5b6900 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5bb290 0x560b3d5bd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5bdd20 con 0x560b3d5bb290 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5bb290 0x560b3d5bd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5bb290 0x560b3d5bd680 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 20 searching for the correct realm 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5bf580 con 0x560b3d5bb290 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c4e7b640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f19b8073060 0x7f19b802d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5bf580 con 0x7f19b8073060 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19bffff640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f19b8073060 0x7f19b802d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19bffff640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f19b8073060 0x7f19b802d260 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19bffff640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f19b00e0040 0x7f19b00e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5bf580 con 0x7f19b00e0040 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.264+0000 7f19c567c640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f19b00e0040 0x7f19b00e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f19b00e0040 0x7f19b00e0420 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b00e0040 2024-09-10T14:30:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b00e0040 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b8073060 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5bb290 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b00e0040 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.268+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b8073060 2024-09-10T14:30:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5bb290 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5bb290 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b8073060 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5bb290 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5bb290 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b00e0040 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5bb290 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b8073060 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b8073060 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5bb290 2024-09-10T14:30:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.272+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b00e0040 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b8073060 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5bb290 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b00e0040 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x560b3d5b6900 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ba530 con 0x7f19b8073060 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5be6a0 con 0x560b3d5b6900 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5beef0 con 0x560b3d5b6900 2024-09-10T14:30:40.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5be300 con 0x7f19b00e0040 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 zone default found 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 4 Realm: () 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 zonegroup default 2024-09-10T14:30:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5bf450 con 0x7f19b8073060 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.276+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c1390 con 0x560b3d5bb290 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c17f0 con 0x560b3d5bb290 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 20 started sync module instance, tier type = 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c0830 con 0x7f19b8073060 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94606274071632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c2100 con 0x7f19b8073060 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c2950 con 0x560b3d5b6900 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94606274071632] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94606274075728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c2950 con 0x560b3d5b6900 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.280+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c3410 con 0x560b3d5bb290 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.284+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94606274075728] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.284+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.284+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94606274077856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c28c0 con 0x560b3d5bb290 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.284+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c41a0 con 0x7f19b8073060 2024-09-10T14:30:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.284+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.284+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94606274086288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c4e60 con 0x7f19b8073060 2024-09-10T14:30:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.284+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c5820 con 0x560b3d5b6900 2024-09-10T14:30:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94606274077856] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94606274086288] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94606274082816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c5820 con 0x560b3d5b6900 2024-09-10T14:30:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c6070 con 0x7f19b00e0040 2024-09-10T14:30:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94606274091312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c6340 con 0x7f19b00e0040 2024-09-10T14:30:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c6e40 con 0x7f19b00e0040 2024-09-10T14:30:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.288+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94606274082816] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.292+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94606274091312] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.292+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.292+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94606274095408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c5d90 con 0x7f19b00e0040 2024-09-10T14:30:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.292+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c7420 con 0x7f19b00e0040 2024-09-10T14:30:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.292+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94606274095408] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94606274089840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c7420 con 0x7f19b00e0040 2024-09-10T14:30:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 add_watcher() i=0 2024-09-10T14:30:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 add_watcher() i=1 2024-09-10T14:30:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 add_watcher() i=2 2024-09-10T14:30:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 add_watcher() i=3 2024-09-10T14:30:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 add_watcher() i=4 2024-09-10T14:30:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 add_watcher() i=5 2024-09-10T14:30:40.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 add_watcher() i=6 2024-09-10T14:30:40.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94606274089840] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 add_watcher() i=7 2024-09-10T14:30:40.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:40.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ca670 con 0x560b3d5b6900 2024-09-10T14:30:40.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94606274097376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c79b0 con 0x560b3d5b6900 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94606274097376] v36'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f187afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 5 note: GC not initialized 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f1879fe3640 20 reqs_thread_entry: start 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f19c736b980 20 Filter name: none 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.296+0000 7f17eb7fe640 20 reqs_thread_entry: start 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5eddd0 con 0x7f19b00e0040 2024-09-10T14:30:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T14:30:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5f46f0 con 0x7f19b00e0040 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94606274281824 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5efde0 con 0x560b3d5b6900 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 94606274082816 notify 154618822677 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f19c002d060 con 0x560b3d5b6900 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f189bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822677 cookie 94606274082816 notifier 4834 bl.length()=636 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f189bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f189bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 94606274281824 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f189bfff640 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f1888003eb0 con 0x560b3d5b6900 2024-09-10T14:30:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.300+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 94606274281824 notify 154618822677 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f19c001e040 con 0x560b3d5b6900 2024-09-10T14:30:40.308 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f187afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94606274097376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ebbd0 con 0x560b3d5b6900 2024-09-10T14:30:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94606274097376] v36'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94606274071632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ebbd0 con 0x7f19b8073060 2024-09-10T14:30:40.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94606274071632] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f19c736b980 20 remove_watcher() i=0 2024-09-10T14:30:40.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f19c736b980 2 removed watcher, disabling cache 2024-09-10T14:30:40.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.304+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94606274075728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ebbd0 con 0x560b3d5b6900 2024-09-10T14:30:40.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.308+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94606274075728] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.308+0000 7f19c736b980 20 remove_watcher() i=1 2024-09-10T14:30:40.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.308+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94606274077856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ebbd0 con 0x560b3d5bb290 2024-09-10T14:30:40.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.308+0000 7f19c4e7b640 1 -- 172.21.15.151:0/1132206778 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94606274077856] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b8070030 con 0x560b3d5bb290 2024-09-10T14:30:40.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.308+0000 7f19c736b980 20 remove_watcher() i=2 2024-09-10T14:30:40.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.308+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94606274086288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ebbd0 con 0x7f19b8073060 2024-09-10T14:30:40.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.312+0000 7f19bffff640 1 -- 172.21.15.151:0/1132206778 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94606274086288] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b00aaae0 con 0x7f19b8073060 2024-09-10T14:30:40.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.312+0000 7f19c736b980 20 remove_watcher() i=3 2024-09-10T14:30:40.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.312+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94606274082816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c4590 con 0x560b3d5b6900 2024-09-10T14:30:40.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.312+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94606274082816] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x560b3d5b6900 2024-09-10T14:30:40.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.312+0000 7f19c736b980 20 remove_watcher() i=4 2024-09-10T14:30:40.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.312+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94606274091312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ebbd0 con 0x7f19b00e0040 2024-09-10T14:30:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.316+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94606274091312] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.316+0000 7f19c736b980 20 remove_watcher() i=5 2024-09-10T14:30:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.316+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94606274095408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5c4590 con 0x7f19b00e0040 2024-09-10T14:30:40.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.316+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94606274095408] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.316+0000 7f19c736b980 20 remove_watcher() i=6 2024-09-10T14:30:40.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.316+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94606274089840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560b3d5ebbd0 con 0x7f19b00e0040 2024-09-10T14:30:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94606274089840] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19c000a4d0 con 0x7f19b00e0040 2024-09-10T14:30:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 20 remove_watcher() i=7 2024-09-10T14:30:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f19b00e0040 msgr2=0x7f19b00e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f19b00e0040 0x7f19b00e0420 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d5b6900 msgr2=0x560b3d5b8d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d5b6900 0x560b3d5b8d90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f19b8073060 msgr2=0x7f19b802d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f19b8073060 0x7f19b802d260 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5bb290 msgr2=0x560b3d5bd680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5bb290 0x560b3d5bd680 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1890034650 msgr2=0x7f1890036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1890034650 0x7f1890036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f19b0000c10 tx=0x7f19b00c1040 comp rx=0 tx=0).stop 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 msgr2=0x560b3d5ab7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c567c640 1 -- 172.21.15.151:0/1132206778 reap_dead start 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5ab7c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f19b803dad0 tx=0x7f19b8035f30 comp rx=0 tx=0).stop 2024-09-10T14:30:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 shutdown_connections 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1132206778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d5a4550 0x560b3d5ab7c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 >> 172.21.15.151:0/1132206778 conn(0x560b3d5a09c0 msgr2=0x560b3d59ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 shutdown_connections 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1132206778 wait complete. 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/3137847714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f189c034650 msgr2=0x7f189c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/3137847714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f189c034650 0x7f189c036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x560b3d581b40 tx=0x7f19b0005ad0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/3137847714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d597ee0 msgr2=0x560b3d598300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/3137847714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d597ee0 0x560b3d598300 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f19b8048ea0 tx=0x7f19b8019970 comp rx=0 tx=0).stop 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/3137847714 shutdown_connections 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/3137847714 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f189c034650 0x7f189c036b10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/3137847714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d597ee0 0x560b3d598300 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/3137847714 >> 172.21.15.151:0/3137847714 conn(0x560b3d58d030 msgr2=0x560b3d58fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/3137847714 shutdown_connections 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/3137847714 wait complete. 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560b3d5878e0 msgr2=0x560b3d589cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560b3d5878e0 0x560b3d589cd0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d48bc70 msgr2=0x560b3d581000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560b3d48bc70 0x560b3d581000 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5839a0 msgr2=0x560b3d585d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560b3d5839a0 0x560b3d585d90 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f18ac034650 msgr2=0x7f18ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f18ac034650 0x7f18ac036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f19b00ae000 tx=0x7f19b00a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 msgr2=0x560b3d57a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 --2- 172.21.15.151:0/1718310721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d4878f0 0x560b3d57a010 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x560b3d573e80 tx=0x7f19b8000bd0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c567c640 1 -- 172.21.15.151:0/1718310721 reap_dead start 2024-09-10T14:30:40.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 shutdown_connections 2024-09-10T14:30:40.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 >> 172.21.15.151:0/1718310721 conn(0x560b3d3fb240 msgr2=0x560b3d56d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 shutdown_connections 2024-09-10T14:30:40.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.320+0000 7f19c736b980 1 -- 172.21.15.151:0/1718310721 wait complete. 2024-09-10T14:30:40.335 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:40.335 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:40.335 ERROR:root:0 2024-09-10T14:30:40.335 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T14:30:40.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T14:30:40.335 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-10T14:30:40.417 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:40.417 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:40.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8b2379980 1 Processor -- start 2024-09-10T14:30:40.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8b2379980 1 -- start start 2024-09-10T14:30:40.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8b2379980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56217e3a0630 0x56217e3a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8b2379980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56217e228ae0 con 0x56217e3a0f80 2024-09-10T14:30:40.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8b2379980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56217e24ce30 con 0x56217e3a0630 2024-09-10T14:30:40.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8afe89640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56217e3a0630 0x56217e3a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8afe89640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56217e3a0630 0x56217e3a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50974/0 (socket says 172.21.15.151:50974) 2024-09-10T14:30:40.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8afe89640 1 -- 172.21.15.151:0/1258271617 learned_addr learned my addr 172.21.15.151:0/1258271617 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.412+0000 7fd8af688640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x56217e3a0f80 0x56217e3a59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33354/0 (socket says 172.21.15.151:33354) 2024-09-10T14:30:40.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.416+0000 7fd8afe89640 1 -- 172.21.15.151:0/1258271617 >> v1:172.21.15.52:6789/0 conn(0x56217e3a0f80 legacy=0x56217e3a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.416+0000 7fd8afe89640 1 -- 172.21.15.151:0/1258271617 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217e3a8200 con 0x56217e3a0630 2024-09-10T14:30:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.416+0000 7fd8afe89640 1 --2- 172.21.15.151:0/1258271617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e3a0a10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000a4e0 tx=0x7fd8a001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7ddb2ed78d28c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.416+0000 7fd8aee87640 1 -- 172.21.15.151:0/1258271617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00aa540 con 0x56217e3a0630 2024-09-10T14:30:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.416+0000 7fd8aee87640 1 -- 172.21.15.151:0/1258271617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a00aa6e0 con 0x56217e3a0630 2024-09-10T14:30:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.416+0000 7fd8aee87640 1 -- 172.21.15.151:0/1258271617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00aaa40 con 0x56217e3a0630 2024-09-10T14:30:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.420+0000 7fd8b2379980 1 -- 172.21.15.151:0/1258271617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 msgr2=0x56217e3a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.420+0000 7fd8b2379980 1 --2- 172.21.15.151:0/1258271617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e3a0a10 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000a4e0 tx=0x7fd8a001b090 comp rx=0 tx=0).stop 2024-09-10T14:30:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.420+0000 7fd8b2379980 1 -- 172.21.15.151:0/1258271617 shutdown_connections 2024-09-10T14:30:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.420+0000 7fd8b2379980 1 --2- 172.21.15.151:0/1258271617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e3a0a10 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.420+0000 7fd8b2379980 1 -- 172.21.15.151:0/1258271617 >> 172.21.15.151:0/1258271617 conn(0x56217e39c150 msgr2=0x56217e39e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.420+0000 7fd8b2379980 1 -- 172.21.15.151:0/1258271617 shutdown_connections 2024-09-10T14:30:40.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.420+0000 7fd8b2379980 1 -- 172.21.15.151:0/1258271617 wait complete. 2024-09-10T14:30:40.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8b2379980 1 Processor -- start 2024-09-10T14:30:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8b2379980 1 -- start start 2024-09-10T14:30:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8b2379980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e489840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8b2379980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56217e24e200 con 0x56217e3a0630 2024-09-10T14:30:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e489840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e489840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50982/0 (socket says 172.21.15.151:50982) 2024-09-10T14:30:40.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8afe89640 1 -- 172.21.15.151:0/3852851605 learned_addr learned my addr 172.21.15.151:0/3852851605 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8afe89640 1 -- 172.21.15.151:0/3852851605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217e489e10 con 0x56217e3a0630 2024-09-10T14:30:40.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd8afe89640 1 --2- 172.21.15.151:0/3852851605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e489840 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0017ca0 tx=0x7fd8a00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc638de9a6693632 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd79de0b640 1 -- 172.21.15.151:0/3852851605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00b9070 con 0x56217e3a0630 2024-09-10T14:30:40.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd79de0b640 1 -- 172.21.15.151:0/3852851605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a00aaa80 con 0x56217e3a0630 2024-09-10T14:30:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.432+0000 7fd79de0b640 1 -- 172.21.15.151:0/3852851605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00aad60 con 0x56217e3a0630 2024-09-10T14:30:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- 172.21.15.151:0/3852851605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 msgr2=0x56217e489840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 --2- 172.21.15.151:0/3852851605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e489840 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0017ca0 tx=0x7fd8a00033b0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- 172.21.15.151:0/3852851605 shutdown_connections 2024-09-10T14:30:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 --2- 172.21.15.151:0/3852851605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e489840 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- 172.21.15.151:0/3852851605 >> 172.21.15.151:0/3852851605 conn(0x56217e39c150 msgr2=0x56217e485470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- 172.21.15.151:0/3852851605 shutdown_connections 2024-09-10T14:30:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- 172.21.15.151:0/3852851605 wait complete. 2024-09-10T14:30:40.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 Processor -- start 2024-09-10T14:30:40.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- start start 2024-09-10T14:30:40.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e490a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56217e3a7c40 con 0x56217e3a0630 2024-09-10T14:30:40.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e490a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e490a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:50994/0 (socket says 172.21.15.151:50994) 2024-09-10T14:30:40.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8afe89640 1 -- 172.21.15.151:0/2884617299 learned_addr learned my addr 172.21.15.151:0/2884617299 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8afe89640 1 -- 172.21.15.151:0/2884617299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217e490f80 con 0x56217e3a0630 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8afe89640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e490a40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd8a001aec0 tx=0x7fd8a0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd797fff640 1 -- 172.21.15.151:0/2884617299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00cc070 con 0x56217e3a0630 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56217e491210 con 0x56217e3a0630 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd797fff640 1 -- 172.21.15.151:0/2884617299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a00c7410 con 0x56217e3a0630 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217e493ef0 con 0x56217e3a0630 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd797fff640 1 -- 172.21.15.151:0/2884617299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00b9070 con 0x56217e3a0630 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd797fff640 1 -- 172.21.15.151:0/2884617299 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd8a00b3040 con 0x56217e3a0630 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd797fff640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd798034650 0x7fd798036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd797fff640 1 -- 172.21.15.151:0/2884617299 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd8a00c4070 con 0x56217e3a0630 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8af688640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd798034650 0x7fd798036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e3a0f80 0x56217e497b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e498080 con 0x56217e3a0f80 2024-09-10T14:30:40.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.436+0000 7fd8b068a640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e3a0f80 0x56217e497b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8af688640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd798034650 0x7fd798036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd898000f70 tx=0x7fd898001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b068a640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e3a0f80 0x56217e497b40 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b068a640 1 -- 172.21.15.151:0/2884617299 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e3a0f80 2024-09-10T14:30:40.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4950f0 con 0x56217e3a0f80 2024-09-10T14:30:40.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b068a640 1 -- 172.21.15.151:0/2884617299 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e3a0f80 2024-09-10T14:30:40.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b2379980 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e49a350 0x56217e49c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e49ce10 con 0x56217e49a350 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8afe89640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e49a350 0x56217e49c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8afe89640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e49a350 0x56217e49c740 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8afe89640 1 -- 172.21.15.151:0/2884617299 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8a00ce310 con 0x56217e49a350 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4991f0 con 0x56217e3a0f80 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b068a640 1 -- 172.21.15.151:0/2884617299 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e3a0f80 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b2379980 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56217e49e250 0x56217e4a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4a0db0 con 0x56217e49e250 2024-09-10T14:30:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8af688640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56217e49e250 0x56217e4a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8af688640 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56217e49e250 0x56217e4a0640 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.440+0000 7fd8af688640 1 -- 172.21.15.151:0/2884617299 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd89800f6a0 con 0x56217e49e250 2024-09-10T14:30:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 Processor -- start 2024-09-10T14:30:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 -- start start 2024-09-10T14:30:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4ae840 0x56217e4aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56217e2a7800 con 0x56217e4ae840 2024-09-10T14:30:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4ae840 0x56217e4aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4ae840 0x56217e4aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51006/0 (socket says 172.21.15.151:51006) 2024-09-10T14:30:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8afe89640 1 -- 172.21.15.151:0/1283852078 learned_addr learned my addr 172.21.15.151:0/1283852078 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8afe89640 1 -- 172.21.15.151:0/1283852078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217e4af1a0 con 0x56217e4ae840 2024-09-10T14:30:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8afe89640 1 --2- 172.21.15.151:0/1283852078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4ae840 0x56217e4aec60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00c6710 tx=0x7fd8a00cf810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd7957fa640 1 -- 172.21.15.151:0/1283852078 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00e8070 con 0x56217e4ae840 2024-09-10T14:30:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd7957fa640 1 -- 172.21.15.151:0/1283852078 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a00c6db0 con 0x56217e4ae840 2024-09-10T14:30:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 -- 172.21.15.151:0/1283852078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56217e4af430 con 0x56217e4ae840 2024-09-10T14:30:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd7957fa640 1 -- 172.21.15.151:0/1283852078 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00da900 con 0x56217e4ae840 2024-09-10T14:30:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 -- 172.21.15.151:0/1283852078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217e4b20b0 con 0x56217e4ae840 2024-09-10T14:30:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd7957fa640 1 -- 172.21.15.151:0/1283852078 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd8a00daaa0 con 0x56217e4ae840 2024-09-10T14:30:40.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd7957fa640 1 --2- 172.21.15.151:0/1283852078 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd788034650 0x7fd788036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd7957fa640 1 -- 172.21.15.151:0/1283852078 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd8a00e1070 con 0x56217e4ae840 2024-09-10T14:30:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8af688640 1 --2- 172.21.15.151:0/1283852078 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd788034650 0x7fd788036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 Processor -- start 2024-09-10T14:30:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 -- start start 2024-09-10T14:30:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8af688640 1 --2- 172.21.15.151:0/1283852078 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd788034650 0x7fd788036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x56217e4a11b0 tx=0x7fd89800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4bb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.444+0000 7fd8b2379980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56217e48a0d0 con 0x56217e4bb1d0 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4bb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4bb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51016/0 (socket says 172.21.15.151:51016) 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 -- 172.21.15.151:0/1677478865 learned_addr learned my addr 172.21.15.151:0/1677478865 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 -- 172.21.15.151:0/1677478865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217e4bbba0 con 0x56217e4bb1d0 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 --2- 172.21.15.151:0/1677478865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4bb5d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00a8040 tx=0x7fd8a00e19d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3b292dd92f302e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd78effd640 1 -- 172.21.15.151:0/1677478865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00c2130 con 0x56217e4bb1d0 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd78effd640 1 -- 172.21.15.151:0/1677478865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a00ec7c0 con 0x56217e4bb1d0 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd78effd640 1 -- 172.21.15.151:0/1677478865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00a5e60 con 0x56217e4bb1d0 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- 172.21.15.151:0/1677478865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 msgr2=0x56217e4bb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 --2- 172.21.15.151:0/1677478865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4bb5d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00a8040 tx=0x7fd8a00e19d0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- 172.21.15.151:0/1677478865 shutdown_connections 2024-09-10T14:30:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 --2- 172.21.15.151:0/1677478865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4bb5d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- 172.21.15.151:0/1677478865 >> 172.21.15.151:0/1677478865 conn(0x56217e4b7550 msgr2=0x56217e4b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- 172.21.15.151:0/1677478865 shutdown_connections 2024-09-10T14:30:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- 172.21.15.151:0/1677478865 wait complete. 2024-09-10T14:30:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 Processor -- start 2024-09-10T14:30:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- start start 2024-09-10T14:30:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56217e4bbf60 con 0x56217e4bb1d0 2024-09-10T14:30:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4c22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51032/0 (socket says 172.21.15.151:51032) 2024-09-10T14:30:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 learned_addr learned my addr 172.21.15.151:0/849713734 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217e4c2830 con 0x56217e4bb1d0 2024-09-10T14:30:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8afe89640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4c22f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00ee030 tx=0x7fd8a00ce5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd78d7fa640 1 -- 172.21.15.151:0/849713734 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a010c020 con 0x56217e4bb1d0 2024-09-10T14:30:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56217e4c2830 con 0x56217e4bb1d0 2024-09-10T14:30:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd78d7fa640 1 -- 172.21.15.151:0/849713734 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a00e1270 con 0x56217e4bb1d0 2024-09-10T14:30:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd78d7fa640 1 -- 172.21.15.151:0/849713734 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8a00d03f0 con 0x56217e4bb1d0 2024-09-10T14:30:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.448+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217e4c2ca0 con 0x56217e4bb1d0 2024-09-10T14:30:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd78d7fa640 1 -- 172.21.15.151:0/849713734 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd8a010f070 con 0x56217e4bb1d0 2024-09-10T14:30:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd78d7fa640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7780346a0 0x7fd778036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd78d7fa640 1 -- 172.21.15.151:0/849713734 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fd8a0109d40 con 0x56217e4bb1d0 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8af688640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7780346a0 0x7fd778036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e4cd490 0x56217e4cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d00a0 con 0x56217e4cd490 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b068a640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e4cd490 0x56217e4cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8af688640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7780346a0 0x7fd778036b60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c010 tx=0x7fd898010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b068a640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e4cd490 0x56217e4cf950 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 realm 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d04b0 con 0x56217e4cd490 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d0d80 con 0x56217e4cd490 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e4d1e80 0x56217e4d4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d4880 con 0x56217e4d1e80 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8afe89640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e4d1e80 0x56217e4d4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8afe89640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e4d1e80 0x56217e4d4270 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 20 searching for the correct realm 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d6150 con 0x56217e4d1e80 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8afe89640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd8a00b09b0 0x7fd8a00b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d6150 con 0x7fd8a00b09b0 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.452+0000 7fd8af688640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd8a00b09b0 0x7fd8a00b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8af688640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd8a00b09b0 0x7fd8a00b88d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8af688640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd89801fbe0 0x7fd89803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d6150 con 0x7fd89801fbe0 2024-09-10T14:30:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd89801fbe0 0x7fd89803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd89801fbe0 0x7fd89803a3c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd89801fbe0 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd89801fbe0 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd8a00b09b0 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.456+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4d1e80 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd89801fbe0 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd8a00b09b0 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4d1e80 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4d1e80 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd8a00b09b0 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4d1e80 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4d1e80 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.460+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd89801fbe0 2024-09-10T14:30:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4d1e80 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd8a00b09b0 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd8a00b09b0 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4d1e80 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd89801fbe0 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd8a00b09b0 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4d1e80 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd89801fbe0 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x56217e4cd490 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d1120 con 0x7fd8a00b09b0 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d5270 con 0x56217e4cd490 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.464+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d4eb0 con 0x56217e4cd490 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d5b90 con 0x7fd89801fbe0 2024-09-10T14:30:40.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 zone default found 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 4 Realm: () 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 zonegroup default 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d5fc0 con 0x7fd8a00b09b0 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d7f60 con 0x56217e4d1e80 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d83a0 con 0x56217e4d1e80 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 started sync module instance, tier type = 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d7400 con 0x7fd8a00b09b0 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94701852915696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d7060 con 0x7fd8a00b09b0 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d91e0 con 0x56217e4cd490 2024-09-10T14:30:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.468+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94701852915696] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.472+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.472+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94701852919808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d95d0 con 0x56217e4cd490 2024-09-10T14:30:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.472+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d9f90 con 0x56217e4d1e80 2024-09-10T14:30:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.472+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94701852919808] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.472+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.472+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94701852924640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4da380 con 0x56217e4d1e80 2024-09-10T14:30:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.472+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4dad40 con 0x7fd8a00b09b0 2024-09-10T14:30:40.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.476+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.476+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94701852928144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4db590 con 0x7fd8a00b09b0 2024-09-10T14:30:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.476+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4dbf90 con 0x56217e4cd490 2024-09-10T14:30:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.476+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94701852924640] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.476+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94701852928144] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.476+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.476+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94701852930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4dbaa0 con 0x56217e4cd490 2024-09-10T14:30:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.476+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4dc830 con 0x7fd89801fbe0 2024-09-10T14:30:40.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.480+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94701852930272] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.480+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.480+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94701852920864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4dc7a0 con 0x7fd89801fbe0 2024-09-10T14:30:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.480+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4dd160 con 0x7fd89801fbe0 2024-09-10T14:30:40.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.480+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94701852920864] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.480+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.480+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94701852935168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4dd160 con 0x7fd89801fbe0 2024-09-10T14:30:40.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.480+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4ddb20 con 0x7fd89801fbe0 2024-09-10T14:30:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94701852935168] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94701852937664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4ddb20 con 0x7fd89801fbe0 2024-09-10T14:30:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b2379980 20 add_watcher() i=0 2024-09-10T14:30:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b2379980 20 add_watcher() i=1 2024-09-10T14:30:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b2379980 20 add_watcher() i=2 2024-09-10T14:30:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b2379980 20 add_watcher() i=3 2024-09-10T14:30:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b2379980 20 add_watcher() i=4 2024-09-10T14:30:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b2379980 20 add_watcher() i=5 2024-09-10T14:30:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.484+0000 7fd8b2379980 20 add_watcher() i=6 2024-09-10T14:30:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94701852937664] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 add_watcher() i=7 2024-09-10T14:30:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e4e0e50 con 0x56217e4cd490 2024-09-10T14:30:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94701852952704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4ddc90 con 0x56217e4cd490 2024-09-10T14:30:40.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94701852952704] v36'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd765fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:40.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:40.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 5 note: GC not initialized 2024-09-10T14:30:40.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd764fe1640 20 reqs_thread_entry: start 2024-09-10T14:30:40.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:40.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 Filter name: none 2024-09-10T14:30:40.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd6de7fc640 20 reqs_thread_entry: start 2024-09-10T14:30:40.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T14:30:40.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e5045f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-10T14:30:40.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e502d90 con 0x56217e4d1e80 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T14:30:40.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.488+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e503630 con 0x7fd89801fbe0 2024-09-10T14:30:40.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v36'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94701853094272 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e508090 con 0x7fd8a00b09b0 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== watch-notify(notify (1) cookie 94701852915696 notify 154618822705 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7fd898018040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd78effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822705 cookie 94701852915696 notifier 4841 bl.length()=533 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd78effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd78effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(65 notify.0 [notify cookie 94701853094272 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd78effd640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd774003eb0 con 0x7fd8a00b09b0 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== watch-notify(notify_complete (2) cookie 94701853094272 notify 154618822705 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56217e228ae0 con 0x7fd8a00b09b0 2024-09-10T14:30:40.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e503180 con 0x56217e4d1e80 2024-09-10T14:30:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v36'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T14:30:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94701853094272 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56217e508090 con 0x56217e4cd490 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 94701852919808 notify 154618822678 ret 0) ==== 218+0+0 (crc 0 0 0) 0x56217e5039d0 con 0x56217e4cd490 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd78e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822678 cookie 94701852919808 notifier 4841 bl.length()=176 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd78e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd78e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(68 notify.1 [notify cookie 94701853094272 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.492+0000 7fd78e7fc640 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd6e4003410 con 0x56217e4cd490 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 94701853094272 notify 154618822678 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56217e504040 con 0x56217e4cd490 2024-09-10T14:30:40.501 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-10T14:30:40.494602Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.494590Z","tags":[],"group_ids":[]} 2024-09-10T14:30:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd765fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94701852952704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e5023f0 con 0x56217e4cd490 2024-09-10T14:30:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94701852952704] v36'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94701852915696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e5023f0 con 0x7fd8a00b09b0 2024-09-10T14:30:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94701852915696] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8b2379980 20 remove_watcher() i=0 2024-09-10T14:30:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8b2379980 2 removed watcher, disabling cache 2024-09-10T14:30:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.496+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94701852919808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e5023f0 con 0x56217e4cd490 2024-09-10T14:30:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.500+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94701852919808] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.500+0000 7fd8b2379980 20 remove_watcher() i=1 2024-09-10T14:30:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.500+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94701852924640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d8800 con 0x56217e4d1e80 2024-09-10T14:30:40.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.500+0000 7fd8afe89640 1 -- 172.21.15.151:0/849713734 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94701852924640] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a010e030 con 0x56217e4d1e80 2024-09-10T14:30:40.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.500+0000 7fd8b2379980 20 remove_watcher() i=2 2024-09-10T14:30:40.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.500+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94701852928144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e5023f0 con 0x7fd8a00b09b0 2024-09-10T14:30:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.504+0000 7fd8af688640 1 -- 172.21.15.151:0/849713734 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94701852928144] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd898037040 con 0x7fd8a00b09b0 2024-09-10T14:30:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.504+0000 7fd8b2379980 20 remove_watcher() i=3 2024-09-10T14:30:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.504+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94701852930272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d9ae0 con 0x56217e4cd490 2024-09-10T14:30:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.504+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94701852930272] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x56217e4cd490 2024-09-10T14:30:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.504+0000 7fd8b2379980 20 remove_watcher() i=4 2024-09-10T14:30:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.504+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94701852920864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4d8800 con 0x7fd89801fbe0 2024-09-10T14:30:40.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.508+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94701852920864] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.508+0000 7fd8b2379980 20 remove_watcher() i=5 2024-09-10T14:30:40.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.508+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94701852935168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e4da890 con 0x7fd89801fbe0 2024-09-10T14:30:40.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.508+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94701852935168] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.508+0000 7fd8b2379980 20 remove_watcher() i=6 2024-09-10T14:30:40.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.508+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94701852937664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56217e5023f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94701852937664] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8a80083f0 con 0x7fd89801fbe0 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 20 remove_watcher() i=7 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd89801fbe0 msgr2=0x7fd89803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fd89801fbe0 0x7fd89803a3c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e4cd490 msgr2=0x56217e4cf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e4cd490 0x56217e4cf950 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd8a00b09b0 msgr2=0x7fd8a00b88d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fd8a00b09b0 0x7fd8a00b88d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e4d1e80 msgr2=0x56217e4d4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e4d1e80 0x56217e4d4270 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7780346a0 msgr2=0x7fd778036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd7780346a0 0x7fd778036b60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd89800c010 tx=0x7fd898010000 comp rx=0 tx=0).stop 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b068a640 1 -- 172.21.15.151:0/849713734 reap_dead start 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 msgr2=0x56217e4c22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4c22f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00ee030 tx=0x7fd8a00ce5a0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 shutdown_connections 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/849713734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4bb1d0 0x56217e4c22f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 >> 172.21.15.151:0/849713734 conn(0x56217e4b7550 msgr2=0x56217e4b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 shutdown_connections 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/849713734 wait complete. 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/1283852078 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd788034650 msgr2=0x7fd788036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/1283852078 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd788034650 0x7fd788036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x56217e4a11b0 tx=0x7fd89800f000 comp rx=0 tx=0).stop 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/1283852078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4ae840 msgr2=0x56217e4aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/1283852078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4ae840 0x56217e4aec60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00c6710 tx=0x7fd8a00cf810 comp rx=0 tx=0).stop 2024-09-10T14:30:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/1283852078 shutdown_connections 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/1283852078 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd788034650 0x7fd788036b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/1283852078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e4ae840 0x56217e4aec60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/1283852078 >> 172.21.15.151:0/1283852078 conn(0x56217e4a3990 msgr2=0x56217e4a6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/1283852078 shutdown_connections 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/1283852078 wait complete. 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56217e49e250 msgr2=0x56217e4a0640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56217e49e250 0x56217e4a0640 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e3a0f80 msgr2=0x56217e497b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56217e3a0f80 0x56217e497b40 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e49a350 msgr2=0x56217e49c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56217e49a350 0x56217e49c740 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd798034650 msgr2=0x7fd798036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fd798034650 0x7fd798036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd898000f70 tx=0x7fd898001380 comp rx=0 tx=0).stop 2024-09-10T14:30:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 msgr2=0x56217e490a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 --2- 172.21.15.151:0/2884617299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56217e3a0630 0x56217e490a40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd8a001aec0 tx=0x7fd8a0017e30 comp rx=0 tx=0).stop 2024-09-10T14:30:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b068a640 1 -- 172.21.15.151:0/2884617299 reap_dead start 2024-09-10T14:30:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 shutdown_connections 2024-09-10T14:30:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 >> 172.21.15.151:0/2884617299 conn(0x56217e39c150 msgr2=0x56217e483ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 shutdown_connections 2024-09-10T14:30:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.512+0000 7fd8b2379980 1 -- 172.21.15.151:0/2884617299 wait complete. 2024-09-10T14:30:40.526 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T14:30:40.494602Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.494590Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:40.526 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T14:30:40.494602Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.494590Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:40.526 ERROR:root:0 2024-09-10T14:30:40.527 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:40.532 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:40.532 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-10T14:30:40.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-10T14:30:40.532 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-10T14:30:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.588+0000 7f0d93f27980 1 Processor -- start 2024-09-10T14:30:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.588+0000 7f0d93f27980 1 -- start start 2024-09-10T14:30:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.588+0000 7f0d93f27980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563339b6cfa0 0x563339b6ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.588+0000 7f0d93f27980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563339a7eae0 con 0x563339b6cb90 2024-09-10T14:30:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.588+0000 7f0d93f27980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x563339aa2e30 con 0x563339b6cfa0 2024-09-10T14:30:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d91236640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563339b6cfa0 0x563339b6ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d91a37640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x563339b6cb90 0x563339b6b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33364/0 (socket says 172.21.15.151:33364) 2024-09-10T14:30:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d91236640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x563339b6cfa0 0x563339b6ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51038/0 (socket says 172.21.15.151:51038) 2024-09-10T14:30:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d91a37640 1 -- 172.21.15.151:0/2064426091 learned_addr learned my addr 172.21.15.151:0/2064426091 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:30:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d91236640 1 -- 172.21.15.151:0/2064426091 >> v1:172.21.15.52:6789/0 conn(0x563339b6cb90 legacy=0x563339b6b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d91236640 1 -- 172.21.15.151:0/2064426091 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563339b6c0c0 con 0x563339b6cfa0 2024-09-10T14:30:40.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d91236640 1 --2- 172.21.15.151:0/2064426091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cfa0 0x563339b6ba60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800a480 tx=0x7f0d8801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cd0cb022c7cee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d90a35640 1 -- 172.21.15.151:0/2064426091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d880b0070 con 0x563339b6cfa0 2024-09-10T14:30:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d90a35640 1 -- 172.21.15.151:0/2064426091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d880ab540 con 0x563339b6cfa0 2024-09-10T14:30:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.592+0000 7f0d90a35640 1 -- 172.21.15.151:0/2064426091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d880ab840 con 0x563339b6cfa0 2024-09-10T14:30:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.596+0000 7f0d93f27980 1 -- 172.21.15.151:0/2064426091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cfa0 msgr2=0x563339b6ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.596+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2064426091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cfa0 0x563339b6ba60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800a480 tx=0x7f0d8801b280 comp rx=0 tx=0).stop 2024-09-10T14:30:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.596+0000 7f0d93f27980 1 -- 172.21.15.151:0/2064426091 shutdown_connections 2024-09-10T14:30:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.596+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2064426091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cfa0 0x563339b6ba60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.596+0000 7f0d93f27980 1 -- 172.21.15.151:0/2064426091 >> 172.21.15.151:0/2064426091 conn(0x563339bf2170 msgr2=0x563339bf4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.596+0000 7f0d93f27980 1 -- 172.21.15.151:0/2064426091 shutdown_connections 2024-09-10T14:30:40.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.596+0000 7f0d93f27980 1 -- 172.21.15.151:0/2064426091 wait complete. 2024-09-10T14:30:40.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 Processor -- start 2024-09-10T14:30:40.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 -- start start 2024-09-10T14:30:40.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ce3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563339aa4200 con 0x563339b6cb90 2024-09-10T14:30:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ce3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ce3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51040/0 (socket says 172.21.15.151:51040) 2024-09-10T14:30:40.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d91a37640 1 -- 172.21.15.151:0/272037526 learned_addr learned my addr 172.21.15.151:0/272037526 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d91a37640 1 -- 172.21.15.151:0/272037526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563339ce4190 con 0x563339b6cb90 2024-09-10T14:30:40.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d91a37640 1 --2- 172.21.15.151:0/272037526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ce3bc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0d840015f0 tx=0x7f0d84001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7c751ee9ec7fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0c7fe07640 1 -- 172.21.15.151:0/272037526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84004530 con 0x563339b6cb90 2024-09-10T14:30:40.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0c7fe07640 1 -- 172.21.15.151:0/272037526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d840046f0 con 0x563339b6cb90 2024-09-10T14:30:40.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0c7fe07640 1 -- 172.21.15.151:0/272037526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84004a90 con 0x563339b6cb90 2024-09-10T14:30:40.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 -- 172.21.15.151:0/272037526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 msgr2=0x563339ce3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 --2- 172.21.15.151:0/272037526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ce3bc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0d840015f0 tx=0x7f0d84001ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 -- 172.21.15.151:0/272037526 shutdown_connections 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 --2- 172.21.15.151:0/272037526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ce3bc0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 -- 172.21.15.151:0/272037526 >> 172.21.15.151:0/272037526 conn(0x563339bf2170 msgr2=0x563339cdf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 -- 172.21.15.151:0/272037526 shutdown_connections 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 -- 172.21.15.151:0/272037526 wait complete. 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 Processor -- start 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.608+0000 7f0d93f27980 1 -- start start 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d93f27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ceaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d93f27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563339c021c0 con 0x563339b6cb90 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ceaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ceaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51048/0 (socket says 172.21.15.151:51048) 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d91a37640 1 -- 172.21.15.151:0/1464415991 learned_addr learned my addr 172.21.15.151:0/1464415991 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d91a37640 1 -- 172.21.15.151:0/1464415991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563339ceb490 con 0x563339b6cb90 2024-09-10T14:30:40.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d91a37640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ceaf50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x563339ce4da0 tx=0x7f0d84000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0c7e604640 1 -- 172.21.15.151:0/1464415991 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84013760 con 0x563339b6cb90 2024-09-10T14:30:40.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563339ceb720 con 0x563339b6cb90 2024-09-10T14:30:40.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563339cee400 con 0x563339b6cb90 2024-09-10T14:30:40.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0c7e604640 1 -- 172.21.15.151:0/1464415991 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d84013900 con 0x563339b6cb90 2024-09-10T14:30:40.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0c7e604640 1 -- 172.21.15.151:0/1464415991 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84013be0 con 0x563339b6cb90 2024-09-10T14:30:40.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0c7e604640 1 -- 172.21.15.151:0/1464415991 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d84010070 con 0x563339b6cb90 2024-09-10T14:30:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0c7e604640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c78034650 0x7f0c78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0c7e604640 1 -- 172.21.15.151:0/1464415991 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0d84018070 con 0x563339b6cb90 2024-09-10T14:30:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d91236640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c78034650 0x7f0c78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d93f27980 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339b6cfa0 0x563339cf1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339cf2580 con 0x563339b6cfa0 2024-09-10T14:30:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d92238640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339b6cfa0 0x563339cf1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d91236640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c78034650 0x7f0c78036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0d880ad000 tx=0x7f0d880a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d92238640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339b6cfa0 0x563339cf1f60 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d92238640 1 -- 172.21.15.151:0/1464415991 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339b6cfa0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.612+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339cef620 con 0x563339b6cfa0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d92238640 1 -- 172.21.15.151:0/1464415991 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339b6cfa0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339cf48d0 0x563339cf6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339cf7390 con 0x563339cf48d0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91a37640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339cf48d0 0x563339cf6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91a37640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339cf48d0 0x563339cf6cc0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91a37640 1 -- 172.21.15.151:0/1464415991 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d8401b030 con 0x563339cf48d0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339cf3770 con 0x563339b6cfa0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d92238640 1 -- 172.21.15.151:0/1464415991 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339b6cfa0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563339cf87d0 0x563339cfabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339cfb350 con 0x563339cf87d0 2024-09-10T14:30:40.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91236640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563339cf87d0 0x563339cfabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91236640 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563339cf87d0 0x563339cfabc0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91236640 1 -- 172.21.15.151:0/1464415991 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0d880b3040 con 0x563339cf87d0 2024-09-10T14:30:40.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 Processor -- start 2024-09-10T14:30:40.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 -- start start 2024-09-10T14:30:40.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d08e00 0x563339d09220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d93f27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563339afd800 con 0x563339d08e00 2024-09-10T14:30:40.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d08e00 0x563339d09220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d08e00 0x563339d09220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51052/0 (socket says 172.21.15.151:51052) 2024-09-10T14:30:40.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.616+0000 7f0d91a37640 1 -- 172.21.15.151:0/2948568175 learned_addr learned my addr 172.21.15.151:0/2948568175 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d91a37640 1 -- 172.21.15.151:0/2948568175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563339d09760 con 0x563339d08e00 2024-09-10T14:30:40.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d91a37640 1 --2- 172.21.15.151:0/2948568175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d08e00 0x563339d09220 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0d840483d0 tx=0x7f0d84028ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0c777fe640 1 -- 172.21.15.151:0/2948568175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84010c30 con 0x563339d08e00 2024-09-10T14:30:40.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0c777fe640 1 -- 172.21.15.151:0/2948568175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d84010dd0 con 0x563339d08e00 2024-09-10T14:30:40.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0c777fe640 1 -- 172.21.15.151:0/2948568175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d840295c0 con 0x563339d08e00 2024-09-10T14:30:40.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d93f27980 1 -- 172.21.15.151:0/2948568175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563339d099f0 con 0x563339d08e00 2024-09-10T14:30:40.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d93f27980 1 -- 172.21.15.151:0/2948568175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563339d0c670 con 0x563339d08e00 2024-09-10T14:30:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0c777fe640 1 -- 172.21.15.151:0/2948568175 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d84029760 con 0x563339d08e00 2024-09-10T14:30:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0c777fe640 1 --2- 172.21.15.151:0/2948568175 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c6c0346a0 0x7f0c6c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0c777fe640 1 -- 172.21.15.151:0/2948568175 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0d8403b070 con 0x563339d08e00 2024-09-10T14:30:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d91236640 1 --2- 172.21.15.151:0/2948568175 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c6c0346a0 0x7f0c6c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d93f27980 1 Processor -- start 2024-09-10T14:30:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d93f27980 1 -- start start 2024-09-10T14:30:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d91236640 1 --2- 172.21.15.151:0/2948568175 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c6c0346a0 0x7f0c6c036b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0d8801b2c0 tx=0x7f0d88005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d93f27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d15a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.620+0000 7f0d93f27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563339ce4510 con 0x563339d15650 2024-09-10T14:30:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d15a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d15a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51054/0 (socket says 172.21.15.151:51054) 2024-09-10T14:30:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 -- 172.21.15.151:0/3330352621 learned_addr learned my addr 172.21.15.151:0/3330352621 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 -- 172.21.15.151:0/3330352621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563339d16020 con 0x563339d15650 2024-09-10T14:30:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 --2- 172.21.15.151:0/3330352621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d15a50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0d840046c0 tx=0x7f0d84038f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c333c375edc2ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0c757fa640 1 -- 172.21.15.151:0/3330352621 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d8405e020 con 0x563339d15650 2024-09-10T14:30:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0c757fa640 1 -- 172.21.15.151:0/3330352621 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d84036460 con 0x563339d15650 2024-09-10T14:30:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0c757fa640 1 -- 172.21.15.151:0/3330352621 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84041df0 con 0x563339d15650 2024-09-10T14:30:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- 172.21.15.151:0/3330352621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 msgr2=0x563339d15a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 --2- 172.21.15.151:0/3330352621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d15a50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0d840046c0 tx=0x7f0d84038f30 comp rx=0 tx=0).stop 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- 172.21.15.151:0/3330352621 shutdown_connections 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 --2- 172.21.15.151:0/3330352621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d15a50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- 172.21.15.151:0/3330352621 >> 172.21.15.151:0/3330352621 conn(0x563339d11ac0 msgr2=0x563339d0fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- 172.21.15.151:0/3330352621 shutdown_connections 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- 172.21.15.151:0/3330352621 wait complete. 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 Processor -- start 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- start start 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d1c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563339d16530 con 0x563339d15650 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d1c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d1c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51064/0 (socket says 172.21.15.151:51064) 2024-09-10T14:30:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 learned_addr learned my addr 172.21.15.151:0/2462121186 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563339d1cd80 con 0x563339d15650 2024-09-10T14:30:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d91a37640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d1c840 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0d840046c0 tx=0x7f0d8402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0c637fe640 1 -- 172.21.15.151:0/2462121186 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84069070 con 0x563339d15650 2024-09-10T14:30:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563339d1cd80 con 0x563339d15650 2024-09-10T14:30:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0c637fe640 1 -- 172.21.15.151:0/2462121186 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8403fcb0 con 0x563339d15650 2024-09-10T14:30:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563339d1cd80 con 0x563339d15650 2024-09-10T14:30:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.624+0000 7f0c637fe640 1 -- 172.21.15.151:0/2462121186 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84073060 con 0x563339d15650 2024-09-10T14:30:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0c637fe640 1 -- 172.21.15.151:0/2462121186 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d8406c070 con 0x563339d15650 2024-09-10T14:30:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0c637fe640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034600 0x7f0c5c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0c637fe640 1 -- 172.21.15.151:0/2462121186 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0d840531b0 con 0x563339d15650 2024-09-10T14:30:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d91236640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034600 0x7f0c5c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339d278b0 0x563339d29d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2a490 con 0x563339d278b0 2024-09-10T14:30:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d92238640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339d278b0 0x563339d29d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d91236640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034600 0x7f0c5c036ac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d88018eb0 tx=0x7f0d880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d92238640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339d278b0 0x563339d29d40 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 realm 2024-09-10T14:30:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2a8a0 con 0x563339d278b0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b140 con 0x563339d278b0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339d2c240 0x563339d2e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2ecd0 con 0x563339d2c240 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d91a37640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339d2c240 0x563339d2e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d91a37640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339d2c240 0x563339d2e630 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 20 searching for the correct realm 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.628+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d30530 con 0x563339d2c240 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d91a37640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d8406e070 0x7f0d84045630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d30530 con 0x7f0d8406e070 2024-09-10T14:30:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d91236640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d8406e070 0x7f0d84045630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d91236640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d8406e070 0x7f0d84045630 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d91236640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d880cd040 0x7f0d880ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d30530 con 0x7f0d880cd040 2024-09-10T14:30:40.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d880cd040 0x7f0d880ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d880cd040 0x7f0d880ce430 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d880cd040 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.632+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d880cd040 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d8406e070 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d2c240 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d880cd040 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d8406e070 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d2c240 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d2c240 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d8406e070 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d2c240 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d2c240 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.636+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d880cd040 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d2c240 2024-09-10T14:30:40.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d8406e070 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d8406e070 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d2c240 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d880cd040 2024-09-10T14:30:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d8406e070 2024-09-10T14:30:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d2c240 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d880cd040 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x563339d278b0 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.640+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x563339d2b4e0 con 0x7f0d8406e070 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2f620 con 0x563339d278b0 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2fe70 con 0x563339d278b0 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2f9c0 con 0x7f0d880cd040 2024-09-10T14:30:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 zone default found 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 4 Realm: () 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 zonegroup default 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d2fdf0 con 0x7f0d8406e070 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d32340 con 0x563339d2c240 2024-09-10T14:30:40.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d32830 con 0x563339d2c240 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 started sync module instance, tier type = 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d317e0 con 0x7f0d8406e070 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94778013457360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d31440 con 0x7f0d8406e070 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.644+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d33650 con 0x563339d278b0 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.648+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94778013457360] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.648+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.648+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94778013461648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d33a40 con 0x563339d278b0 2024-09-10T14:30:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.648+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d34400 con 0x563339d2c240 2024-09-10T14:30:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.648+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94778013461648] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.648+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94778013466448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d347f0 con 0x563339d2c240 2024-09-10T14:30:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d351b0 con 0x7f0d8406e070 2024-09-10T14:30:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94778013469952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d35a00 con 0x7f0d8406e070 2024-09-10T14:30:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d36400 con 0x563339d278b0 2024-09-10T14:30:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94778013466448] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94778013469952] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94778013472080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d35f10 con 0x563339d278b0 2024-09-10T14:30:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.652+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d36ca0 con 0x7f0d880cd040 2024-09-10T14:30:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.656+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.656+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94778013476704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d37030 con 0x7f0d880cd040 2024-09-10T14:30:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.656+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d37a80 con 0x7f0d880cd040 2024-09-10T14:30:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.656+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94778013472080] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.656+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94778013476704] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.656+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.656+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94778013480304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d36bc0 con 0x7f0d880cd040 2024-09-10T14:30:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.656+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d38110 con 0x7f0d880cd040 2024-09-10T14:30:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94778013480304] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94778013462704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d38110 con 0x7f0d880cd040 2024-09-10T14:30:40.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 20 add_watcher() i=0 2024-09-10T14:30:40.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 20 add_watcher() i=1 2024-09-10T14:30:40.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 20 add_watcher() i=2 2024-09-10T14:30:40.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 20 add_watcher() i=3 2024-09-10T14:30:40.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 20 add_watcher() i=4 2024-09-10T14:30:40.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 20 add_watcher() i=5 2024-09-10T14:30:40.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 20 add_watcher() i=6 2024-09-10T14:30:40.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94778013462704] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 20 add_watcher() i=7 2024-09-10T14:30:40.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:40.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d3b2a0 con 0x563339d278b0 2024-09-10T14:30:40.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.660+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94778013482080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d38530 con 0x563339d278b0 2024-09-10T14:30:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.664+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94778013482080] v36'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.664+0000 7f0c437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.664+0000 7f0d93f27980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.664+0000 7f0d93f27980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.664+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d3aa80 con 0x563339d278b0 2024-09-10T14:30:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.664+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.664+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d44360 con 0x7f0d880cd040 2024-09-10T14:30:40.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.668+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.668+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d44360 con 0x563339d2c240 2024-09-10T14:30:40.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.668+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.668+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d44360 con 0x563339d278b0 2024-09-10T14:30:40.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.668+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'247 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.668+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d44dc0 con 0x7f0d8406e070 2024-09-10T14:30:40.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.668+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'78 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.672+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d452c0 con 0x563339d2c240 2024-09-10T14:30:40.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.672+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.672+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d452c0 con 0x563339d278b0 2024-09-10T14:30:40.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.672+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.672+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d452c0 con 0x7f0d880cd040 2024-09-10T14:30:40.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.676+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.676+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45350 con 0x7f0d8406e070 2024-09-10T14:30:40.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.676+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.676+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d458c0 con 0x563339d2c240 2024-09-10T14:30:40.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.680+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.680+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d458c0 con 0x7f0d8406e070 2024-09-10T14:30:40.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.680+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.680+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x7f0d880cd040 2024-09-10T14:30:40.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.680+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.680+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x7f0d8406e070 2024-09-10T14:30:40.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.684+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.684+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x7f0d880cd040 2024-09-10T14:30:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.684+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.684+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x563339d278b0 2024-09-10T14:30:40.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.688+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'248 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.688+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x563339d2c240 2024-09-10T14:30:40.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.688+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.688+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x7f0d8406e070 2024-09-10T14:30:40.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.688+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.688+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x563339d2c240 2024-09-10T14:30:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.692+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.692+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x563339d278b0 2024-09-10T14:30:40.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.692+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.692+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x563339d278b0 2024-09-10T14:30:40.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.692+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'249 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.692+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45d70 con 0x563339d2c240 2024-09-10T14:30:40.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.696+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.696+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x7f0d8406e070 2024-09-10T14:30:40.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.696+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.696+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x563339d2c240 2024-09-10T14:30:40.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.696+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.696+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x563339d2c240 2024-09-10T14:30:40.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.700+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.700+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x563339d2c240 2024-09-10T14:30:40.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.700+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.700+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x563339d2c240 2024-09-10T14:30:40.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.700+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'53 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.700+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x7f0d880cd040 2024-09-10T14:30:40.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.704+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.704+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x563339d2c240 2024-09-10T14:30:40.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.704+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.704+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x7f0d880cd040 2024-09-10T14:30:40.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.708+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.708+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x563339d2c240 2024-09-10T14:30:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.708+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.708+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x7f0d880cd040 2024-09-10T14:30:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d45dc0 con 0x7f0d8406e070 2024-09-10T14:30:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0c427fc640 20 reqs_thread_entry: start 2024-09-10T14:30:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0d93f27980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0d93f27980 20 Filter name: none 2024-09-10T14:30:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0bb3fff640 20 reqs_thread_entry: start 2024-09-10T14:30:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0d93f27980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T14:30:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.712+0000 7f0d93f27980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d42de0 con 0x7f0d880cd040 2024-09-10T14:30:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 20 rados_obj.operate() r=0 bl.length=349 2024-09-10T14:30:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-10T14:30:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T14:30:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d428b0 con 0x7f0d880cd040 2024-09-10T14:30:40.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 10 removing key index: system_akey 2024-09-10T14:30:40.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d428b0 con 0x563339d2c240 2024-09-10T14:30:40.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(96 system_akey [delete] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94778013656256 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d63ea0 con 0x563339d278b0 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== watch-notify(notify (1) cookie 94778013461648 notify 154618822679 ret 0) ==== 203+0+0 (crc 0 0 0) 0x563339d44e10 con 0x563339d278b0 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(97 notify.1 [notify cookie 94778013656256 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0c74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822679 cookie 94778013461648 notifier 4848 bl.length()=161 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0c74ff9640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f0bbc0032d0 con 0x563339d278b0 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== watch-notify(notify_complete (2) cookie 94778013656256 notify 154618822679 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563339d099f0 con 0x563339d278b0 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 10 removing email index: 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 10 removing user buckets index 2024-09-10T14:30:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.716+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d61910 con 0x7f0d880cd040 2024-09-10T14:30:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(99 system_user.buckets [delete] v36'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d93f27980 10 removing user index: system_user 2024-09-10T14:30:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d61910 con 0x7f0d880cd040 2024-09-10T14:30:40.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(100 system_user [call,call,delete] v36'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d93f27980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-10T14:30:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d93f27980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T14:30:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94778013652064 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x563339d61880 con 0x7f0d8406e070 2024-09-10T14:30:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== watch-notify(notify (1) cookie 94778013457360 notify 154618822706 ret 0) ==== 202+0+0 (crc 0 0 0) 0x563339d44530 con 0x7f0d8406e070 2024-09-10T14:30:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0c74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822706 cookie 94778013457360 notifier 4848 bl.length()=160 2024-09-10T14:30:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(101 notify.0 [notify cookie 94778013652064 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.720+0000 7f0c74ff9640 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f0bbc0032d0 con 0x7f0d8406e070 2024-09-10T14:30:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== watch-notify(notify_complete (2) cookie 94778013652064 notify 154618822706 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563339d456f0 con 0x7f0d8406e070 2024-09-10T14:30:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0c437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94778013482080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d40bc0 con 0x563339d278b0 2024-09-10T14:30:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94778013482080] v36'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94778013457360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d37c60 con 0x7f0d8406e070 2024-09-10T14:30:40.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94778013457360] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d93f27980 20 remove_watcher() i=0 2024-09-10T14:30:40.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d93f27980 2 removed watcher, disabling cache 2024-09-10T14:30:40.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.724+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94778013461648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d37c60 con 0x563339d278b0 2024-09-10T14:30:40.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.728+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94778013461648] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.728+0000 7f0d93f27980 20 remove_watcher() i=1 2024-09-10T14:30:40.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.728+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94778013466448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d37c60 con 0x563339d2c240 2024-09-10T14:30:40.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.728+0000 7f0d91a37640 1 -- 172.21.15.151:0/2462121186 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94778013466448] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8406b030 con 0x563339d2c240 2024-09-10T14:30:40.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.728+0000 7f0d93f27980 20 remove_watcher() i=2 2024-09-10T14:30:40.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.728+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94778013469952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d33f50 con 0x7f0d8406e070 2024-09-10T14:30:40.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.732+0000 7f0d91236640 1 -- 172.21.15.151:0/2462121186 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94778013469952] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d880d8070 con 0x7f0d8406e070 2024-09-10T14:30:40.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.732+0000 7f0d93f27980 20 remove_watcher() i=3 2024-09-10T14:30:40.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.732+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94778013472080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d37c60 con 0x563339d278b0 2024-09-10T14:30:40.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.732+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94778013472080] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x563339d278b0 2024-09-10T14:30:40.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.732+0000 7f0d93f27980 20 remove_watcher() i=4 2024-09-10T14:30:40.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.732+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94778013476704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d34d00 con 0x7f0d880cd040 2024-09-10T14:30:40.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.736+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94778013476704] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.736+0000 7f0d93f27980 20 remove_watcher() i=5 2024-09-10T14:30:40.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.736+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94778013480304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d33f50 con 0x7f0d880cd040 2024-09-10T14:30:40.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.736+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94778013480304] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.736+0000 7f0d93f27980 20 remove_watcher() i=6 2024-09-10T14:30:40.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.736+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94778013462704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x563339d37c60 con 0x7f0d880cd040 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94778013462704] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d8c0083f0 con 0x7f0d880cd040 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 20 remove_watcher() i=7 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d880cd040 msgr2=0x7f0d880ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d880cd040 0x7f0d880ce430 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339d278b0 msgr2=0x563339d29d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339d278b0 0x563339d29d40 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d8406e070 msgr2=0x7f0d84045630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d8406e070 0x7f0d84045630 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339d2c240 msgr2=0x563339d2e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339d2c240 0x563339d2e630 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034600 msgr2=0x7f0c5c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034600 0x7f0c5c036ac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d88018eb0 tx=0x7f0d880a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d92238640 1 -- 172.21.15.151:0/2462121186 reap_dead start 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 msgr2=0x563339d1c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d1c840 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0d840046c0 tx=0x7f0d8402bf20 comp rx=0 tx=0).stop 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 shutdown_connections 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2462121186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d15650 0x563339d1c840 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 >> 172.21.15.151:0/2462121186 conn(0x563339d11ac0 msgr2=0x563339d0fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 shutdown_connections 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2462121186 wait complete. 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2948568175 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c6c0346a0 msgr2=0x7f0c6c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2948568175 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c6c0346a0 0x7f0c6c036b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0d8801b2c0 tx=0x7f0d88005a10 comp rx=0 tx=0).stop 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2948568175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d08e00 msgr2=0x563339d09220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2948568175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d08e00 0x563339d09220 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0d840483d0 tx=0x7f0d84028ef0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2948568175 shutdown_connections 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2948568175 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c6c0346a0 0x7f0c6c036b60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/2948568175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339d08e00 0x563339d09220 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2948568175 >> 172.21.15.151:0/2948568175 conn(0x563339cfdf50 msgr2=0x563339d009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2948568175 shutdown_connections 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/2948568175 wait complete. 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563339cf87d0 msgr2=0x563339cfabc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x563339cf87d0 0x563339cfabc0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339b6cfa0 msgr2=0x563339cf1f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x563339b6cfa0 0x563339cf1f60 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339cf48d0 msgr2=0x563339cf6cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x563339cf48d0 0x563339cf6cc0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c78034650 msgr2=0x7f0c78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c78034650 0x7f0c78036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0d880ad000 tx=0x7f0d880a5040 comp rx=0 tx=0).stop 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 msgr2=0x563339ceaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 --2- 172.21.15.151:0/1464415991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563339b6cb90 0x563339ceaf50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x563339ce4da0 tx=0x7f0d84000f50 comp rx=0 tx=0).stop 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d92238640 1 -- 172.21.15.151:0/1464415991 reap_dead start 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 shutdown_connections 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 >> 172.21.15.151:0/1464415991 conn(0x563339bf2170 msgr2=0x563339cde370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 shutdown_connections 2024-09-10T14:30:40.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.740+0000 7f0d93f27980 1 -- 172.21.15.151:0/1464415991 wait complete. 2024-09-10T14:30:40.754 ERROR:root:None 2024-09-10T14:30:40.754 ERROR:root:0 2024-09-10T14:30:40.754 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T14:30:40.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T14:30:40.755 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-10T14:30:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008a95a980 1 Processor -- start 2024-09-10T14:30:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008a95a980 1 -- start start 2024-09-10T14:30:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008a95a980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5594b1ce5a60 0x5594b1d74310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008a95a980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594b1bf9ae0 con 0x5594b1d74850 2024-09-10T14:30:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008a95a980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5594b1c1de30 con 0x5594b1ce5a60 2024-09-10T14:30:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008846a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5594b1ce5a60 0x5594b1d74310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f0087c69640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5594b1d74850 0x5594b1d76c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33368/0 (socket says 172.21.15.151:33368) 2024-09-10T14:30:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008846a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5594b1ce5a60 0x5594b1d74310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51070/0 (socket says 172.21.15.151:51070) 2024-09-10T14:30:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f0087c69640 1 -- 172.21.15.151:0/644418592 learned_addr learned my addr 172.21.15.151:0/644418592 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:30:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008846a640 1 -- 172.21.15.151:0/644418592 >> v1:172.21.15.52:6789/0 conn(0x5594b1d74850 legacy=0x5594b1d76c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.828+0000 7f008846a640 1 -- 172.21.15.151:0/644418592 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b1d79370 con 0x5594b1ce5a60 2024-09-10T14:30:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f008846a640 1 --2- 172.21.15.151:0/644418592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1d74310 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f007800a480 tx=0x7f007801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbd02f2c726fb70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f0087468640 1 -- 172.21.15.151:0/644418592 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780b0070 con 0x5594b1ce5a60 2024-09-10T14:30:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f0087468640 1 -- 172.21.15.151:0/644418592 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00780ab540 con 0x5594b1ce5a60 2024-09-10T14:30:40.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f0087468640 1 -- 172.21.15.151:0/644418592 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780ab840 con 0x5594b1ce5a60 2024-09-10T14:30:40.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f008a95a980 1 -- 172.21.15.151:0/644418592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 msgr2=0x5594b1d74310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f008a95a980 1 --2- 172.21.15.151:0/644418592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1d74310 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f007800a480 tx=0x7f007801b280 comp rx=0 tx=0).stop 2024-09-10T14:30:40.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f008a95a980 1 -- 172.21.15.151:0/644418592 shutdown_connections 2024-09-10T14:30:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f008a95a980 1 --2- 172.21.15.151:0/644418592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1d74310 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f008a95a980 1 -- 172.21.15.151:0/644418592 >> 172.21.15.151:0/644418592 conn(0x5594b1d6c000 msgr2=0x5594b1d6e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f008a95a980 1 -- 172.21.15.151:0/644418592 shutdown_connections 2024-09-10T14:30:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.832+0000 7f008a95a980 1 -- 172.21.15.151:0/644418592 wait complete. 2024-09-10T14:30:40.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 Processor -- start 2024-09-10T14:30:40.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- start start 2024-09-10T14:30:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e5cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5594b1c1f200 con 0x5594b1ce5a60 2024-09-10T14:30:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e5cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e5cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51078/0 (socket says 172.21.15.151:51078) 2024-09-10T14:30:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 -- 172.21.15.151:0/4120415478 learned_addr learned my addr 172.21.15.151:0/4120415478 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 -- 172.21.15.151:0/4120415478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b1e5d080 con 0x5594b1ce5a60 2024-09-10T14:30:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 --2- 172.21.15.151:0/4120415478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e5cab0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f00780ae040 tx=0x7f0078003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbed42effbd99b74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7eff7561a640 1 -- 172.21.15.151:0/4120415478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780b0040 con 0x5594b1ce5a60 2024-09-10T14:30:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7eff7561a640 1 -- 172.21.15.151:0/4120415478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00780ab9d0 con 0x5594b1ce5a60 2024-09-10T14:30:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7eff7561a640 1 -- 172.21.15.151:0/4120415478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780abcf0 con 0x5594b1ce5a60 2024-09-10T14:30:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- 172.21.15.151:0/4120415478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 msgr2=0x5594b1e5cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 --2- 172.21.15.151:0/4120415478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e5cab0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f00780ae040 tx=0x7f0078003030 comp rx=0 tx=0).stop 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- 172.21.15.151:0/4120415478 shutdown_connections 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 --2- 172.21.15.151:0/4120415478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e5cab0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- 172.21.15.151:0/4120415478 >> 172.21.15.151:0/4120415478 conn(0x5594b1d6c000 msgr2=0x5594b1e586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- 172.21.15.151:0/4120415478 shutdown_connections 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- 172.21.15.151:0/4120415478 wait complete. 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 Processor -- start 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- start start 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e63cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008a95a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5594b1d78db0 con 0x5594b1ce5a60 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e63cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e63cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51084/0 (socket says 172.21.15.151:51084) 2024-09-10T14:30:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 -- 172.21.15.151:0/1164697616 learned_addr learned my addr 172.21.15.151:0/1164697616 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.848+0000 7f008846a640 1 -- 172.21.15.151:0/1164697616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b1e64200 con 0x5594b1ce5a60 2024-09-10T14:30:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f008846a640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e63cc0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0078019930 tx=0x7f0078018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7eff73e17640 1 -- 172.21.15.151:0/1164697616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780b0070 con 0x5594b1ce5a60 2024-09-10T14:30:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7eff73e17640 1 -- 172.21.15.151:0/1164697616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00780b68b0 con 0x5594b1ce5a60 2024-09-10T14:30:40.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7eff73e17640 1 -- 172.21.15.151:0/1164697616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780b6b90 con 0x5594b1ce5a60 2024-09-10T14:30:40.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594b1e64490 con 0x5594b1ce5a60 2024-09-10T14:30:40.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594b1e67170 con 0x5594b1ce5a60 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7eff73e17640 1 -- 172.21.15.151:0/1164697616 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00780bf3f0 con 0x5594b1ce5a60 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7eff73e17640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff6c034650 0x7eff6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7eff73e17640 1 -- 172.21.15.151:0/1164697616 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f00780bc070 con 0x5594b1ce5a60 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f0087c69640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff6c034650 0x7eff6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f008a95a980 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1d74850 0x5594b1e6ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1e6b270 con 0x5594b1d74850 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f0088c6b640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1d74850 0x5594b1e6ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f0087c69640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff6c034650 0x7eff6c036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0070001da0 tx=0x7f0070001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f0088c6b640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1d74850 0x5594b1e6ac50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f0088c6b640 1 -- 172.21.15.151:0/1164697616 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1d74850 2024-09-10T14:30:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1e6bb30 con 0x5594b1d74850 2024-09-10T14:30:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.852+0000 7f0088c6b640 1 -- 172.21.15.151:0/1164697616 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1d74850 2024-09-10T14:30:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1e6d440 0x5594b1e6f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1e70070 con 0x5594b1e6d440 2024-09-10T14:30:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008846a640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1e6d440 0x5594b1e6f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008846a640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1e6d440 0x5594b1e6f8e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008846a640 1 -- 172.21.15.151:0/1164697616 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00780b3040 con 0x5594b1e6d440 2024-09-10T14:30:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1e6c380 con 0x5594b1d74850 2024-09-10T14:30:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f0088c6b640 1 -- 172.21.15.151:0/1164697616 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1d74850 2024-09-10T14:30:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5594b1e714d0 0x5594b1e738c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1e74030 con 0x5594b1e714d0 2024-09-10T14:30:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f0087c69640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5594b1e714d0 0x5594b1e738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f0087c69640 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5594b1e714d0 0x5594b1e738c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f0087c69640 1 -- 172.21.15.151:0/1164697616 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f007000e6c0 con 0x5594b1e714d0 2024-09-10T14:30:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 Processor -- start 2024-09-10T14:30:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 -- start start 2024-09-10T14:30:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e81ae0 0x5594b1e81f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008a95a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5594b1c78800 con 0x5594b1e81ae0 2024-09-10T14:30:40.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e81ae0 0x5594b1e81f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e81ae0 0x5594b1e81f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51100/0 (socket says 172.21.15.151:51100) 2024-09-10T14:30:40.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.856+0000 7f008846a640 1 -- 172.21.15.151:0/4002555519 learned_addr learned my addr 172.21.15.151:0/4002555519 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008846a640 1 -- 172.21.15.151:0/4002555519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b1e82440 con 0x5594b1e81ae0 2024-09-10T14:30:40.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008846a640 1 --2- 172.21.15.151:0/4002555519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e81ae0 0x5594b1e81f00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f00780e2cb0 tx=0x7f00780b56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7eff71612640 1 -- 172.21.15.151:0/4002555519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780b4b80 con 0x5594b1e81ae0 2024-09-10T14:30:40.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7eff71612640 1 -- 172.21.15.151:0/4002555519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00780b4d20 con 0x5594b1e81ae0 2024-09-10T14:30:40.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008a95a980 1 -- 172.21.15.151:0/4002555519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594b1e826d0 con 0x5594b1e81ae0 2024-09-10T14:30:40.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7eff71612640 1 -- 172.21.15.151:0/4002555519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780bf860 con 0x5594b1e81ae0 2024-09-10T14:30:40.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008a95a980 1 -- 172.21.15.151:0/4002555519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594b1e826d0 con 0x5594b1e81ae0 2024-09-10T14:30:40.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7eff71612640 1 -- 172.21.15.151:0/4002555519 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00780bfa00 con 0x5594b1e81ae0 2024-09-10T14:30:40.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7eff71612640 1 --2- 172.21.15.151:0/4002555519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff60034650 0x7eff60036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7eff71612640 1 -- 172.21.15.151:0/4002555519 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f00780a8070 con 0x5594b1e81ae0 2024-09-10T14:30:40.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f0087c69640 1 --2- 172.21.15.151:0/4002555519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff60034650 0x7eff60036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008a95a980 1 Processor -- start 2024-09-10T14:30:40.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008a95a980 1 -- start start 2024-09-10T14:30:40.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f0087c69640 1 --2- 172.21.15.151:0/4002555519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff60034650 0x7eff60036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5594b1e70410 tx=0x7f007000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008a95a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e8e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008a95a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5594b1e5d340 con 0x5594b1e8e160 2024-09-10T14:30:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e8e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e8e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51102/0 (socket says 172.21.15.151:51102) 2024-09-10T14:30:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008846a640 1 -- 172.21.15.151:0/8313999 learned_addr learned my addr 172.21.15.151:0/8313999 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.860+0000 7f008846a640 1 -- 172.21.15.151:0/8313999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b1e8eb30 con 0x5594b1e8e160 2024-09-10T14:30:40.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008846a640 1 --2- 172.21.15.151:0/8313999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e8e560 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f00780a6f90 tx=0x7f00780d5f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec60735b2eecade7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7eff6affd640 1 -- 172.21.15.151:0/8313999 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780e9040 con 0x5594b1e8e160 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7eff6affd640 1 -- 172.21.15.151:0/8313999 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00780e12b0 con 0x5594b1e8e160 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7eff6affd640 1 -- 172.21.15.151:0/8313999 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780c03a0 con 0x5594b1e8e160 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- 172.21.15.151:0/8313999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 msgr2=0x5594b1e8e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 --2- 172.21.15.151:0/8313999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e8e560 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f00780a6f90 tx=0x7f00780d5f80 comp rx=0 tx=0).stop 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- 172.21.15.151:0/8313999 shutdown_connections 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 --2- 172.21.15.151:0/8313999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e8e560 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- 172.21.15.151:0/8313999 >> 172.21.15.151:0/8313999 conn(0x5594b1e8a590 msgr2=0x5594b1e88690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- 172.21.15.151:0/8313999 shutdown_connections 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- 172.21.15.151:0/8313999 wait complete. 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 Processor -- start 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- start start 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e95360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5594b1e8f000 con 0x5594b1e8e160 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e95360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008846a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e95360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51106/0 (socket says 172.21.15.151:51106) 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 learned_addr learned my addr 172.21.15.151:0/2919487380 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594b1e958a0 con 0x5594b1e8e160 2024-09-10T14:30:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008846a640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e95360 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f00780a6f90 tx=0x7f00780bef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7eff697fa640 1 -- 172.21.15.151:0/2919487380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780fc040 con 0x5594b1e8e160 2024-09-10T14:30:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594b1e958a0 con 0x5594b1e8e160 2024-09-10T14:30:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594b1e958a0 con 0x5594b1e8e160 2024-09-10T14:30:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7eff697fa640 1 -- 172.21.15.151:0/2919487380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0078107070 con 0x5594b1e8e160 2024-09-10T14:30:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.864+0000 7eff697fa640 1 -- 172.21.15.151:0/2919487380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00780e9040 con 0x5594b1e8e160 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7eff697fa640 1 -- 172.21.15.151:0/2919487380 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00780c0990 con 0x5594b1e8e160 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7eff697fa640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff50034620 0x7eff50036ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7eff697fa640 1 -- 172.21.15.151:0/2919487380 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f00780a52b0 con 0x5594b1e8e160 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0087c69640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff50034620 0x7eff50036ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1ea02f0 0x5594b1ea2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea2ee0 con 0x5594b1ea02f0 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0088c6b640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1ea02f0 0x5594b1ea2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0087c69640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff50034620 0x7eff50036ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5594b1e74410 tx=0x7f0070010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0088c6b640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1ea02f0 0x5594b1ea2790 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 realm 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea32f0 con 0x5594b1ea02f0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3b90 con 0x5594b1ea02f0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1ea4c90 0x5594b1ea7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea76d0 con 0x5594b1ea4c90 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008846a640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1ea4c90 0x5594b1ea7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008846a640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1ea4c90 0x5594b1ea7080 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 20 searching for the correct realm 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea8f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008846a640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f00780e4090 0x7f00780d46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea8f30 con 0x7f00780e4090 2024-09-10T14:30:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0087c69640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f00780e4090 0x7f00780d46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0087c69640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f00780e4090 0x7f00780d46c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0087c69640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0070037040 0x7f0070036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.868+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea8f30 con 0x7f0070037040 2024-09-10T14:30:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0070037040 0x7f0070036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0070037040 0x7f0070036410 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f0070037040 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f0070037040 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f00780e4090 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.872+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f0070037040 2024-09-10T14:30:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f00780e4090 2024-09-10T14:30:40.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f00780e4090 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.876+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f0070037040 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f00780e4090 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f00780e4090 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f0070037040 2024-09-10T14:30:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f00780e4090 2024-09-10T14:30:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea4c90 2024-09-10T14:30:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f0070037040 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x5594b1ea02f0 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.880+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea3f30 con 0x7f00780e4090 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea8050 con 0x5594b1ea02f0 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea88a0 con 0x5594b1ea02f0 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea83f0 con 0x7f0070037040 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 zone default found 2024-09-10T14:30:40.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 4 Realm: () 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 zonegroup default 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea8820 con 0x7f00780e4090 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ea8d80 con 0x5594b1ea4c90 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eab310 con 0x5594b1ea4c90 2024-09-10T14:30:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 started sync module instance, tier type = 2024-09-10T14:30:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eaa680 con 0x7f00780e4090 2024-09-10T14:30:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94097128467056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eabc20 con 0x7f00780e4090 2024-09-10T14:30:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.884+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eac470 con 0x5594b1ea02f0 2024-09-10T14:30:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.888+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94097128467056] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.888+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.888+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94097128470384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eac470 con 0x5594b1ea02f0 2024-09-10T14:30:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.888+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eace90 con 0x5594b1ea4c90 2024-09-10T14:30:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.888+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.888+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94097128475008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ead6e0 con 0x5594b1ea4c90 2024-09-10T14:30:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.888+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eae1b0 con 0x7f00780e4090 2024-09-10T14:30:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94097128470384] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94097128472512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eaea80 con 0x7f00780e4090 2024-09-10T14:30:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eaf2d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94097128472512] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94097128475008] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94097128482256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eaeea0 con 0x5594b1ea02f0 2024-09-10T14:30:40.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.892+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eaf6f0 con 0x7f0070037040 2024-09-10T14:30:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.896+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94097128482256] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.896+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.896+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94097128483584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eaf4d0 con 0x7f0070037040 2024-09-10T14:30:40.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.896+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eb0100 con 0x7f0070037040 2024-09-10T14:30:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.896+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.896+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94097128488016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eb0520 con 0x7f0070037040 2024-09-10T14:30:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.896+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eb0f80 con 0x7f0070037040 2024-09-10T14:30:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.896+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94097128483584] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94097128488016] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94097128491616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eb0070 con 0x7f0070037040 2024-09-10T14:30:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 add_watcher() i=0 2024-09-10T14:30:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 add_watcher() i=1 2024-09-10T14:30:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 add_watcher() i=2 2024-09-10T14:30:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 add_watcher() i=3 2024-09-10T14:30:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 add_watcher() i=4 2024-09-10T14:30:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 add_watcher() i=5 2024-09-10T14:30:40.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 add_watcher() i=6 2024-09-10T14:30:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94097128491616] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 add_watcher() i=7 2024-09-10T14:30:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eb4080 con 0x5594b1ea02f0 2024-09-10T14:30:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94097128484640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eb1500 con 0x5594b1ea02f0 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94097128484640] v36'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7eff3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.900+0000 7f008a95a980 5 note: GC not initialized 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7eff3cfe1640 20 reqs_thread_entry: start 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 20 Filter name: none 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7efeb67fc640 20 reqs_thread_entry: start 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T14:30:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed7530 con 0x5594b1ea4c90 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 20 rados->read ofs=0 len=0 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed5cd0 con 0x5594b1ea4c90 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T14:30:40.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T14:30:40.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T14:30:40.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed6570 con 0x5594b1ea4c90 2024-09-10T14:30:40.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v36'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T14:30:40.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T14:30:40.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T14:30:40.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94097128644800 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1edab20 con 0x5594b1ea4c90 2024-09-10T14:30:40.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== watch-notify(notify (1) cookie 94097128475008 notify 154618822667 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5594b1ed6f80 con 0x5594b1ea4c90 2024-09-10T14:30:40.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7eff6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822667 cookie 94097128475008 notifier 4855 bl.length()=542 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(65 notify.2 [notify cookie 94097128644800 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7eff6affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7eff6affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7eff6affd640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7eff4c003eb0 con 0x5594b1ea4c90 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== watch-notify(notify_complete (2) cookie 94097128644800 notify 154618822667 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f00780d7070 con 0x5594b1ea4c90 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed6520 con 0x5594b1ea4c90 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v36'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T14:30:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.904+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94097128644720 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed6490 con 0x7f0070037040 2024-09-10T14:30:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== watch-notify(notify (1) cookie 94097128483584 notify 154618822686 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f008002d060 con 0x7f0070037040 2024-09-10T14:30:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7eff6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822686 cookie 94097128483584 notifier 4855 bl.length()=175 2024-09-10T14:30:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7eff6affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T14:30:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7eff6affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T14:30:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7eff6affd640 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7eff4c003eb0 con 0x7f0070037040 2024-09-10T14:30:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(68 notify.5 [notify cookie 94097128644720 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== watch-notify(notify_complete (2) cookie 94097128644720 notify 154618822686 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f008001e040 con 0x7f0070037040 2024-09-10T14:30:40.914 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-10T14:30:40.908221Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.908209Z","tags":[],"group_ids":[]} 2024-09-10T14:30:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7eff3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.908+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94097128484640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed5330 con 0x5594b1ea02f0 2024-09-10T14:30:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94097128484640] v36'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94097128467056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed5330 con 0x7f00780e4090 2024-09-10T14:30:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94097128467056] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f008a95a980 20 remove_watcher() i=0 2024-09-10T14:30:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f008a95a980 2 removed watcher, disabling cache 2024-09-10T14:30:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94097128470384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed5330 con 0x5594b1ea02f0 2024-09-10T14:30:40.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94097128470384] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f008a95a980 20 remove_watcher() i=1 2024-09-10T14:30:40.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.912+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94097128475008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eab770 con 0x5594b1ea4c90 2024-09-10T14:30:40.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.916+0000 7f008846a640 1 -- 172.21.15.151:0/2919487380 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94097128475008] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00780eb070 con 0x5594b1ea4c90 2024-09-10T14:30:40.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.916+0000 7f008a95a980 20 remove_watcher() i=2 2024-09-10T14:30:40.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.916+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94097128472512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed5330 con 0x7f00780e4090 2024-09-10T14:30:40.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.916+0000 7f0087c69640 1 -- 172.21.15.151:0/2919487380 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94097128472512] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f007000e6c0 con 0x7f00780e4090 2024-09-10T14:30:40.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.916+0000 7f008a95a980 20 remove_watcher() i=3 2024-09-10T14:30:40.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.916+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94097128482256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eab770 con 0x5594b1ea02f0 2024-09-10T14:30:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.920+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94097128482256] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x5594b1ea02f0 2024-09-10T14:30:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.920+0000 7f008a95a980 20 remove_watcher() i=4 2024-09-10T14:30:40.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.920+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94097128483584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed5330 con 0x7f0070037040 2024-09-10T14:30:40.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.920+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94097128483584] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.920+0000 7f008a95a980 20 remove_watcher() i=5 2024-09-10T14:30:40.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.920+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94097128488016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1eae5d0 con 0x7f0070037040 2024-09-10T14:30:40.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94097128488016] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 20 remove_watcher() i=6 2024-09-10T14:30:40.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94097128491616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5594b1ed5330 con 0x7f0070037040 2024-09-10T14:30:40.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94097128491616] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008000a4d0 con 0x7f0070037040 2024-09-10T14:30:40.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 20 remove_watcher() i=7 2024-09-10T14:30:40.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0070037040 msgr2=0x7f0070036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0070037040 0x7f0070036410 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1ea02f0 msgr2=0x5594b1ea2790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1ea02f0 0x5594b1ea2790 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f00780e4090 msgr2=0x7f00780d46c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f00780e4090 0x7f00780d46c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1ea4c90 msgr2=0x5594b1ea7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1ea4c90 0x5594b1ea7080 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff50034620 msgr2=0x7eff50036ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff50034620 0x7eff50036ae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5594b1e74410 tx=0x7f0070010000 comp rx=0 tx=0).stop 2024-09-10T14:30:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 msgr2=0x5594b1e95360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 --2- 172.21.15.151:0/2919487380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e8e160 0x5594b1e95360 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f00780a6f90 tx=0x7f00780bef00 comp rx=0 tx=0).stop 2024-09-10T14:30:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 reap_dead start 2024-09-10T14:30:40.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f0088c6b640 1 -- 172.21.15.151:0/2919487380 reap_dead start 2024-09-10T14:30:40.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 shutdown_connections 2024-09-10T14:30:40.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 >> 172.21.15.151:0/2919487380 conn(0x5594b1e8a590 msgr2=0x5594b1e88660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 shutdown_connections 2024-09-10T14:30:40.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.924+0000 7f008a95a980 1 -- 172.21.15.151:0/2919487380 wait complete. 2024-09-10T14:30:40.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/4002555519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff60034650 msgr2=0x7eff60036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/4002555519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff60034650 0x7eff60036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5594b1e70410 tx=0x7f007000f000 comp rx=0 tx=0).stop 2024-09-10T14:30:40.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/4002555519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e81ae0 msgr2=0x5594b1e81f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/4002555519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e81ae0 0x5594b1e81f00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f00780e2cb0 tx=0x7f00780b56c0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/4002555519 shutdown_connections 2024-09-10T14:30:40.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/4002555519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff60034650 0x7eff60036b10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/4002555519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1e81ae0 0x5594b1e81f00 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/4002555519 >> 172.21.15.151:0/4002555519 conn(0x5594b1e76c30 msgr2=0x5594b1e796b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/4002555519 shutdown_connections 2024-09-10T14:30:40.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/4002555519 wait complete. 2024-09-10T14:30:40.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5594b1e714d0 msgr2=0x5594b1e738c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5594b1e714d0 0x5594b1e738c0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1d74850 msgr2=0x5594b1e6ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5594b1d74850 0x5594b1e6ac50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1e6d440 msgr2=0x5594b1e6f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5594b1e6d440 0x5594b1e6f8e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:40.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff6c034650 msgr2=0x7eff6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7eff6c034650 0x7eff6c036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0070001da0 tx=0x7f0070001300 comp rx=0 tx=0).stop 2024-09-10T14:30:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 msgr2=0x5594b1e63cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 --2- 172.21.15.151:0/1164697616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5594b1ce5a60 0x5594b1e63cc0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0078019930 tx=0x7f0078018020 comp rx=0 tx=0).stop 2024-09-10T14:30:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f0088c6b640 1 -- 172.21.15.151:0/1164697616 reap_dead start 2024-09-10T14:30:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 shutdown_connections 2024-09-10T14:30:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 >> 172.21.15.151:0/1164697616 conn(0x5594b1d6c000 msgr2=0x5594b1e57260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:40.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 shutdown_connections 2024-09-10T14:30:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:40.928+0000 7f008a95a980 1 -- 172.21.15.151:0/1164697616 wait complete. 2024-09-10T14:30:40.945 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T14:30:40.908221Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.908209Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:40.945 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T14:30:40.908221Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.908209Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:40.945 ERROR:root:0 2024-09-10T14:30:40.946 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:40.952 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:40.952 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-10T14:30:40.953 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-10T14:30:40.953 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-10T14:30:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:41.021 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd3c6f0980 1 Processor -- start 2024-09-10T14:30:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd3c6f0980 1 -- start start 2024-09-10T14:30:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd3c6f0980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557d2ffbe8e0 0x557d2ffbecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd3c6f0980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d2fe44ae0 con 0x557d2ffbf230 2024-09-10T14:30:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd3c6f0980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x557d2fe68e30 con 0x557d2ffbe8e0 2024-09-10T14:30:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd3a200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557d2ffbe8e0 0x557d2ffbecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd3a200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x557d2ffbe8e0 0x557d2ffbecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51122/0 (socket says 172.21.15.151:51122) 2024-09-10T14:30:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd399ff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x557d2ffbf230 0x557d2ffc3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33376/0 (socket says 172.21.15.151:33376) 2024-09-10T14:30:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.016+0000 7fbd3a200640 1 -- 172.21.15.151:0/603252524 learned_addr learned my addr 172.21.15.151:0/603252524 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3a200640 1 -- 172.21.15.151:0/603252524 >> v1:172.21.15.52:6789/0 conn(0x557d2ffbf230 legacy=0x557d2ffc3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3a200640 1 -- 172.21.15.151:0/603252524 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2ffc64b0 con 0x557d2ffbe8e0 2024-09-10T14:30:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3a200640 1 --2- 172.21.15.151:0/603252524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d2ffbecc0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00a5c0 tx=0x7fbd2c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67eba7b9a11e295 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd391fe640 1 -- 172.21.15.151:0/603252524 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0a6070 con 0x557d2ffbe8e0 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd391fe640 1 -- 172.21.15.151:0/603252524 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0af070 con 0x557d2ffbe8e0 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd391fe640 1 -- 172.21.15.151:0/603252524 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0aa5c0 con 0x557d2ffbe8e0 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/603252524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 msgr2=0x557d2ffbecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/603252524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d2ffbecc0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00a5c0 tx=0x7fbd2c01b340 comp rx=0 tx=0).stop 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/603252524 shutdown_connections 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/603252524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d2ffbecc0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/603252524 >> 172.21.15.151:0/603252524 conn(0x557d2ff32230 msgr2=0x557d2ff32640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/603252524 shutdown_connections 2024-09-10T14:30:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.020+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/603252524 wait complete. 2024-09-10T14:30:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 Processor -- start 2024-09-10T14:30:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- start start 2024-09-10T14:30:41.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557d2fe6a200 con 0x557d2ffbe8e0 2024-09-10T14:30:41.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300a9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51136/0 (socket says 172.21.15.151:51136) 2024-09-10T14:30:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3a200640 1 -- 172.21.15.151:0/1023909222 learned_addr learned my addr 172.21.15.151:0/1023909222 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3a200640 1 -- 172.21.15.151:0/1023909222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d300aa1a0 con 0x557d2ffbe8e0 2024-09-10T14:30:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1023909222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300a9bd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0199f0 tx=0x7fbd2c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f564746356b1645 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbc28608640 1 -- 172.21.15.151:0/1023909222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0aaa00 con 0x557d2ffbe8e0 2024-09-10T14:30:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbc28608640 1 -- 172.21.15.151:0/1023909222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0aaba0 con 0x557d2ffbe8e0 2024-09-10T14:30:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbc28608640 1 -- 172.21.15.151:0/1023909222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0bd3f0 con 0x557d2ffbe8e0 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1023909222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 msgr2=0x557d300a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1023909222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300a9bd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0199f0 tx=0x7fbd2c003030 comp rx=0 tx=0).stop 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1023909222 shutdown_connections 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1023909222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300a9bd0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1023909222 >> 172.21.15.151:0/1023909222 conn(0x557d2ff32230 msgr2=0x557d300a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1023909222 shutdown_connections 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1023909222 wait complete. 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 Processor -- start 2024-09-10T14:30:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- start start 2024-09-10T14:30:41.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.036+0000 7fbd3c6f0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557d2ffc5ef0 con 0x557d2ffbe8e0 2024-09-10T14:30:41.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51142/0 (socket says 172.21.15.151:51142) 2024-09-10T14:30:41.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3a200640 1 -- 172.21.15.151:0/1787072511 learned_addr learned my addr 172.21.15.151:0/1787072511 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3a200640 1 -- 172.21.15.151:0/1787072511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d300b13c0 con 0x557d2ffbe8e0 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300b0e80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c01b380 tx=0x7fbd2c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbc26e05640 1 -- 172.21.15.151:0/1787072511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0bd7c0 con 0x557d2ffbe8e0 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d300b1650 con 0x557d2ffbe8e0 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbc26e05640 1 -- 172.21.15.151:0/1787072511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0cc070 con 0x557d2ffbe8e0 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d300b4330 con 0x557d2ffbe8e0 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbc26e05640 1 -- 172.21.15.151:0/1787072511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0bda90 con 0x557d2ffbe8e0 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbc26e05640 1 -- 172.21.15.151:0/1787072511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbd2c0bdc30 con 0x557d2ffbe8e0 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbc26e05640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc20034650 0x7fbc20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbc26e05640 1 -- 172.21.15.151:0/1787072511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fbd2c0e5880 con 0x557d2ffbe8e0 2024-09-10T14:30:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc20034650 0x7fbc20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d2ffbf230 0x557d300b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300b8460 con 0x557d2ffbf230 2024-09-10T14:30:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3aa01640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d2ffbf230 0x557d300b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc20034650 0x7fbc20036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd24001e50 tx=0x7fbd240013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3aa01640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d2ffbf230 0x557d300b7e10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1787072511 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d2ffbf230 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300b8ce0 con 0x557d2ffbf230 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1787072511 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d2ffbf230 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300ba5f0 0x557d300bcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.040+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300bd240 con 0x557d300ba5f0 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300ba5f0 0x557d300bcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300ba5f0 0x557d300bcab0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3a200640 1 -- 172.21.15.151:0/1787072511 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd2c0d1460 con 0x557d300ba5f0 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300b9530 con 0x557d2ffbf230 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1787072511 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d2ffbf230 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557d300be6a0 0x557d300c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300c1180 con 0x557d300be6a0 2024-09-10T14:30:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557d300be6a0 0x557d300c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557d300be6a0 0x557d300c0a90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd399ff640 1 -- 172.21.15.151:0/1787072511 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd2400f700 con 0x557d300be6a0 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3c6f0980 1 Processor -- start 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3c6f0980 1 -- start start 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3c6f0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300cec50 0x557d300cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3c6f0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557d2fec3800 con 0x557d300cec50 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300cec50 0x557d300cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300cec50 0x557d300cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51158/0 (socket says 172.21.15.151:51158) 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.044+0000 7fbd3a200640 1 -- 172.21.15.151:0/4088784903 learned_addr learned my addr 172.21.15.151:0/4088784903 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3a200640 1 -- 172.21.15.151:0/4088784903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d300cf5b0 con 0x557d300cec50 2024-09-10T14:30:41.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3a200640 1 --2- 172.21.15.151:0/4088784903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300cec50 0x557d300cf070 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0e5010 tx=0x7fbd2c0bce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbc1ffff640 1 -- 172.21.15.151:0/4088784903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0b3d60 con 0x557d300cec50 2024-09-10T14:30:41.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbc1ffff640 1 -- 172.21.15.151:0/4088784903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0b33f0 con 0x557d300cec50 2024-09-10T14:30:41.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/4088784903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d300cf840 con 0x557d300cec50 2024-09-10T14:30:41.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbc1ffff640 1 -- 172.21.15.151:0/4088784903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0b3710 con 0x557d300cec50 2024-09-10T14:30:41.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/4088784903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d300d24c0 con 0x557d300cec50 2024-09-10T14:30:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbc1ffff640 1 -- 172.21.15.151:0/4088784903 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbd2c0e50b0 con 0x557d300cec50 2024-09-10T14:30:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbc1ffff640 1 --2- 172.21.15.151:0/4088784903 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc140346a0 0x7fbc14036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbc1ffff640 1 -- 172.21.15.151:0/4088784903 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fbd2c0efda0 con 0x557d300cec50 2024-09-10T14:30:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd399ff640 1 --2- 172.21.15.151:0/4088784903 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc140346a0 0x7fbc14036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3c6f0980 1 Processor -- start 2024-09-10T14:30:41.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3c6f0980 1 -- start start 2024-09-10T14:30:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd399ff640 1 --2- 172.21.15.151:0/4088784903 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc140346a0 0x7fbc14036b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x557d300b5590 tx=0x7fbd2400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3c6f0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300db9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3c6f0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557d300aa460 con 0x557d300db5b0 2024-09-10T14:30:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300db9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300db9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51168/0 (socket says 172.21.15.151:51168) 2024-09-10T14:30:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3a200640 1 -- 172.21.15.151:0/1563938099 learned_addr learned my addr 172.21.15.151:0/1563938099 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3a200640 1 -- 172.21.15.151:0/1563938099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d300dbf80 con 0x557d300db5b0 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1563938099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300db9b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0aab20 tx=0x7fbd2c0b3970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4cdb3e786c2f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.048+0000 7fbc1dffb640 1 -- 172.21.15.151:0/1563938099 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c107070 con 0x557d300db5b0 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbc1dffb640 1 -- 172.21.15.151:0/1563938099 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0c6820 con 0x557d300db5b0 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbc1dffb640 1 -- 172.21.15.151:0/1563938099 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0f75d0 con 0x557d300db5b0 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1563938099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 msgr2=0x557d300db9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1563938099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300db9b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0aab20 tx=0x7fbd2c0b3970 comp rx=0 tx=0).stop 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1563938099 shutdown_connections 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1563938099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300db9b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1563938099 >> 172.21.15.151:0/1563938099 conn(0x557d300d79d0 msgr2=0x557d300d5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1563938099 shutdown_connections 2024-09-10T14:30:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1563938099 wait complete. 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 Processor -- start 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- start start 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557d300dc3e0 con 0x557d300db5b0 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300e27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51174/0 (socket says 172.21.15.151:51174) 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 learned_addr learned my addr 172.21.15.151:0/1930041307 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d300e2d30 con 0x557d300db5b0 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300e27f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0aab20 tx=0x7fbd2c0d8f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbc0bfff640 1 -- 172.21.15.151:0/1930041307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c112070 con 0x557d300db5b0 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d300e2d30 con 0x557d300db5b0 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbc0bfff640 1 -- 172.21.15.151:0/1930041307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0e55b0 con 0x557d300db5b0 2024-09-10T14:30:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d300e2d30 con 0x557d300db5b0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbc0bfff640 1 -- 172.21.15.151:0/1930041307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c11c060 con 0x557d300db5b0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbc0bfff640 1 -- 172.21.15.151:0/1930041307 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbd2c115070 con 0x557d300db5b0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbc0bfff640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc04034650 0x7fbc04036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbc0bfff640 1 -- 172.21.15.151:0/1930041307 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fbd2c1071e0 con 0x557d300db5b0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc04034650 0x7fbc04036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d300ed670 0x557d300efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.052+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f0280 con 0x557d300ed670 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3aa01640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d300ed670 0x557d300efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc04034650 0x7fbc04036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x557d300c1580 tx=0x7fbd24010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3aa01640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d300ed670 0x557d300efb30 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 realm 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f0690 con 0x557d300ed670 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f0f30 con 0x557d300ed670 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300f2030 0x557d300f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f4a70 con 0x557d300f2030 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300f2030 0x557d300f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300f2030 0x557d300f4420 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 20 searching for the correct realm 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f62d0 con 0x557d300f2030 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3a200640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbd2c117070 0x7fbd2c0f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f62d0 con 0x7fbd2c117070 2024-09-10T14:30:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbd2c117070 0x7fbd2c0f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbd2c117070 0x7fbd2c0f3210 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd399ff640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbd2401fc60 0x7fbd2403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f62d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.056+0000 7fbd3aa01640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbd2401fc60 0x7fbd2403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbd2401fc60 0x7fbd2403a3c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2c117070 2024-09-10T14:30:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300f2030 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.060+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2c117070 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300f2030 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300f2030 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2c117070 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300f2030 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300f2030 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300f2030 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2c117070 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2c117070 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.064+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300f2030 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2c117070 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300f2030 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x557d300ed670 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557d300f12d0 con 0x7fbd2c117070 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f5420 con 0x557d300ed670 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f5c70 con 0x557d300ed670 2024-09-10T14:30:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f57c0 con 0x7fbd2401fc60 2024-09-10T14:30:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 zone default found 2024-09-10T14:30:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 4 Realm: () 2024-09-10T14:30:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 zonegroup default 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.068+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f5bf0 con 0x7fbd2c117070 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f8170 con 0x557d300f2030 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d300f8620 con 0x557d300f2030 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 20 started sync module instance, tier type = 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300f7580 con 0x7fbd2c117070 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996165593456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300f7d90 con 0x7fbd2c117070 2024-09-10T14:30:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300f9550 con 0x557d300ed670 2024-09-10T14:30:41.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996165593456] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996165599392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300f94c0 con 0x557d300ed670 2024-09-10T14:30:41.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.072+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fa2e0 con 0x557d300f2030 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.076+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.076+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996165602800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fab80 con 0x557d300f2030 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.076+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fb580 con 0x7fbd2c117070 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.076+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996165599392] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.076+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.076+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996165601600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fbe50 con 0x7fbd2c117070 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.076+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fc6a0 con 0x557d300ed670 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996165602800] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996165601600] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996165605072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fc6a0 con 0x557d300ed670 2024-09-10T14:30:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fcf40 con 0x7fbd2401fc60 2024-09-10T14:30:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996165605072] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996165612288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fccb0 con 0x7fbd2401fc60 2024-09-10T14:30:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.080+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fd7d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.084+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.084+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996165616288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fdc40 con 0x7fbd2401fc60 2024-09-10T14:30:41.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.084+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fe730 con 0x7fbd2401fc60 2024-09-10T14:30:41.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.084+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996165612288] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.084+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996165616288] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996165620224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fd790 con 0x7fbd2401fc60 2024-09-10T14:30:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 add_watcher() i=0 2024-09-10T14:30:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 add_watcher() i=1 2024-09-10T14:30:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 add_watcher() i=2 2024-09-10T14:30:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 add_watcher() i=3 2024-09-10T14:30:41.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 add_watcher() i=4 2024-09-10T14:30:41.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 add_watcher() i=5 2024-09-10T14:30:41.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 add_watcher() i=6 2024-09-10T14:30:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996165620224] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 add_watcher() i=7 2024-09-10T14:30:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d30101830 con 0x557d300ed670 2024-09-10T14:30:41.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996165613344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fecb0 con 0x557d300ed670 2024-09-10T14:30:41.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996165613344] v36'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbbf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:41.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.088+0000 7fbd3c6f0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:41.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.092+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d30109f10 con 0x557d300ed670 2024-09-10T14:30:41.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.092+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.092+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010a5e0 con 0x7fbd2401fc60 2024-09-10T14:30:41.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.096+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.096+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010aa20 con 0x557d300f2030 2024-09-10T14:30:41.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.096+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.096+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010aa30 con 0x557d300ed670 2024-09-10T14:30:41.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.096+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'254 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.096+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010b020 con 0x7fbd2c117070 2024-09-10T14:30:41.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.096+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'81 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.096+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010b870 con 0x557d300f2030 2024-09-10T14:30:41.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.100+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'54 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.100+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010b870 con 0x557d300ed670 2024-09-10T14:30:41.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.100+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.100+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010b870 con 0x7fbd2401fc60 2024-09-10T14:30:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.104+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.104+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010b950 con 0x7fbd2c117070 2024-09-10T14:30:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.104+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.104+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010bff0 con 0x557d300f2030 2024-09-10T14:30:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.104+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.104+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010bff0 con 0x7fbd2c117070 2024-09-10T14:30:41.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.108+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.108+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c3d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.108+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.108+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c3d0 con 0x7fbd2c117070 2024-09-10T14:30:41.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.108+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.108+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c3d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.112+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.112+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c3d0 con 0x557d300ed670 2024-09-10T14:30:41.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.112+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'255 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.112+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c3d0 con 0x557d300f2030 2024-09-10T14:30:41.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.116+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.116+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c460 con 0x7fbd2c117070 2024-09-10T14:30:41.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.116+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.116+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c4f0 con 0x557d300f2030 2024-09-10T14:30:41.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.116+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.116+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c4f0 con 0x557d300ed670 2024-09-10T14:30:41.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.120+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.120+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c4f0 con 0x557d300ed670 2024-09-10T14:30:41.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.120+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'256 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.120+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c4f0 con 0x557d300f2030 2024-09-10T14:30:41.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.124+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.124+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c4f0 con 0x7fbd2c117070 2024-09-10T14:30:41.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.124+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.124+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x557d300f2030 2024-09-10T14:30:41.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.124+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.124+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x557d300f2030 2024-09-10T14:30:41.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.124+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.124+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x557d300f2030 2024-09-10T14:30:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.128+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.128+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x557d300f2030 2024-09-10T14:30:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.128+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'55 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.128+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x7fbd2401fc60 2024-09-10T14:30:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.132+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.132+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x557d300f2030 2024-09-10T14:30:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.132+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.132+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x7fbd2401fc60 2024-09-10T14:30:41.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.132+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.132+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x557d300f2030 2024-09-10T14:30:41.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.136+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.136+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x7fbd2401fc60 2024-09-10T14:30:41.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.136+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.136+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3010c580 con 0x7fbd2c117070 2024-09-10T14:30:41.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbb6b7fe640 20 reqs_thread_entry: start 2024-09-10T14:30:41.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:41.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 20 Filter name: none 2024-09-10T14:30:41.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbb697fa640 20 reqs_thread_entry: start 2024-09-10T14:30:41.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T14:30:41.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d30108260 con 0x557d300f2030 2024-09-10T14:30:41.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 20 rados_obj.operate() r=0 bl.length=363 2024-09-10T14:30:41.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-10T14:30:41.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T14:30:41.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:41.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d3012a310 con 0x557d300f2030 2024-09-10T14:30:41.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 10 removing key index: true_admin_akey 2024-09-10T14:30:41.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.140+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d301282f0 con 0x557d300f2030 2024-09-10T14:30:41.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(96 true_admin_akey [delete] v36'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3c6f0980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T14:30:41.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93996165795408 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d3012a7f0 con 0x7fbd2401fc60 2024-09-10T14:30:41.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== watch-notify(notify (1) cookie 93996165612288 notify 154618822687 ret 0) ==== 207+0+0 (crc 0 0 0) 0x557d3010cae0 con 0x7fbd2401fc60 2024-09-10T14:30:41.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbc1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 93996165612288 notifier 4862 bl.length()=165 2024-09-10T14:30:41.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(97 notify.5 [notify cookie 93996165795408 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbc1dffb640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fbc00003d70 con 0x7fbd2401fc60 2024-09-10T14:30:41.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== watch-notify(notify_complete (2) cookie 93996165795408 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d3010a0a0 con 0x7fbd2401fc60 2024-09-10T14:30:41.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3c6f0980 10 removing email index: 2024-09-10T14:30:41.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3c6f0980 10 removing user buckets index 2024-09-10T14:30:41.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3012a770 con 0x557d300f2030 2024-09-10T14:30:41.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(99 a_user.buckets [delete] v36'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3c6f0980 10 removing user index: a_user 2024-09-10T14:30:41.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.144+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d3012a310 con 0x557d300f2030 2024-09-10T14:30:41.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(100 a_user [call,call,delete] v36'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3c6f0980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-10T14:30:41.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3c6f0980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T14:30:41.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 93996165791296 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557d30129720 con 0x557d300f2030 2024-09-10T14:30:41.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== watch-notify(notify (1) cookie 93996165602800 notify 154618822668 ret 0) ==== 197+0+0 (crc 0 0 0) 0x557d3010b950 con 0x557d300f2030 2024-09-10T14:30:41.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbc1d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822668 cookie 93996165602800 notifier 4862 bl.length()=155 2024-09-10T14:30:41.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbc1d7fa640 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fbb700032d0 con 0x557d300f2030 2024-09-10T14:30:41.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(101 notify.2 [notify cookie 93996165791296 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== watch-notify(notify_complete (2) cookie 93996165791296 notify 154618822668 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d300cf5b0 con 0x557d300f2030 2024-09-10T14:30:41.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbbf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.148+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996165613344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d30129b10 con 0x557d300ed670 2024-09-10T14:30:41.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93996165613344] v36'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996165593456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fc720 con 0x7fbd2c117070 2024-09-10T14:30:41.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93996165593456] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd3c6f0980 20 remove_watcher() i=0 2024-09-10T14:30:41.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd3c6f0980 2 removed watcher, disabling cache 2024-09-10T14:30:41.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996165599392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fc720 con 0x557d300ed670 2024-09-10T14:30:41.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93996165599392] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd3c6f0980 20 remove_watcher() i=1 2024-09-10T14:30:41.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.152+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996165602800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300f90a0 con 0x557d300f2030 2024-09-10T14:30:41.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.156+0000 7fbd3a200640 1 -- 172.21.15.151:0/1930041307 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93996165602800] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c114030 con 0x557d300f2030 2024-09-10T14:30:41.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.156+0000 7fbd3c6f0980 20 remove_watcher() i=2 2024-09-10T14:30:41.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.156+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996165601600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fc720 con 0x7fbd2c117070 2024-09-10T14:30:41.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.156+0000 7fbd399ff640 1 -- 172.21.15.151:0/1930041307 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93996165601600] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24037040 con 0x7fbd2c117070 2024-09-10T14:30:41.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.156+0000 7fbd3c6f0980 20 remove_watcher() i=3 2024-09-10T14:30:41.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.156+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996165605072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300f90a0 con 0x557d300ed670 2024-09-10T14:30:41.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.160+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93996165605072] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x557d300ed670 2024-09-10T14:30:41.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.160+0000 7fbd3c6f0980 20 remove_watcher() i=4 2024-09-10T14:30:41.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.160+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996165612288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fc720 con 0x7fbd2401fc60 2024-09-10T14:30:41.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.160+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93996165612288] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.160+0000 7fbd3c6f0980 20 remove_watcher() i=5 2024-09-10T14:30:41.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.160+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996165616288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300fa6d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93996165616288] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 20 remove_watcher() i=6 2024-09-10T14:30:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996165620224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557d300f90a0 con 0x7fbd2401fc60 2024-09-10T14:30:41.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93996165620224] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3400a4d0 con 0x7fbd2401fc60 2024-09-10T14:30:41.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 20 remove_watcher() i=7 2024-09-10T14:30:41.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbd2401fc60 msgr2=0x7fbd2403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fbd2401fc60 0x7fbd2403a3c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d300ed670 msgr2=0x557d300efb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d300ed670 0x557d300efb30 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbd2c117070 msgr2=0x7fbd2c0f3210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fbd2c117070 0x7fbd2c0f3210 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300f2030 msgr2=0x557d300f4420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300f2030 0x557d300f4420 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc04034650 msgr2=0x7fbc04036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc04034650 0x7fbc04036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x557d300c1580 tx=0x7fbd24010000 comp rx=0 tx=0).stop 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1930041307 reap_dead start 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 msgr2=0x557d300e27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300e27f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0aab20 tx=0x7fbd2c0d8f50 comp rx=0 tx=0).stop 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 shutdown_connections 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1930041307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300db5b0 0x557d300e27f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 >> 172.21.15.151:0/1930041307 conn(0x557d300d79d0 msgr2=0x557d300d5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 shutdown_connections 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.164+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1930041307 wait complete. 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/4088784903 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc140346a0 msgr2=0x7fbc14036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/4088784903 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc140346a0 0x7fbc14036b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x557d300b5590 tx=0x7fbd2400f000 comp rx=0 tx=0).stop 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/4088784903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300cec50 msgr2=0x557d300cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/4088784903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300cec50 0x557d300cf070 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0e5010 tx=0x7fbd2c0bce90 comp rx=0 tx=0).stop 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/4088784903 shutdown_connections 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/4088784903 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc140346a0 0x7fbc14036b60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/4088784903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d300cec50 0x557d300cf070 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/4088784903 >> 172.21.15.151:0/4088784903 conn(0x557d300c3da0 msgr2=0x557d300c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/4088784903 shutdown_connections 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/4088784903 wait complete. 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557d300be6a0 msgr2=0x557d300c0a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x557d300be6a0 0x557d300c0a90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d2ffbf230 msgr2=0x557d300b7e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x557d2ffbf230 0x557d300b7e10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300ba5f0 msgr2=0x557d300bcab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x557d300ba5f0 0x557d300bcab0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc20034650 msgr2=0x7fbc20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fbc20034650 0x7fbc20036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd24001e50 tx=0x7fbd240013b0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 msgr2=0x557d300b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 --2- 172.21.15.151:0/1787072511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d2ffbe8e0 0x557d300b0e80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c01b380 tx=0x7fbd2c0180e0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3aa01640 1 -- 172.21.15.151:0/1787072511 reap_dead start 2024-09-10T14:30:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 shutdown_connections 2024-09-10T14:30:41.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 >> 172.21.15.151:0/1787072511 conn(0x557d2ff32230 msgr2=0x557d300a4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 shutdown_connections 2024-09-10T14:30:41.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.168+0000 7fbd3c6f0980 1 -- 172.21.15.151:0/1787072511 wait complete. 2024-09-10T14:30:41.180 ERROR:root:None 2024-09-10T14:30:41.181 ERROR:root:0 2024-09-10T14:30:41.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T14:30:41.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T14:30:41.181 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-10T14:30:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf871fa980 1 Processor -- start 2024-09-10T14:30:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf871fa980 1 -- start start 2024-09-10T14:30:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf871fa980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55670ffe9550 0x55670ffe9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf871fa980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55670fe72ae0 con 0x55670ffe9ea0 2024-09-10T14:30:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf871fa980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55670fe96e30 con 0x55670ffe9550 2024-09-10T14:30:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf84d0a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55670ffe9550 0x55670ffe9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf84509640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55670ffe9ea0 0x55670ffee920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33378/0 (socket says 172.21.15.151:33378) 2024-09-10T14:30:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf84509640 1 -- 172.21.15.151:0/1822097902 learned_addr learned my addr 172.21.15.151:0/1822097902 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:30:41.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf84d0a640 1 -- 172.21.15.151:0/1822097902 >> v1:172.21.15.52:6789/0 conn(0x55670ffe9ea0 legacy=0x55670ffee920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.252+0000 7fdf84d0a640 1 -- 172.21.15.151:0/1822097902 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670fff1170 con 0x55670ffe9550 2024-09-10T14:30:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/1822097902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ffe9930 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400a480 tx=0x7fdf7401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b84858964a4a62f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf83d08640 1 -- 172.21.15.151:0/1822097902 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740b0070 con 0x55670ffe9550 2024-09-10T14:30:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf83d08640 1 -- 172.21.15.151:0/1822097902 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf740ab540 con 0x55670ffe9550 2024-09-10T14:30:41.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf83d08640 1 -- 172.21.15.151:0/1822097902 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740ab840 con 0x55670ffe9550 2024-09-10T14:30:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf871fa980 1 -- 172.21.15.151:0/1822097902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 msgr2=0x55670ffe9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf871fa980 1 --2- 172.21.15.151:0/1822097902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ffe9930 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400a480 tx=0x7fdf7401b280 comp rx=0 tx=0).stop 2024-09-10T14:30:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf871fa980 1 -- 172.21.15.151:0/1822097902 shutdown_connections 2024-09-10T14:30:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf871fa980 1 --2- 172.21.15.151:0/1822097902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ffe9930 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf871fa980 1 -- 172.21.15.151:0/1822097902 >> 172.21.15.151:0/1822097902 conn(0x55670ffe5070 msgr2=0x55670ffe7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf871fa980 1 -- 172.21.15.151:0/1822097902 shutdown_connections 2024-09-10T14:30:41.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.256+0000 7fdf871fa980 1 -- 172.21.15.151:0/1822097902 wait complete. 2024-09-10T14:30:41.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.268+0000 7fdf871fa980 1 Processor -- start 2024-09-10T14:30:41.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.268+0000 7fdf871fa980 1 -- start start 2024-09-10T14:30:41.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.268+0000 7fdf871fa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ff5e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.268+0000 7fdf871fa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55670fe98200 con 0x55670ffe9550 2024-09-10T14:30:41.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ff5e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ff5e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51192/0 (socket says 172.21.15.151:51192) 2024-09-10T14:30:41.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 -- 172.21.15.151:0/3172939254 learned_addr learned my addr 172.21.15.151:0/3172939254 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 -- 172.21.15.151:0/3172939254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670ff5e9c0 con 0x55670ffe9550 2024-09-10T14:30:41.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/3172939254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ff5e3f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdf740ae040 tx=0x7fdf74003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a069701052dd7b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fde72e0d640 1 -- 172.21.15.151:0/3172939254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740b0040 con 0x55670ffe9550 2024-09-10T14:30:41.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fde72e0d640 1 -- 172.21.15.151:0/3172939254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf740ab9d0 con 0x55670ffe9550 2024-09-10T14:30:41.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fde72e0d640 1 -- 172.21.15.151:0/3172939254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740abcf0 con 0x55670ffe9550 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 -- 172.21.15.151:0/3172939254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 msgr2=0x55670ff5e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 --2- 172.21.15.151:0/3172939254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ff5e3f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdf740ae040 tx=0x7fdf74003030 comp rx=0 tx=0).stop 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 -- 172.21.15.151:0/3172939254 shutdown_connections 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 --2- 172.21.15.151:0/3172939254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x55670ff5e3f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 -- 172.21.15.151:0/3172939254 >> 172.21.15.151:0/3172939254 conn(0x55670ffe5070 msgr2=0x5567100d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 -- 172.21.15.151:0/3172939254 shutdown_connections 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 -- 172.21.15.151:0/3172939254 wait complete. 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 Processor -- start 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 -- start start 2024-09-10T14:30:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x5567100dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf871fa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55670fff0bb0 con 0x55670ffe9550 2024-09-10T14:30:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x5567100dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x5567100dcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51208/0 (socket says 172.21.15.151:51208) 2024-09-10T14:30:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 -- 172.21.15.151:0/4273188680 learned_addr learned my addr 172.21.15.151:0/4273188680 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.272+0000 7fdf84d0a640 1 -- 172.21.15.151:0/4273188680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567100dd290 con 0x55670ffe9550 2024-09-10T14:30:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x5567100dcd50 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdf74019930 tx=0x7fdf74018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fde7160a640 1 -- 172.21.15.151:0/4273188680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740b0070 con 0x55670ffe9550 2024-09-10T14:30:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567100dd520 con 0x55670ffe9550 2024-09-10T14:30:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567100e0200 con 0x55670ffe9550 2024-09-10T14:30:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fde7160a640 1 -- 172.21.15.151:0/4273188680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf740b68b0 con 0x55670ffe9550 2024-09-10T14:30:41.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fde7160a640 1 -- 172.21.15.151:0/4273188680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740b6b90 con 0x55670ffe9550 2024-09-10T14:30:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fde7160a640 1 -- 172.21.15.151:0/4273188680 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdf740b7420 con 0x55670ffe9550 2024-09-10T14:30:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fde7160a640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde6c0346a0 0x7fde6c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fde7160a640 1 -- 172.21.15.151:0/4273188680 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fdf740bc070 con 0x55670ffe9550 2024-09-10T14:30:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf84509640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde6c0346a0 0x7fde6c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55670ffe9ea0 0x5567100e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5567100e4320 con 0x55670ffe9ea0 2024-09-10T14:30:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf8550b640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55670ffe9ea0 0x5567100e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf84509640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde6c0346a0 0x7fde6c036b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c001650 tx=0x7fdf6c006740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf8550b640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55670ffe9ea0 0x5567100e3ce0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf8550b640 1 -- 172.21.15.151:0/4273188680 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x55670ffe9ea0 2024-09-10T14:30:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5567100e1400 con 0x55670ffe9ea0 2024-09-10T14:30:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf8550b640 1 -- 172.21.15.151:0/4273188680 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdf7c0083f0 con 0x55670ffe9ea0 2024-09-10T14:30:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5567100e6650 0x5567100e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5567100e9130 con 0x5567100e6650 2024-09-10T14:30:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5567100e6650 0x5567100e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5567100e6650 0x5567100e8a40 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf84d0a640 1 -- 172.21.15.151:0/4273188680 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdf740b3040 con 0x5567100e6650 2024-09-10T14:30:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.276+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5567100e54f0 con 0x55670ffe9ea0 2024-09-10T14:30:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf8550b640 1 -- 172.21.15.151:0/4273188680 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdf7c0083f0 con 0x55670ffe9ea0 2024-09-10T14:30:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5567100ea590 0x5567100ec980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5567100ed0c0 con 0x5567100ea590 2024-09-10T14:30:41.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf84509640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5567100ea590 0x5567100ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf84509640 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5567100ea590 0x5567100ec980 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf84509640 1 -- 172.21.15.151:0/4273188680 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdf6c00f070 con 0x5567100ea590 2024-09-10T14:30:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf871fa980 1 Processor -- start 2024-09-10T14:30:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf871fa980 1 -- start start 2024-09-10T14:30:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf871fa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5567100fab90 0x5567100fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf871fa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55670fef1800 con 0x5567100fab90 2024-09-10T14:30:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5567100fab90 0x5567100fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5567100fab90 0x5567100fafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51216/0 (socket says 172.21.15.151:51216) 2024-09-10T14:30:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf84d0a640 1 -- 172.21.15.151:0/85706495 learned_addr learned my addr 172.21.15.151:0/85706495 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf84d0a640 1 -- 172.21.15.151:0/85706495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567100fb4f0 con 0x5567100fab90 2024-09-10T14:30:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/85706495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5567100fab90 0x5567100fafb0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdf740ab510 tx=0x7fdf740aa6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fde6a7fc640 1 -- 172.21.15.151:0/85706495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740e40b0 con 0x5567100fab90 2024-09-10T14:30:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf871fa980 1 -- 172.21.15.151:0/85706495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567100fb780 con 0x5567100fab90 2024-09-10T14:30:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fde6a7fc640 1 -- 172.21.15.151:0/85706495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf740e4250 con 0x5567100fab90 2024-09-10T14:30:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fde6a7fc640 1 -- 172.21.15.151:0/85706495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740e12c0 con 0x5567100fab90 2024-09-10T14:30:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.280+0000 7fdf871fa980 1 -- 172.21.15.151:0/85706495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567100fe400 con 0x5567100fab90 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fde6a7fc640 1 -- 172.21.15.151:0/85706495 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdf740aaa70 con 0x5567100fab90 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fde6a7fc640 1 --2- 172.21.15.151:0/85706495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde5c034650 0x7fde5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fde6a7fc640 1 -- 172.21.15.151:0/85706495 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fdf740a8070 con 0x5567100fab90 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf84509640 1 --2- 172.21.15.151:0/85706495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde5c034650 0x7fde5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 Processor -- start 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 -- start start 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf84509640 1 --2- 172.21.15.151:0/85706495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde5c034650 0x7fde5c036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c006340 tx=0x7fdf6c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x556710107920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55670ff5ec80 con 0x556710107520 2024-09-10T14:30:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x556710107920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x556710107920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51224/0 (socket says 172.21.15.151:51224) 2024-09-10T14:30:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf84d0a640 1 -- 172.21.15.151:0/4274899912 learned_addr learned my addr 172.21.15.151:0/4274899912 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf84d0a640 1 -- 172.21.15.151:0/4274899912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556710107ef0 con 0x556710107520 2024-09-10T14:30:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/4274899912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x556710107920 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdf740b6040 tx=0x7fdf740d1f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e60cbb6903a4b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fde5bfff640 1 -- 172.21.15.151:0/4274899912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740f2070 con 0x556710107520 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fde5bfff640 1 -- 172.21.15.151:0/4274899912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf740e4850 con 0x556710107520 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fde5bfff640 1 -- 172.21.15.151:0/4274899912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740b9df0 con 0x556710107520 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 -- 172.21.15.151:0/4274899912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 msgr2=0x556710107920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4274899912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x556710107920 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdf740b6040 tx=0x7fdf740d1f10 comp rx=0 tx=0).stop 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 -- 172.21.15.151:0/4274899912 shutdown_connections 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4274899912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x556710107920 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 -- 172.21.15.151:0/4274899912 >> 172.21.15.151:0/4274899912 conn(0x5567101038b0 msgr2=0x5567101019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 -- 172.21.15.151:0/4274899912 shutdown_connections 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.284+0000 7fdf871fa980 1 -- 172.21.15.151:0/4274899912 wait complete. 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 1 Processor -- start 2024-09-10T14:30:41.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 1 -- start start 2024-09-10T14:30:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x55671010e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556710108440 con 0x556710107520 2024-09-10T14:30:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x55671010e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf84d0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x55671010e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51228/0 (socket says 172.21.15.151:51228) 2024-09-10T14:30:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 learned_addr learned my addr 172.21.15.151:0/673100008 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671010ec20 con 0x556710107520 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x55671010e6e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdf740b6040 tx=0x7fdf740cafa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fde5a7fc640 1 -- 172.21.15.151:0/673100008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf74108070 con 0x556710107520 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55671010ec20 con 0x556710107520 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fde5a7fc640 1 -- 172.21.15.151:0/673100008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf740fd070 con 0x556710107520 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671010ec20 con 0x556710107520 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fde5a7fc640 1 -- 172.21.15.151:0/673100008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf740b7840 con 0x556710107520 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fde5a7fc640 1 -- 172.21.15.151:0/673100008 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdf7410b070 con 0x556710107520 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fde5a7fc640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde50034650 0x7fde50036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fde5a7fc640 1 -- 172.21.15.151:0/673100008 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fdf74104d90 con 0x556710107520 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf84509640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde50034650 0x7fde50036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556710119840 0x55671011bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55671011c450 con 0x556710119840 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf8550b640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556710119840 0x55671011bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf84509640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde50034650 0x7fde50036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5567100e47f0 tx=0x7fdf6c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.288+0000 7fdf8550b640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556710119840 0x55671011bd00 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 realm 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55671011c860 con 0x556710119840 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:41.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55671011d130 con 0x556710119840 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55671011e230 0x556710120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556710120bf0 con 0x55671011e230 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55671011e230 0x556710120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55671011e230 0x556710120620 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 20 searching for the correct realm 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5567101224c0 con 0x55671011e230 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84d0a640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdf7410d060 0x7fdf740ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5567101224c0 con 0x7fdf7410d060 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84509640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdf7410d060 0x7fdf740ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84509640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdf7410d060 0x7fdf740ee850 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c00f070 con 0x7fdf7410d060 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84509640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdf6c024070 0x7fdf6c031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5567101224c0 con 0x7fdf6c024070 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf8550b640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdf6c024070 0x7fdf6c031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.292+0000 7fdf8550b640 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdf6c024070 0x7fdf6c031970 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf6c024070 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf6c024070 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf7410d060 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c00f070 con 0x7fdf7410d060 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x55671011e230 2024-09-10T14:30:41.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf6c024070 2024-09-10T14:30:41.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.296+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf7410d060 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x55671011e230 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x55671011e230 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf7410d060 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x55671011e230 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x55671011e230 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf6c024070 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x55671011e230 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf7410d060 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf7410d060 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x55671011e230 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.300+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf6c024070 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf7410d060 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x55671011e230 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf6c024070 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x556710119840 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55671011d4d0 con 0x7fdf7410d060 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5567101215e0 con 0x556710119840 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556710121e80 con 0x556710119840 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5567101219d0 con 0x7fdf6c024070 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 zone default found 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 4 Realm: () 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:41.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 zonegroup default 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.304+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556710121e00 con 0x7fdf7410d060 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556710122360 con 0x55671011e230 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556710124820 con 0x55671011e230 2024-09-10T14:30:41.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 20 started sync module instance, tier type = 2024-09-10T14:30:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710123c10 con 0x7fdf7410d060 2024-09-10T14:30:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93901139623936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710125130 con 0x7fdf7410d060 2024-09-10T14:30:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710125980 con 0x556710119840 2024-09-10T14:30:41.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.308+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93901139623936] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93901139627136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710125980 con 0x556710119840 2024-09-10T14:30:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710126480 con 0x55671011e230 2024-09-10T14:30:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93901139631984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710126d20 con 0x55671011e230 2024-09-10T14:30:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710127740 con 0x7fdf7410d060 2024-09-10T14:30:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93901139627136] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93901139636784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710127b30 con 0x7fdf7410d060 2024-09-10T14:30:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.312+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5567101284f0 con 0x556710119840 2024-09-10T14:30:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93901139631984] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93901139636784] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93901139634288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5567101255e0 con 0x556710119840 2024-09-10T14:30:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710128bf0 con 0x7fdf6c024070 2024-09-10T14:30:41.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93901139634288] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93901139642048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710128bb0 con 0x7fdf6c024070 2024-09-10T14:30:41.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.316+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710129600 con 0x7fdf6c024070 2024-09-10T14:30:41.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.320+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.320+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93901139644752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710129a20 con 0x7fdf6c024070 2024-09-10T14:30:41.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.320+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671012a470 con 0x7fdf6c024070 2024-09-10T14:30:41.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.320+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93901139642048] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.320+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93901139644752] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93901139648352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556710129570 con 0x7fdf6c024070 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 add_watcher() i=0 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 add_watcher() i=1 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 add_watcher() i=2 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 add_watcher() i=3 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 add_watcher() i=4 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 add_watcher() i=5 2024-09-10T14:30:41.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 add_watcher() i=6 2024-09-10T14:30:41.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93901139648352] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 add_watcher() i=7 2024-09-10T14:30:41.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:41.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55671012d570 con 0x556710119840 2024-09-10T14:30:41.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93901139640384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671012a9f0 con 0x556710119840 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93901139640384] v36'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fde3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 5 note: GC not initialized 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fde39fe3640 20 reqs_thread_entry: start 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.324+0000 7fdf871fa980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 20 Filter name: none 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fddab7fe640 20 reqs_thread_entry: start 2024-09-10T14:30:41.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:41.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556710150ab0 con 0x7fdf6c024070 2024-09-10T14:30:41.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T14:30:41.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:41.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:41.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5567101570c0 con 0x7fdf6c024070 2024-09-10T14:30:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93901139831600 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5567101527d0 con 0x556710119840 2024-09-10T14:30:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 93901139634288 notify 154618822680 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fdf7c010040 con 0x556710119840 2024-09-10T14:30:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fde5bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822680 cookie 93901139634288 notifier 4869 bl.length()=666 2024-09-10T14:30:41.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fde5bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:41.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fde5bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 93901139831600 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.328+0000 7fde5bfff640 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fde48003eb0 con 0x556710119840 2024-09-10T14:30:41.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== watch-notify(notify_complete (2) cookie 93901139831600 notify 154618822680 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdf7c00bd80 con 0x556710119840 2024-09-10T14:30:41.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.336 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:41.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fde3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93901139640384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014e8b0 con 0x556710119840 2024-09-10T14:30:41.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93901139640384] v36'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93901139623936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014e8b0 con 0x7fdf7410d060 2024-09-10T14:30:41.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93901139623936] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf871fa980 20 remove_watcher() i=0 2024-09-10T14:30:41.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf871fa980 2 removed watcher, disabling cache 2024-09-10T14:30:41.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.332+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93901139627136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014fe90 con 0x556710119840 2024-09-10T14:30:41.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.336+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93901139627136] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.336+0000 7fdf871fa980 20 remove_watcher() i=1 2024-09-10T14:30:41.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.336+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93901139631984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014fe90 con 0x55671011e230 2024-09-10T14:30:41.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.336+0000 7fdf84d0a640 1 -- 172.21.15.151:0/673100008 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93901139631984] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7410a030 con 0x55671011e230 2024-09-10T14:30:41.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.336+0000 7fdf871fa980 20 remove_watcher() i=2 2024-09-10T14:30:41.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.336+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93901139636784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014fe90 con 0x7fdf7410d060 2024-09-10T14:30:41.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.340+0000 7fdf84509640 1 -- 172.21.15.151:0/673100008 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93901139636784] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf6c040040 con 0x7fdf7410d060 2024-09-10T14:30:41.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.340+0000 7fdf871fa980 20 remove_watcher() i=3 2024-09-10T14:30:41.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.340+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93901139634288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014fe90 con 0x556710119840 2024-09-10T14:30:41.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.340+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93901139634288] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x556710119840 2024-09-10T14:30:41.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.340+0000 7fdf871fa980 20 remove_watcher() i=4 2024-09-10T14:30:41.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.340+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93901139642048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014fe90 con 0x7fdf6c024070 2024-09-10T14:30:41.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.344+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93901139642048] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.344+0000 7fdf871fa980 20 remove_watcher() i=5 2024-09-10T14:30:41.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.344+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93901139644752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014fe90 con 0x7fdf6c024070 2024-09-10T14:30:41.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.344+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93901139644752] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.344+0000 7fdf871fa980 20 remove_watcher() i=6 2024-09-10T14:30:41.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.344+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93901139648352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55671014fe90 con 0x7fdf6c024070 2024-09-10T14:30:41.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93901139648352] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7c0083f0 con 0x7fdf6c024070 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 20 remove_watcher() i=7 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdf6c024070 msgr2=0x7fdf6c031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fdf6c024070 0x7fdf6c031970 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556710119840 msgr2=0x55671011bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x556710119840 0x55671011bd00 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdf7410d060 msgr2=0x7fdf740ee850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fdf7410d060 0x7fdf740ee850 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55671011e230 msgr2=0x556710120620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55671011e230 0x556710120620 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde50034650 msgr2=0x7fde50036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde50034650 0x7fde50036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5567100e47f0 tx=0x7fdf6c010000 comp rx=0 tx=0).stop 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 msgr2=0x55671010e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf8550b640 1 -- 172.21.15.151:0/673100008 reap_dead start 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x55671010e6e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdf740b6040 tx=0x7fdf740cafa0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 shutdown_connections 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/673100008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556710107520 0x55671010e6e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 >> 172.21.15.151:0/673100008 conn(0x5567101038b0 msgr2=0x556710101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 shutdown_connections 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/673100008 wait complete. 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/85706495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde5c034650 msgr2=0x7fde5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/85706495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde5c034650 0x7fde5c036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c006340 tx=0x7fdf6c00f000 comp rx=0 tx=0).stop 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/85706495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5567100fab90 msgr2=0x5567100fafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/85706495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5567100fab90 0x5567100fafb0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdf740ab510 tx=0x7fdf740aa6a0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/85706495 shutdown_connections 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/85706495 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde5c034650 0x7fde5c036b10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/85706495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5567100fab90 0x5567100fafb0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/85706495 >> 172.21.15.151:0/85706495 conn(0x5567100efce0 msgr2=0x5567100f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/85706495 shutdown_connections 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/85706495 wait complete. 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5567100ea590 msgr2=0x5567100ec980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5567100ea590 0x5567100ec980 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55670ffe9ea0 msgr2=0x5567100e3ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55670ffe9ea0 0x5567100e3ce0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5567100e6650 msgr2=0x5567100e8a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5567100e6650 0x5567100e8a40 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde6c0346a0 msgr2=0x7fde6c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fde6c0346a0 0x7fde6c036b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c001650 tx=0x7fdf6c006740 comp rx=0 tx=0).stop 2024-09-10T14:30:41.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 msgr2=0x5567100dcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 --2- 172.21.15.151:0/4273188680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55670ffe9550 0x5567100dcd50 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdf74019930 tx=0x7fdf74018020 comp rx=0 tx=0).stop 2024-09-10T14:30:41.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf8550b640 1 -- 172.21.15.151:0/4273188680 reap_dead start 2024-09-10T14:30:41.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 shutdown_connections 2024-09-10T14:30:41.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 >> 172.21.15.151:0/4273188680 conn(0x55670ffe5070 msgr2=0x5567100cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 shutdown_connections 2024-09-10T14:30:41.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.348+0000 7fdf871fa980 1 -- 172.21.15.151:0/4273188680 wait complete. 2024-09-10T14:30:41.362 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:41.362 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:41.362 ERROR:root:0 2024-09-10T14:30:41.362 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:41.366 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:41.366 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T14:30:41.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T14:30:41.367 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-10T14:30:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.436+0000 7fab9612d980 1 Processor -- start 2024-09-10T14:30:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.436+0000 7fab9612d980 1 -- start start 2024-09-10T14:30:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9612d980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56176cac1a20 0x56176cac3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9612d980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56176c945ae0 con 0x56176cabd6a0 2024-09-10T14:30:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9612d980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x56176c969e30 con 0x56176cac1a20 2024-09-10T14:30:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9343c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56176cac1a20 0x56176cac3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9343c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x56176cac1a20 0x56176cac3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51232/0 (socket says 172.21.15.151:51232) 2024-09-10T14:30:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9343c640 1 -- 172.21.15.151:0/1109869120 learned_addr learned my addr 172.21.15.151:0/1109869120 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab93c3d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x56176cabd6a0 0x56176cabda80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33380/0 (socket says 172.21.15.151:33380) 2024-09-10T14:30:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9343c640 1 -- 172.21.15.151:0/1109869120 >> v1:172.21.15.52:6789/0 conn(0x56176cabd6a0 legacy=0x56176cabda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9343c640 1 -- 172.21.15.151:0/1109869120 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176cac5360 con 0x56176cac1a20 2024-09-10T14:30:41.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab9343c640 1 --2- 172.21.15.151:0/1109869120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cac1a20 0x56176cac3e10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00a5c0 tx=0x7fab7c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b973d78362c761ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab92c3b640 1 -- 172.21.15.151:0/1109869120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c0a6070 con 0x56176cac1a20 2024-09-10T14:30:41.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab92c3b640 1 -- 172.21.15.151:0/1109869120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c0af070 con 0x56176cac1a20 2024-09-10T14:30:41.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.440+0000 7fab92c3b640 1 -- 172.21.15.151:0/1109869120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7c0aa5c0 con 0x56176cac1a20 2024-09-10T14:30:41.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.444+0000 7fab9612d980 1 -- 172.21.15.151:0/1109869120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cac1a20 msgr2=0x56176cac3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.444+0000 7fab9612d980 1 --2- 172.21.15.151:0/1109869120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cac1a20 0x56176cac3e10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00a5c0 tx=0x7fab7c01b340 comp rx=0 tx=0).stop 2024-09-10T14:30:41.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.444+0000 7fab9612d980 1 -- 172.21.15.151:0/1109869120 shutdown_connections 2024-09-10T14:30:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.444+0000 7fab9612d980 1 --2- 172.21.15.151:0/1109869120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cac1a20 0x56176cac3e10 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.444+0000 7fab9612d980 1 -- 172.21.15.151:0/1109869120 >> 172.21.15.151:0/1109869120 conn(0x56176cab91c0 msgr2=0x56176cabb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.444+0000 7fab9612d980 1 -- 172.21.15.151:0/1109869120 shutdown_connections 2024-09-10T14:30:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.444+0000 7fab9612d980 1 -- 172.21.15.151:0/1109869120 wait complete. 2024-09-10T14:30:41.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 Processor -- start 2024-09-10T14:30:41.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 -- start start 2024-09-10T14:30:41.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cba8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56176c96b200 con 0x56176cabd6a0 2024-09-10T14:30:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cba8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cba8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51246/0 (socket says 172.21.15.151:51246) 2024-09-10T14:30:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab93c3d640 1 -- 172.21.15.151:0/3222744511 learned_addr learned my addr 172.21.15.151:0/3222744511 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab93c3d640 1 -- 172.21.15.151:0/3222744511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176cba9060 con 0x56176cabd6a0 2024-09-10T14:30:41.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab93c3d640 1 --2- 172.21.15.151:0/3222744511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cba8a90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fab840015f0 tx=0x7fab84001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef243356a6e3c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7faa81e0b640 1 -- 172.21.15.151:0/3222744511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab84013420 con 0x56176cabd6a0 2024-09-10T14:30:41.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7faa81e0b640 1 -- 172.21.15.151:0/3222744511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab840135e0 con 0x56176cabd6a0 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7faa81e0b640 1 -- 172.21.15.151:0/3222744511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab84013940 con 0x56176cabd6a0 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 -- 172.21.15.151:0/3222744511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 msgr2=0x56176cba8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 --2- 172.21.15.151:0/3222744511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cba8a90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fab840015f0 tx=0x7fab84001ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 -- 172.21.15.151:0/3222744511 shutdown_connections 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 --2- 172.21.15.151:0/3222744511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cba8a90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 -- 172.21.15.151:0/3222744511 >> 172.21.15.151:0/3222744511 conn(0x56176cab91c0 msgr2=0x56176cba46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 -- 172.21.15.151:0/3222744511 shutdown_connections 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.456+0000 7fab9612d980 1 -- 172.21.15.151:0/3222744511 wait complete. 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9612d980 1 Processor -- start 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9612d980 1 -- start start 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9612d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cbafde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9612d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56176cac4e60 con 0x56176cabd6a0 2024-09-10T14:30:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cbafde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cbafde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51248/0 (socket says 172.21.15.151:51248) 2024-09-10T14:30:41.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab93c3d640 1 -- 172.21.15.151:0/2164567512 learned_addr learned my addr 172.21.15.151:0/2164567512 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab93c3d640 1 -- 172.21.15.151:0/2164567512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176cbb0320 con 0x56176cabd6a0 2024-09-10T14:30:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab93c3d640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cbafde0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fab84006640 tx=0x7fab84000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7faa7bfff640 1 -- 172.21.15.151:0/2164567512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab84022020 con 0x56176cabd6a0 2024-09-10T14:30:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56176cbb05b0 con 0x56176cabd6a0 2024-09-10T14:30:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56176cbb3290 con 0x56176cabd6a0 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7faa7bfff640 1 -- 172.21.15.151:0/2164567512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab84006320 con 0x56176cabd6a0 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7faa7bfff640 1 -- 172.21.15.151:0/2164567512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab84004ab0 con 0x56176cabd6a0 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7faa7bfff640 1 -- 172.21.15.151:0/2164567512 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab84025020 con 0x56176cabd6a0 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7faa7bfff640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa7c034650 0x7faa7c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7faa7bfff640 1 -- 172.21.15.151:0/2164567512 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fab84018030 con 0x56176cabd6a0 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9343c640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa7c034650 0x7faa7c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9612d980 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cac1a20 0x56176cbb6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbb7420 con 0x56176cac1a20 2024-09-10T14:30:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9443e640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cac1a20 0x56176cbb6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9343c640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa7c034650 0x7faa7c036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0ae000 tx=0x7fab7c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.460+0000 7fab9443e640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cac1a20 0x56176cbb6db0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9443e640 1 -- 172.21.15.151:0/2164567512 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cac1a20 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbb44b0 con 0x56176cac1a20 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9443e640 1 -- 172.21.15.151:0/2164567512 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cac1a20 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbb9750 0x56176cbbbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbbc230 con 0x56176cbb9750 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab93c3d640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbb9750 0x56176cbbbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab93c3d640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbb9750 0x56176cbbbb40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab93c3d640 1 -- 172.21.15.151:0/2164567512 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab8401b070 con 0x56176cbb9750 2024-09-10T14:30:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbb85c0 con 0x56176cac1a20 2024-09-10T14:30:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9443e640 1 -- 172.21.15.151:0/2164567512 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cac1a20 2024-09-10T14:30:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56176cbbd690 0x56176cbbfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbc0180 con 0x56176cbbd690 2024-09-10T14:30:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9343c640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56176cbbd690 0x56176cbbfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9343c640 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56176cbbd690 0x56176cbbfa80 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9343c640 1 -- 172.21.15.151:0/2164567512 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab7c0aaae0 con 0x56176cbbd690 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 Processor -- start 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 -- start start 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbcdc50 0x56176cbce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.464+0000 7fab9612d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56176c9c4800 con 0x56176cbcdc50 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbcdc50 0x56176cbce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbcdc50 0x56176cbce070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51250/0 (socket says 172.21.15.151:51250) 2024-09-10T14:30:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab93c3d640 1 -- 172.21.15.151:0/3879323571 learned_addr learned my addr 172.21.15.151:0/3879323571 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab93c3d640 1 -- 172.21.15.151:0/3879323571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176cbce5b0 con 0x56176cbcdc50 2024-09-10T14:30:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab93c3d640 1 --2- 172.21.15.151:0/3879323571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbcdc50 0x56176cbce070 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fab84006790 tx=0x7fab84010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7faa797fa640 1 -- 172.21.15.151:0/3879323571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab84041290 con 0x56176cbcdc50 2024-09-10T14:30:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab9612d980 1 -- 172.21.15.151:0/3879323571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56176cbce840 con 0x56176cbcdc50 2024-09-10T14:30:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab9612d980 1 -- 172.21.15.151:0/3879323571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56176cbd14c0 con 0x56176cbcdc50 2024-09-10T14:30:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7faa797fa640 1 -- 172.21.15.151:0/3879323571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab84041430 con 0x56176cbcdc50 2024-09-10T14:30:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7faa797fa640 1 -- 172.21.15.151:0/3879323571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab8401d6b0 con 0x56176cbcdc50 2024-09-10T14:30:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7faa797fa640 1 -- 172.21.15.151:0/3879323571 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab8403b070 con 0x56176cbcdc50 2024-09-10T14:30:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7faa797fa640 1 --2- 172.21.15.151:0/3879323571 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa6c0346a0 0x7faa6c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7faa797fa640 1 -- 172.21.15.151:0/3879323571 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fab840312e0 con 0x56176cbcdc50 2024-09-10T14:30:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab9343c640 1 --2- 172.21.15.151:0/3879323571 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa6c0346a0 0x7faa6c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab9612d980 1 Processor -- start 2024-09-10T14:30:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab9612d980 1 -- start start 2024-09-10T14:30:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab9343c640 1 --2- 172.21.15.151:0/3879323571 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa6c0346a0 0x7faa6c036b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x56176cbb78d0 tx=0x7fab7c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab9612d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbda9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab9612d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56176cba93e0 con 0x56176cbda5a0 2024-09-10T14:30:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbda9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbda9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51260/0 (socket says 172.21.15.151:51260) 2024-09-10T14:30:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.468+0000 7fab93c3d640 1 -- 172.21.15.151:0/3905225116 learned_addr learned my addr 172.21.15.151:0/3905225116 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab93c3d640 1 -- 172.21.15.151:0/3905225116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176cbdaf70 con 0x56176cbda5a0 2024-09-10T14:30:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab93c3d640 1 --2- 172.21.15.151:0/3905225116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbda9a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fab84036f80 tx=0x7fab84012530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757887a0223fd4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7faa72ffd640 1 -- 172.21.15.151:0/3905225116 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab8401c410 con 0x56176cbda5a0 2024-09-10T14:30:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7faa72ffd640 1 -- 172.21.15.151:0/3905225116 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8402ac10 con 0x56176cbda5a0 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7faa72ffd640 1 -- 172.21.15.151:0/3905225116 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab84026af0 con 0x56176cbda5a0 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- 172.21.15.151:0/3905225116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 msgr2=0x56176cbda9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 --2- 172.21.15.151:0/3905225116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbda9a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fab84036f80 tx=0x7fab84012530 comp rx=0 tx=0).stop 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- 172.21.15.151:0/3905225116 shutdown_connections 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 --2- 172.21.15.151:0/3905225116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbda9a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- 172.21.15.151:0/3905225116 >> 172.21.15.151:0/3905225116 conn(0x56176cbd6a10 msgr2=0x56176cbd4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- 172.21.15.151:0/3905225116 shutdown_connections 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- 172.21.15.151:0/3905225116 wait complete. 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 Processor -- start 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- start start 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbe1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56176cbdb480 con 0x56176cbda5a0 2024-09-10T14:30:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbe1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab93c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbe1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51268/0 (socket says 172.21.15.151:51268) 2024-09-10T14:30:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 learned_addr learned my addr 172.21.15.151:0/2044516423 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56176cbe1dd0 con 0x56176cbda5a0 2024-09-10T14:30:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab93c3d640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbe1890 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fab84046ed0 tx=0x7fab84036f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7faa717fa640 1 -- 172.21.15.151:0/2044516423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab84070070 con 0x56176cbda5a0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56176cbe1dd0 con 0x56176cbda5a0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56176cbe2240 con 0x56176cbda5a0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7faa717fa640 1 -- 172.21.15.151:0/2044516423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8401c8c0 con 0x56176cbda5a0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.472+0000 7faa717fa640 1 -- 172.21.15.151:0/2044516423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab8401cba0 con 0x56176cbda5a0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7faa717fa640 1 -- 172.21.15.151:0/2044516423 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab84073070 con 0x56176cbda5a0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7faa717fa640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa5c0346a0 0x7faa5c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7faa717fa640 1 -- 172.21.15.151:0/2044516423 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fab8405b070 con 0x56176cbda5a0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9343c640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa5c0346a0 0x7faa5c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cbec700 0x56176cbeeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbef2e0 con 0x56176cbec700 2024-09-10T14:30:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9443e640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cbec700 0x56176cbeeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9443e640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cbec700 0x56176cbeeb90 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9343c640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa5c0346a0 0x7faa5c036b60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fab7c000c10 tx=0x7fab7c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 realm 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbef6f0 con 0x56176cbec700 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbeff90 con 0x56176cbec700 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbf1090 0x56176cbf3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf3ad0 con 0x56176cbf1090 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab93c3d640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbf1090 0x56176cbf3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab93c3d640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbf1090 0x56176cbf3480 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab84072030 con 0x56176cbf1090 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 20 searching for the correct realm 2024-09-10T14:30:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf5330 con 0x56176cbf1090 2024-09-10T14:30:41.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab84072030 con 0x56176cbf1090 2024-09-10T14:30:41.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab93c3d640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fab84075060 0x7fab84031970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf5330 con 0x7fab84075060 2024-09-10T14:30:41.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.476+0000 7fab9343c640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fab84075060 0x7fab84031970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9343c640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fab84075060 0x7fab84031970 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9343c640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fab7c0e0040 0x7fab7c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf5330 con 0x7fab7c0e0040 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fab7c0e0040 0x7fab7c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fab7c0e0040 0x7fab7c0e0420 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab7c0e0040 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab7c0e0040 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.480+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab84075060 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbf1090 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab7c0e0040 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab84075060 2024-09-10T14:30:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbf1090 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbf1090 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab84075060 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbf1090 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbf1090 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.484+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab7c0e0040 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbf1090 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab84075060 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab84075060 2024-09-10T14:30:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbf1090 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab7c0e0040 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab84075060 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbf1090 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab7c0e0040 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x56176cbec700 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf0330 con 0x7fab84075060 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf4420 con 0x56176cbec700 2024-09-10T14:30:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.488+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf4c70 con 0x56176cbec700 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf47c0 con 0x7fab7c0e0040 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 zone default found 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 4 Realm: () 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 zonegroup default 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf4bf0 con 0x7fab84075060 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf7170 con 0x56176cbf1090 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf7660 con 0x56176cbf1090 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 started sync module instance, tier type = 2024-09-10T14:30:41.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:41.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf65e0 con 0x7fab84075060 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94658608720336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf7f70 con 0x7fab84075060 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.492+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf87c0 con 0x56176cbec700 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.496+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94658608720336] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.496+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.496+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94658608724672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf87c0 con 0x56176cbec700 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.496+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf92c0 con 0x56176cbf1090 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.496+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.496+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94658608729520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf9b90 con 0x56176cbf1090 2024-09-10T14:30:41.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.496+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfa590 con 0x7fab84075060 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.496+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94658608724672] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.500+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.500+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94658608726800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfa9b0 con 0x7fab84075060 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.500+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfb370 con 0x56176cbec700 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.500+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94658608729520] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.500+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94658608726800] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.500+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.500+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94658608734368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfaec0 con 0x56176cbec700 2024-09-10T14:30:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.500+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfb750 con 0x7fab7c0e0040 2024-09-10T14:30:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.504+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94658608734368] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.504+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.504+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94658608731872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfb370 con 0x7fab7c0e0040 2024-09-10T14:30:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.504+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfc160 con 0x7fab7c0e0040 2024-09-10T14:30:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.504+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94658608731872] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.504+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.504+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94658608738464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfc160 con 0x7fab7c0e0040 2024-09-10T14:30:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.504+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfcb20 con 0x7fab7c0e0040 2024-09-10T14:30:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94658608738464] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94658608742032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfcb20 con 0x7fab7c0e0040 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 20 add_watcher() i=0 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 20 add_watcher() i=1 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 20 add_watcher() i=2 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 20 add_watcher() i=3 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 20 add_watcher() i=4 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 20 add_watcher() i=5 2024-09-10T14:30:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 20 add_watcher() i=6 2024-09-10T14:30:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94658608742032] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 20 add_watcher() i=7 2024-09-10T14:30:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cbffe50 con 0x56176cbec700 2024-09-10T14:30:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.508+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94658608744416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfd0b0 con 0x56176cbec700 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94658608744416] v36'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7faa49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 5 note: GC not initialized 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7faa48fe1640 20 reqs_thread_entry: start 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 20 Filter name: none 2024-09-10T14:30:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fa9c27fc640 20 reqs_thread_entry: start 2024-09-10T14:30:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cc23590 con 0x7fab7c0e0040 2024-09-10T14:30:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T14:30:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.512+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cc29ed0 con 0x7fab7c0e0040 2024-09-10T14:30:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9612d980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9612d980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9612d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94658608929088 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56176cc25580 con 0x56176cbec700 2024-09-10T14:30:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 94658608734368 notify 154618822681 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fab8c010040 con 0x56176cbec700 2024-09-10T14:30:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7faa72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822681 cookie 94658608734368 notifier 4876 bl.length()=666 2024-09-10T14:30:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 94658608929088 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7faa72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7faa72ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7faa72ffd640 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7faa58003eb0 con 0x56176cbec700 2024-09-10T14:30:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 94658608929088 notify 154618822681 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab8c00bdd0 con 0x56176cbec700 2024-09-10T14:30:41.521 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7faa49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94658608744416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cc21390 con 0x56176cbec700 2024-09-10T14:30:41.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94658608744416] v36'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.516+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94658608720336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cc21390 con 0x7fab84075060 2024-09-10T14:30:41.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.520+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94658608720336] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.520+0000 7fab9612d980 20 remove_watcher() i=0 2024-09-10T14:30:41.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.520+0000 7fab9612d980 2 removed watcher, disabling cache 2024-09-10T14:30:41.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.520+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94658608724672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf69d0 con 0x56176cbec700 2024-09-10T14:30:41.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.520+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94658608724672] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.520+0000 7fab9612d980 20 remove_watcher() i=1 2024-09-10T14:30:41.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.520+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94658608729520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cc21390 con 0x56176cbf1090 2024-09-10T14:30:41.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab93c3d640 1 -- 172.21.15.151:0/2044516423 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94658608729520] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab84084040 con 0x56176cbf1090 2024-09-10T14:30:41.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab9612d980 20 remove_watcher() i=2 2024-09-10T14:30:41.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94658608726800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf7ac0 con 0x7fab84075060 2024-09-10T14:30:41.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab9343c640 1 -- 172.21.15.151:0/2044516423 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94658608726800] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7c0aaae0 con 0x7fab84075060 2024-09-10T14:30:41.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab9612d980 20 remove_watcher() i=3 2024-09-10T14:30:41.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94658608734368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf69d0 con 0x56176cbec700 2024-09-10T14:30:41.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94658608734368] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x56176cbec700 2024-09-10T14:30:41.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab9612d980 20 remove_watcher() i=4 2024-09-10T14:30:41.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.524+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94658608731872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cc21390 con 0x7fab7c0e0040 2024-09-10T14:30:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.528+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94658608731872] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.528+0000 7fab9612d980 20 remove_watcher() i=5 2024-09-10T14:30:41.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.528+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94658608738464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbf7ac0 con 0x7fab7c0e0040 2024-09-10T14:30:41.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.528+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94658608738464] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.528+0000 7fab9612d980 20 remove_watcher() i=6 2024-09-10T14:30:41.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.528+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94658608742032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56176cbfa0a0 con 0x7fab7c0e0040 2024-09-10T14:30:41.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94658608742032] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab8c0083f0 con 0x7fab7c0e0040 2024-09-10T14:30:41.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 20 remove_watcher() i=7 2024-09-10T14:30:41.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fab7c0e0040 msgr2=0x7fab7c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fab7c0e0040 0x7fab7c0e0420 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cbec700 msgr2=0x56176cbeeb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cbec700 0x56176cbeeb90 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fab84075060 msgr2=0x7fab84031970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fab84075060 0x7fab84031970 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbf1090 msgr2=0x56176cbf3480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbf1090 0x56176cbf3480 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa5c0346a0 msgr2=0x7faa5c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa5c0346a0 0x7faa5c036b60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fab7c000c10 tx=0x7fab7c0c1040 comp rx=0 tx=0).stop 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 msgr2=0x56176cbe1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbe1890 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fab84046ed0 tx=0x7fab84036f10 comp rx=0 tx=0).stop 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9443e640 1 -- 172.21.15.151:0/2044516423 reap_dead start 2024-09-10T14:30:41.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 shutdown_connections 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2044516423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbda5a0 0x56176cbe1890 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 >> 172.21.15.151:0/2044516423 conn(0x56176cbd6a10 msgr2=0x56176cbd4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 shutdown_connections 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2044516423 wait complete. 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/3879323571 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa6c0346a0 msgr2=0x7faa6c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/3879323571 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa6c0346a0 0x7faa6c036b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x56176cbb78d0 tx=0x7fab7c005ad0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/3879323571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbcdc50 msgr2=0x56176cbce070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/3879323571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbcdc50 0x56176cbce070 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fab84006790 tx=0x7fab84010ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/3879323571 shutdown_connections 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/3879323571 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa6c0346a0 0x7faa6c036b60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/3879323571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cbcdc50 0x56176cbce070 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/3879323571 >> 172.21.15.151:0/3879323571 conn(0x56176cbc2da0 msgr2=0x56176cbc5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/3879323571 shutdown_connections 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/3879323571 wait complete. 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56176cbbd690 msgr2=0x56176cbbfa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x56176cbbd690 0x56176cbbfa80 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cac1a20 msgr2=0x56176cbb6db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x56176cac1a20 0x56176cbb6db0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbb9750 msgr2=0x56176cbbbb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x56176cbb9750 0x56176cbbbb40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa7c034650 msgr2=0x7faa7c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7faa7c034650 0x7faa7c036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0ae000 tx=0x7fab7c0a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 msgr2=0x56176cbafde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 --2- 172.21.15.151:0/2164567512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56176cabd6a0 0x56176cbafde0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fab84006640 tx=0x7fab84000f50 comp rx=0 tx=0).stop 2024-09-10T14:30:41.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9443e640 1 -- 172.21.15.151:0/2164567512 reap_dead start 2024-09-10T14:30:41.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 shutdown_connections 2024-09-10T14:30:41.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 >> 172.21.15.151:0/2164567512 conn(0x56176cab91c0 msgr2=0x56176cba3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 shutdown_connections 2024-09-10T14:30:41.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.532+0000 7fab9612d980 1 -- 172.21.15.151:0/2164567512 wait complete. 2024-09-10T14:30:41.547 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:41.547 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:41.547 ERROR:root:0 2024-09-10T14:30:41.547 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:41.551 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:41.552 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T14:30:41.552 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T14:30:41.552 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T14:30:41.626 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:41.626 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:41.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde4bea980 1 Processor -- start 2024-09-10T14:30:41.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde4bea980 1 -- start start 2024-09-10T14:30:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde4bea980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c668c06a60 0x55c668c08e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde4bea980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c668a8aae0 con 0x55c668b76b10 2024-09-10T14:30:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde4bea980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55c668aaee30 con 0x55c668c06a60 2024-09-10T14:30:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde1ef9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c668c06a60 0x55c668c08e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde1ef9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55c668c06a60 0x55c668c08e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51274/0 (socket says 172.21.15.151:51274) 2024-09-10T14:30:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde26fa640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55c668b76b10 0x55c668c05340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33382/0 (socket says 172.21.15.151:33382) 2024-09-10T14:30:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1274939962 learned_addr learned my addr 172.21.15.151:0/1274939962 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1274939962 >> v1:172.21.15.52:6789/0 conn(0x55c668b76b10 legacy=0x55c668c05340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1274939962 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c668c0a3a0 con 0x55c668c06a60 2024-09-10T14:30:41.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.624+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/1274939962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668c06a60 0x55c668c08e50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800a5c0 tx=0x7fcdd801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f4065f81cf1c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde16f8640 1 -- 172.21.15.151:0/1274939962 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd80a6070 con 0x55c668c06a60 2024-09-10T14:30:41.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde16f8640 1 -- 172.21.15.151:0/1274939962 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd80af070 con 0x55c668c06a60 2024-09-10T14:30:41.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde16f8640 1 -- 172.21.15.151:0/1274939962 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd80aa5c0 con 0x55c668c06a60 2024-09-10T14:30:41.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde4bea980 1 -- 172.21.15.151:0/1274939962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668c06a60 msgr2=0x55c668c08e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1274939962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668c06a60 0x55c668c08e50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800a5c0 tx=0x7fcdd801b340 comp rx=0 tx=0).stop 2024-09-10T14:30:41.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde4bea980 1 -- 172.21.15.151:0/1274939962 shutdown_connections 2024-09-10T14:30:41.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1274939962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668c06a60 0x55c668c08e50 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde4bea980 1 -- 172.21.15.151:0/1274939962 >> 172.21.15.151:0/1274939962 conn(0x55c668bfd070 msgr2=0x55c668bff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde4bea980 1 -- 172.21.15.151:0/1274939962 shutdown_connections 2024-09-10T14:30:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.628+0000 7fcde4bea980 1 -- 172.21.15.151:0/1274939962 wait complete. 2024-09-10T14:30:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.640+0000 7fcde4bea980 1 Processor -- start 2024-09-10T14:30:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.640+0000 7fcde4bea980 1 -- start start 2024-09-10T14:30:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.640+0000 7fcde4bea980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cedac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.640+0000 7fcde4bea980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c668ab0200 con 0x55c668b76b10 2024-09-10T14:30:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.640+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cedac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.640+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cedac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51282/0 (socket says 172.21.15.151:51282) 2024-09-10T14:30:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.640+0000 7fcde26fa640 1 -- 172.21.15.151:0/547871989 learned_addr learned my addr 172.21.15.151:0/547871989 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.640+0000 7fcde26fa640 1 -- 172.21.15.151:0/547871989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c668cee090 con 0x55c668b76b10 2024-09-10T14:30:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde26fa640 1 --2- 172.21.15.151:0/547871989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cedac0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40015f0 tx=0x7fcdd4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfce1113e48d82c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fccd0608640 1 -- 172.21.15.151:0/547871989 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd4013420 con 0x55c668b76b10 2024-09-10T14:30:41.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fccd0608640 1 -- 172.21.15.151:0/547871989 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd40135e0 con 0x55c668b76b10 2024-09-10T14:30:41.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fccd0608640 1 -- 172.21.15.151:0/547871989 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd4013940 con 0x55c668b76b10 2024-09-10T14:30:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- 172.21.15.151:0/547871989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 msgr2=0x55c668cedac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 --2- 172.21.15.151:0/547871989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cedac0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40015f0 tx=0x7fcdd4001ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- 172.21.15.151:0/547871989 shutdown_connections 2024-09-10T14:30:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 --2- 172.21.15.151:0/547871989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cedac0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- 172.21.15.151:0/547871989 >> 172.21.15.151:0/547871989 conn(0x55c668bfd070 msgr2=0x55c668ce96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- 172.21.15.151:0/547871989 shutdown_connections 2024-09-10T14:30:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- 172.21.15.151:0/547871989 wait complete. 2024-09-10T14:30:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 Processor -- start 2024-09-10T14:30:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- start start 2024-09-10T14:30:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cf4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c668c09e40 con 0x55c668b76b10 2024-09-10T14:30:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cf4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cf4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51286/0 (socket says 172.21.15.151:51286) 2024-09-10T14:30:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde26fa640 1 -- 172.21.15.151:0/555700170 learned_addr learned my addr 172.21.15.151:0/555700170 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde26fa640 1 -- 172.21.15.151:0/555700170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c668cf53b0 con 0x55c668b76b10 2024-09-10T14:30:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde26fa640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cf4e70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4006640 tx=0x7fcdd4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcccee05640 1 -- 172.21.15.151:0/555700170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd4022020 con 0x55c668b76b10 2024-09-10T14:30:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c668cf5640 con 0x55c668b76b10 2024-09-10T14:30:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcccee05640 1 -- 172.21.15.151:0/555700170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4006320 con 0x55c668b76b10 2024-09-10T14:30:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcccee05640 1 -- 172.21.15.151:0/555700170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd4004ab0 con 0x55c668b76b10 2024-09-10T14:30:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.644+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c668cf8320 con 0x55c668b76b10 2024-09-10T14:30:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcccee05640 1 -- 172.21.15.151:0/555700170 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcdd4025020 con 0x55c668b76b10 2024-09-10T14:30:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcccee05640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccc8034650 0x7fccc8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcccee05640 1 -- 172.21.15.151:0/555700170 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fcdd4018030 con 0x55c668b76b10 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccc8034650 0x7fccc8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde4bea980 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668c06a60 0x55c668cfbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668cfc490 con 0x55c668c06a60 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde2efb640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668c06a60 0x55c668cfbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccc8034650 0x7fccc8036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80ae000 tx=0x7fcdd80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde2efb640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668c06a60 0x55c668cfbe20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde2efb640 1 -- 172.21.15.151:0/555700170 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668c06a60 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668cf9540 con 0x55c668c06a60 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde2efb640 1 -- 172.21.15.151:0/555700170 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668c06a60 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde4bea980 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668cfe7e0 0x55c668d00bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d012c0 con 0x55c668cfe7e0 2024-09-10T14:30:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde26fa640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668cfe7e0 0x55c668d00bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde26fa640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668cfe7e0 0x55c668d00bd0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde26fa640 1 -- 172.21.15.151:0/555700170 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcdd401b070 con 0x55c668cfe7e0 2024-09-10T14:30:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668cfd650 con 0x55c668c06a60 2024-09-10T14:30:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde2efb640 1 -- 172.21.15.151:0/555700170 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668c06a60 2024-09-10T14:30:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde4bea980 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c668d02720 0x55c668d04b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d05210 con 0x55c668d02720 2024-09-10T14:30:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.648+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c668d02720 0x55c668d04b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c668d02720 0x55c668d04b10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde1ef9640 1 -- 172.21.15.151:0/555700170 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcdd80aaae0 con 0x55c668d02720 2024-09-10T14:30:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde4bea980 1 Processor -- start 2024-09-10T14:30:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde4bea980 1 -- start start 2024-09-10T14:30:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde4bea980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d12ce0 0x55c668d13100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde4bea980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c668b09800 con 0x55c668d12ce0 2024-09-10T14:30:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d12ce0 0x55c668d13100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d12ce0 0x55c668d13100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51290/0 (socket says 172.21.15.151:51290) 2024-09-10T14:30:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde26fa640 1 -- 172.21.15.151:0/3190031326 learned_addr learned my addr 172.21.15.151:0/3190031326 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde26fa640 1 -- 172.21.15.151:0/3190031326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c668d13640 con 0x55c668d12ce0 2024-09-10T14:30:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde26fa640 1 --2- 172.21.15.151:0/3190031326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d12ce0 0x55c668d13100 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4006790 tx=0x7fcdd4010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fccc7fff640 1 -- 172.21.15.151:0/3190031326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd401d580 con 0x55c668d12ce0 2024-09-10T14:30:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde4bea980 1 -- 172.21.15.151:0/3190031326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c668d138d0 con 0x55c668d12ce0 2024-09-10T14:30:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fccc7fff640 1 -- 172.21.15.151:0/3190031326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4041210 con 0x55c668d12ce0 2024-09-10T14:30:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fcde4bea980 1 -- 172.21.15.151:0/3190031326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c668d16550 con 0x55c668d12ce0 2024-09-10T14:30:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.652+0000 7fccc7fff640 1 -- 172.21.15.151:0/3190031326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd40414f0 con 0x55c668d12ce0 2024-09-10T14:30:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fccc7fff640 1 -- 172.21.15.151:0/3190031326 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcdd4010070 con 0x55c668d12ce0 2024-09-10T14:30:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fccc7fff640 1 --2- 172.21.15.151:0/3190031326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccbc0347a0 0x7fccbc036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fccc7fff640 1 -- 172.21.15.151:0/3190031326 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fcdd404b980 con 0x55c668d12ce0 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/3190031326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccbc0347a0 0x7fccbc036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 Processor -- start 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- start start 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/3190031326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccbc0347a0 0x7fccbc036c60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55c668cfc960 tx=0x7fcdd8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d1f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c668cee410 con 0x55c668d1f610 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d1f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d1f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51300/0 (socket says 172.21.15.151:51300) 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde26fa640 1 -- 172.21.15.151:0/1347896274 learned_addr learned my addr 172.21.15.151:0/1347896274 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde26fa640 1 -- 172.21.15.151:0/1347896274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c668d1ffc0 con 0x55c668d1f610 2024-09-10T14:30:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde26fa640 1 --2- 172.21.15.151:0/1347896274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d1f9f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40154b0 tx=0x7fcdd401d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e437988d6b25fbfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fccc5ffb640 1 -- 172.21.15.151:0/1347896274 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd405d070 con 0x55c668d1f610 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fccc5ffb640 1 -- 172.21.15.151:0/1347896274 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd401da00 con 0x55c668d1f610 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fccc5ffb640 1 -- 172.21.15.151:0/1347896274 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd40150c0 con 0x55c668d1f610 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- 172.21.15.151:0/1347896274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 msgr2=0x55c668d1f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1347896274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d1f9f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40154b0 tx=0x7fcdd401d8f0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- 172.21.15.151:0/1347896274 shutdown_connections 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1347896274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d1f9f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- 172.21.15.151:0/1347896274 >> 172.21.15.151:0/1347896274 conn(0x55c668d1b9f0 msgr2=0x55c668d19af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- 172.21.15.151:0/1347896274 shutdown_connections 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- 172.21.15.151:0/1347896274 wait complete. 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 Processor -- start 2024-09-10T14:30:41.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- start start 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d26790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde4bea980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c668d20460 con 0x55c668d1f610 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d26790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde26fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d26790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51308/0 (socket says 172.21.15.151:51308) 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.656+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 learned_addr learned my addr 172.21.15.151:0/1815056549 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c668d26cd0 con 0x55c668d1f610 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde26fa640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d26790 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4049eb0 tx=0x7fcdd4015440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fccb3fff640 1 -- 172.21.15.151:0/1815056549 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd405d030 con 0x55c668d1f610 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c668d26cd0 con 0x55c668d1f610 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c668d26cd0 con 0x55c668d1f610 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fccb3fff640 1 -- 172.21.15.151:0/1815056549 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4069070 con 0x55c668d1f610 2024-09-10T14:30:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fccb3fff640 1 -- 172.21.15.151:0/1815056549 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd401dbb0 con 0x55c668d1f610 2024-09-10T14:30:41.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fccb3fff640 1 -- 172.21.15.151:0/1815056549 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcdd404b070 con 0x55c668d1f610 2024-09-10T14:30:41.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fccb3fff640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccac034650 0x7fccac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fccb3fff640 1 -- 172.21.15.151:0/1815056549 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fcdd405e070 con 0x55c668d1f610 2024-09-10T14:30:41.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccac034650 0x7fccac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668d31800 0x55c668d33cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d34410 con 0x55c668d31800 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde2efb640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668d31800 0x55c668d33cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccac034650 0x7fccac036b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8000c10 tx=0x7fcdd80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde2efb640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668d31800 0x55c668d33cc0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 realm 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d34820 con 0x55c668d31800 2024-09-10T14:30:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d350c0 con 0x55c668d31800 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.660+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668d361c0 0x55c668d385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d38c00 con 0x55c668d361c0 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde26fa640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668d361c0 0x55c668d385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde26fa640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668d361c0 0x55c668d385b0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde4bea980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde4bea980 20 searching for the correct realm 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3a460 con 0x55c668d361c0 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde26fa640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fcdd403c070 0x7fcdd4058890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3a460 con 0x7fcdd403c070 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fcdd403c070 0x7fcdd4058890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fcdd403c070 0x7fcdd4058890 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde1ef9640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fcdd80e0040 0x7fcdd80e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3a460 con 0x7fcdd80e0040 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde2efb640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fcdd80e0040 0x7fcdd80e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde2efb640 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fcdd80e0040 0x7fcdd80e0420 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.664+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd80e0040 2024-09-10T14:30:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd80e0040 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd403c070 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d361c0 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd80e0040 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd403c070 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d361c0 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d361c0 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.668+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd403c070 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d361c0 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d361c0 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd80e0040 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d361c0 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd403c070 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd403c070 2024-09-10T14:30:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d361c0 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd80e0040 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.672+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd403c070 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d361c0 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd80e0040 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x55c668d31800 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c668d35460 con 0x7fcdd403c070 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d395b0 con 0x55c668d31800 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d39e00 con 0x55c668d31800 2024-09-10T14:30:41.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d39950 con 0x7fcdd80e0040 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 zone default found 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 4 Realm: () 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 zonegroup default 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d39d80 con 0x7fcdd403c070 2024-09-10T14:30:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3c2d0 con 0x55c668d361c0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3c7d0 con 0x55c668d361c0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 started sync module instance, tier type = 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:41.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.676+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3b740 con 0x7fcdd403c070 2024-09-10T14:30:41.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.680+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.680+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94310650592048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3d0e0 con 0x7fcdd403c070 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.680+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3d930 con 0x55c668d31800 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.680+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94310650592048] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.680+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.680+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94310650596400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3d930 con 0x55c668d31800 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.680+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3e410 con 0x55c668d361c0 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94310650596400] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94310650601248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3d930 con 0x55c668d361c0 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3ee20 con 0x7fcdd403c070 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94310650603888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3f670 con 0x7fcdd403c070 2024-09-10T14:30:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d40090 con 0x55c668d31800 2024-09-10T14:30:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94310650603888] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.684+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94310650601248] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.688+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.688+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94310650598528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3f1c0 con 0x55c668d31800 2024-09-10T14:30:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.688+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d40500 con 0x7fcdd80e0040 2024-09-10T14:30:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.688+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94310650598528] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.688+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.688+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94310650608512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d40500 con 0x7fcdd80e0040 2024-09-10T14:30:41.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.688+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d40ec0 con 0x7fcdd80e0040 2024-09-10T14:30:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94310650612240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d412e0 con 0x7fcdd80e0040 2024-09-10T14:30:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d41d90 con 0x7fcdd80e0040 2024-09-10T14:30:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94310650608512] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94310650612240] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94310650609744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d40e30 con 0x7fcdd80e0040 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 20 add_watcher() i=0 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 20 add_watcher() i=1 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 20 add_watcher() i=2 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 20 add_watcher() i=3 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 20 add_watcher() i=4 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 20 add_watcher() i=5 2024-09-10T14:30:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.692+0000 7fcde4bea980 20 add_watcher() i=6 2024-09-10T14:30:41.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94310650609744] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 20 add_watcher() i=7 2024-09-10T14:30:41.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:41.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d44e90 con 0x55c668d31800 2024-09-10T14:30:41.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94310650615920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d42310 con 0x55c668d31800 2024-09-10T14:30:41.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94310650615920] v36'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcc98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 5 note: GC not initialized 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcc137fe640 20 reqs_thread_entry: start 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 20 Filter name: none 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcc117fa640 20 reqs_thread_entry: start 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.696+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d68310 con 0x7fcdd80e0040 2024-09-10T14:30:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.700+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.700+0000 7fcde4bea980 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T14:30:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.700+0000 7fcde4bea980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.700+0000 7fcde4bea980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.700+0000 7fcde4bea980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.700+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d6ec70 con 0x7fcdd80e0040 2024-09-10T14:30:41.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v36'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:41.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94310650799840 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c668d6a340 con 0x55c668d31800 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 94310650598528 notify 154618822682 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7fcddc010040 con 0x55c668d31800 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fccc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822682 cookie 94310650598528 notifier 4883 bl.length()=679 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fccc5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fccc5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 94310650799840 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fccc5ffb640 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fcca8003eb0 con 0x55c668d31800 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 94310650799840 notify 154618822682 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcddc00bdd0 con 0x55c668d31800 2024-09-10T14:30:41.709 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:41.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcc98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94310650615920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d66110 con 0x55c668d31800 2024-09-10T14:30:41.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94310650615920] v36'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94310650592048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d66110 con 0x7fcdd403c070 2024-09-10T14:30:41.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94310650592048] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 20 remove_watcher() i=0 2024-09-10T14:30:41.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 2 removed watcher, disabling cache 2024-09-10T14:30:41.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.704+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94310650596400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3bb30 con 0x55c668d31800 2024-09-10T14:30:41.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.708+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94310650596400] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.708+0000 7fcde4bea980 20 remove_watcher() i=1 2024-09-10T14:30:41.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.708+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94310650601248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d66110 con 0x55c668d361c0 2024-09-10T14:30:41.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.708+0000 7fcde26fa640 1 -- 172.21.15.151:0/1815056549 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94310650601248] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd4039070 con 0x55c668d361c0 2024-09-10T14:30:41.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.708+0000 7fcde4bea980 20 remove_watcher() i=2 2024-09-10T14:30:41.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.708+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94310650603888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3bb30 con 0x7fcdd403c070 2024-09-10T14:30:41.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.712+0000 7fcde1ef9640 1 -- 172.21.15.151:0/1815056549 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94310650603888] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdd80aaae0 con 0x7fcdd403c070 2024-09-10T14:30:41.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.712+0000 7fcde4bea980 20 remove_watcher() i=3 2024-09-10T14:30:41.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.712+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94310650598528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d66110 con 0x55c668d31800 2024-09-10T14:30:41.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.712+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94310650598528] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x55c668d31800 2024-09-10T14:30:41.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.712+0000 7fcde4bea980 20 remove_watcher() i=4 2024-09-10T14:30:41.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.712+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94310650608512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3e970 con 0x7fcdd80e0040 2024-09-10T14:30:41.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.716+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94310650608512] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.716+0000 7fcde4bea980 20 remove_watcher() i=5 2024-09-10T14:30:41.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.716+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94310650612240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d3bb30 con 0x7fcdd80e0040 2024-09-10T14:30:41.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.716+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94310650612240] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.716+0000 7fcde4bea980 20 remove_watcher() i=6 2024-09-10T14:30:41.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.716+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94310650609744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c668d66110 con 0x7fcdd80e0040 2024-09-10T14:30:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94310650609744] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcddc0083f0 con 0x7fcdd80e0040 2024-09-10T14:30:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 20 remove_watcher() i=7 2024-09-10T14:30:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fcdd80e0040 msgr2=0x7fcdd80e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fcdd80e0040 0x7fcdd80e0420 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668d31800 msgr2=0x55c668d33cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668d31800 0x55c668d33cc0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fcdd403c070 msgr2=0x7fcdd4058890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fcdd403c070 0x7fcdd4058890 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668d361c0 msgr2=0x55c668d385b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668d361c0 0x55c668d385b0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccac034650 msgr2=0x7fccac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccac034650 0x7fccac036b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8000c10 tx=0x7fcdd80c1040 comp rx=0 tx=0).stop 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde2efb640 1 -- 172.21.15.151:0/1815056549 reap_dead start 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 msgr2=0x55c668d26790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d26790 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4049eb0 tx=0x7fcdd4015440 comp rx=0 tx=0).stop 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 shutdown_connections 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/1815056549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d1f610 0x55c668d26790 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 >> 172.21.15.151:0/1815056549 conn(0x55c668d1b9f0 msgr2=0x55c668d19ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 shutdown_connections 2024-09-10T14:30:41.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/1815056549 wait complete. 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/3190031326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccbc0347a0 msgr2=0x7fccbc036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/3190031326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccbc0347a0 0x7fccbc036c60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55c668cfc960 tx=0x7fcdd8005ad0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/3190031326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d12ce0 msgr2=0x55c668d13100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/3190031326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d12ce0 0x55c668d13100 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4006790 tx=0x7fcdd4010ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/3190031326 shutdown_connections 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/3190031326 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccbc0347a0 0x7fccbc036c60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/3190031326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668d12ce0 0x55c668d13100 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/3190031326 >> 172.21.15.151:0/3190031326 conn(0x55c668d07e30 msgr2=0x55c668d0a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/3190031326 shutdown_connections 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/3190031326 wait complete. 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c668d02720 msgr2=0x55c668d04b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55c668d02720 0x55c668d04b10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668c06a60 msgr2=0x55c668cfbe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55c668c06a60 0x55c668cfbe20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668cfe7e0 msgr2=0x55c668d00bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55c668cfe7e0 0x55c668d00bd0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccc8034650 msgr2=0x7fccc8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fccc8034650 0x7fccc8036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80ae000 tx=0x7fcdd80a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 msgr2=0x55c668cf4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 --2- 172.21.15.151:0/555700170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c668b76b10 0x55c668cf4e70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4006640 tx=0x7fcdd4000f50 comp rx=0 tx=0).stop 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde2efb640 1 -- 172.21.15.151:0/555700170 reap_dead start 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 shutdown_connections 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 >> 172.21.15.151:0/555700170 conn(0x55c668bfd070 msgr2=0x55c668ce8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 shutdown_connections 2024-09-10T14:30:41.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.720+0000 7fcde4bea980 1 -- 172.21.15.151:0/555700170 wait complete. 2024-09-10T14:30:41.734 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:41.734 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:41.735 ERROR:root:0 2024-09-10T14:30:41.735 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:41.739 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:41.739 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T14:30:41.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T14:30:41.739 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-10T14:30:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49eeb1980 1 Processor -- start 2024-09-10T14:30:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49eeb1980 1 -- start start 2024-09-10T14:30:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49eeb1980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5591a9688ad0 0x5591a968aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49eeb1980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591a950cae0 con 0x5591a95f92a0 2024-09-10T14:30:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49eeb1980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x5591a9530e30 con 0x5591a9688ad0 2024-09-10T14:30:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49c1c0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5591a9688ad0 0x5591a968aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49c1c0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x5591a9688ad0 0x5591a968aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51320/0 (socket says 172.21.15.151:51320) 2024-09-10T14:30:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49c9c1640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x5591a95f92a0 0x5591a96873b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33386/0 (socket says 172.21.15.151:33386) 2024-09-10T14:30:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49c1c0640 1 -- 172.21.15.151:0/2883734000 learned_addr learned my addr 172.21.15.151:0/2883734000 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49c1c0640 1 -- 172.21.15.151:0/2883734000 >> v1:172.21.15.52:6789/0 conn(0x5591a95f92a0 legacy=0x5591a96873b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49c1c0640 1 -- 172.21.15.151:0/2883734000 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a95f9830 con 0x5591a9688ad0 2024-09-10T14:30:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.800+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/2883734000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9688ad0 0x5591a968aec0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa48400a5c0 tx=0x7fa48401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a234dce77054c358 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49b9bf640 1 -- 172.21.15.151:0/2883734000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4840a6070 con 0x5591a9688ad0 2024-09-10T14:30:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49b9bf640 1 -- 172.21.15.151:0/2883734000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4840af070 con 0x5591a9688ad0 2024-09-10T14:30:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49b9bf640 1 -- 172.21.15.151:0/2883734000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4840aa5c0 con 0x5591a9688ad0 2024-09-10T14:30:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2883734000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9688ad0 msgr2=0x5591a968aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/2883734000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9688ad0 0x5591a968aec0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa48400a5c0 tx=0x7fa48401b340 comp rx=0 tx=0).stop 2024-09-10T14:30:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2883734000 shutdown_connections 2024-09-10T14:30:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/2883734000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9688ad0 0x5591a968aec0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2883734000 >> 172.21.15.151:0/2883734000 conn(0x5591a967f0a0 msgr2=0x5591a96814c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2883734000 shutdown_connections 2024-09-10T14:30:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.804+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2883734000 wait complete. 2024-09-10T14:30:41.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49eeb1980 1 Processor -- start 2024-09-10T14:30:41.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49eeb1980 1 -- start start 2024-09-10T14:30:41.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49eeb1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a976faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49eeb1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591a9532200 con 0x5591a95f92a0 2024-09-10T14:30:41.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a976faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a976faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51322/0 (socket says 172.21.15.151:51322) 2024-09-10T14:30:41.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3470972318 learned_addr learned my addr 172.21.15.151:0/3470972318 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3470972318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a9770070 con 0x5591a95f92a0 2024-09-10T14:30:41.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.816+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/3470972318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a976faa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0015f0 tx=0x7fa48c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e04bf7cfb5eae5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa38ae0d640 1 -- 172.21.15.151:0/3470972318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c013420 con 0x5591a95f92a0 2024-09-10T14:30:41.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa38ae0d640 1 -- 172.21.15.151:0/3470972318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c0135e0 con 0x5591a95f92a0 2024-09-10T14:30:41.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa38ae0d640 1 -- 172.21.15.151:0/3470972318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c013940 con 0x5591a95f92a0 2024-09-10T14:30:41.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3470972318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 msgr2=0x5591a976faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3470972318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a976faa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0015f0 tx=0x7fa48c001ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3470972318 shutdown_connections 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3470972318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a976faa0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3470972318 >> 172.21.15.151:0/3470972318 conn(0x5591a967f0a0 msgr2=0x5591a976b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3470972318 shutdown_connections 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3470972318 wait complete. 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 Processor -- start 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- start start 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a9776df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591a968bf10 con 0x5591a95f92a0 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a9776df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a9776df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51328/0 (socket says 172.21.15.151:51328) 2024-09-10T14:30:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49c9c1640 1 -- 172.21.15.151:0/4143438374 learned_addr learned my addr 172.21.15.151:0/4143438374 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49c9c1640 1 -- 172.21.15.151:0/4143438374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a9777330 con 0x5591a95f92a0 2024-09-10T14:30:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a9776df0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa48c006640 tx=0x7fa48c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa38960a640 1 -- 172.21.15.151:0/4143438374 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c022020 con 0x5591a95f92a0 2024-09-10T14:30:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591a97775c0 con 0x5591a95f92a0 2024-09-10T14:30:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a977a2a0 con 0x5591a95f92a0 2024-09-10T14:30:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa38960a640 1 -- 172.21.15.151:0/4143438374 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c006320 con 0x5591a95f92a0 2024-09-10T14:30:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.820+0000 7fa38960a640 1 -- 172.21.15.151:0/4143438374 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c004ab0 con 0x5591a95f92a0 2024-09-10T14:30:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa38960a640 1 -- 172.21.15.151:0/4143438374 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa48c025020 con 0x5591a95f92a0 2024-09-10T14:30:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa38960a640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa3840346a0 0x7fa384036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa38960a640 1 -- 172.21.15.151:0/4143438374 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa48c018030 con 0x5591a95f92a0 2024-09-10T14:30:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa3840346a0 0x7fa384036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a9688ad0 0x5591a977ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a977e430 con 0x5591a9688ad0 2024-09-10T14:30:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49d1c2640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a9688ad0 0x5591a977ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa3840346a0 0x7fa384036b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ae000 tx=0x7fa4840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49d1c2640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a9688ad0 0x5591a977ddc0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49d1c2640 1 -- 172.21.15.151:0/4143438374 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a9688ad0 2024-09-10T14:30:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a977b4c0 con 0x5591a9688ad0 2024-09-10T14:30:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49d1c2640 1 -- 172.21.15.151:0/4143438374 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a9688ad0 2024-09-10T14:30:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a9780760 0x5591a9782b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a9783240 con 0x5591a9780760 2024-09-10T14:30:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a9780760 0x5591a9782b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a9780760 0x5591a9782b50 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49c9c1640 1 -- 172.21.15.151:0/4143438374 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa48c01b070 con 0x5591a9780760 2024-09-10T14:30:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a977f5d0 con 0x5591a9688ad0 2024-09-10T14:30:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49d1c2640 1 -- 172.21.15.151:0/4143438374 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a9688ad0 2024-09-10T14:30:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5591a97846a0 0x5591a9786a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.824+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a9787190 con 0x5591a97846a0 2024-09-10T14:30:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5591a97846a0 0x5591a9786a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5591a97846a0 0x5591a9786a90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49c1c0640 1 -- 172.21.15.151:0/4143438374 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa4840aaae0 con 0x5591a97846a0 2024-09-10T14:30:41.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49eeb1980 1 Processor -- start 2024-09-10T14:30:41.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49eeb1980 1 -- start start 2024-09-10T14:30:41.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49eeb1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9794c60 0x5591a9795080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49eeb1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591a958b800 con 0x5591a9794c60 2024-09-10T14:30:41.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9794c60 0x5591a9795080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9794c60 0x5591a9795080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51332/0 (socket says 172.21.15.151:51332) 2024-09-10T14:30:41.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3348170316 learned_addr learned my addr 172.21.15.151:0/3348170316 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3348170316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a97955c0 con 0x5591a9794c60 2024-09-10T14:30:41.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/3348170316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9794c60 0x5591a9795080 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa48c006790 tx=0x7fa48c010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa3827fc640 1 -- 172.21.15.151:0/3348170316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c041290 con 0x5591a9794c60 2024-09-10T14:30:41.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3348170316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591a9795850 con 0x5591a9794c60 2024-09-10T14:30:41.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3348170316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a97984d0 con 0x5591a9794c60 2024-09-10T14:30:41.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa3827fc640 1 -- 172.21.15.151:0/3348170316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c041430 con 0x5591a9794c60 2024-09-10T14:30:41.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.828+0000 7fa3827fc640 1 -- 172.21.15.151:0/3348170316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c01d580 con 0x5591a9794c60 2024-09-10T14:30:41.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa3827fc640 1 -- 172.21.15.151:0/3348170316 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa48c03b070 con 0x5591a9794c60 2024-09-10T14:30:41.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa3827fc640 1 --2- 172.21.15.151:0/3348170316 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa374034650 0x7fa374036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa3827fc640 1 -- 172.21.15.151:0/3348170316 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa48c0310e0 con 0x5591a9794c60 2024-09-10T14:30:41.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/3348170316 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa374034650 0x7fa374036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 Processor -- start 2024-09-10T14:30:41.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 -- start start 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/3348170316 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa374034650 0x7fa374036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x5591a977e8e0 tx=0x7fa484005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591a97703f0 con 0x5591a97a1640 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51342/0 (socket says 172.21.15.151:51342) 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49c9c1640 1 -- 172.21.15.151:0/2353188872 learned_addr learned my addr 172.21.15.151:0/2353188872 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49c9c1640 1 -- 172.21.15.151:0/2353188872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a97a1ff0 con 0x5591a97a1640 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/2353188872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a1a20 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa48c027d00 tx=0x7fa48c036130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af16654b9251ab1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa373fff640 1 -- 172.21.15.151:0/2353188872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c0265d0 con 0x5591a97a1640 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa373fff640 1 -- 172.21.15.151:0/2353188872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c02ac10 con 0x5591a97a1640 2024-09-10T14:30:41.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa373fff640 1 -- 172.21.15.151:0/2353188872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c026770 con 0x5591a97a1640 2024-09-10T14:30:41.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2353188872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 msgr2=0x5591a97a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/2353188872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a1a20 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa48c027d00 tx=0x7fa48c036130 comp rx=0 tx=0).stop 2024-09-10T14:30:41.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2353188872 shutdown_connections 2024-09-10T14:30:41.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/2353188872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a1a20 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2353188872 >> 172.21.15.151:0/2353188872 conn(0x5591a979da20 msgr2=0x5591a979bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2353188872 shutdown_connections 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 -- 172.21.15.151:0/2353188872 wait complete. 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.832+0000 7fa49eeb1980 1 Processor -- start 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 1 -- start start 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591a97a2490 con 0x5591a97a1640 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49c9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51346/0 (socket says 172.21.15.151:51346) 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 learned_addr learned my addr 172.21.15.151:0/3321106748 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a97a8cc0 con 0x5591a97a1640 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a8780 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa48c027fd0 tx=0x7fa48c039e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa3727fc640 1 -- 172.21.15.151:0/3321106748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c070070 con 0x5591a97a1640 2024-09-10T14:30:41.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591a97a8cc0 con 0x5591a97a1640 2024-09-10T14:30:41.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a97a9130 con 0x5591a97a1640 2024-09-10T14:30:41.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa3727fc640 1 -- 172.21.15.151:0/3321106748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48c047380 con 0x5591a97a1640 2024-09-10T14:30:41.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa3727fc640 1 -- 172.21.15.151:0/3321106748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa48c07a060 con 0x5591a97a1640 2024-09-10T14:30:41.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa3727fc640 1 -- 172.21.15.151:0/3321106748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa48c073070 con 0x5591a97a1640 2024-09-10T14:30:41.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa3727fc640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa368034650 0x7fa368036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa3727fc640 1 -- 172.21.15.151:0/3321106748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fa48c05b070 con 0x5591a97a1640 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa368034650 0x7fa368036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a97b3780 0x5591a97b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b6390 con 0x5591a97b3780 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49d1c2640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a97b3780 0x5591a97b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa368034650 0x7fa368036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa484000c10 tx=0x7fa4840c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49d1c2640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a97b3780 0x5591a97b5c40 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 20 realm 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.836+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b67a0 con 0x5591a97b3780 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b7040 con 0x5591a97b3780 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a97b8140 0x5591a97ba530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bab80 con 0x5591a97b8140 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a97b8140 0x5591a97ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a97b8140 0x5591a97ba530 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 20 searching for the correct realm 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bc3e0 con 0x5591a97b8140 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c9c1640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa48c075060 0x7fa48c047850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bc3e0 con 0x7fa48c075060 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa48c075060 0x7fa48c047850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa48c075060 0x7fa48c047850 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c1c0640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa4840e0040 0x7fa4840e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bc3e0 con 0x7fa4840e0040 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49d1c2640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa4840e0040 0x7fa4840e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49d1c2640 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa4840e0040 0x7fa4840e0420 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.840+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa4840e0040 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa4840e0040 2024-09-10T14:30:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa48c075060 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b8140 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa4840e0040 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa48c075060 2024-09-10T14:30:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b8140 2024-09-10T14:30:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b8140 2024-09-10T14:30:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.844+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa48c075060 2024-09-10T14:30:41.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b8140 2024-09-10T14:30:41.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b8140 2024-09-10T14:30:41.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa4840e0040 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b8140 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa48c075060 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa48c075060 2024-09-10T14:30:41.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b8140 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa4840e0040 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa48c075060 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.848+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b8140 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa4840e0040 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x5591a97b3780 2024-09-10T14:30:41.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5591a97b73e0 con 0x7fa48c075060 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bb500 con 0x5591a97b3780 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bbd50 con 0x5591a97b3780 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bb160 con 0x7fa4840e0040 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 zone default found 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 4 Realm: () 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 zonegroup default 2024-09-10T14:30:41.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bc2b0 con 0x7fa48c075060 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97be1f0 con 0x5591a97b8140 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97be710 con 0x5591a97b8140 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 started sync module instance, tier type = 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.852+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bd690 con 0x7fa48c075060 2024-09-10T14:30:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.856+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.856+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94084102085248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bf020 con 0x7fa48c075060 2024-09-10T14:30:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.856+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bf870 con 0x5591a97b3780 2024-09-10T14:30:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.856+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94084102085248] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.856+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.856+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94084102089584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bf870 con 0x5591a97b3780 2024-09-10T14:30:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.856+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c0340 con 0x5591a97b8140 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94084102089584] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94084102094384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bf870 con 0x5591a97b8140 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c0d80 con 0x7fa48c075060 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94084102097104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c15d0 con 0x7fa48c075060 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c1fd0 con 0x5591a97b3780 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94084102094384] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94084102097104] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.860+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.864+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94084102099232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c1ae0 con 0x5591a97b3780 2024-09-10T14:30:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.864+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c2870 con 0x7fa4840e0040 2024-09-10T14:30:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.864+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94084102099232] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.864+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.864+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94084102091712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c27b0 con 0x7fa4840e0040 2024-09-10T14:30:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.864+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c3170 con 0x7fa4840e0040 2024-09-10T14:30:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94084102091712] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94084102104080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c3170 con 0x7fa4840e0040 2024-09-10T14:30:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c3b30 con 0x7fa4840e0040 2024-09-10T14:30:41.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94084102104080] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94084102106304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c3d10 con 0x7fa4840e0040 2024-09-10T14:30:41.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 20 add_watcher() i=0 2024-09-10T14:30:41.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 20 add_watcher() i=1 2024-09-10T14:30:41.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 20 add_watcher() i=2 2024-09-10T14:30:41.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 20 add_watcher() i=3 2024-09-10T14:30:41.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 20 add_watcher() i=4 2024-09-10T14:30:41.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 20 add_watcher() i=5 2024-09-10T14:30:41.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.868+0000 7fa49eeb1980 20 add_watcher() i=6 2024-09-10T14:30:41.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94084102106304] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 20 add_watcher() i=7 2024-09-10T14:30:41.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:41.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c6ec0 con 0x5591a97b3780 2024-09-10T14:30:41.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94084102121648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c3c80 con 0x5591a97b3780 2024-09-10T14:30:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94084102121648] v36'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa352fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 5 note: GC not initialized 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa351fe3640 20 reqs_thread_entry: start 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 20 Filter name: none 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa2c37fe640 20 reqs_thread_entry: start 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 20 rados->read ofs=0 len=0 2024-09-10T14:30:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.872+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97ea640 con 0x7fa4840e0040 2024-09-10T14:30:41.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 20 rados_obj.operate() r=0 bl.length=503 2024-09-10T14:30:41.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:41.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:41.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97f0fe0 con 0x7fa4840e0040 2024-09-10T14:30:41.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:41.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:41.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94084102294096 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5591a97ec6d0 con 0x5591a97b3780 2024-09-10T14:30:41.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 94084102099232 notify 154618822683 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fa494010040 con 0x5591a97b3780 2024-09-10T14:30:41.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa373fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 94084102099232 notifier 4890 bl.length()=636 2024-09-10T14:30:41.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa373fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:41.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa373fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:41.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 94084102294096 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa373fff640 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fa360003eb0 con 0x5591a97b3780 2024-09-10T14:30:41.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.876+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 94084102294096 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa49400bdd0 con 0x5591a97b3780 2024-09-10T14:30:41.883 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:41.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.880+0000 7fa352fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:41.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.880+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94084102121648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97e8430 con 0x5591a97b3780 2024-09-10T14:30:41.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.880+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94084102121648] v36'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.880+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94084102085248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97e8430 con 0x7fa48c075060 2024-09-10T14:30:41.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.880+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94084102085248] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.880+0000 7fa49eeb1980 20 remove_watcher() i=0 2024-09-10T14:30:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.880+0000 7fa49eeb1980 2 removed watcher, disabling cache 2024-09-10T14:30:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.880+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94084102089584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97e8430 con 0x5591a97b3780 2024-09-10T14:30:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94084102089584] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49eeb1980 20 remove_watcher() i=1 2024-09-10T14:30:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94084102094384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97beb70 con 0x5591a97b8140 2024-09-10T14:30:41.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49c9c1640 1 -- 172.21.15.151:0/3321106748 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94084102094384] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa48c072030 con 0x5591a97b8140 2024-09-10T14:30:41.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49eeb1980 20 remove_watcher() i=2 2024-09-10T14:30:41.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94084102097104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97e8430 con 0x7fa48c075060 2024-09-10T14:30:41.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49c1c0640 1 -- 172.21.15.151:0/3321106748 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94084102097104] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4840aaae0 con 0x7fa48c075060 2024-09-10T14:30:41.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49eeb1980 20 remove_watcher() i=3 2024-09-10T14:30:41.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.884+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94084102099232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bfe30 con 0x5591a97b3780 2024-09-10T14:30:41.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.888+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94084102099232] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x5591a97b3780 2024-09-10T14:30:41.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.888+0000 7fa49eeb1980 20 remove_watcher() i=4 2024-09-10T14:30:41.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.888+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94084102091712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97beb70 con 0x7fa4840e0040 2024-09-10T14:30:41.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94084102091712] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 20 remove_watcher() i=5 2024-09-10T14:30:41.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94084102104080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97c08d0 con 0x7fa4840e0040 2024-09-10T14:30:41.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94084102104080] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 20 remove_watcher() i=6 2024-09-10T14:30:41.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94084102106304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5591a97bfe30 con 0x7fa4840e0040 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94084102106304] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4940083f0 con 0x7fa4840e0040 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 20 remove_watcher() i=7 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa4840e0040 msgr2=0x7fa4840e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fa4840e0040 0x7fa4840e0420 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a97b3780 msgr2=0x5591a97b5c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a97b3780 0x5591a97b5c40 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.892+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa48c075060 msgr2=0x7fa48c047850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fa48c075060 0x7fa48c047850 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a97b8140 msgr2=0x5591a97ba530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a97b8140 0x5591a97ba530 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa368034650 msgr2=0x7fa368036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa368034650 0x7fa368036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa484000c10 tx=0x7fa4840c1040 comp rx=0 tx=0).stop 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 msgr2=0x5591a97a8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3321106748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a97a1640 0x5591a97a8780 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa48c027fd0 tx=0x7fa48c039e70 comp rx=0 tx=0).stop 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 reap_dead start 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49d1c2640 1 -- 172.21.15.151:0/3321106748 reap_dead start 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 shutdown_connections 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 >> 172.21.15.151:0/3321106748 conn(0x5591a979da20 msgr2=0x5591a979baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 shutdown_connections 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3321106748 wait complete. 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3348170316 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa374034650 msgr2=0x7fa374036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3348170316 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa374034650 0x7fa374036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x5591a977e8e0 tx=0x7fa484005ad0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3348170316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9794c60 msgr2=0x5591a9795080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3348170316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9794c60 0x5591a9795080 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa48c006790 tx=0x7fa48c010ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3348170316 shutdown_connections 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3348170316 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa374034650 0x7fa374036b10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/3348170316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a9794c60 0x5591a9795080 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3348170316 >> 172.21.15.151:0/3348170316 conn(0x5591a9789db0 msgr2=0x5591a978c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3348170316 shutdown_connections 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/3348170316 wait complete. 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5591a97846a0 msgr2=0x5591a9786a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x5591a97846a0 0x5591a9786a90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a9688ad0 msgr2=0x5591a977ddc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5591a9688ad0 0x5591a977ddc0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a9780760 msgr2=0x5591a9782b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5591a9780760 0x5591a9782b50 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa3840346a0 msgr2=0x7fa384036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fa3840346a0 0x7fa384036b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ae000 tx=0x7fa4840a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:41.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 msgr2=0x5591a9776df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 --2- 172.21.15.151:0/4143438374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591a95f92a0 0x5591a9776df0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa48c006640 tx=0x7fa48c000f50 comp rx=0 tx=0).stop 2024-09-10T14:30:41.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49d1c2640 1 -- 172.21.15.151:0/4143438374 reap_dead start 2024-09-10T14:30:41.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 shutdown_connections 2024-09-10T14:30:41.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 >> 172.21.15.151:0/4143438374 conn(0x5591a967f0a0 msgr2=0x5591a976a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 shutdown_connections 2024-09-10T14:30:41.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.896+0000 7fa49eeb1980 1 -- 172.21.15.151:0/4143438374 wait complete. 2024-09-10T14:30:41.909 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:41.909 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:41.909 ERROR:root:0 2024-09-10T14:30:41.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T14:30:41.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T14:30:41.910 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-10T14:30:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:41.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a14bf9980 1 Processor -- start 2024-09-10T14:30:41.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a14bf9980 1 -- start start 2024-09-10T14:30:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a14bf9980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560853ceb920 0x560853cedd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a14bf9980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560853b70ae0 con 0x560853ce7550 2024-09-10T14:30:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a14bf9980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x560853b94e30 con 0x560853ceb920 2024-09-10T14:30:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a11f08640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560853ceb920 0x560853cedd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a11f08640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x560853ceb920 0x560853cedd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51354/0 (socket says 172.21.15.151:51354) 2024-09-10T14:30:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a12709640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x560853ce7550 0x560853ce7930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33392/0 (socket says 172.21.15.151:33392) 2024-09-10T14:30:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a11f08640 1 -- 172.21.15.151:0/1210676802 learned_addr learned my addr 172.21.15.151:0/1210676802 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:41.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a11f08640 1 -- 172.21.15.151:0/1210676802 >> v1:172.21.15.52:6789/0 conn(0x560853ce7550 legacy=0x560853ce7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a11f08640 1 -- 172.21.15.151:0/1210676802 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560853cef260 con 0x560853ceb920 2024-09-10T14:30:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.984+0000 7f9a11f08640 1 --2- 172.21.15.151:0/1210676802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ceb920 0x560853cedd10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00a5c0 tx=0x7f99fc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b395f969aa5e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a11707640 1 -- 172.21.15.151:0/1210676802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99fc0a6070 con 0x560853ceb920 2024-09-10T14:30:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a11707640 1 -- 172.21.15.151:0/1210676802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99fc0af070 con 0x560853ceb920 2024-09-10T14:30:41.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a11707640 1 -- 172.21.15.151:0/1210676802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99fc0aa5c0 con 0x560853ceb920 2024-09-10T14:30:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1210676802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ceb920 msgr2=0x560853cedd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/1210676802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ceb920 0x560853cedd10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00a5c0 tx=0x7f99fc01b340 comp rx=0 tx=0).stop 2024-09-10T14:30:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1210676802 shutdown_connections 2024-09-10T14:30:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/1210676802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ceb920 0x560853cedd10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1210676802 >> 172.21.15.151:0/1210676802 conn(0x560853ce3070 msgr2=0x560853ce5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1210676802 shutdown_connections 2024-09-10T14:30:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:41.988+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1210676802 wait complete. 2024-09-10T14:30:42.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a14bf9980 1 Processor -- start 2024-09-10T14:30:42.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a14bf9980 1 -- start start 2024-09-10T14:30:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a14bf9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853c5c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a14bf9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560853b96200 con 0x560853ce7550 2024-09-10T14:30:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853c5c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853c5c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51358/0 (socket says 172.21.15.151:51358) 2024-09-10T14:30:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a12709640 1 -- 172.21.15.151:0/3206642400 learned_addr learned my addr 172.21.15.151:0/3206642400 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a12709640 1 -- 172.21.15.151:0/3206642400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560853c5c9c0 con 0x560853ce7550 2024-09-10T14:30:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9a12709640 1 --2- 172.21.15.151:0/3206642400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853c5c3f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0015f0 tx=0x7f9a0c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb59febab5612704 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9900608640 1 -- 172.21.15.151:0/3206642400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c013420 con 0x560853ce7550 2024-09-10T14:30:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9900608640 1 -- 172.21.15.151:0/3206642400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c0135e0 con 0x560853ce7550 2024-09-10T14:30:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.000+0000 7f9900608640 1 -- 172.21.15.151:0/3206642400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c013940 con 0x560853ce7550 2024-09-10T14:30:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- 172.21.15.151:0/3206642400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 msgr2=0x560853c5c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/3206642400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853c5c3f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0015f0 tx=0x7f9a0c001ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- 172.21.15.151:0/3206642400 shutdown_connections 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/3206642400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853c5c3f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- 172.21.15.151:0/3206642400 >> 172.21.15.151:0/3206642400 conn(0x560853ce3070 msgr2=0x560853dce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- 172.21.15.151:0/3206642400 shutdown_connections 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- 172.21.15.151:0/3206642400 wait complete. 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 Processor -- start 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- start start 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853dd41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560853ceed60 con 0x560853ce7550 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853dd41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853dd41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51370/0 (socket says 172.21.15.151:51370) 2024-09-10T14:30:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a12709640 1 -- 172.21.15.151:0/606927602 learned_addr learned my addr 172.21.15.151:0/606927602 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a12709640 1 -- 172.21.15.151:0/606927602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560853dd28f0 con 0x560853ce7550 2024-09-10T14:30:42.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a12709640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853dd41d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c006640 tx=0x7f9a0c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f98fee05640 1 -- 172.21.15.151:0/606927602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c022020 con 0x560853ce7550 2024-09-10T14:30:42.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560853dd2b80 con 0x560853ce7550 2024-09-10T14:30:42.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f98fee05640 1 -- 172.21.15.151:0/606927602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c006320 con 0x560853ce7550 2024-09-10T14:30:42.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560853dd3070 con 0x560853ce7550 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f98fee05640 1 -- 172.21.15.151:0/606927602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c004ab0 con 0x560853ce7550 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.004+0000 7f98fee05640 1 -- 172.21.15.151:0/606927602 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a0c025020 con 0x560853ce7550 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f98fee05640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98f8034650 0x7f98f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f98fee05640 1 -- 172.21.15.151:0/606927602 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9a0c018030 con 0x560853ce7550 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a11f08640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98f8034650 0x7f98f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853ceb920 0x560853de4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853de47c0 con 0x560853ceb920 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a12f0a640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853ceb920 0x560853de4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a11f08640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98f8034650 0x7f98f8036b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0ae000 tx=0x7f99fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a12f0a640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853ceb920 0x560853de4280 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a12f0a640 1 -- 172.21.15.151:0/606927602 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853ceb920 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853de4be0 con 0x560853ceb920 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a12f0a640 1 -- 172.21.15.151:0/606927602 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a040083f0 con 0x560853ceb920 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853de69f0 0x560853de8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853de94b0 con 0x560853de69f0 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a12709640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853de69f0 0x560853de8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a12709640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853de69f0 0x560853de8de0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a12709640 1 -- 172.21.15.151:0/606927602 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a0c01b070 con 0x560853de69f0 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853de5890 con 0x560853ceb920 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a12f0a640 1 -- 172.21.15.151:0/606927602 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a040083f0 con 0x560853ceb920 2024-09-10T14:30:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560853dea8f0 0x560853decce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853ded450 con 0x560853dea8f0 2024-09-10T14:30:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a11f08640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560853dea8f0 0x560853decce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.008+0000 7f9a11f08640 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560853dea8f0 0x560853decce0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a11f08640 1 -- 172.21.15.151:0/606927602 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f99fc0aaae0 con 0x560853dea8f0 2024-09-10T14:30:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a14bf9980 1 Processor -- start 2024-09-10T14:30:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a14bf9980 1 -- start start 2024-09-10T14:30:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a14bf9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853dfaee0 0x560853dfb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a14bf9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560853bef800 con 0x560853dfaee0 2024-09-10T14:30:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853dfaee0 0x560853dfb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853dfaee0 0x560853dfb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51386/0 (socket says 172.21.15.151:51386) 2024-09-10T14:30:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a12709640 1 -- 172.21.15.151:0/4081847723 learned_addr learned my addr 172.21.15.151:0/4081847723 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a12709640 1 -- 172.21.15.151:0/4081847723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560853dfb840 con 0x560853dfaee0 2024-09-10T14:30:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a12709640 1 --2- 172.21.15.151:0/4081847723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853dfaee0 0x560853dfb300 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c014fd0 tx=0x7f9a0c010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f98f7fff640 1 -- 172.21.15.151:0/4081847723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c043e60 con 0x560853dfaee0 2024-09-10T14:30:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a14bf9980 1 -- 172.21.15.151:0/4081847723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560853dfbad0 con 0x560853dfaee0 2024-09-10T14:30:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a14bf9980 1 -- 172.21.15.151:0/4081847723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560853dfe750 con 0x560853dfaee0 2024-09-10T14:30:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f98f7fff640 1 -- 172.21.15.151:0/4081847723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c0412c0 con 0x560853dfaee0 2024-09-10T14:30:42.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f98f7fff640 1 -- 172.21.15.151:0/4081847723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c01d950 con 0x560853dfaee0 2024-09-10T14:30:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f98f7fff640 1 -- 172.21.15.151:0/4081847723 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a0c010070 con 0x560853dfaee0 2024-09-10T14:30:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f98f7fff640 1 --2- 172.21.15.151:0/4081847723 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98ec034650 0x7f98ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f98f7fff640 1 -- 172.21.15.151:0/4081847723 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9a0c0317e0 con 0x560853dfaee0 2024-09-10T14:30:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.012+0000 7f9a11f08640 1 --2- 172.21.15.151:0/4081847723 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98ec034650 0x7f98ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 Processor -- start 2024-09-10T14:30:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- start start 2024-09-10T14:30:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a11f08640 1 --2- 172.21.15.151:0/4081847723 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98ec034650 0x7f98ec036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f99fc000c10 tx=0x7f99fc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e07b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560853c5cd40 con 0x560853e07760 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e07b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e07b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51400/0 (socket says 172.21.15.151:51400) 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 -- 172.21.15.151:0/1859842080 learned_addr learned my addr 172.21.15.151:0/1859842080 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 -- 172.21.15.151:0/1859842080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560853e08130 con 0x560853e07760 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 --2- 172.21.15.151:0/1859842080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e07b60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c031490 tx=0x7f9a0c02f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156310ede04d0663 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f98f5ffb640 1 -- 172.21.15.151:0/1859842080 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c059070 con 0x560853e07760 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f98f5ffb640 1 -- 172.21.15.151:0/1859842080 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c04ade0 con 0x560853e07760 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f98f5ffb640 1 -- 172.21.15.151:0/1859842080 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c012ce0 con 0x560853e07760 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1859842080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 msgr2=0x560853e07b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/1859842080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e07b60 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c031490 tx=0x7f9a0c02f770 comp rx=0 tx=0).stop 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1859842080 shutdown_connections 2024-09-10T14:30:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/1859842080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e07b60 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1859842080 >> 172.21.15.151:0/1859842080 conn(0x560853e03b90 msgr2=0x560853e01c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1859842080 shutdown_connections 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- 172.21.15.151:0/1859842080 wait complete. 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 Processor -- start 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- start start 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e0e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a14bf9980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560853e08600 con 0x560853e07760 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e0e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e0e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51406/0 (socket says 172.21.15.151:51406) 2024-09-10T14:30:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 learned_addr learned my addr 172.21.15.151:0/2721745644 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.016+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560853e0eeb0 con 0x560853e07760 2024-09-10T14:30:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12709640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e0e970 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c046ed0 tx=0x7f9a0c031420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f98e3fff640 1 -- 172.21.15.151:0/2721745644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c02e340 con 0x560853e07760 2024-09-10T14:30:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560853e0eeb0 con 0x560853e07760 2024-09-10T14:30:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f98e3fff640 1 -- 172.21.15.151:0/2721745644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c02e4e0 con 0x560853e07760 2024-09-10T14:30:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560853e0eeb0 con 0x560853e07760 2024-09-10T14:30:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f98e3fff640 1 -- 172.21.15.151:0/2721745644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c031b00 con 0x560853e07760 2024-09-10T14:30:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f98e3fff640 1 -- 172.21.15.151:0/2721745644 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a0c05c070 con 0x560853e07760 2024-09-10T14:30:42.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f98e3fff640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98dc034650 0x7f98dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f98e3fff640 1 -- 172.21.15.151:0/2721745644 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f9a0c066070 con 0x560853e07760 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a11f08640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98dc034650 0x7f98dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853e19ac0 0x560853e1bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e1c6b0 con 0x560853e19ac0 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12f0a640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853e19ac0 0x560853e1bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a11f08640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98dc034650 0x7f98dc036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0aa910 tx=0x7f99fc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12f0a640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853e19ac0 0x560853e1bf60 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 realm 2024-09-10T14:30:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e1cac0 con 0x560853e19ac0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d360 con 0x560853e19ac0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853e1e460 0x560853e20850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e20ea0 con 0x560853e1e460 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12709640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853e1e460 0x560853e20850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.020+0000 7f9a12709640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853e1e460 0x560853e20850 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a14bf9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a14bf9980 20 searching for the correct realm 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e22700 con 0x560853e1e460 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12709640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9a0c031040 0x7f9a0c02e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e22700 con 0x7f9a0c031040 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a11f08640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9a0c031040 0x7f9a0c02e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a11f08640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9a0c031040 0x7f9a0c02e780 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a11f08640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f99fc0e0040 0x7f99fc0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e22700 con 0x7f99fc0e0040 2024-09-10T14:30:42.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12f0a640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f99fc0e0040 0x7f99fc0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12f0a640 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f99fc0e0040 0x7f99fc0e0420 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.024+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f99fc0e0040 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f99fc0e0040 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f9a0c031040 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e1e460 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f99fc0e0040 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f9a0c031040 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e1e460 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e1e460 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f9a0c031040 2024-09-10T14:30:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e1e460 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e1e460 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.028+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f99fc0e0040 2024-09-10T14:30:42.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e1e460 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f9a0c031040 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f9a0c031040 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e1e460 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f99fc0e0040 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f9a0c031040 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e1e460 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.032+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f99fc0e0040 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x560853e19ac0 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x560853e1d700 con 0x7f9a0c031040 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e217f0 con 0x560853e19ac0 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e22040 con 0x560853e19ac0 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e21b90 con 0x7f99fc0e0040 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 zone default found 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 4 Realm: () 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 zonegroup default 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e21fc0 con 0x7f9a0c031040 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e24510 con 0x560853e1e460 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e24970 con 0x560853e1e460 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 started sync module instance, tier type = 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.036+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e239b0 con 0x7f9a0c031040 2024-09-10T14:30:42.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.040+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.040+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94593767062944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e25280 con 0x7f9a0c031040 2024-09-10T14:30:42.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.040+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e25ad0 con 0x560853e19ac0 2024-09-10T14:30:42.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.040+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94593767062944] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.040+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.040+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94593767067088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e25b30 con 0x560853e19ac0 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.040+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e26620 con 0x560853e1e460 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94593767067088] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94593767071984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e26a40 con 0x560853e1e460 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e27400 con 0x7f9a0c031040 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94593767075664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e27c50 con 0x7f9a0c031040 2024-09-10T14:30:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e28650 con 0x560853e19ac0 2024-09-10T14:30:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94593767071984] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.044+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94593767075664] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.048+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.048+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94593767069216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e277a0 con 0x560853e19ac0 2024-09-10T14:30:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.048+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e28ef0 con 0x7f99fc0e0040 2024-09-10T14:30:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.048+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94593767069216] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.048+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.048+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94593767080288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e277a0 con 0x7f99fc0e0040 2024-09-10T14:30:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.048+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e29400 con 0x7f99fc0e0040 2024-09-10T14:30:42.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94593767083760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e29870 con 0x7f99fc0e0040 2024-09-10T14:30:42.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e2a350 con 0x7f99fc0e0040 2024-09-10T14:30:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94593767080288] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94593767087712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e2a350 con 0x7f99fc0e0040 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 20 add_watcher() i=0 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 20 add_watcher() i=1 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 20 add_watcher() i=2 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 20 add_watcher() i=3 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 20 add_watcher() i=4 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 20 add_watcher() i=5 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94593767083760] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.052+0000 7f9a14bf9980 20 add_watcher() i=6 2024-09-10T14:30:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94593767087712] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 20 add_watcher() i=7 2024-09-10T14:30:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e2d380 con 0x560853e19ac0 2024-09-10T14:30:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94593767084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e2a800 con 0x560853e19ac0 2024-09-10T14:30:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94593767084992] v36'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f98c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 5 note: GC not initialized 2024-09-10T14:30:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f98c37fe640 20 reqs_thread_entry: start 2024-09-10T14:30:42.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:42.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 20 Filter name: none 2024-09-10T14:30:42.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f98c17fa640 20 reqs_thread_entry: start 2024-09-10T14:30:42.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:42.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.056+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e508d0 con 0x7f99fc0e0040 2024-09-10T14:30:42.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T14:30:42.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:42.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:42.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e56ee0 con 0x7f99fc0e0040 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94593767270736 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560853e525f0 con 0x560853e19ac0 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 94593767069216 notify 154618822684 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f9a04010040 con 0x560853e19ac0 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f98f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 94593767069216 notifier 4897 bl.length()=666 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f98f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f98f5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 94593767270736 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f98f5ffb640 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f98d8003eb0 con 0x560853e19ac0 2024-09-10T14:30:42.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 94593767270736 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9a0400be30 con 0x560853e19ac0 2024-09-10T14:30:42.067 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f98c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.060+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94593767084992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e4e6d0 con 0x560853e19ac0 2024-09-10T14:30:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.064+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94593767084992] v36'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.064+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94593767062944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e4e6d0 con 0x7f9a0c031040 2024-09-10T14:30:42.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.064+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94593767062944] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.064+0000 7f9a14bf9980 20 remove_watcher() i=0 2024-09-10T14:30:42.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.064+0000 7f9a14bf9980 2 removed watcher, disabling cache 2024-09-10T14:30:42.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.064+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94593767067088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e4e6d0 con 0x560853e19ac0 2024-09-10T14:30:42.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.064+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94593767067088] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.068+0000 7f9a14bf9980 20 remove_watcher() i=1 2024-09-10T14:30:42.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.068+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94593767071984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e24dd0 con 0x560853e1e460 2024-09-10T14:30:42.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.068+0000 7f9a12709640 1 -- 172.21.15.151:0/2721745644 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94593767071984] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a0c070020 con 0x560853e1e460 2024-09-10T14:30:42.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.068+0000 7f9a14bf9980 20 remove_watcher() i=2 2024-09-10T14:30:42.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.068+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94593767075664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e4e6d0 con 0x7f9a0c031040 2024-09-10T14:30:42.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.068+0000 7f9a11f08640 1 -- 172.21.15.151:0/2721745644 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94593767075664] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99fc0aaae0 con 0x7f9a0c031040 2024-09-10T14:30:42.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.068+0000 7f9a14bf9980 20 remove_watcher() i=3 2024-09-10T14:30:42.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.068+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94593767069216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e24dd0 con 0x560853e19ac0 2024-09-10T14:30:42.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.072+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94593767069216] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x560853e19ac0 2024-09-10T14:30:42.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.072+0000 7f9a14bf9980 20 remove_watcher() i=4 2024-09-10T14:30:42.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.072+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94593767080288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e26f50 con 0x7f99fc0e0040 2024-09-10T14:30:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.072+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94593767080288] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.072+0000 7f9a14bf9980 20 remove_watcher() i=5 2024-09-10T14:30:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.072+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94593767083760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e4e6d0 con 0x7f99fc0e0040 2024-09-10T14:30:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94593767083760] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 20 remove_watcher() i=6 2024-09-10T14:30:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94593767087712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560853e24dd0 con 0x7f99fc0e0040 2024-09-10T14:30:42.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94593767087712] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a040083f0 con 0x7f99fc0e0040 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 20 remove_watcher() i=7 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f99fc0e0040 msgr2=0x7f99fc0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f99fc0e0040 0x7f99fc0e0420 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853e19ac0 msgr2=0x560853e1bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853e19ac0 0x560853e1bf60 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9a0c031040 msgr2=0x7f9a0c02e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f9a0c031040 0x7f9a0c02e780 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853e1e460 msgr2=0x560853e20850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853e1e460 0x560853e20850 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98dc034650 msgr2=0x7f98dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98dc034650 0x7f98dc036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0aa910 tx=0x7f99fc0c1040 comp rx=0 tx=0).stop 2024-09-10T14:30:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 msgr2=0x560853e0e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e0e970 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c046ed0 tx=0x7f9a0c031420 comp rx=0 tx=0).stop 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a12f0a640 1 -- 172.21.15.151:0/2721745644 reap_dead start 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 shutdown_connections 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/2721745644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853e07760 0x560853e0e970 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 >> 172.21.15.151:0/2721745644 conn(0x560853e03b90 msgr2=0x560853e01c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 shutdown_connections 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/2721745644 wait complete. 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/4081847723 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98ec034650 msgr2=0x7f98ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/4081847723 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98ec034650 0x7f98ec036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f99fc000c10 tx=0x7f99fc005ad0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/4081847723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853dfaee0 msgr2=0x560853dfb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/4081847723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853dfaee0 0x560853dfb300 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c014fd0 tx=0x7f9a0c010ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/4081847723 shutdown_connections 2024-09-10T14:30:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/4081847723 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98ec034650 0x7f98ec036b10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/4081847723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853dfaee0 0x560853dfb300 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/4081847723 >> 172.21.15.151:0/4081847723 conn(0x560853df0030 msgr2=0x560853df2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/4081847723 shutdown_connections 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.076+0000 7f9a14bf9980 1 -- 172.21.15.151:0/4081847723 wait complete. 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560853dea8f0 msgr2=0x560853decce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x560853dea8f0 0x560853decce0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853ceb920 msgr2=0x560853de4280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x560853ceb920 0x560853de4280 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853de69f0 msgr2=0x560853de8de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x560853de69f0 0x560853de8de0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98f8034650 msgr2=0x7f98f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f98f8034650 0x7f98f8036b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0ae000 tx=0x7f99fc0a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 msgr2=0x560853dd41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 --2- 172.21.15.151:0/606927602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560853ce7550 0x560853dd41d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c006640 tx=0x7f9a0c000f50 comp rx=0 tx=0).stop 2024-09-10T14:30:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a12f0a640 1 -- 172.21.15.151:0/606927602 reap_dead start 2024-09-10T14:30:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 shutdown_connections 2024-09-10T14:30:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 >> 172.21.15.151:0/606927602 conn(0x560853ce3070 msgr2=0x560853dcd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 shutdown_connections 2024-09-10T14:30:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.080+0000 7f9a14bf9980 1 -- 172.21.15.151:0/606927602 wait complete. 2024-09-10T14:30:42.092 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:42.092 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:42.093 ERROR:root:0 2024-09-10T14:30:42.093 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.097 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000036bed29cf8eff3d5-0066e05812-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:30:42.097 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T14:30:42.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T14:30:42.098 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-10T14:30:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:42.163 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:42.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4c55c980 1 Processor -- start 2024-09-10T14:30:42.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4c55c980 1 -- start start 2024-09-10T14:30:42.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4c55c980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ed80ba67d0 0x55ed80ba5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4c55c980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed80ab7ae0 con 0x55ed80ba63c0 2024-09-10T14:30:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4c55c980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55ed80adbe30 con 0x55ed80ba67d0 2024-09-10T14:30:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4986b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ed80ba67d0 0x55ed80ba5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4a06c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55ed80ba63c0 0x55ed80ba4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33400/0 (socket says 172.21.15.151:33400) 2024-09-10T14:30:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4a06c640 1 -- 172.21.15.151:0/3560678891 learned_addr learned my addr 172.21.15.151:0/3560678891 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-10T14:30:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4986b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55ed80ba67d0 0x55ed80ba5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51412/0 (socket says 172.21.15.151:51412) 2024-09-10T14:30:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4986b640 1 -- 172.21.15.151:0/3560678891 >> v1:172.21.15.52:6789/0 conn(0x55ed80ba63c0 legacy=0x55ed80ba4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.160+0000 7fec4986b640 1 -- 172.21.15.151:0/3560678891 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed80ba58f0 con 0x55ed80ba67d0 2024-09-10T14:30:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4986b640 1 --2- 172.21.15.151:0/3560678891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba67d0 0x55ed80ba5290 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fec3400a480 tx=0x7fec3401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d899381884022f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4906a640 1 -- 172.21.15.151:0/3560678891 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec340b0070 con 0x55ed80ba67d0 2024-09-10T14:30:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4906a640 1 -- 172.21.15.151:0/3560678891 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec340ab540 con 0x55ed80ba67d0 2024-09-10T14:30:42.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4906a640 1 -- 172.21.15.151:0/3560678891 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec340ab840 con 0x55ed80ba67d0 2024-09-10T14:30:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4c55c980 1 -- 172.21.15.151:0/3560678891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba67d0 msgr2=0x55ed80ba5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4c55c980 1 --2- 172.21.15.151:0/3560678891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba67d0 0x55ed80ba5290 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fec3400a480 tx=0x7fec3401b280 comp rx=0 tx=0).stop 2024-09-10T14:30:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4c55c980 1 -- 172.21.15.151:0/3560678891 shutdown_connections 2024-09-10T14:30:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4c55c980 1 --2- 172.21.15.151:0/3560678891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba67d0 0x55ed80ba5290 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4c55c980 1 -- 172.21.15.151:0/3560678891 >> 172.21.15.151:0/3560678891 conn(0x55ed80c2b1c0 msgr2=0x55ed80c2d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4c55c980 1 -- 172.21.15.151:0/3560678891 shutdown_connections 2024-09-10T14:30:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.164+0000 7fec4c55c980 1 -- 172.21.15.151:0/3560678891 wait complete. 2024-09-10T14:30:42.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.176+0000 7fec4c55c980 1 Processor -- start 2024-09-10T14:30:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.176+0000 7fec4c55c980 1 -- start start 2024-09-10T14:30:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.176+0000 7fec4c55c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d1cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.176+0000 7fec4c55c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ed80add200 con 0x55ed80ba63c0 2024-09-10T14:30:42.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.176+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d1cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.176+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d1cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51428/0 (socket says 172.21.15.151:51428) 2024-09-10T14:30:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.176+0000 7fec4a06c640 1 -- 172.21.15.151:0/3007105535 learned_addr learned my addr 172.21.15.151:0/3007105535 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.176+0000 7fec4a06c640 1 -- 172.21.15.151:0/3007105535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed80d1d1e0 con 0x55ed80ba63c0 2024-09-10T14:30:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4a06c640 1 --2- 172.21.15.151:0/3007105535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d1cc10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fec3c001d90 tx=0x7fec3c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26ce2fcaba344b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7feb38608640 1 -- 172.21.15.151:0/3007105535 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c013030 con 0x55ed80ba63c0 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7feb38608640 1 -- 172.21.15.151:0/3007105535 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c00e690 con 0x55ed80ba63c0 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7feb38608640 1 -- 172.21.15.151:0/3007105535 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c00ea10 con 0x55ed80ba63c0 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- 172.21.15.151:0/3007105535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 msgr2=0x55ed80d1cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 --2- 172.21.15.151:0/3007105535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d1cc10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fec3c001d90 tx=0x7fec3c001e80 comp rx=0 tx=0).stop 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- 172.21.15.151:0/3007105535 shutdown_connections 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 --2- 172.21.15.151:0/3007105535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d1cc10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- 172.21.15.151:0/3007105535 >> 172.21.15.151:0/3007105535 conn(0x55ed80c2b1c0 msgr2=0x55ed80d18840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- 172.21.15.151:0/3007105535 shutdown_connections 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- 172.21.15.151:0/3007105535 wait complete. 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 Processor -- start 2024-09-10T14:30:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- start start 2024-09-10T14:30:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d23f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ed80c3b210 con 0x55ed80ba63c0 2024-09-10T14:30:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d23f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d23f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51444/0 (socket says 172.21.15.151:51444) 2024-09-10T14:30:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4a06c640 1 -- 172.21.15.151:0/197760794 learned_addr learned my addr 172.21.15.151:0/197760794 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4a06c640 1 -- 172.21.15.151:0/197760794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed80d244c0 con 0x55ed80ba63c0 2024-09-10T14:30:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4a06c640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d23f80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x55ed80d1ddf0 tx=0x7fec3c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7feb36e05640 1 -- 172.21.15.151:0/197760794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c027070 con 0x55ed80ba63c0 2024-09-10T14:30:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed80d24750 con 0x55ed80ba63c0 2024-09-10T14:30:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed80d27430 con 0x55ed80ba63c0 2024-09-10T14:30:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7feb36e05640 1 -- 172.21.15.151:0/197760794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c019900 con 0x55ed80ba63c0 2024-09-10T14:30:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.180+0000 7feb36e05640 1 -- 172.21.15.151:0/197760794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c019be0 con 0x55ed80ba63c0 2024-09-10T14:30:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7feb36e05640 1 -- 172.21.15.151:0/197760794 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec3c02a070 con 0x55ed80ba63c0 2024-09-10T14:30:42.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7feb36e05640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb300346f0 0x7feb30036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7feb36e05640 1 -- 172.21.15.151:0/197760794 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fec3c01f070 con 0x55ed80ba63c0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4986b640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb300346f0 0x7feb30036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4c55c980 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80ba67d0 0x55ed80d2af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d2b580 con 0x55ed80ba67d0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4a86d640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80ba67d0 0x55ed80d2af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4986b640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb300346f0 0x7feb30036bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fec340ad000 tx=0x7fec340a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4a86d640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80ba67d0 0x55ed80d2af90 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4a86d640 1 -- 172.21.15.151:0/197760794 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80ba67d0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d28650 con 0x55ed80ba67d0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4a86d640 1 -- 172.21.15.151:0/197760794 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80ba67d0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4c55c980 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d2d8d0 0x55ed80d2fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d30390 con 0x55ed80d2d8d0 2024-09-10T14:30:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4a06c640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d2d8d0 0x55ed80d2fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4a06c640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d2d8d0 0x55ed80d2fcc0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4a06c640 1 -- 172.21.15.151:0/197760794 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec3c029030 con 0x55ed80d2d8d0 2024-09-10T14:30:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d2c740 con 0x55ed80ba67d0 2024-09-10T14:30:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4a86d640 1 -- 172.21.15.151:0/197760794 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80ba67d0 2024-09-10T14:30:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4c55c980 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55ed80d317d0 0x55ed80d33bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d34330 con 0x55ed80d317d0 2024-09-10T14:30:42.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.184+0000 7fec4986b640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55ed80d317d0 0x55ed80d33bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4986b640 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55ed80d317d0 0x55ed80d33bc0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4986b640 1 -- 172.21.15.151:0/197760794 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec340b3040 con 0x55ed80d317d0 2024-09-10T14:30:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4c55c980 1 Processor -- start 2024-09-10T14:30:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4c55c980 1 -- start start 2024-09-10T14:30:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4c55c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d41dc0 0x55ed80d421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4c55c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ed80b36800 con 0x55ed80d41dc0 2024-09-10T14:30:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d41dc0 0x55ed80d421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d41dc0 0x55ed80d421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51452/0 (socket says 172.21.15.151:51452) 2024-09-10T14:30:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4a06c640 1 -- 172.21.15.151:0/4201991897 learned_addr learned my addr 172.21.15.151:0/4201991897 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4a06c640 1 -- 172.21.15.151:0/4201991897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed80d42720 con 0x55ed80d41dc0 2024-09-10T14:30:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4a06c640 1 --2- 172.21.15.151:0/4201991897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d41dc0 0x55ed80d421e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fec3c048370 tx=0x7fec3c02aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7feb2ffff640 1 -- 172.21.15.151:0/4201991897 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c037040 con 0x55ed80d41dc0 2024-09-10T14:30:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4c55c980 1 -- 172.21.15.151:0/4201991897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed80d429b0 con 0x55ed80d41dc0 2024-09-10T14:30:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7fec4c55c980 1 -- 172.21.15.151:0/4201991897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed80d45630 con 0x55ed80d41dc0 2024-09-10T14:30:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7feb2ffff640 1 -- 172.21.15.151:0/4201991897 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c045040 con 0x55ed80d41dc0 2024-09-10T14:30:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.188+0000 7feb2ffff640 1 -- 172.21.15.151:0/4201991897 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c022410 con 0x55ed80d41dc0 2024-09-10T14:30:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7feb2ffff640 1 -- 172.21.15.151:0/4201991897 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec3c016070 con 0x55ed80d41dc0 2024-09-10T14:30:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7feb2ffff640 1 --2- 172.21.15.151:0/4201991897 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb24034600 0x7feb24036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7feb2ffff640 1 -- 172.21.15.151:0/4201991897 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fec3c014070 con 0x55ed80d41dc0 2024-09-10T14:30:42.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4986b640 1 --2- 172.21.15.151:0/4201991897 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb24034600 0x7feb24036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 Processor -- start 2024-09-10T14:30:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- start start 2024-09-10T14:30:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4986b640 1 --2- 172.21.15.151:0/4201991897 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb24034600 0x7feb24036ac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fec3401b2c0 tx=0x7fec34005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d4eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ed80d1d560 con 0x55ed80d4e6e0 2024-09-10T14:30:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d4eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d4eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51464/0 (socket says 172.21.15.151:51464) 2024-09-10T14:30:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4a06c640 1 -- 172.21.15.151:0/2370647404 learned_addr learned my addr 172.21.15.151:0/2370647404 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4a06c640 1 -- 172.21.15.151:0/2370647404 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed80d4f090 con 0x55ed80d4e6e0 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4a06c640 1 --2- 172.21.15.151:0/2370647404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d4eac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fec3c019640 tx=0x7fec3c033e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be41e2b936134678 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7feb2dffb640 1 -- 172.21.15.151:0/2370647404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c01b1b0 con 0x55ed80d4e6e0 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7feb2dffb640 1 -- 172.21.15.151:0/2370647404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c060070 con 0x55ed80d4e6e0 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7feb2dffb640 1 -- 172.21.15.151:0/2370647404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c048d50 con 0x55ed80d4e6e0 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- 172.21.15.151:0/2370647404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 msgr2=0x55ed80d4eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2370647404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d4eac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fec3c019640 tx=0x7fec3c033e60 comp rx=0 tx=0).stop 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- 172.21.15.151:0/2370647404 shutdown_connections 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2370647404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d4eac0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- 172.21.15.151:0/2370647404 >> 172.21.15.151:0/2370647404 conn(0x55ed80d4aac0 msgr2=0x55ed80d48bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- 172.21.15.151:0/2370647404 shutdown_connections 2024-09-10T14:30:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- 172.21.15.151:0/2370647404 wait complete. 2024-09-10T14:30:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 Processor -- start 2024-09-10T14:30:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- start start 2024-09-10T14:30:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d55820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.192+0000 7fec4c55c980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ed80d4f530 con 0x55ed80d4e6e0 2024-09-10T14:30:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d55820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4a06c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d55820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51478/0 (socket says 172.21.15.151:51478) 2024-09-10T14:30:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 learned_addr learned my addr 172.21.15.151:0/2622081500 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed80d55d60 con 0x55ed80d4e6e0 2024-09-10T14:30:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4a06c640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d55820 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fec3c050e20 tx=0x7fec3c01b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7feb1bfff640 1 -- 172.21.15.151:0/2622081500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c074070 con 0x55ed80d4e6e0 2024-09-10T14:30:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed80d55d60 con 0x55ed80d4e6e0 2024-09-10T14:30:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed80d55d60 con 0x55ed80d4e6e0 2024-09-10T14:30:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7feb1bfff640 1 -- 172.21.15.151:0/2622081500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c045420 con 0x55ed80d4e6e0 2024-09-10T14:30:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7feb1bfff640 1 -- 172.21.15.151:0/2622081500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec3c02b8d0 con 0x55ed80d4e6e0 2024-09-10T14:30:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7feb1bfff640 1 -- 172.21.15.151:0/2622081500 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec3c077070 con 0x55ed80d4e6e0 2024-09-10T14:30:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7feb1bfff640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb14034650 0x7feb14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7feb1bfff640 1 -- 172.21.15.151:0/2622081500 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fec3c06b030 con 0x55ed80d4e6e0 2024-09-10T14:30:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4986b640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb14034650 0x7feb14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80d609c0 0x55ed80d62e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d635b0 con 0x55ed80d609c0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.196+0000 7fec4a86d640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80d609c0 0x55ed80d62e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4986b640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb14034650 0x7feb14036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec34018eb0 tx=0x7fec340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a86d640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80d609c0 0x55ed80d62e60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 realm 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d639c0 con 0x55ed80d609c0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:42.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64260 con 0x55ed80d609c0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d65360 0x55ed80d67750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d67da0 con 0x55ed80d65360 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a06c640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d65360 0x55ed80d67750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a06c640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d65360 0x55ed80d67750 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 20 searching for the correct realm 2024-09-10T14:30:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d69600 con 0x55ed80d65360 2024-09-10T14:30:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a06c640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec3c079060 0x7fec3c0541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d67da0 con 0x7fec3c079060 2024-09-10T14:30:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4986b640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec3c079060 0x7fec3c0541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4986b640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec3c079060 0x7fec3c0541b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4986b640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec340cd040 0x7fec340ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d67da0 con 0x7fec340cd040 2024-09-10T14:30:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a86d640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec340cd040 0x7fec340ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.200+0000 7fec4a86d640 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec340cd040 0x7fec340ce430 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec340cd040 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec340cd040 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec3c079060 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d65360 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec340cd040 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec3c079060 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d65360 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.204+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d65360 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec3c079060 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d65360 2024-09-10T14:30:42.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d65360 2024-09-10T14:30:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec340cd040 2024-09-10T14:30:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d65360 2024-09-10T14:30:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec3c079060 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec3c079060 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d65360 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec340cd040 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec3c079060 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.208+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d65360 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec340cd040 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x55ed80d609c0 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d64600 con 0x7fec3c079060 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d68380 con 0x55ed80d609c0 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d68bd0 con 0x55ed80d609c0 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d68bd0 con 0x7fec340cd040 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 zone default found 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 4 Realm: () 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 zonegroup default 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d68ff0 con 0x7fec3c079060 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d695b0 con 0x55ed80d65360 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6b440 con 0x55ed80d65360 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 started sync module instance, tier type = 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.212+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6a8b0 con 0x7fec3c079060 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.216+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.216+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94478557160448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6b8a0 con 0x7fec3c079060 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.216+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6c0f0 con 0x55ed80d609c0 2024-09-10T14:30:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.216+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94478557160448] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.216+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.216+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94478557166656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6c510 con 0x55ed80d609c0 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.216+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6cd60 con 0x55ed80d65360 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94478557166656] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94478557167984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6cb80 con 0x55ed80d65360 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6d770 con 0x7fec3c079060 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94478557172416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6dfc0 con 0x7fec3c079060 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6e980 con 0x55ed80d609c0 2024-09-10T14:30:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94478557167984] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.220+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94478557172416] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.224+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.224+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94478557169104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6e980 con 0x55ed80d609c0 2024-09-10T14:30:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.224+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6f220 con 0x7fec340cd040 2024-09-10T14:30:42.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.224+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94478557169104] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.224+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.224+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94478557177312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6efd0 con 0x7fec340cd040 2024-09-10T14:30:42.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.224+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6fac0 con 0x7fec340cd040 2024-09-10T14:30:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(56 notify.6 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94478557177312] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94478557181328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6fa80 con 0x7fec340cd040 2024-09-10T14:30:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d70480 con 0x7fec340cd040 2024-09-10T14:30:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94478557183888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d708e0 con 0x7fec340cd040 2024-09-10T14:30:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 20 add_watcher() i=0 2024-09-10T14:30:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 20 add_watcher() i=1 2024-09-10T14:30:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 20 add_watcher() i=2 2024-09-10T14:30:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 20 add_watcher() i=3 2024-09-10T14:30:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 20 add_watcher() i=4 2024-09-10T14:30:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.228+0000 7fec4c55c980 20 add_watcher() i=5 2024-09-10T14:30:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94478557181328] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4c55c980 20 add_watcher() i=6 2024-09-10T14:30:42.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94478557183888] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4c55c980 20 add_watcher() i=7 2024-09-10T14:30:42.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4c55c980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:42.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6ea80 con 0x55ed80d609c0 2024-09-10T14:30:42.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94478557178496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d70df0 con 0x55ed80d609c0 2024-09-10T14:30:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94478557178496] v36'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7feb00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4c55c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4c55c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fec4c55c980 5 note: GC not initialized 2024-09-10T14:30:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.232+0000 7fea7b7fe640 20 reqs_thread_entry: start 2024-09-10T14:30:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 20 Filter name: none 2024-09-10T14:30:42.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fea797fa640 20 reqs_thread_entry: start 2024-09-10T14:30:42.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:42.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d96fc0 con 0x7fec340cd040 2024-09-10T14:30:42.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T14:30:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.236+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d9d950 con 0x7fec340cd040 2024-09-10T14:30:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4c55c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4c55c980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4c55c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94478557369280 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d99000 con 0x55ed80d609c0 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 94478557169104 notify 154618822685 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fec4402d060 con 0x55ed80d609c0 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7feb2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94478557169104 notifier 4904 bl.length()=636 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7feb2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7feb2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 94478557369280 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7feb2dffb640 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7feb10003eb0 con 0x55ed80d609c0 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 94478557369280 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fec4401e040 con 0x55ed80d609c0 2024-09-10T14:30:42.246 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:42.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7feb00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:42.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94478557178496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d94dc0 con 0x55ed80d609c0 2024-09-10T14:30:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94478557178496] v36'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.240+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94478557160448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d94dc0 con 0x7fec3c079060 2024-09-10T14:30:42.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.244+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94478557160448] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.244+0000 7fec4c55c980 20 remove_watcher() i=0 2024-09-10T14:30:42.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.244+0000 7fec4c55c980 2 removed watcher, disabling cache 2024-09-10T14:30:42.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.244+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94478557166656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d94dc0 con 0x55ed80d609c0 2024-09-10T14:30:42.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.244+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94478557166656] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.244+0000 7fec4c55c980 20 remove_watcher() i=1 2024-09-10T14:30:42.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.244+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94478557167984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6bc40 con 0x55ed80d65360 2024-09-10T14:30:42.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4a06c640 1 -- 172.21.15.151:0/2622081500 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94478557167984] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec3c076030 con 0x55ed80d65360 2024-09-10T14:30:42.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4c55c980 20 remove_watcher() i=2 2024-09-10T14:30:42.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94478557172416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d94dc0 con 0x7fec3c079060 2024-09-10T14:30:42.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4986b640 1 -- 172.21.15.151:0/2622081500 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94478557172416] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec340d8070 con 0x7fec3c079060 2024-09-10T14:30:42.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4c55c980 20 remove_watcher() i=3 2024-09-10T14:30:42.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94478557169104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6bc40 con 0x55ed80d609c0 2024-09-10T14:30:42.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94478557169104] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x55ed80d609c0 2024-09-10T14:30:42.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4c55c980 20 remove_watcher() i=4 2024-09-10T14:30:42.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.248+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94478557177312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6c620 con 0x7fec340cd040 2024-09-10T14:30:42.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.252+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94478557177312] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.252+0000 7fec4c55c980 20 remove_watcher() i=5 2024-09-10T14:30:42.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.252+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94478557181328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d6d2c0 con 0x7fec340cd040 2024-09-10T14:30:42.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.252+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94478557181328] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.252+0000 7fec4c55c980 20 remove_watcher() i=6 2024-09-10T14:30:42.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.252+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94478557183888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ed80d94dc0 con 0x7fec340cd040 2024-09-10T14:30:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94478557183888] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec4400a4d0 con 0x7fec340cd040 2024-09-10T14:30:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 20 remove_watcher() i=7 2024-09-10T14:30:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec340cd040 msgr2=0x7fec340ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7fec340cd040 0x7fec340ce430 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80d609c0 msgr2=0x55ed80d62e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80d609c0 0x55ed80d62e60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec3c079060 msgr2=0x7fec3c0541b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7fec3c079060 0x7fec3c0541b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d65360 msgr2=0x55ed80d67750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d65360 0x55ed80d67750 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb14034650 msgr2=0x7feb14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb14034650 0x7feb14036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec34018eb0 tx=0x7fec340a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 msgr2=0x55ed80d55820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4a86d640 1 -- 172.21.15.151:0/2622081500 reap_dead start 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d55820 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fec3c050e20 tx=0x7fec3c01b140 comp rx=0 tx=0).stop 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 shutdown_connections 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/2622081500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d4e6e0 0x55ed80d55820 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 >> 172.21.15.151:0/2622081500 conn(0x55ed80d4aac0 msgr2=0x55ed80d48b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 shutdown_connections 2024-09-10T14:30:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/2622081500 wait complete. 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/4201991897 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb24034600 msgr2=0x7feb24036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/4201991897 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb24034600 0x7feb24036ac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fec3401b2c0 tx=0x7fec34005a10 comp rx=0 tx=0).stop 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/4201991897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d41dc0 msgr2=0x55ed80d421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/4201991897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d41dc0 0x55ed80d421e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fec3c048370 tx=0x7fec3c02aab0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/4201991897 shutdown_connections 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/4201991897 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb24034600 0x7feb24036ac0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/4201991897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80d41dc0 0x55ed80d421e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/4201991897 >> 172.21.15.151:0/4201991897 conn(0x55ed80d36f10 msgr2=0x55ed80d39990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/4201991897 shutdown_connections 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/4201991897 wait complete. 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55ed80d317d0 msgr2=0x55ed80d33bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55ed80d317d0 0x55ed80d33bc0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80ba67d0 msgr2=0x55ed80d2af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55ed80ba67d0 0x55ed80d2af90 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d2d8d0 msgr2=0x55ed80d2fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55ed80d2d8d0 0x55ed80d2fcc0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb300346f0 msgr2=0x7feb30036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7feb300346f0 0x7feb30036bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fec340ad000 tx=0x7fec340a5040 comp rx=0 tx=0).stop 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 msgr2=0x55ed80d23f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 --2- 172.21.15.151:0/197760794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed80ba63c0 0x55ed80d23f80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x55ed80d1ddf0 tx=0x7fec3c000bd0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4a86d640 1 -- 172.21.15.151:0/197760794 reap_dead start 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 shutdown_connections 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 >> 172.21.15.151:0/197760794 conn(0x55ed80c2b1c0 msgr2=0x55ed80d173c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 shutdown_connections 2024-09-10T14:30:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.256+0000 7fec4c55c980 1 -- 172.21.15.151:0/197760794 wait complete. 2024-09-10T14:30:42.271 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:42.272 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:42.272 ERROR:root:0 2024-09-10T14:30:42.272 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T14:30:42.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T14:30:42.272 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T14:30:42.351 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:42.351 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660eadf980 1 Processor -- start 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660eadf980 1 -- start start 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660eadf980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55781d6daed0 0x55781d6dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660eadf980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55781d55cae0 con 0x55781d6492a0 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660eadf980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55781d580e30 con 0x55781d6daed0 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660bdee640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55781d6daed0 0x55781d6dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660bdee640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55781d6daed0 0x55781d6dd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51490/0 (socket says 172.21.15.151:51490) 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660c5ef640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55781d6492a0 0x55781d6d97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33412/0 (socket says 172.21.15.151:33412) 2024-09-10T14:30:42.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660bdee640 1 -- 172.21.15.151:0/3098276555 learned_addr learned my addr 172.21.15.151:0/3098276555 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660bdee640 1 -- 172.21.15.151:0/3098276555 >> v1:172.21.15.52:6789/0 conn(0x55781d6492a0 legacy=0x55781d6d97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660bdee640 1 -- 172.21.15.151:0/3098276555 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781d649680 con 0x55781d6daed0 2024-09-10T14:30:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.348+0000 7f660bdee640 1 --2- 172.21.15.151:0/3098276555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 0x55781d6dd2c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f65f400a5c0 tx=0x7f65f401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3a953aa34cb2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660b5ed640 1 -- 172.21.15.151:0/3098276555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65f40a6070 con 0x55781d6daed0 2024-09-10T14:30:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660b5ed640 1 -- 172.21.15.151:0/3098276555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f40af070 con 0x55781d6daed0 2024-09-10T14:30:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660b5ed640 1 -- 172.21.15.151:0/3098276555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65f40aa5c0 con 0x55781d6daed0 2024-09-10T14:30:42.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660eadf980 1 -- 172.21.15.151:0/3098276555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 msgr2=0x55781d6dd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660eadf980 1 --2- 172.21.15.151:0/3098276555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 0x55781d6dd2c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f65f400a5c0 tx=0x7f65f401b340 comp rx=0 tx=0).stop 2024-09-10T14:30:42.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660eadf980 1 -- 172.21.15.151:0/3098276555 shutdown_connections 2024-09-10T14:30:42.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660eadf980 1 --2- 172.21.15.151:0/3098276555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 0x55781d6dd2c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660eadf980 1 -- 172.21.15.151:0/3098276555 >> 172.21.15.151:0/3098276555 conn(0x55781d6cf0a0 msgr2=0x55781d6d14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660eadf980 1 -- 172.21.15.151:0/3098276555 shutdown_connections 2024-09-10T14:30:42.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.352+0000 7f660eadf980 1 -- 172.21.15.151:0/3098276555 wait complete. 2024-09-10T14:30:42.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.364+0000 7f660eadf980 1 Processor -- start 2024-09-10T14:30:42.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.364+0000 7f660eadf980 1 -- start start 2024-09-10T14:30:42.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.364+0000 7f660eadf980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6492a0 0x55781d7c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.364+0000 7f660eadf980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55781d582200 con 0x55781d6492a0 2024-09-10T14:30:42.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.364+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6492a0 0x55781d7c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.364+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6492a0 0x55781d7c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51496/0 (socket says 172.21.15.151:51496) 2024-09-10T14:30:42.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.364+0000 7f660c5ef640 1 -- 172.21.15.151:0/2220582634 learned_addr learned my addr 172.21.15.151:0/2220582634 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.364+0000 7f660c5ef640 1 -- 172.21.15.151:0/2220582634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781d7c22a0 con 0x55781d6492a0 2024-09-10T14:30:42.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660c5ef640 1 --2- 172.21.15.151:0/2220582634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6492a0 0x55781d7c1cd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f66040015f0 tx=0x7f6604001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb4efc417015b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f64fa60c640 1 -- 172.21.15.151:0/2220582634 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6604013420 con 0x55781d6492a0 2024-09-10T14:30:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f64fa60c640 1 -- 172.21.15.151:0/2220582634 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66040135e0 con 0x55781d6492a0 2024-09-10T14:30:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f64fa60c640 1 -- 172.21.15.151:0/2220582634 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6604013940 con 0x55781d6492a0 2024-09-10T14:30:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- 172.21.15.151:0/2220582634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6492a0 msgr2=0x55781d7c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 --2- 172.21.15.151:0/2220582634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6492a0 0x55781d7c1cd0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f66040015f0 tx=0x7f6604001ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- 172.21.15.151:0/2220582634 shutdown_connections 2024-09-10T14:30:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 --2- 172.21.15.151:0/2220582634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6492a0 0x55781d7c1cd0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- 172.21.15.151:0/2220582634 >> 172.21.15.151:0/2220582634 conn(0x55781d6cf0a0 msgr2=0x55781d7bd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- 172.21.15.151:0/2220582634 shutdown_connections 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- 172.21.15.151:0/2220582634 wait complete. 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 Processor -- start 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- start start 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 0x55781d7c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55781d6e0230 con 0x55781d6daed0 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 0x55781d7c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 0x55781d7c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51498/0 (socket says 172.21.15.151:51498) 2024-09-10T14:30:42.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660c5ef640 1 -- 172.21.15.151:0/671318436 learned_addr learned my addr 172.21.15.151:0/671318436 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660c5ef640 1 -- 172.21.15.151:0/671318436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781d7c97b0 con 0x55781d6daed0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660c5ef640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 0x55781d7c9270 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6604006640 tx=0x7f6604000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f64f8e09640 1 -- 172.21.15.151:0/671318436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6604022020 con 0x55781d6daed0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55781d7c9a40 con 0x55781d6daed0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55781d7cc720 con 0x55781d6daed0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f64f8e09640 1 -- 172.21.15.151:0/671318436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6604006320 con 0x55781d6daed0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.368+0000 7f64f8e09640 1 -- 172.21.15.151:0/671318436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6604004a60 con 0x55781d6daed0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f64f8e09640 1 -- 172.21.15.151:0/671318436 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6604025020 con 0x55781d6daed0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f64f8e09640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64f4034650 0x7f64f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f64f8e09640 1 -- 172.21.15.151:0/671318436 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6604018030 con 0x55781d6daed0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660bdee640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64f4034650 0x7f64f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660eadf980 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d7ce1f0 0x55781d7d0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d7d0ba0 con 0x55781d7ce1f0 2024-09-10T14:30:42.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660cdf0640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d7ce1f0 0x55781d7d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660bdee640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64f4034650 0x7f64f4036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ae000 tx=0x7f65f40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660cdf0640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d7ce1f0 0x55781d7d0600 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660cdf0640 1 -- 172.21.15.151:0/671318436 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d7ce1f0 2024-09-10T14:30:42.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d7cd940 con 0x55781d7ce1f0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660cdf0640 1 -- 172.21.15.151:0/671318436 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d7ce1f0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660eadf980 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d7d2ef0 0x55781d7d52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d7d59b0 con 0x55781d7d2ef0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660c5ef640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d7d2ef0 0x55781d7d52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660c5ef640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d7d2ef0 0x55781d7d52e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660c5ef640 1 -- 172.21.15.151:0/671318436 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f660401b070 con 0x55781d7d2ef0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d7d1d90 con 0x55781d7ce1f0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660cdf0640 1 -- 172.21.15.151:0/671318436 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d7ce1f0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660eadf980 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55781d7d6df0 0x55781d7d91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d7d9970 con 0x55781d7d6df0 2024-09-10T14:30:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.372+0000 7f660bdee640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55781d7d6df0 0x55781d7d91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660bdee640 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55781d7d6df0 0x55781d7d91e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660bdee640 1 -- 172.21.15.151:0/671318436 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65f40aaa80 con 0x55781d7d6df0 2024-09-10T14:30:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660eadf980 1 Processor -- start 2024-09-10T14:30:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660eadf980 1 -- start start 2024-09-10T14:30:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660eadf980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7e7400 0x55781d7e7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660eadf980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55781d5db800 con 0x55781d7e7400 2024-09-10T14:30:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7e7400 0x55781d7e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7e7400 0x55781d7e7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51510/0 (socket says 172.21.15.151:51510) 2024-09-10T14:30:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660c5ef640 1 -- 172.21.15.151:0/657938761 learned_addr learned my addr 172.21.15.151:0/657938761 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660c5ef640 1 -- 172.21.15.151:0/657938761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781d7e7d60 con 0x55781d7e7400 2024-09-10T14:30:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660c5ef640 1 --2- 172.21.15.151:0/657938761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7e7400 0x55781d7e7820 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6604047fb0 tx=0x7f6604010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f64f1ffb640 1 -- 172.21.15.151:0/657938761 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6604030930 con 0x55781d7e7400 2024-09-10T14:30:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660eadf980 1 -- 172.21.15.151:0/657938761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55781d7e7ff0 con 0x55781d7e7400 2024-09-10T14:30:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f64f1ffb640 1 -- 172.21.15.151:0/657938761 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6604041210 con 0x55781d7e7400 2024-09-10T14:30:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f64f1ffb640 1 -- 172.21.15.151:0/657938761 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6604030ad0 con 0x55781d7e7400 2024-09-10T14:30:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.376+0000 7f660eadf980 1 -- 172.21.15.151:0/657938761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55781d7eac70 con 0x55781d7e7400 2024-09-10T14:30:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f64f1ffb640 1 -- 172.21.15.151:0/657938761 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6604010070 con 0x55781d7e7400 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f64f1ffb640 1 --2- 172.21.15.151:0/657938761 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64e4034650 0x7f64e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f64f1ffb640 1 -- 172.21.15.151:0/657938761 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6604038070 con 0x55781d7e7400 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660bdee640 1 --2- 172.21.15.151:0/657938761 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64e4034650 0x7f64e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 Processor -- start 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- start start 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660bdee640 1 --2- 172.21.15.151:0/657938761 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64e4034650 0x7f64e4036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f65f401b380 tx=0x7f65f4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55781d7c2620 con 0x55781d7f3cf0 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51518/0 (socket says 172.21.15.151:51518) 2024-09-10T14:30:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660c5ef640 1 -- 172.21.15.151:0/1432665314 learned_addr learned my addr 172.21.15.151:0/1432665314 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660c5ef640 1 -- 172.21.15.151:0/1432665314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781d7f46c0 con 0x55781d7f3cf0 2024-09-10T14:30:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660c5ef640 1 --2- 172.21.15.151:0/1432665314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7f40f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6604029040 tx=0x7f6604030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134602d5e5b0a948 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f64eb7fe640 1 -- 172.21.15.151:0/1432665314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f660403cb50 con 0x55781d7f3cf0 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f64eb7fe640 1 -- 172.21.15.151:0/1432665314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6604059070 con 0x55781d7f3cf0 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f64eb7fe640 1 -- 172.21.15.151:0/1432665314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6604026c90 con 0x55781d7f3cf0 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- 172.21.15.151:0/1432665314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 msgr2=0x55781d7f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 --2- 172.21.15.151:0/1432665314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7f40f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6604029040 tx=0x7f6604030c70 comp rx=0 tx=0).stop 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- 172.21.15.151:0/1432665314 shutdown_connections 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 --2- 172.21.15.151:0/1432665314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7f40f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- 172.21.15.151:0/1432665314 >> 172.21.15.151:0/1432665314 conn(0x55781d7f0120 msgr2=0x55781d7ee220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- 172.21.15.151:0/1432665314 shutdown_connections 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- 172.21.15.151:0/1432665314 wait complete. 2024-09-10T14:30:42.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 Processor -- start 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- start start 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7faef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660eadf980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55781d7f4b90 con 0x55781d7f3cf0 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7faef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660c5ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7faef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51520/0 (socket says 172.21.15.151:51520) 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.380+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 learned_addr learned my addr 172.21.15.151:0/4114154502 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781d7fb430 con 0x55781d7f3cf0 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660c5ef640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7faef0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6604029040 tx=0x7f660400bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f64e9ffb640 1 -- 172.21.15.151:0/4114154502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f660403c460 con 0x55781d7f3cf0 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55781d7fb430 con 0x55781d7f3cf0 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55781d7fb430 con 0x55781d7f3cf0 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f64e9ffb640 1 -- 172.21.15.151:0/4114154502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660401dbb0 con 0x55781d7f3cf0 2024-09-10T14:30:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f64e9ffb640 1 -- 172.21.15.151:0/4114154502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f660401d690 con 0x55781d7f3cf0 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f64e9ffb640 1 -- 172.21.15.151:0/4114154502 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f66040263b0 con 0x55781d7f3cf0 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f64e9ffb640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64dc034650 0x7f64dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f64e9ffb640 1 -- 172.21.15.151:0/4114154502 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6604021170 con 0x55781d7f3cf0 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660bdee640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64dc034650 0x7f64dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d805fc0 0x55781d808480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d808bd0 con 0x55781d805fc0 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660cdf0640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d805fc0 0x55781d808480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660bdee640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64dc034650 0x7f64dc036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55781d7d9d70 tx=0x7f65f40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660cdf0640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d805fc0 0x55781d808480 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 20 realm 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d808fe0 con 0x55781d805fc0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d809880 con 0x55781d805fc0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.384+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660eadf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d80a980 0x55781d80cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d80d410 con 0x55781d80a980 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660c5ef640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d80a980 0x55781d80cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660c5ef640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d80a980 0x55781d80cd70 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660eadf980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660eadf980 20 searching for the correct realm 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d80ec70 con 0x55781d80a980 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660c5ef640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6604030040 0x7f660406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d80ec70 con 0x7f6604030040 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660bdee640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6604030040 0x7f660406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660bdee640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6604030040 0x7f660406a7c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660bdee640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f65f40e0040 0x7f65f40e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d80ec70 con 0x7f65f40e0040 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f65f40e0040 0x7f65f40e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f65f40e0040 0x7f65f40e0420 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.388+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f65f40e0040 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f65f40e0040 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f6604030040 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d80a980 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f65f40e0040 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f6604030040 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d80a980 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d80a980 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.392+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f6604030040 2024-09-10T14:30:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d80a980 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d80a980 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f65f40e0040 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d80a980 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f6604030040 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f6604030040 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d80a980 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f65f40e0040 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f6604030040 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.396+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d80a980 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f65f40e0040 2024-09-10T14:30:42.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x55781d805fc0 2024-09-10T14:30:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55781d809c20 con 0x7f6604030040 2024-09-10T14:30:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d80dd90 con 0x55781d805fc0 2024-09-10T14:30:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d80d9d0 con 0x55781d805fc0 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d80e660 con 0x7f65f40e0040 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 zone default found 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 4 Realm: () 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 zonegroup default 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d80ea90 con 0x7f6604030040 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d810a80 con 0x55781d80a980 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d810e90 con 0x55781d80a980 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 started sync module instance, tier type = 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.400+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d80ff20 con 0x7f6604030040 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.404+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.404+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93974379430672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d80fb80 con 0x7f6604030040 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.404+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d811dc0 con 0x55781d805fc0 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.404+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93974379430672] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.404+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.404+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93974379436304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d8121e0 con 0x55781d805fc0 2024-09-10T14:30:42.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.404+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d812a90 con 0x55781d80a980 2024-09-10T14:30:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93974379436304] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93974379437632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d812e80 con 0x55781d80a980 2024-09-10T14:30:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d813840 con 0x7f6604030040 2024-09-10T14:30:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93974379443088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d814090 con 0x7f6604030040 2024-09-10T14:30:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d814a50 con 0x55781d805fc0 2024-09-10T14:30:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93974379443088] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.408+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93974379437632] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.412+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.412+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93974379447712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d814090 con 0x55781d805fc0 2024-09-10T14:30:42.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.412+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d814a00 con 0x7f65f40e0040 2024-09-10T14:30:42.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.412+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93974379447712] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.412+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.412+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93974379445216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d814000 con 0x7f65f40e0040 2024-09-10T14:30:42.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.412+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d815900 con 0x7f65f40e0040 2024-09-10T14:30:42.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93974379445216] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93974379449840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d8158c0 con 0x7f65f40e0040 2024-09-10T14:30:42.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d8162c0 con 0x7f65f40e0040 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93974379453904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d8161f0 con 0x7f65f40e0040 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 20 add_watcher() i=0 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 20 add_watcher() i=1 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 20 add_watcher() i=2 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 20 add_watcher() i=3 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 20 add_watcher() i=4 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 20 add_watcher() i=5 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93974379449840] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.416+0000 7f660eadf980 20 add_watcher() i=6 2024-09-10T14:30:42.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93974379453904] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 20 add_watcher() i=7 2024-09-10T14:30:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d815410 con 0x55781d805fc0 2024-09-10T14:30:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93974379451408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d816c50 con 0x55781d805fc0 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93974379451408] v36'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f64c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 5 note: GC not initialized 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f64c17e2640 20 reqs_thread_entry: start 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.420+0000 7f660eadf980 20 Filter name: none 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f6432ffd640 20 reqs_thread_entry: start 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d83cdd0 con 0x7f65f40e0040 2024-09-10T14:30:42.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T14:30:42.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d8433b0 con 0x7f65f40e0040 2024-09-10T14:30:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.424+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93974379638304 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55781d83eac0 con 0x55781d805fc0 2024-09-10T14:30:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 93974379447712 notify 154618822686 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f65fc010040 con 0x55781d805fc0 2024-09-10T14:30:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f64eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822686 cookie 93974379447712 notifier 4911 bl.length()=649 2024-09-10T14:30:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f64eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f64eb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 93974379638304 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f64eb7fe640 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f64d0003eb0 con 0x55781d805fc0 2024-09-10T14:30:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 93974379638304 notify 154618822686 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f65fc00bdb0 con 0x55781d805fc0 2024-09-10T14:30:42.432 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f64c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93974379451408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d83f280 con 0x55781d805fc0 2024-09-10T14:30:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93974379451408] v36'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.428+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93974379430672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d83f280 con 0x7f6604030040 2024-09-10T14:30:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.432+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93974379430672] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.432+0000 7f660eadf980 20 remove_watcher() i=0 2024-09-10T14:30:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.432+0000 7f660eadf980 2 removed watcher, disabling cache 2024-09-10T14:30:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.432+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93974379436304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d83f280 con 0x55781d805fc0 2024-09-10T14:30:42.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.432+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93974379436304] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.432+0000 7f660eadf980 20 remove_watcher() i=1 2024-09-10T14:30:42.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.432+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93974379437632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d83f280 con 0x55781d80a980 2024-09-10T14:30:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.436+0000 7f660c5ef640 1 -- 172.21.15.151:0/4114154502 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93974379437632] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f660401b070 con 0x55781d80a980 2024-09-10T14:30:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.436+0000 7f660eadf980 20 remove_watcher() i=2 2024-09-10T14:30:42.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.436+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93974379443088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d83f280 con 0x7f6604030040 2024-09-10T14:30:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.436+0000 7f660bdee640 1 -- 172.21.15.151:0/4114154502 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93974379443088] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65f40aaa80 con 0x7f6604030040 2024-09-10T14:30:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.436+0000 7f660eadf980 20 remove_watcher() i=3 2024-09-10T14:30:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.436+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93974379447712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d83f280 con 0x55781d805fc0 2024-09-10T14:30:42.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.440+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93974379447712] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x55781d805fc0 2024-09-10T14:30:42.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.440+0000 7f660eadf980 20 remove_watcher() i=4 2024-09-10T14:30:42.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.440+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93974379445216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d810310 con 0x7f65f40e0040 2024-09-10T14:30:42.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.440+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93974379445216] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.440+0000 7f660eadf980 20 remove_watcher() i=5 2024-09-10T14:30:42.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.440+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93974379449840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d811910 con 0x7f65f40e0040 2024-09-10T14:30:42.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93974379449840] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 20 remove_watcher() i=6 2024-09-10T14:30:42.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93974379453904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55781d811e40 con 0x7f65f40e0040 2024-09-10T14:30:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93974379453904] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65fc0083f0 con 0x7f65f40e0040 2024-09-10T14:30:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 20 remove_watcher() i=7 2024-09-10T14:30:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f65f40e0040 msgr2=0x7f65f40e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f65f40e0040 0x7f65f40e0420 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d805fc0 msgr2=0x55781d808480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d805fc0 0x55781d808480 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6604030040 msgr2=0x7f660406a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f6604030040 0x7f660406a7c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d80a980 msgr2=0x55781d80cd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d80a980 0x55781d80cd70 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64dc034650 msgr2=0x7f64dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64dc034650 0x7f64dc036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55781d7d9d70 tx=0x7f65f40c1040 comp rx=0 tx=0).stop 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 msgr2=0x55781d7faef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660cdf0640 1 -- 172.21.15.151:0/4114154502 reap_dead start 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7faef0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6604029040 tx=0x7f660400bfb0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 shutdown_connections 2024-09-10T14:30:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/4114154502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7f3cf0 0x55781d7faef0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 >> 172.21.15.151:0/4114154502 conn(0x55781d7f0120 msgr2=0x55781d7ee1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 shutdown_connections 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/4114154502 wait complete. 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/657938761 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64e4034650 msgr2=0x7f64e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/657938761 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64e4034650 0x7f64e4036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f65f401b380 tx=0x7f65f4005ad0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/657938761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7e7400 msgr2=0x55781d7e7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/657938761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7e7400 0x55781d7e7820 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6604047fb0 tx=0x7f6604010ab0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/657938761 shutdown_connections 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/657938761 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64e4034650 0x7f64e4036b10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/657938761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d7e7400 0x55781d7e7820 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/657938761 >> 172.21.15.151:0/657938761 conn(0x55781d7dc550 msgr2=0x55781d7defd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/657938761 shutdown_connections 2024-09-10T14:30:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/657938761 wait complete. 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55781d7d6df0 msgr2=0x55781d7d91e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55781d7d6df0 0x55781d7d91e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d7ce1f0 msgr2=0x55781d7d0600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55781d7ce1f0 0x55781d7d0600 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d7d2ef0 msgr2=0x55781d7d52e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55781d7d2ef0 0x55781d7d52e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64f4034650 msgr2=0x7f64f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f64f4034650 0x7f64f4036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f65f40ae000 tx=0x7f65f40a6000 comp rx=0 tx=0).stop 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 msgr2=0x55781d7c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660eadf980 1 --2- 172.21.15.151:0/671318436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55781d6daed0 0x55781d7c9270 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6604006640 tx=0x7f6604000f50 comp rx=0 tx=0).stop 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.444+0000 7f660cdf0640 1 -- 172.21.15.151:0/671318436 reap_dead start 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.448+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 shutdown_connections 2024-09-10T14:30:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.448+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 >> 172.21.15.151:0/671318436 conn(0x55781d6cf0a0 msgr2=0x55781d7bc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.448+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 shutdown_connections 2024-09-10T14:30:42.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.448+0000 7f660eadf980 1 -- 172.21.15.151:0/671318436 wait complete. 2024-09-10T14:30:42.460 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:42.460 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:42.460 ERROR:root:0 2024-09-10T14:30:42.460 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T14:30:42.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T14:30:42.460 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T14:30:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:30:42.535 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:30:42.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f512c422980 1 Processor -- start 2024-09-10T14:30:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f512c422980 1 -- start start 2024-09-10T14:30:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f512c422980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55887467ab90 0x55887467cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f512c422980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558874503ae0 con 0x55887467d4c0 2024-09-10T14:30:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f512c422980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x558874527e30 con 0x55887467ab90 2024-09-10T14:30:42.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f5129f32640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55887467ab90 0x55887467cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f5129f32640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55887467ab90 0x55887467cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51532/0 (socket says 172.21.15.151:51532) 2024-09-10T14:30:42.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f5129f32640 1 -- 172.21.15.151:0/3981318156 learned_addr learned my addr 172.21.15.151:0/3981318156 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f5129731640 1 --1- 172.21.15.151:0/3981318156 >> v1:172.21.15.52:6789/0 conn(0x55887467d4c0 0x55887467f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.151:33426/0 (socket says 172.21.15.151:33426) 2024-09-10T14:30:42.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f5129f32640 1 -- 172.21.15.151:0/3981318156 >> v1:172.21.15.52:6789/0 conn(0x55887467d4c0 legacy=0x55887467f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.532+0000 7f5129f32640 1 -- 172.21.15.151:0/3981318156 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558874682130 con 0x55887467ab90 2024-09-10T14:30:42.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f5129f32640 1 --2- 172.21.15.151:0/3981318156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x55887467cf80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f512400a4e0 tx=0x7f512401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736427259afd400 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f5128f30640 1 -- 172.21.15.151:0/3981318156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240aa540 con 0x55887467ab90 2024-09-10T14:30:42.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f5128f30640 1 -- 172.21.15.151:0/3981318156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240aa6e0 con 0x55887467ab90 2024-09-10T14:30:42.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f5128f30640 1 -- 172.21.15.151:0/3981318156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240aaa40 con 0x55887467ab90 2024-09-10T14:30:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f512c422980 1 -- 172.21.15.151:0/3981318156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 msgr2=0x55887467cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f512c422980 1 --2- 172.21.15.151:0/3981318156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x55887467cf80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f512400a4e0 tx=0x7f512401b090 comp rx=0 tx=0).stop 2024-09-10T14:30:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f512c422980 1 -- 172.21.15.151:0/3981318156 shutdown_connections 2024-09-10T14:30:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f512c422980 1 --2- 172.21.15.151:0/3981318156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x55887467cf80 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f512c422980 1 -- 172.21.15.151:0/3981318156 >> 172.21.15.151:0/3981318156 conn(0x5588746757b0 msgr2=0x558874677bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f512c422980 1 -- 172.21.15.151:0/3981318156 shutdown_connections 2024-09-10T14:30:42.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.536+0000 7f512c422980 1 -- 172.21.15.151:0/3981318156 wait complete. 2024-09-10T14:30:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.548+0000 7f512c422980 1 Processor -- start 2024-09-10T14:30:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.548+0000 7f512c422980 1 -- start start 2024-09-10T14:30:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.548+0000 7f512c422980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x558874768cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.548+0000 7f512c422980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558874529200 con 0x55887467ab90 2024-09-10T14:30:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.548+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x558874768cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.548+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x558874768cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51534/0 (socket says 172.21.15.151:51534) 2024-09-10T14:30:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.548+0000 7f5129f32640 1 -- 172.21.15.151:0/3728199781 learned_addr learned my addr 172.21.15.151:0/3728199781 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.548+0000 7f5129f32640 1 -- 172.21.15.151:0/3728199781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558874769290 con 0x55887467ab90 2024-09-10T14:30:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5129f32640 1 --2- 172.21.15.151:0/3728199781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x558874768cc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5124017ca0 tx=0x7f51240033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3cabd89f7b2e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5017e07640 1 -- 172.21.15.151:0/3728199781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240b9030 con 0x55887467ab90 2024-09-10T14:30:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5017e07640 1 -- 172.21.15.151:0/3728199781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240aaac0 con 0x55887467ab90 2024-09-10T14:30:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5017e07640 1 -- 172.21.15.151:0/3728199781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240aada0 con 0x55887467ab90 2024-09-10T14:30:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 -- 172.21.15.151:0/3728199781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 msgr2=0x558874768cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 --2- 172.21.15.151:0/3728199781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x558874768cc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5124017ca0 tx=0x7f51240033b0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 -- 172.21.15.151:0/3728199781 shutdown_connections 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 --2- 172.21.15.151:0/3728199781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x558874768cc0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 -- 172.21.15.151:0/3728199781 >> 172.21.15.151:0/3728199781 conn(0x5588746757b0 msgr2=0x5588747604e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 -- 172.21.15.151:0/3728199781 shutdown_connections 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 -- 172.21.15.151:0/3728199781 wait complete. 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 Processor -- start 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 -- start start 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x55887476ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558874681b70 con 0x55887467ab90 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x55887476ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x55887476ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51542/0 (socket says 172.21.15.151:51542) 2024-09-10T14:30:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5129f32640 1 -- 172.21.15.151:0/3045773424 learned_addr learned my addr 172.21.15.151:0/3045773424 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5129f32640 1 -- 172.21.15.151:0/3045773424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558874770450 con 0x55887467ab90 2024-09-10T14:30:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5129f32640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x55887476ff10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5124005cc0 tx=0x7f5124017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5016604640 1 -- 172.21.15.151:0/3045773424 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240b9030 con 0x55887467ab90 2024-09-10T14:30:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5016604640 1 -- 172.21.15.151:0/3045773424 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240c3070 con 0x55887467ab90 2024-09-10T14:30:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f5016604640 1 -- 172.21.15.151:0/3045773424 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240bf750 con 0x55887467ab90 2024-09-10T14:30:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.552+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588747706e0 con 0x55887467ab90 2024-09-10T14:30:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588747733c0 con 0x55887467ab90 2024-09-10T14:30:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f5016604640 1 -- 172.21.15.151:0/3045773424 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51240c5030 con 0x55887467ab90 2024-09-10T14:30:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f5016604640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50100346a0 0x7f5010036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f5016604640 1 -- 172.21.15.151:0/3045773424 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f51240ba070 con 0x55887467ab90 2024-09-10T14:30:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f5129731640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50100346a0 0x7f5010036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512c422980 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55887467d4c0 0x558874776ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747774c0 con 0x55887467d4c0 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512a733640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55887467d4c0 0x558874776ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f5129731640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50100346a0 0x7f5010036b60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5114000f70 tx=0x7f5114001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512a733640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55887467d4c0 0x558874776ea0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512a733640 1 -- 172.21.15.151:0/3045773424 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x55887467d4c0 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747745e0 con 0x55887467d4c0 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512a733640 1 -- 172.21.15.151:0/3045773424 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f511c0083f0 con 0x55887467d4c0 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512c422980 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558874779860 0x55887477bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55887477c320 con 0x558874779860 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f5129f32640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558874779860 0x55887477bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f5129f32640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558874779860 0x55887477bc50 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f5129f32640 1 -- 172.21.15.151:0/3045773424 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51240ce070 con 0x558874779860 2024-09-10T14:30:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.556+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558874778700 con 0x55887467d4c0 2024-09-10T14:30:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f512a733640 1 -- 172.21.15.151:0/3045773424 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f511c0083f0 con 0x55887467d4c0 2024-09-10T14:30:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f512c422980 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55887477d760 0x55887477fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747802e0 con 0x55887477d760 2024-09-10T14:30:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f5129731640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55887477d760 0x55887477fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f5129731640 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55887477d760 0x55887477fb50 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f5129731640 1 -- 172.21.15.151:0/3045773424 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f511400f6a0 con 0x55887477d760 2024-09-10T14:30:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f512c422980 1 Processor -- start 2024-09-10T14:30:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f512c422980 1 -- start start 2024-09-10T14:30:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f512c422980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887478dd70 0x55887478e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f512c422980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558874582800 con 0x55887478dd70 2024-09-10T14:30:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887478dd70 0x55887478e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887478dd70 0x55887478e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51554/0 (socket says 172.21.15.151:51554) 2024-09-10T14:30:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f5129f32640 1 -- 172.21.15.151:0/2378925653 learned_addr learned my addr 172.21.15.151:0/2378925653 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f5129f32640 1 -- 172.21.15.151:0/2378925653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887478e6d0 con 0x55887478dd70 2024-09-10T14:30:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f5129f32640 1 --2- 172.21.15.151:0/2378925653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887478dd70 0x55887478e190 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f51240b7010 tx=0x7f51240b4d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.560+0000 7f500f7fe640 1 -- 172.21.15.151:0/2378925653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240c65d0 con 0x55887478dd70 2024-09-10T14:30:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- 172.21.15.151:0/2378925653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55887478e960 con 0x55887478dd70 2024-09-10T14:30:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f500f7fe640 1 -- 172.21.15.151:0/2378925653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240c6770 con 0x55887478dd70 2024-09-10T14:30:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f500f7fe640 1 -- 172.21.15.151:0/2378925653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240bfaf0 con 0x55887478dd70 2024-09-10T14:30:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- 172.21.15.151:0/2378925653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588747915e0 con 0x55887478dd70 2024-09-10T14:30:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f500f7fe640 1 -- 172.21.15.151:0/2378925653 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51240b3040 con 0x55887478dd70 2024-09-10T14:30:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f500f7fe640 1 --2- 172.21.15.151:0/2378925653 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5004034650 0x7f5004036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f500f7fe640 1 -- 172.21.15.151:0/2378925653 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f51240d7070 con 0x55887478dd70 2024-09-10T14:30:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f5129731640 1 --2- 172.21.15.151:0/2378925653 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5004034650 0x7f5004036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 Processor -- start 2024-09-10T14:30:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- start start 2024-09-10T14:30:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f5129731640 1 --2- 172.21.15.151:0/2378925653 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5004034650 0x7f5004036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5588747806e0 tx=0x7f511400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x55887479ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558874769550 con 0x55887479a730 2024-09-10T14:30:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x55887479ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x55887479ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51566/0 (socket says 172.21.15.151:51566) 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f5129f32640 1 -- 172.21.15.151:0/4046236 learned_addr learned my addr 172.21.15.151:0/4046236 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f5129f32640 1 -- 172.21.15.151:0/4046236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887479b100 con 0x55887479a730 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f5129f32640 1 --2- 172.21.15.151:0/4046236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x55887479ab30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f51240c8560 tx=0x7f51240c8900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfb9b042b10ecde server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f500d7fa640 1 -- 172.21.15.151:0/4046236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240fa070 con 0x55887479a730 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f500d7fa640 1 -- 172.21.15.151:0/4046236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240dcb30 con 0x55887479a730 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f500d7fa640 1 -- 172.21.15.151:0/4046236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5124005020 con 0x55887479a730 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- 172.21.15.151:0/4046236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 msgr2=0x55887479ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 --2- 172.21.15.151:0/4046236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x55887479ab30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f51240c8560 tx=0x7f51240c8900 comp rx=0 tx=0).stop 2024-09-10T14:30:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- 172.21.15.151:0/4046236 shutdown_connections 2024-09-10T14:30:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 --2- 172.21.15.151:0/4046236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x55887479ab30 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- 172.21.15.151:0/4046236 >> 172.21.15.151:0/4046236 conn(0x558874796ab0 msgr2=0x558874794bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- 172.21.15.151:0/4046236 shutdown_connections 2024-09-10T14:30:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.564+0000 7f512c422980 1 -- 172.21.15.151:0/4046236 wait complete. 2024-09-10T14:30:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f512c422980 1 Processor -- start 2024-09-10T14:30:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f512c422980 1 -- start start 2024-09-10T14:30:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f512c422980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x5588747a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f512c422980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55887479b4c0 con 0x55887479a730 2024-09-10T14:30:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x5588747a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f5129f32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x5588747a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:51580/0 (socket says 172.21.15.151:51580) 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 learned_addr learned my addr 172.21.15.151:0/4032936994 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588747a1da0 con 0x55887479a730 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f5129f32640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x5588747a1860 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5124004fd0 tx=0x7f51240f3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f4ffb7fe640 1 -- 172.21.15.151:0/4032936994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512410e070 con 0x55887479a730 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f4ffb7fe640 1 -- 172.21.15.151:0/4032936994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240e8280 con 0x55887479a730 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f4ffb7fe640 1 -- 172.21.15.151:0/4032936994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240e8880 con 0x55887479a730 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588747a1da0 con 0x55887479a730 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588747a1da0 con 0x55887479a730 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.568+0000 7f4ffb7fe640 1 -- 172.21.15.151:0/4032936994 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5124111070 con 0x55887479a730 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f4ffb7fe640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4ff4034650 0x7f4ff4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f4ffb7fe640 1 -- 172.21.15.151:0/4032936994 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f5124106050 con 0x55887479a730 2024-09-10T14:30:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129731640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4ff4034650 0x7f4ff4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5588747ac880 0x5588747aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747af490 con 0x5588747ac880 2024-09-10T14:30:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512a733640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5588747ac880 0x5588747aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129731640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4ff4034650 0x7f4ff4036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f511400c010 tx=0x7f5114010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512a733640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5588747ac880 0x5588747aed40 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 realm 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747af8a0 con 0x5588747ac880 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b0140 con 0x5588747ac880 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5588747b1240 0x5588747b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b3cd0 con 0x5588747b1240 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129f32640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5588747b1240 0x5588747b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129f32640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5588747b1240 0x5588747b3630 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 20 searching for the correct realm 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b5530 con 0x5588747b1240 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129f32640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5124113060 0x7f51240daa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b5530 con 0x7f5124113060 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129731640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5124113060 0x7f51240daa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129731640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5124113060 0x7f51240daa10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129731640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f511401fbe0 0x7f511403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.572+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b5530 con 0x7f511401fbe0 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f511401fbe0 0x7f511403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f511401fbe0 0x7f511403a3c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f511401fbe0 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f511401fbe0 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f5124113060 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747b1240 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.576+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f511401fbe0 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f5124113060 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747b1240 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747b1240 2024-09-10T14:30:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f5124113060 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747b1240 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747b1240 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f511401fbe0 2024-09-10T14:30:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747b1240 2024-09-10T14:30:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f5124113060 2024-09-10T14:30:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.580+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f5124113060 2024-09-10T14:30:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747b1240 2024-09-10T14:30:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f511401fbe0 2024-09-10T14:30:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f5124113060 2024-09-10T14:30:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747b1240 2024-09-10T14:30:42.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f511401fbe0 2024-09-10T14:30:42.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x5588747ac880 2024-09-10T14:30:42.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5588747b04e0 con 0x7f5124113060 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:30:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b4650 con 0x5588747ac880 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b4ea0 con 0x5588747ac880 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.584+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b42b0 con 0x7f511401fbe0 2024-09-10T14:30:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:30:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 zone default found 2024-09-10T14:30:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 4 Realm: () 2024-09-10T14:30:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:30:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:30:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 zonegroup default 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b5960 con 0x7f5124113060 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b76e0 con 0x5588747b1240 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747b7a80 con 0x5588747b1240 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:30:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 started sync module instance, tier type = 2024-09-10T14:30:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:30:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b6b80 con 0x7f5124113060 2024-09-10T14:30:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94044558159728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b82d0 con 0x7f5124113060 2024-09-10T14:30:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b8b20 con 0x5588747ac880 2024-09-10T14:30:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.588+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94044558159728] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.592+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.592+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94044558163488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b8b20 con 0x5588747ac880 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.592+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b94e0 con 0x5588747b1240 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.592+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94044558163488] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.592+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.592+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94044558165616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b8a90 con 0x5588747b1240 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.592+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747ba230 con 0x7f5124113060 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.596+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.596+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94044558173728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747baef0 con 0x7f5124113060 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.596+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bb8b0 con 0x5588747ac880 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.596+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94044558165616] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.596+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94044558173728] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.596+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.596+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94044558170320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bb8b0 con 0x5588747ac880 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.596+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bc150 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.600+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94044558170320] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.600+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.600+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94044558177552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bbec0 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.600+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bc9e0 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.600+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94044558177552] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.600+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.600+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94044558181552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bc9a0 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.600+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bd3a0 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(58 notify.7 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94044558184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bd7c0 con 0x7f511401fbe0 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512c422980 20 add_watcher() i=0 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512c422980 20 add_watcher() i=1 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512c422980 20 add_watcher() i=2 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512c422980 20 add_watcher() i=3 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512c422980 20 add_watcher() i=4 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512c422980 20 add_watcher() i=5 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94044558181552] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.604+0000 7f512c422980 20 add_watcher() i=6 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94044558184112] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 20 add_watcher() i=7 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 2 all 8 watchers are set, enabling cache 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747bb930 con 0x5588747ac880 2024-09-10T14:30:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94044558178608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747bdd00 con 0x5588747ac880 2024-09-10T14:30:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94044558178608] v36'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f4fdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:30:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:30:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 5 note: GC not initialized 2024-09-10T14:30:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f4fda7fc640 20 reqs_thread_entry: start 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 20 init_complete bucket index max shards: 11 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 20 Filter name: none 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f4f4bfff640 20 reqs_thread_entry: start 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 20 rados->read ofs=0 len=0 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.608+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747e3ed0 con 0x7f511401fbe0 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T14:30:42.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T14:30:42.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T14:30:42.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747ea7f0 con 0x7f511401fbe0 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94044558369376 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5588747e5ee0 con 0x5588747ac880 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== watch-notify(notify (1) cookie 94044558170320 notify 154618822687 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f511c010040 con 0x5588747ac880 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f500d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822687 cookie 94044558170320 notifier 4918 bl.length()=649 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f500d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f500d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T14:30:42.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(64 notify.4 [notify cookie 94044558369376 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f500d7fa640 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f4fec003eb0 con 0x5588747ac880 2024-09-10T14:30:42.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.612+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== watch-notify(notify_complete (2) cookie 94044558369376 notify 154618822687 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f511c00bdb0 con 0x5588747ac880 2024-09-10T14:30:42.620 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T14:30:40.076542Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T14:30:40.076525Z","tags":[],"group_ids":[]} 2024-09-10T14:30:42.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.616+0000 7f4fdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:30:42.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.616+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94044558178608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747e66a0 con 0x5588747ac880 2024-09-10T14:30:42.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.616+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94044558178608] v36'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.616+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94044558159728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747e66a0 con 0x7f5124113060 2024-09-10T14:30:42.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.616+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94044558159728] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.616+0000 7f512c422980 20 remove_watcher() i=0 2024-09-10T14:30:42.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.616+0000 7f512c422980 2 removed watcher, disabling cache 2024-09-10T14:30:42.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.616+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94044558163488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747e66a0 con 0x5588747ac880 2024-09-10T14:30:42.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.620+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94044558163488] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.620+0000 7f512c422980 20 remove_watcher() i=1 2024-09-10T14:30:42.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.620+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94044558165616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747e66a0 con 0x5588747b1240 2024-09-10T14:30:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.620+0000 7f5129f32640 1 -- 172.21.15.151:0/4032936994 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94044558165616] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5124110030 con 0x5588747b1240 2024-09-10T14:30:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.620+0000 7f512c422980 20 remove_watcher() i=2 2024-09-10T14:30:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.620+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94044558173728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b6f70 con 0x7f5124113060 2024-09-10T14:30:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.624+0000 7f5129731640 1 -- 172.21.15.151:0/4032936994 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94044558173728] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5114037040 con 0x7f5124113060 2024-09-10T14:30:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.624+0000 7f512c422980 20 remove_watcher() i=3 2024-09-10T14:30:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.624+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94044558170320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b8670 con 0x5588747ac880 2024-09-10T14:30:42.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.624+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94044558170320] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x5588747ac880 2024-09-10T14:30:42.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.624+0000 7f512c422980 20 remove_watcher() i=4 2024-09-10T14:30:42.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.624+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94044558177552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747ba620 con 0x7f511401fbe0 2024-09-10T14:30:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.624+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94044558177552] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.624+0000 7f512c422980 20 remove_watcher() i=5 2024-09-10T14:30:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.628+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94044558181552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b6f70 con 0x7f511401fbe0 2024-09-10T14:30:42.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.628+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94044558181552] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.628+0000 7f512c422980 20 remove_watcher() i=6 2024-09-10T14:30:42.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.628+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94044558184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5588747b8670 con 0x7f511401fbe0 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94044558184112] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511c0083f0 con 0x7f511401fbe0 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 20 remove_watcher() i=7 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f511401fbe0 msgr2=0x7f511403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f511401fbe0 0x7f511403a3c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5588747ac880 msgr2=0x5588747aed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x5588747ac880 0x5588747aed40 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5124113060 msgr2=0x7f51240daa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f5124113060 0x7f51240daa10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5588747b1240 msgr2=0x5588747b3630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x5588747b1240 0x5588747b3630 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4ff4034650 msgr2=0x7f4ff4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4ff4034650 0x7f4ff4036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f511400c010 tx=0x7f5114010000 comp rx=0 tx=0).stop 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512a733640 1 -- 172.21.15.151:0/4032936994 reap_dead start 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 msgr2=0x5588747a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x5588747a1860 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5124004fd0 tx=0x7f51240f3000 comp rx=0 tx=0).stop 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 shutdown_connections 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/4032936994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887479a730 0x5588747a1860 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 >> 172.21.15.151:0/4032936994 conn(0x558874796ab0 msgr2=0x558874794b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 shutdown_connections 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/4032936994 wait complete. 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/2378925653 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5004034650 msgr2=0x7f5004036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/2378925653 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5004034650 0x7f5004036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5588747806e0 tx=0x7f511400f000 comp rx=0 tx=0).stop 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/2378925653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887478dd70 msgr2=0x55887478e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/2378925653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887478dd70 0x55887478e190 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f51240b7010 tx=0x7f51240b4d10 comp rx=0 tx=0).stop 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/2378925653 shutdown_connections 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/2378925653 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5004034650 0x7f5004036b10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/2378925653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887478dd70 0x55887478e190 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/2378925653 >> 172.21.15.151:0/2378925653 conn(0x558874782ec0 msgr2=0x558874785940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/2378925653 shutdown_connections 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/2378925653 wait complete. 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55887477d760 msgr2=0x55887477fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55887477d760 0x55887477fb50 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55887467d4c0 msgr2=0x558874776ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55887467d4c0 0x558874776ea0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558874779860 msgr2=0x55887477bc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x558874779860 0x55887477bc50 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50100346a0 msgr2=0x7f5010036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f50100346a0 0x7f5010036b60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5114000f70 tx=0x7f5114001380 comp rx=0 tx=0).stop 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 msgr2=0x55887476ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 --2- 172.21.15.151:0/3045773424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55887467ab90 0x55887476ff10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5124005cc0 tx=0x7f5124017e30 comp rx=0 tx=0).stop 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512a733640 1 -- 172.21.15.151:0/3045773424 reap_dead start 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 shutdown_connections 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 >> 172.21.15.151:0/3045773424 conn(0x5588746757b0 msgr2=0x55887475f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 shutdown_connections 2024-09-10T14:30:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:30:42.632+0000 7f512c422980 1 -- 172.21.15.151:0/3045773424 wait complete. 2024-09-10T14:30:42.646 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:42.646 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T14:30:40.076542Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T14:30:40.076525Z', 'tags': [], 'group_ids': []} 2024-09-10T14:30:42.646 ERROR:root:0 2024-09-10T14:30:42.646 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T14:30:42.654 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.654 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.658 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.658 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T14:30:42.664 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.664 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.668 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.668 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-10T14:30:42.678 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-10T14:30:42.678 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.682 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.684 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-10T14:30:42.692 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:42.692 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.696 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.696 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-10T14:30:42.705 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-10T14:30:42.705 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.709 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.709 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-10T14:30:42.718 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-10T14:30:42.718 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.722 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.722 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-10T14:30:42.730 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:42.730 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.734 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.734 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-10T14:30:42.740 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:42.740 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.744 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.744 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-10T14:30:42.753 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:42.753 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.757 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.757 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.761 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T14:30:42.762 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T14:30:42.766 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T14:30:42.784 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T14:30:42.789 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-10T14:30:42.789 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T14:30:42.795 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T14:30:42.775716Z', 'creation_time': '2024-09-10T14:30:42.771066Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-10T14:30:42.795 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T14:30:42.801 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T14:30:42.775716Z', 'creation_time': '2024-09-10T14:30:42.771066Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-10T14:30:42.808 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T14:30:42.815 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T14:30:42.775716Z', 'creation_time': '2024-09-10T14:30:42.771066Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-10T14:30:42.815 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-10T14:30:42.820 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000007756f9b580edd19e-0066e05812-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:30:42.827 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-10T14:30:42.837 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:42.837 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-10T14:30:42.851 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:30:42.908 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11'} 2024-09-10T14:30:42.929 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:42.934 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11'} 2024-09-10T14:30:42.955 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:42.955 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-10T14:30:42.976 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:42.990 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-10T14:30:43.003 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:30:43.003 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T14:30:43.010 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '58a4d2fa-bc9c-4537-a4ac-e71f7240f583', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11', 'marker': '83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T14:30:42.942256Z', 'creation_time': '2024-09-10T14:30:42.771066Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-10T14:31:43.131 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-10T14:31:43.163 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-10T14:31:43.163 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-10T14:31:43.193 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-10T14:31:43.193 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T14:31:43.199 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-10T14:31:43.199 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-10T14:31:43.205 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-10T14:31:43.205 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-10T14:31:43.210 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-10T14:31:43.211 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-10T14:31:43.216 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-10T14:31:43.216 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-10T14:31:43.221 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-10T14:00:00.000000Z', 'epoch': 1725976800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-10T14:31:43.222 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-10T14:31:43.233 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:31:43.233 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T14:31:43.238 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-10T14:31:43.238 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T14:31:43.254 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:31:43.259 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T14:31:43.274 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:31:43.659 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T14:31:43.664 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000618f65a8147a06e0-0066e0584f-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:43.841 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T14:31:43.847 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T14:31:43.859 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T14:31:43.865 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T14:31:44.005 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-10T14:31:44.099 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:31:44.099 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T14:31:44.109 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-10T14:31:44.110 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T14:31:44.118 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T14:31:44.143 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T14:31:44.148 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000006d819ea8fbac5f4-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.195 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-10T14:31:44.269 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:31:44.269 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T14:31:44.274 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000ed8b31a3e4a70b33-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.275 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-10T14:31:44.279 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'e936b5de-d383-459c-816e-e37e3a1e8eca'}]}} 2024-09-10T14:31:44.279 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-10T14:31:44.300 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T14:31:44.301 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T14:31:44.305 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T14:31:44.305 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-10T14:31:44.310 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000000cc83332a411f2db-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-10T14:31:44.314 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000007b4b166e9030ce26-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.338 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T14:31:44.342 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T14:31:44.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-10T14:31:44.348 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000007cb27513dd80dbee-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-10T14:31:44.352 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000006dcec0db0a75892e-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.352 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-10T14:31:44.357 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T14:31:44.357 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-10T14:31:44.361 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000002d71278d09f347aa-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.362 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-10T14:31:44.365 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000001871bc50443dfb7e-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.366 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-10T14:31:44.369 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000054982c34529d020b-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.370 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-10T14:31:44.373 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000aa97a6b66a28506d-0066e05850-4225-default', 'HostId': '4225-default-default'} 2024-09-10T14:31:44.373 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-10T14:31:44.393 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:31:44.394 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T14:31:44.398 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-10T14:31:44.398 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-10T14:31:44.408 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:31:44.408 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T14:31:44.412 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-10T14:31:44.412 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-10T14:31:44.421 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T14:31:44.426 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-10T14:31:44.436 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-10T14:31:44.436 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T14:31:44.437 INFO:tasks.rgw.client.0.smithi151.stdout:2024-09-10T14:31:44.431+0000 7fb5b5107640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29306) UID: 0 2024-09-10T14:31:44.437 INFO:tasks.rgw.client.0.smithi151.stdout:2024-09-10T14:31:44.431+0000 7fb5b894fa40 -1 shutting down 2024-09-10T14:32:14.943 INFO:tasks.rgw.client.0:Stopped 2024-09-10T14:32:14.944 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-10T14:32:14.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/vault-root-token 2024-09-10T14:32:15.008 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-10T14:32:15.063 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-10T14:32:15.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-10T14:32:15.063 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-10T14:32:15.141 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-10T14:32:15.142 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T14:32:15.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.135+0000 7f0d7973a980 1 Processor -- start 2024-09-10T14:32:15.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.135+0000 7f0d7973a980 1 -- start start 2024-09-10T14:32:15.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.135+0000 7f0d7973a980 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55823a8ca840 0x55823a8ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.135+0000 7f0d7973a980 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55823a750ae0 con 0x55823a83cb00 2024-09-10T14:32:15.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d7973a980 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x55823a774e30 con 0x55823a8ca840 2024-09-10T14:32:15.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76a49640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55823a8ca840 0x55823a8ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76a49640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x55823a8ca840 0x55823a8ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:46508/0 (socket says 172.21.15.151:46508) 2024-09-10T14:32:15.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76a49640 1 -- 172.21.15.151:0/1514425616 learned_addr learned my addr 172.21.15.151:0/1514425616 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:32:15.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76a49640 1 -- 172.21.15.151:0/1514425616 >> v1:172.21.15.52:6789/0 conn(0x55823a83cb00 legacy=0x55823a8c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76a49640 1 -- 172.21.15.151:0/1514425616 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823a8cd1a0 con 0x55823a8ca840 2024-09-10T14:32:15.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76a49640 1 --2- 172.21.15.151:0/1514425616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a8ca840 0x55823a8ccc60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000a5c0 tx=0x7f0d6001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd42e34a8fe4fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76248640 1 -- 172.21.15.151:0/1514425616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d600af070 con 0x55823a8ca840 2024-09-10T14:32:15.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76248640 1 -- 172.21.15.151:0/1514425616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d600aa530 con 0x55823a8ca840 2024-09-10T14:32:15.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.139+0000 7f0d76248640 1 -- 172.21.15.151:0/1514425616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d600aa830 con 0x55823a8ca840 2024-09-10T14:32:15.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.143+0000 7f0d7973a980 1 -- 172.21.15.151:0/1514425616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a8ca840 msgr2=0x55823a8ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.143+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1514425616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a8ca840 0x55823a8ccc60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000a5c0 tx=0x7f0d6001b340 comp rx=0 tx=0).stop 2024-09-10T14:32:15.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.143+0000 7f0d7973a980 1 -- 172.21.15.151:0/1514425616 shutdown_connections 2024-09-10T14:32:15.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.143+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1514425616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a8ca840 0x55823a8ccc60 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.143+0000 7f0d7973a980 1 -- 172.21.15.151:0/1514425616 >> 172.21.15.151:0/1514425616 conn(0x55823a8c3060 msgr2=0x55823a8c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:15.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.143+0000 7f0d7973a980 1 -- 172.21.15.151:0/1514425616 shutdown_connections 2024-09-10T14:32:15.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.143+0000 7f0d7973a980 1 -- 172.21.15.151:0/1514425616 wait complete. 2024-09-10T14:32:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 Processor -- start 2024-09-10T14:32:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 -- start start 2024-09-10T14:32:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9ba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55823a776200 con 0x55823a83cb00 2024-09-10T14:32:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9ba450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:46510/0 (socket says 172.21.15.151:46510) 2024-09-10T14:32:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7724a640 1 -- 172.21.15.151:0/2162260534 learned_addr learned my addr 172.21.15.151:0/2162260534 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:32:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7724a640 1 -- 172.21.15.151:0/2162260534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823a9baa20 con 0x55823a83cb00 2024-09-10T14:32:15.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7724a640 1 --2- 172.21.15.151:0/2162260534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9ba450 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0d680015f0 tx=0x7f0d68001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25db8b62c9ca5c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0c6560a640 1 -- 172.21.15.151:0/2162260534 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d68016070 con 0x55823a83cb00 2024-09-10T14:32:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0c6560a640 1 -- 172.21.15.151:0/2162260534 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6800f640 con 0x55823a83cb00 2024-09-10T14:32:15.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0c6560a640 1 -- 172.21.15.151:0/2162260534 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d6800f960 con 0x55823a83cb00 2024-09-10T14:32:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 -- 172.21.15.151:0/2162260534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 msgr2=0x55823a9ba450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2162260534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9ba450 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0d680015f0 tx=0x7f0d68001ab0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 -- 172.21.15.151:0/2162260534 shutdown_connections 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2162260534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9ba450 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.159+0000 7f0d7973a980 1 -- 172.21.15.151:0/2162260534 >> 172.21.15.151:0/2162260534 conn(0x55823a8c3060 msgr2=0x55823a9b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 -- 172.21.15.151:0/2162260534 shutdown_connections 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 -- 172.21.15.151:0/2162260534 wait complete. 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 Processor -- start 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 -- start start 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9c1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55823a8d8a00 con 0x55823a83cb00 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9c1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:46520/0 (socket says 172.21.15.151:46520) 2024-09-10T14:32:15.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7724a640 1 -- 172.21.15.151:0/2568086866 learned_addr learned my addr 172.21.15.151:0/2568086866 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:32:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7724a640 1 -- 172.21.15.151:0/2568086866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823a9c1d80 con 0x55823a83cb00 2024-09-10T14:32:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7724a640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9c1840 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0d68001af0 tx=0x7f0d68000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0c63e07640 1 -- 172.21.15.151:0/2568086866 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d68016040 con 0x55823a83cb00 2024-09-10T14:32:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55823a9c2010 con 0x55823a83cb00 2024-09-10T14:32:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0c63e07640 1 -- 172.21.15.151:0/2568086866 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68022070 con 0x55823a83cb00 2024-09-10T14:32:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0c63e07640 1 -- 172.21.15.151:0/2568086866 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d68006180 con 0x55823a83cb00 2024-09-10T14:32:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55823a9c4cf0 con 0x55823a83cb00 2024-09-10T14:32:15.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0c63e07640 1 -- 172.21.15.151:0/2568086866 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d680117c0 con 0x55823a83cb00 2024-09-10T14:32:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0c63e07640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034650 0x7f0c5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0c63e07640 1 -- 172.21.15.151:0/2568086866 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0d680498e0 con 0x55823a83cb00 2024-09-10T14:32:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d76a49640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034650 0x7f0c5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.163+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a8ca840 0x55823a9c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823a9c8df0 con 0x55823a8ca840 2024-09-10T14:32:15.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d77a4b640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a8ca840 0x55823a9c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d76a49640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034650 0x7f0c5c036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0d600ac000 tx=0x7f0d600a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d77a4b640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a8ca840 0x55823a9c87d0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d77a4b640 1 -- 172.21.15.151:0/2568086866 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a8ca840 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823a9c5f10 con 0x55823a8ca840 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d77a4b640 1 -- 172.21.15.151:0/2568086866 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a8ca840 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823a9cb190 0x55823a9cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:3 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823a9cdc50 con 0x55823a9cb190 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7724a640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823a9cb190 0x55823a9cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7724a640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823a9cb190 0x55823a9cd580 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7724a640 1 -- 172.21.15.151:0/2568086866 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(3 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d6800f070 con 0x55823a9cb190 2024-09-10T14:32:15.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823a9ca000 con 0x55823a8ca840 2024-09-10T14:32:15.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d77a4b640 1 -- 172.21.15.151:0/2568086866 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a8ca840 2024-09-10T14:32:15.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55823a9cf090 0x55823a9d1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:5 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823a9d1bf0 con 0x55823a9cf090 2024-09-10T14:32:15.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d76a49640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55823a9cf090 0x55823a9d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.167+0000 7f0d76a49640 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55823a9cf090 0x55823a9d1480 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d76a49640 1 -- 172.21.15.151:0/2568086866 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(5 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0d600b2040 con 0x55823a9cf090 2024-09-10T14:32:15.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7973a980 1 Processor -- start 2024-09-10T14:32:15.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7973a980 1 -- start start 2024-09-10T14:32:15.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7973a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9df680 0x55823a9dfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7973a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55823a7cf800 con 0x55823a9df680 2024-09-10T14:32:15.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9df680 0x55823a9dfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9df680 0x55823a9dfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:46528/0 (socket says 172.21.15.151:46528) 2024-09-10T14:32:15.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7724a640 1 -- 172.21.15.151:0/1067523953 learned_addr learned my addr 172.21.15.151:0/1067523953 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:32:15.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7724a640 1 -- 172.21.15.151:0/1067523953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823a9dffe0 con 0x55823a9df680 2024-09-10T14:32:15.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7724a640 1 --2- 172.21.15.151:0/1067523953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9df680 0x55823a9dfaa0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0d680313f0 tx=0x7f0d680264a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0c61602640 1 -- 172.21.15.151:0/1067523953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d68011c90 con 0x55823a9df680 2024-09-10T14:32:15.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7973a980 1 -- 172.21.15.151:0/1067523953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55823a9e0270 con 0x55823a9df680 2024-09-10T14:32:15.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0c61602640 1 -- 172.21.15.151:0/1067523953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68011e30 con 0x55823a9df680 2024-09-10T14:32:15.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0c61602640 1 -- 172.21.15.151:0/1067523953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d68041330 con 0x55823a9df680 2024-09-10T14:32:15.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0d7973a980 1 -- 172.21.15.151:0/1067523953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55823a9e2ef0 con 0x55823a9df680 2024-09-10T14:32:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.171+0000 7f0c61602640 1 -- 172.21.15.151:0/1067523953 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d680414d0 con 0x55823a9df680 2024-09-10T14:32:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0c61602640 1 --2- 172.21.15.151:0/1067523953 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c50034650 0x7f0c50036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0c61602640 1 -- 172.21.15.151:0/1067523953 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0d68040070 con 0x55823a9df680 2024-09-10T14:32:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d76a49640 1 --2- 172.21.15.151:0/1067523953 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c50034650 0x7f0c50036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 Processor -- start 2024-09-10T14:32:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- start start 2024-09-10T14:32:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d76a49640 1 --2- 172.21.15.151:0/1067523953 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c50034650 0x7f0c50036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55823a9c9360 tx=0x7f0d60005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9ec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55823a9bada0 con 0x55823a9ec060 2024-09-10T14:32:15.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9ec440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:46534/0 (socket says 172.21.15.151:46534) 2024-09-10T14:32:15.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7724a640 1 -- 172.21.15.151:0/409448985 learned_addr learned my addr 172.21.15.151:0/409448985 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:32:15.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7724a640 1 -- 172.21.15.151:0/409448985 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823a9eca10 con 0x55823a9ec060 2024-09-10T14:32:15.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7724a640 1 --2- 172.21.15.151:0/409448985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9ec440 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0d680497e0 tx=0x7f0d68018980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59583af579ae0db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0c5affd640 1 -- 172.21.15.151:0/409448985 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d6805c070 con 0x55823a9ec060 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0c5affd640 1 -- 172.21.15.151:0/409448985 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6801fdc0 con 0x55823a9ec060 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0c5affd640 1 -- 172.21.15.151:0/409448985 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680491e0 con 0x55823a9ec060 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- 172.21.15.151:0/409448985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 msgr2=0x55823a9ec440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 --2- 172.21.15.151:0/409448985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9ec440 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0d680497e0 tx=0x7f0d68018980 comp rx=0 tx=0).stop 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- 172.21.15.151:0/409448985 shutdown_connections 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 --2- 172.21.15.151:0/409448985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9ec440 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- 172.21.15.151:0/409448985 >> 172.21.15.151:0/409448985 conn(0x55823a9e8390 msgr2=0x55823a9e6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- 172.21.15.151:0/409448985 shutdown_connections 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- 172.21.15.151:0/409448985 wait complete. 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 Processor -- start 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- start start 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7973a980 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55823a9ecda0 con 0x55823a9ec060 2024-09-10T14:32:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7724a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9f3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.151:46544/0 (socket says 172.21.15.151:46544) 2024-09-10T14:32:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.175+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 learned_addr learned my addr 172.21.15.151:0/1025958181 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-10T14:32:15.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823a9f3650 con 0x55823a9ec060 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7724a640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9f3110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0d680497e0 tx=0x7f0d6802fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0c597fa640 1 -- 172.21.15.151:0/1025958181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d6806b070 con 0x55823a9ec060 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55823a9f3650 con 0x55823a9ec060 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0c597fa640 1 -- 172.21.15.151:0/1025958181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68031810 con 0x55823a9ec060 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0c597fa640 1 -- 172.21.15.151:0/1025958181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d68018320 con 0x55823a9ec060 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55823a9f3650 con 0x55823a9ec060 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0c597fa640 1 -- 172.21.15.151:0/1025958181 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d68076060 con 0x55823a9ec060 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0c597fa640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c40034650 0x7f0c40036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0c597fa640 1 -- 172.21.15.151:0/1025958181 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f0d68070d20 con 0x55823a9ec060 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d76a49640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c40034650 0x7f0c40036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a9fe2c0 0x55823aa00780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa00ed0 con 0x55823a9fe2c0 2024-09-10T14:32:15.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d77a4b640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a9fe2c0 0x55823aa00780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d76a49640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c40034650 0x7f0c40036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55823a9d1ff0 tx=0x7f0d600b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d77a4b640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a9fe2c0 0x55823aa00780 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7973a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:32:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7973a980 20 realm 2024-09-10T14:32:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.179+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa012e0 con 0x55823a9fe2c0 2024-09-10T14:32:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01bb0 con 0x55823a9fe2c0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x55823a9fe2c0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823aa02cb0 0x55823aa050a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:5 5.16 5:69539d0f:::zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa05660 con 0x55823aa02cb0 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7724a640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823aa02cb0 0x55823aa050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7724a640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823aa02cb0 0x55823aa050a0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== osd_op_reply(5 zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 20 searching for the correct realm 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa06f30 con 0x55823aa02cb0 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7724a640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d68078070 0x7f0d680749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa06f30 con 0x7f0d68078070 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d76a49640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d68078070 0x7f0d680749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d76a49640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d68078070 0x7f0d680749d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d76a49640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d600cc040 0x7f0d600d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa06f30 con 0x7f0d600cc040 2024-09-10T14:32:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.183+0000 7f0d77a4b640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d600cc040 0x7f0d600d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d600cc040 0x7f0d600d9410 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x55823a9fe2c0 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 5 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x55823a9fe2c0 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 6 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x7f0d600cc040 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x7f0d600cc040 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 3 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x7f0d68078070 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x55823aa02cb0 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 3 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x55823a9fe2c0 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.187+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x7f0d600cc040 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 4 ==== osd_op_reply(16 [pgnls start_epoch 36 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x55823a9fe2c0 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55823aa01f50 con 0x7f0d68078070 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823aa02cb0 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 4 ==== osd_op_reply(19 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823aa02cb0 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 5 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x7f0d68078070 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 4 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823aa02cb0 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 6 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823aa02cb0 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 7 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823a9fe2c0 2024-09-10T14:32:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 9 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823a9fe2c0 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 10 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x7f0d600cc040 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823aa02cb0 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 8 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.191+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x7f0d68078070 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 5 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823a9fe2c0 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 11 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x7f0d68078070 2024-09-10T14:32:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=82b] v36'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823aa02cb0 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 9 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x7f0d600cc040 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x7f0d68078070 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 7 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823aa02cb0 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 10 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x7f0d600cc040 2024-09-10T14:32:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x55823a9fe2c0 2024-09-10T14:32:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 12 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f0d600e6060 con 0x7f0d68078070 2024-09-10T14:32:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 8 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 RGWRados::pool_iterate: got zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 2024-09-10T14:32:15.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 RGWRados::pool_iterate: got zone_info.83ac83e0-59cd-4326-be92-5c5921f5e4a6 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 RGWRados::pool_iterate: got period_config.default 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa06050 con 0x55823a9fe2c0 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.195+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa05c90 con 0x55823a9fe2c0 2024-09-10T14:32:15.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:40 5.a 5:50363d4a:::zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa06970 con 0x7f0d600cc040 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 8 ==== osd_op_reply(40 zonegroup_info.58a4d2fa-bc9c-4537-a4ac-e71f7240f583 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 zone default found 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 4 Realm: () 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 4 ZoneGroup: default (58a4d2fa-bc9c-4537-a4ac-e71f7240f583) 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 4 Zone: default (83ac83e0-59cd-4326-be92-5c5921f5e4a6) 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 zonegroup default 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa06da0 con 0x7f0d68078070 2024-09-10T14:32:15.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados_obj.operate() r=0 bl.length=187 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa06530 con 0x55823aa02cb0 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados->read ofs=0 len=0 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa09310 con 0x55823aa02cb0 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 started sync module instance, tier type = 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 20 started zone id=83ac83e0-59cd-4326-be92-5c5921f5e4a6 (name=default) with tier type = 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa08680 con 0x7f0d68078070 2024-09-10T14:32:15.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 10 ==== osd_op_reply(44 notify.0 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94017817709168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa082e0 con 0x7f0d68078070 2024-09-10T14:32:15.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.199+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0a150 con 0x55823a9fe2c0 2024-09-10T14:32:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.203+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94017817709168] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.203+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 15 ==== osd_op_reply(46 notify.1 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.203+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94017817712496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0a540 con 0x55823a9fe2c0 2024-09-10T14:32:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.203+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0af00 con 0x55823aa02cb0 2024-09-10T14:32:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.207+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94017817712496] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.207+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 13 ==== osd_op_reply(48 notify.2 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.207+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94017817717328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0b2f0 con 0x55823aa02cb0 2024-09-10T14:32:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.207+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0bcb0 con 0x7f0d68078070 2024-09-10T14:32:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.207+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 12 ==== osd_op_reply(50 notify.3 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.207+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94017817721104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0c380 con 0x7f0d68078070 2024-09-10T14:32:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.207+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0cea0 con 0x55823a9fe2c0 2024-09-10T14:32:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.207+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94017817717328] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.211+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94017817721104] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.211+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 17 ==== osd_op_reply(52 notify.4 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.211+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94017817725296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0ce60 con 0x55823a9fe2c0 2024-09-10T14:32:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.211+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0d740 con 0x7f0d600cc040 2024-09-10T14:32:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.211+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94017817725296] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.211+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 9 ==== osd_op_reply(54 notify.5 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.211+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94017817713552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0d310 con 0x7f0d600cc040 2024-09-10T14:32:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.211+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0dcd0 con 0x7f0d600cc040 2024-09-10T14:32:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94017817713552] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 11 ==== osd_op_reply(56 notify.6 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94017817726560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0dde0 con 0x7f0d600cc040 2024-09-10T14:32:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0e630 con 0x7f0d600cc040 2024-09-10T14:32:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94017817726560] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 13 ==== osd_op_reply(58 notify.7 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94017817729808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0e480 con 0x7f0d600cc040 2024-09-10T14:32:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 20 add_watcher() i=0 2024-09-10T14:32:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 20 add_watcher() i=1 2024-09-10T14:32:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 20 add_watcher() i=2 2024-09-10T14:32:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 20 add_watcher() i=3 2024-09-10T14:32:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 20 add_watcher() i=4 2024-09-10T14:32:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 20 add_watcher() i=5 2024-09-10T14:32:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.215+0000 7f0d7973a980 20 add_watcher() i=6 2024-09-10T14:32:15.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94017817729808] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d7973a980 20 add_watcher() i=7 2024-09-10T14:32:15.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d7973a980 2 all 8 watchers are set, enabling cache 2024-09-10T14:32:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa11990 con 0x55823a9fe2c0 2024-09-10T14:32:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94017817730864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa0eeb0 con 0x55823a9fe2c0 2024-09-10T14:32:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94017817730864] v36'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:32:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d7973a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T14:32:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d7973a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T14:32:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.219+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1a1e0 con 0x55823a9fe2c0 2024-09-10T14:32:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.223+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'39 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.223+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1a830 con 0x7f0d600cc040 2024-09-10T14:32:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.223+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.223+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1ac90 con 0x55823aa02cb0 2024-09-10T14:32:15.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.227+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.227+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1b030 con 0x55823a9fe2c0 2024-09-10T14:32:15.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.227+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'277 uv163 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.227+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1b5a0 con 0x7f0d68078070 2024-09-10T14:32:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.227+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.227+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1b9c0 con 0x55823aa02cb0 2024-09-10T14:32:15.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.231+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'56 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.231+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1ba50 con 0x55823a9fe2c0 2024-09-10T14:32:15.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.231+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.231+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1bf00 con 0x7f0d600cc040 2024-09-10T14:32:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.235+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.235+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1bf00 con 0x7f0d68078070 2024-09-10T14:32:15.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.235+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'33 uv32 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.235+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1c490 con 0x55823aa02cb0 2024-09-10T14:32:15.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.239+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.239+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1c490 con 0x7f0d68078070 2024-09-10T14:32:15.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.239+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.239+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1c880 con 0x7f0d600cc040 2024-09-10T14:32:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.239+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.243+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1c880 con 0x7f0d68078070 2024-09-10T14:32:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.243+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.243+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1c880 con 0x7f0d600cc040 2024-09-10T14:32:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.243+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.243+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1c880 con 0x55823a9fe2c0 2024-09-10T14:32:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.247+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'278 uv165 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.247+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1c880 con 0x55823aa02cb0 2024-09-10T14:32:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.247+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.247+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1bf00 con 0x7f0d68078070 2024-09-10T14:32:15.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.251+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.251+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1bf00 con 0x55823aa02cb0 2024-09-10T14:32:15.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.251+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.251+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1bf00 con 0x55823a9fe2c0 2024-09-10T14:32:15.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.255+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.255+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1bf00 con 0x55823a9fe2c0 2024-09-10T14:32:15.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.255+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'279 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.255+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1bf00 con 0x55823aa02cb0 2024-09-10T14:32:15.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.255+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.255+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1bf00 con 0x7f0d68078070 2024-09-10T14:32:15.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.259+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.259+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x55823aa02cb0 2024-09-10T14:32:15.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.259+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.259+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x55823aa02cb0 2024-09-10T14:32:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.263+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.263+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x55823aa02cb0 2024-09-10T14:32:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.263+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.263+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x55823aa02cb0 2024-09-10T14:32:15.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.267+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'57 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.267+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x7f0d600cc040 2024-09-10T14:32:15.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.267+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.267+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x55823aa02cb0 2024-09-10T14:32:15.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.271+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'34 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.271+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x7f0d600cc040 2024-09-10T14:32:15.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.271+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.271+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x55823aa02cb0 2024-09-10T14:32:15.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.275+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.275+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x7f0d600cc040 2024-09-10T14:32:15.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.279+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.279+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa1be70 con 0x7f0d68078070 2024-09-10T14:32:15.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.279+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0c2cfe1640 20 reqs_thread_entry: start 2024-09-10T14:32:15.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 20 init_complete bucket index max shards: 11 2024-09-10T14:32:15.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 20 Filter name: none 2024-09-10T14:32:15.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0ba67fc640 20 reqs_thread_entry: start 2024-09-10T14:32:15.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-10T14:32:15.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:94 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 21 ==== osd_op_reply(94 gc.10 [call] v36'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:95 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 22 ==== osd_op_reply(95 gc.10 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:96 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d68078070 2024-09-10T14:32:15.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 23 ==== osd_op_reply(96 gc.10 [call out=24b] v0'0 uv87 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:97 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 24 ==== osd_op_reply(97 gc.10 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.283+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:98 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.287+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 25 ==== osd_op_reply(98 gc.10 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.287+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.287+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:99 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.287+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 26 ==== osd_op_reply(99 gc.10 [call] v36'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.287+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-10T14:32:15.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.287+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:100 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.287+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 22 ==== osd_op_reply(100 gc.11 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.287+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:101 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 23 ==== osd_op_reply(101 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:102 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d600cc040 2024-09-10T14:32:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 24 ==== osd_op_reply(102 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:103 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 25 ==== osd_op_reply(103 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:104 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 26 ==== osd_op_reply(104 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.291+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:105 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 27 ==== osd_op_reply(105 gc.11 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-10T14:32:15.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:106 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 27 ==== osd_op_reply(106 gc.12 [call] v36'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:107 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 28 ==== osd_op_reply(107 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:108 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d68078070 2024-09-10T14:32:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 29 ==== osd_op_reply(108 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:109 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 30 ==== osd_op_reply(109 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:110 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 31 ==== osd_op_reply(110 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.295+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:111 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.299+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 32 ==== osd_op_reply(111 gc.12 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.299+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-10T14:32:15.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.299+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:112 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.299+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 28 ==== osd_op_reply(112 gc.13 [call] v36'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.299+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:113 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 29 ==== osd_op_reply(113 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:114 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d600cc040 2024-09-10T14:32:15.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 30 ==== osd_op_reply(114 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:115 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 31 ==== osd_op_reply(115 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:116 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 32 ==== osd_op_reply(116 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.303+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:117 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 33 ==== osd_op_reply(117 gc.13 [call] v36'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-10T14:32:15.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:118 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 27 ==== osd_op_reply(118 gc.14 [call] v36'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:119 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 28 ==== osd_op_reply(119 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:120 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823a9fe2c0 2024-09-10T14:32:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 29 ==== osd_op_reply(120 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.307+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:121 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 30 ==== osd_op_reply(121 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:122 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 31 ==== osd_op_reply(122 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:123 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 32 ==== osd_op_reply(123 gc.14 [call] v36'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-10T14:32:15.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.311+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:124 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 27 ==== osd_op_reply(124 gc.15 [call] v36'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:125 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 28 ==== osd_op_reply(125 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:126 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 29 ==== osd_op_reply(126 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:127 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 30 ==== osd_op_reply(127 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:128 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 31 ==== osd_op_reply(128 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.315+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:129 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 32 ==== osd_op_reply(129 gc.15 [call] v36'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-10T14:32:15.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:130 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 33 ==== osd_op_reply(130 gc.16 [call] v36'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:131 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 34 ==== osd_op_reply(131 gc.16 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:132 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d68078070 2024-09-10T14:32:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 35 ==== osd_op_reply(132 gc.16 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:133 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 36 ==== osd_op_reply(133 gc.16 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:134 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 37 ==== osd_op_reply(134 gc.16 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.319+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:135 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 38 ==== osd_op_reply(135 gc.16 [call] v36'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-10T14:32:15.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:136 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 33 ==== osd_op_reply(136 gc.17 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:137 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 34 ==== osd_op_reply(137 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:138 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 35 ==== osd_op_reply(138 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:139 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 36 ==== osd_op_reply(139 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:140 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 37 ==== osd_op_reply(140 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.323+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:141 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.327+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 38 ==== osd_op_reply(141 gc.17 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.327+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-10T14:32:15.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.327+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:142 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.327+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 33 ==== osd_op_reply(142 gc.18 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:143 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 34 ==== osd_op_reply(143 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:144 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823a9fe2c0 2024-09-10T14:32:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 35 ==== osd_op_reply(144 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:145 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 36 ==== osd_op_reply(145 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:146 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 37 ==== osd_op_reply(146 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:147 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.331+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 38 ==== osd_op_reply(147 gc.18 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-10T14:32:15.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:148 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 39 ==== osd_op_reply(148 gc.19 [call] v36'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:149 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 40 ==== osd_op_reply(149 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:150 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823a9fe2c0 2024-09-10T14:32:15.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 41 ==== osd_op_reply(150 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.335+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.339+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 43 ==== osd_op_reply(152 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.339+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.339+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.339+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 44 ==== osd_op_reply(153 gc.19 [call] v36'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.339+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-10T14:32:15.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.339+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 39 ==== osd_op_reply(154 gc.20 [call] v36'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 40 ==== osd_op_reply(155 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 41 ==== osd_op_reply(156 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:157 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 42 ==== osd_op_reply(157 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:158 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 43 ==== osd_op_reply(158 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.343+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:159 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.347+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 44 ==== osd_op_reply(159 gc.20 [call] v36'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.347+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-10T14:32:15.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.347+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:160 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 39 ==== osd_op_reply(160 gc.21 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:161 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 40 ==== osd_op_reply(161 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:162 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d68078070 2024-09-10T14:32:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 41 ==== osd_op_reply(162 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:163 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 42 ==== osd_op_reply(163 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:164 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 43 ==== osd_op_reply(164 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:165 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 44 ==== osd_op_reply(165 gc.21 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-10T14:32:15.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.351+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:166 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 45 ==== osd_op_reply(166 gc.22 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:167 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 46 ==== osd_op_reply(167 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:168 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 47 ==== osd_op_reply(168 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:169 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 48 ==== osd_op_reply(169 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:170 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 49 ==== osd_op_reply(170 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.355+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:171 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.359+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 50 ==== osd_op_reply(171 gc.22 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.359+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-10T14:32:15.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.359+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:172 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.359+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 51 ==== osd_op_reply(172 gc.23 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.359+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:173 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 52 ==== osd_op_reply(173 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:174 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 53 ==== osd_op_reply(174 gc.23 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:175 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 54 ==== osd_op_reply(175 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:176 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 55 ==== osd_op_reply(176 gc.23 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:177 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 56 ==== osd_op_reply(177 gc.23 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-10T14:32:15.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.363+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:178 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 57 ==== osd_op_reply(178 gc.24 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:179 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 58 ==== osd_op_reply(179 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:180 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 59 ==== osd_op_reply(180 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:181 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 60 ==== osd_op_reply(181 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:182 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 61 ==== osd_op_reply(182 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.367+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:183 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.371+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 62 ==== osd_op_reply(183 gc.24 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.371+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-10T14:32:15.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.371+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:184 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 63 ==== osd_op_reply(184 gc.25 [call] v36'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:185 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 64 ==== osd_op_reply(185 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:186 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 65 ==== osd_op_reply(186 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:187 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 66 ==== osd_op_reply(187 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:188 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 67 ==== osd_op_reply(188 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:189 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 68 ==== osd_op_reply(189 gc.25 [call] v36'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-10T14:32:15.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.375+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:190 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.379+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 34 ==== osd_op_reply(190 gc.26 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.379+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:191 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.379+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 35 ==== osd_op_reply(191 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.379+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.379+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:192 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d600cc040 2024-09-10T14:32:15.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.383+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 36 ==== osd_op_reply(192 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.383+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:193 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.383+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 37 ==== osd_op_reply(193 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.383+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.383+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:194 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.383+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 38 ==== osd_op_reply(194 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.383+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.383+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:195 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 39 ==== osd_op_reply(195 gc.26 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-10T14:32:15.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:196 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 69 ==== osd_op_reply(196 gc.27 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:197 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 70 ==== osd_op_reply(197 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:198 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 71 ==== osd_op_reply(198 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:199 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 72 ==== osd_op_reply(199 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.387+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:200 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.391+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 73 ==== osd_op_reply(200 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.391+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.391+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:201 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.391+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 74 ==== osd_op_reply(201 gc.27 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.391+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-10T14:32:15.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.391+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:202 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 40 ==== osd_op_reply(202 gc.28 [call] v36'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:203 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 41 ==== osd_op_reply(203 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:204 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d600cc040 2024-09-10T14:32:15.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 42 ==== osd_op_reply(204 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:205 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 43 ==== osd_op_reply(205 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:206 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 44 ==== osd_op_reply(206 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.395+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:207 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.399+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 45 ==== osd_op_reply(207 gc.28 [call] v36'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.399+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-10T14:32:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.399+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:208 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 75 ==== osd_op_reply(208 gc.29 [call] v36'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:209 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 76 ==== osd_op_reply(209 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:210 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 77 ==== osd_op_reply(210 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:211 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 78 ==== osd_op_reply(211 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:212 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 79 ==== osd_op_reply(212 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.403+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:213 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.407+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 80 ==== osd_op_reply(213 gc.29 [call] v36'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.407+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-10T14:32:15.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.407+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:214 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 46 ==== osd_op_reply(214 gc.30 [call] v36'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:215 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 47 ==== osd_op_reply(215 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:216 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d600cc040 2024-09-10T14:32:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 48 ==== osd_op_reply(216 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:217 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 49 ==== osd_op_reply(217 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:218 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.411+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 50 ==== osd_op_reply(218 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.415+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.415+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:219 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.415+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 51 ==== osd_op_reply(219 gc.30 [call] v36'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.415+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-10T14:32:15.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.415+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:220 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 45 ==== osd_op_reply(220 gc.31 [call] v36'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:221 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 46 ==== osd_op_reply(221 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:222 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d68078070 2024-09-10T14:32:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 47 ==== osd_op_reply(222 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:223 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 48 ==== osd_op_reply(223 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:224 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 49 ==== osd_op_reply(224 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.419+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:225 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.423+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 50 ==== osd_op_reply(225 gc.31 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.423+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-10T14:32:15.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.423+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:226 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 45 ==== osd_op_reply(226 gc.0 [call] v36'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:227 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 46 ==== osd_op_reply(227 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:228 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823a9fe2c0 2024-09-10T14:32:15.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 47 ==== osd_op_reply(228 gc.0 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:229 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 48 ==== osd_op_reply(229 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:230 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 49 ==== osd_op_reply(230 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.427+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:231 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.431+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 50 ==== osd_op_reply(231 gc.0 [call] v36'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.431+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-10T14:32:15.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.431+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:232 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 52 ==== osd_op_reply(232 gc.1 [call] v36'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:233 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 53 ==== osd_op_reply(233 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:234 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d600cc040 2024-09-10T14:32:15.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 54 ==== osd_op_reply(234 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:235 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 55 ==== osd_op_reply(235 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:236 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 56 ==== osd_op_reply(236 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.435+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:237 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.439+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 57 ==== osd_op_reply(237 gc.1 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.439+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-10T14:32:15.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.439+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:238 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 81 ==== osd_op_reply(238 gc.2 [call] v36'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:239 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 82 ==== osd_op_reply(239 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:240 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 83 ==== osd_op_reply(240 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:241 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 84 ==== osd_op_reply(241 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:242 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 85 ==== osd_op_reply(242 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.443+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:243 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.447+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 86 ==== osd_op_reply(243 gc.2 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.447+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-10T14:32:15.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.447+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:244 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.447+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 51 ==== osd_op_reply(244 gc.3 [call] v36'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.447+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:245 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 52 ==== osd_op_reply(245 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:246 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823a9fe2c0 2024-09-10T14:32:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 53 ==== osd_op_reply(246 gc.3 [call out=24b] v0'0 uv284 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:247 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 54 ==== osd_op_reply(247 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:248 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 55 ==== osd_op_reply(248 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.451+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:249 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.455+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 56 ==== osd_op_reply(249 gc.3 [call] v36'285 uv285 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.455+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-10T14:32:15.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.455+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:250 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 51 ==== osd_op_reply(250 gc.4 [call] v36'91 uv91 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:251 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 52 ==== osd_op_reply(251 gc.4 [call out=15b] v0'0 uv91 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:252 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d68078070 2024-09-10T14:32:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 53 ==== osd_op_reply(252 gc.4 [call out=24b] v0'0 uv91 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:253 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 54 ==== osd_op_reply(253 gc.4 [call out=15b] v0'0 uv91 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:254 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 55 ==== osd_op_reply(254 gc.4 [call out=15b] v0'0 uv91 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.459+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:255 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.463+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 56 ==== osd_op_reply(255 gc.4 [call] v36'92 uv92 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.463+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-10T14:32:15.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.463+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:256 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 87 ==== osd_op_reply(256 gc.5 [call] v36'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:257 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 88 ==== osd_op_reply(257 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:258 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823aa02cb0 2024-09-10T14:32:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 89 ==== osd_op_reply(258 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:259 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 90 ==== osd_op_reply(259 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:260 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 91 ==== osd_op_reply(260 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.467+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:261 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823aa02cb0 2024-09-10T14:32:15.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.471+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 92 ==== osd_op_reply(261 gc.5 [call] v36'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.471+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-10T14:32:15.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.471+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:262 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 57 ==== osd_op_reply(262 gc.6 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:263 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 58 ==== osd_op_reply(263 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:264 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x55823a9fe2c0 2024-09-10T14:32:15.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 59 ==== osd_op_reply(264 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:265 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 60 ==== osd_op_reply(265 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:266 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 61 ==== osd_op_reply(266 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.475+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:267 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x55823a9fe2c0 2024-09-10T14:32:15.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.479+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 62 ==== osd_op_reply(267 gc.6 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.479+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-10T14:32:15.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.479+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:268 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 58 ==== osd_op_reply(268 gc.7 [call] v36'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:269 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 59 ==== osd_op_reply(269 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:270 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d600cc040 2024-09-10T14:32:15.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 60 ==== osd_op_reply(270 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:271 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 61 ==== osd_op_reply(271 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.483+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:272 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.487+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 62 ==== osd_op_reply(272 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.487+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.487+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:273 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d600cc040 2024-09-10T14:32:15.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.487+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 63 ==== osd_op_reply(273 gc.7 [call] v36'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.487+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-10T14:32:15.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.487+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:274 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.491+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 57 ==== osd_op_reply(274 gc.8 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.491+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:275 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.491+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 58 ==== osd_op_reply(275 gc.8 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.491+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.491+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:276 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa37dd0 con 0x7f0d68078070 2024-09-10T14:32:15.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.491+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 59 ==== osd_op_reply(276 gc.8 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.491+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:277 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 60 ==== osd_op_reply(277 gc.8 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:278 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa38de0 con 0x7f0d68078070 2024-09-10T14:32:15.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 61 ==== osd_op_reply(278 gc.8 [call out=1716b] v0'0 uv34 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T14:32:15.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 20 garbage collection: RGWGC::process iterating over entry tag='83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.15113155216486185268', time=2024-09-10T14:31:58.655085+0000, chain.objs.size()=7 2024-09-10T14:32:15.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_1 2024-09-10T14:32:15.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:279 3.12s0 3:49fd9b24:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa17a40 con 0x7f0d68078070 2024-09-10T14:32:15.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_2 2024-09-10T14:32:15.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:280 3.1ds0 3:b9f1e333:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa3bf30 con 0x55823aa02cb0 2024-09-10T14:32:15.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_3 2024-09-10T14:32:15.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:281 3.11s0 3:8ac2c1e8:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa3e890 con 0x55823aa02cb0 2024-09-10T14:32:15.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_4 2024-09-10T14:32:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:282 3.1s0 3:8174966b:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa41200 con 0x7f0d600cc040 2024-09-10T14:32:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_5 2024-09-10T14:32:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:283 3.31s0 3:8f1cd7b6:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa3e890 con 0x7f0d600cc040 2024-09-10T14:32:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_6 2024-09-10T14:32:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:284 3.6s0 3:6244b6df:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa462a0 con 0x55823a9fe2c0 2024-09-10T14:32:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_7 2024-09-10T14:32:15.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.495+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:285 3.5s0 3:a0b3d890:::83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x7f0d68078070 2024-09-10T14:32:15.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.503+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 62 ==== osd_op_reply(279 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_1 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.503+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 63 ==== osd_op_reply(285 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_7 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.503+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 63 ==== osd_op_reply(284 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_6 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.503+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 64 ==== osd_op_reply(282 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_4 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.503+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 65 ==== osd_op_reply(283 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_5 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.503+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 93 ==== osd_op_reply(280 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_2 [call] v36'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.507+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 94 ==== osd_op_reply(281 83ac83e0-59cd-4326-be92-5c5921f5e4a6.4225.11__shadow_.PEM00ArWuD4UoLYlfTSgHmDh3lvYvbj_3 [call] v36'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.507+0000 7f0d7973a980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T14:32:15.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.507+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:286 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x7f0d68078070 2024-09-10T14:32:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.511+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 64 ==== osd_op_reply(286 gc.8 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.511+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:287 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x7f0d68078070 2024-09-10T14:32:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.515+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 65 ==== osd_op_reply(287 gc.8 [call] v36'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.515+0000 7f0d7973a980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-10T14:32:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.515+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:288 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823aa02cb0 2024-09-10T14:32:15.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 95 ==== osd_op_reply(288 gc.9 [call] v36'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:289 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823aa02cb0 2024-09-10T14:32:15.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 96 ==== osd_op_reply(289 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:290 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823aa02cb0 2024-09-10T14:32:15.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 97 ==== osd_op_reply(290 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:291 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823aa02cb0 2024-09-10T14:32:15.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 98 ==== osd_op_reply(291 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T14:32:15.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:292 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823aa02cb0 2024-09-10T14:32:15.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.519+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 99 ==== osd_op_reply(292 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.523+0000 7f0d7973a980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T14:32:15.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.523+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:293 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823aa02cb0 2024-09-10T14:32:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.523+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 100 ==== osd_op_reply(293 gc.9 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.527+0000 7f0c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T14:32:15.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.527+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94017817730864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823a9fe2c0 2024-09-10T14:32:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.527+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94017817730864] v36'286 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.527+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94017817709168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x7f0d68078070 2024-09-10T14:32:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.531+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 66 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94017817709168] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.531+0000 7f0d7973a980 20 remove_watcher() i=0 2024-09-10T14:32:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.531+0000 7f0d7973a980 2 removed watcher, disabling cache 2024-09-10T14:32:15.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.531+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94017817712496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823a9fe2c0 2024-09-10T14:32:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.535+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94017817712496] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.535+0000 7f0d7973a980 20 remove_watcher() i=1 2024-09-10T14:32:15.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.535+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94017817717328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823aa02cb0 2024-09-10T14:32:15.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.535+0000 7f0d7724a640 1 -- 172.21.15.151:0/1025958181 <== osd.3 v2:172.21.15.151:6803/3136276598 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94017817717328] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6800f070 con 0x55823aa02cb0 2024-09-10T14:32:15.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.535+0000 7f0d7973a980 20 remove_watcher() i=2 2024-09-10T14:32:15.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.535+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94017817721104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x7f0d68078070 2024-09-10T14:32:15.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.539+0000 7f0d76a49640 1 -- 172.21.15.151:0/1025958181 <== osd.2 v2:172.21.15.151:6816/2885613778 67 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94017817721104] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d600d7070 con 0x7f0d68078070 2024-09-10T14:32:15.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.539+0000 7f0d7973a980 20 remove_watcher() i=3 2024-09-10T14:32:15.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.539+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94017817725296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x55823a9fe2c0 2024-09-10T14:32:15.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.543+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.1 v2:172.21.15.151:6800/103268966 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94017817725296] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x55823a9fe2c0 2024-09-10T14:32:15.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.543+0000 7f0d7973a980 20 remove_watcher() i=4 2024-09-10T14:32:15.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.543+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94017817713552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x7f0d600cc040 2024-09-10T14:32:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.547+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94017817713552] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.547+0000 7f0d7973a980 20 remove_watcher() i=5 2024-09-10T14:32:15.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.547+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94017817726560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x7f0d600cc040 2024-09-10T14:32:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.547+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94017817726560] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.547+0000 7f0d7973a980 20 remove_watcher() i=6 2024-09-10T14:32:15.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.547+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94017817729808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55823aa48e50 con 0x7f0d600cc040 2024-09-10T14:32:15.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 <== osd.0 v2:172.21.15.52:6800/2968015226 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94017817729808] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d600cc040 2024-09-10T14:32:15.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 20 remove_watcher() i=7 2024-09-10T14:32:15.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d600cc040 msgr2=0x7f0d600d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f0d600cc040 0x7f0d600d9410 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a9fe2c0 msgr2=0x55823aa00780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a9fe2c0 0x55823aa00780 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d68078070 msgr2=0x7f0d680749d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7f0d68078070 0x7f0d680749d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823aa02cb0 msgr2=0x55823aa050a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823aa02cb0 0x55823aa050a0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c40034650 msgr2=0x7f0c40036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c40034650 0x7f0c40036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55823a9d1ff0 tx=0x7f0d600b8040 comp rx=0 tx=0).stop 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 msgr2=0x55823a9f3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d77a4b640 1 -- 172.21.15.151:0/1025958181 reap_dead start 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9f3110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0d680497e0 tx=0x7f0d6802fed0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 shutdown_connections 2024-09-10T14:32:15.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1025958181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9ec060 0x55823a9f3110 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 >> 172.21.15.151:0/1025958181 conn(0x55823a9e8390 msgr2=0x55823a9e6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 shutdown_connections 2024-09-10T14:32:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1025958181 wait complete. 2024-09-10T14:32:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1067523953 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c50034650 msgr2=0x7f0c50036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1067523953 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c50034650 0x7f0c50036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55823a9c9360 tx=0x7f0d60005ad0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 -- 172.21.15.151:0/1067523953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9df680 msgr2=0x55823a9dfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.551+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1067523953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9df680 0x55823a9dfaa0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0d680313f0 tx=0x7f0d680264a0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/1067523953 shutdown_connections 2024-09-10T14:32:15.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1067523953 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c50034650 0x7f0c50036b10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 --2- 172.21.15.151:0/1067523953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a9df680 0x55823a9dfaa0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/1067523953 >> 172.21.15.151:0/1067523953 conn(0x55823a9d47d0 msgr2=0x55823a9d7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/1067523953 shutdown_connections 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/1067523953 wait complete. 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55823a9cf090 msgr2=0x55823a9d1480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x55823a9cf090 0x55823a9d1480 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a8ca840 msgr2=0x55823a9c87d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x55823a8ca840 0x55823a9c87d0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823a9cb190 msgr2=0x55823a9cd580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x55823a9cb190 0x55823a9cd580 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034650 msgr2=0x7f0c5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f0c5c034650 0x7f0c5c036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0d600ac000 tx=0x7f0d600a5000 comp rx=0 tx=0).stop 2024-09-10T14:32:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 msgr2=0x55823a9c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 --2- 172.21.15.151:0/2568086866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55823a83cb00 0x55823a9c1840 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0d68001af0 tx=0x7f0d68000f50 comp rx=0 tx=0).stop 2024-09-10T14:32:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d77a4b640 1 -- 172.21.15.151:0/2568086866 reap_dead start 2024-09-10T14:32:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 shutdown_connections 2024-09-10T14:32:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 >> 172.21.15.151:0/2568086866 conn(0x55823a8c3060 msgr2=0x55823a9b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 shutdown_connections 2024-09-10T14:32:15.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-10T14:32:15.555+0000 7f0d7973a980 1 -- 172.21.15.151:0/2568086866 wait complete. 2024-09-10T14:32:15.576 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T14:32:15.585 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T14:32:15.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:32:15.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fd03e4640 1 Processor -- start 2024-09-10T14:32:15.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fd03e4640 1 -- start start 2024-09-10T14:32:15.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fd03e4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7fc806f190 0x7f7fc8072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fd03e4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc806fa30 con 0x7f7fc8072760 2024-09-10T14:32:15.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fd03e4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc806e800 con 0x7f7fc806f190 2024-09-10T14:32:15.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fcd97f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7fc806f190 0x7f7fc8072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fce180640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7fc8072760 0x7f7fc806d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45694/0 (socket says 172.21.15.52:45694) 2024-09-10T14:32:15.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fce180640 1 -- 172.21.15.52:0/3127084079 learned_addr learned my addr 172.21.15.52:0/3127084079 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:15.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fcd97f640 1 -- 172.21.15.52:0/3127084079 >> v1:172.21.15.52:6789/0 conn(0x7f7fc8072760 legacy=0x7f7fc806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fcd97f640 1 -- 172.21.15.52:0/3127084079 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc806fd40 con 0x7f7fc806f190 2024-09-10T14:32:15.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fcd97f640 1 --2- 172.21.15.52:0/3127084079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8072b40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009740 tx=0x7f7fb801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f6d03383e5f86d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fcd17e640 1 -- 172.21.15.52:0/3127084079 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80b0070 con 0x7f7fc806f190 2024-09-10T14:32:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fcd17e640 1 -- 172.21.15.52:0/3127084079 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb80ab530 con 0x7f7fc806f190 2024-09-10T14:32:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.720+0000 7f7fcd17e640 1 -- 172.21.15.52:0/3127084079 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80ab830 con 0x7f7fc806f190 2024-09-10T14:32:15.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- 172.21.15.52:0/3127084079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 msgr2=0x7f7fc8072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 --2- 172.21.15.52:0/3127084079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8072b40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009740 tx=0x7f7fb801c370 comp rx=0 tx=0).stop 2024-09-10T14:32:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- 172.21.15.52:0/3127084079 shutdown_connections 2024-09-10T14:32:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 --2- 172.21.15.52:0/3127084079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8072b40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- 172.21.15.52:0/3127084079 >> 172.21.15.52:0/3127084079 conn(0x7f7fc8099a50 msgr2=0x7f7fc80972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- 172.21.15.52:0/3127084079 shutdown_connections 2024-09-10T14:32:15.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- 172.21.15.52:0/3127084079 wait complete. 2024-09-10T14:32:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 Processor -- start 2024-09-10T14:32:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- start start 2024-09-10T14:32:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8123b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8137620 con 0x7f7fc806f190 2024-09-10T14:32:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fce180640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8123b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fce180640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8123b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40540/0 (socket says 172.21.15.52:40540) 2024-09-10T14:32:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fce180640 1 -- 172.21.15.52:0/1620311813 learned_addr learned my addr 172.21.15.52:0/1620311813 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fce180640 1 -- 172.21.15.52:0/1620311813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc8134820 con 0x7f7fc806f190 2024-09-10T14:32:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fce180640 1 --2- 172.21.15.52:0/1620311813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8123b90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400c3a0 tx=0x7f7fc400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fbeffd640 1 -- 172.21.15.52:0/1620311813 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc4017070 con 0x7f7fc806f190 2024-09-10T14:32:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fbeffd640 1 -- 172.21.15.52:0/1620311813 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc4005c20 con 0x7f7fc806f190 2024-09-10T14:32:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fbeffd640 1 -- 172.21.15.52:0/1620311813 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc40070d0 con 0x7f7fc806f190 2024-09-10T14:32:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc8126d50 con 0x7f7fc806f190 2024-09-10T14:32:15.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.724+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc81242a0 con 0x7f7fc806f190 2024-09-10T14:32:15.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.728+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc81254b0 con 0x7f7fc806f190 2024-09-10T14:32:15.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.728+0000 7f7fbeffd640 1 -- 172.21.15.52:0/1620311813 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fc401a070 con 0x7f7fc806f190 2024-09-10T14:32:15.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.728+0000 7f7fbeffd640 1 --2- 172.21.15.52:0/1620311813 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7fac035db0 0x7f7fac038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:15.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.728+0000 7f7fbeffd640 1 -- 172.21.15.52:0/1620311813 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f7fc4048430 con 0x7f7fc806f190 2024-09-10T14:32:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.728+0000 7f7fcd97f640 1 --2- 172.21.15.52:0/1620311813 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7fac035db0 0x7f7fac038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:15.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.728+0000 7f7fcd97f640 1 --2- 172.21.15.52:0/1620311813 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7fac035db0 0x7f7fac038270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80ad000 tx=0x7f7fb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.732+0000 7f7fbeffd640 1 -- 172.21.15.52:0/1620311813 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7fc4007270 con 0x7f7fc806f190 2024-09-10T14:32:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:15.892+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fc8126700 con 0x7f7fac035db0 2024-09-10T14:32:16.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.020+0000 7f7fbeffd640 1 -- 172.21.15.52:0/1620311813 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666056 (secure 0 0 0) 0x7f7fb80b1040 con 0x7f7fac035db0 2024-09-10T14:32:16.032 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:32:16.038 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:32:16.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7fac035db0 msgr2=0x7f7fac038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 --2- 172.21.15.52:0/1620311813 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7fac035db0 0x7f7fac038270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80ad000 tx=0x7f7fb8008040 comp rx=0 tx=0).stop 2024-09-10T14:32:16.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 msgr2=0x7f7fc8123b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 --2- 172.21.15.52:0/1620311813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8123b90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400c3a0 tx=0x7f7fc400c860 comp rx=0 tx=0).stop 2024-09-10T14:32:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 shutdown_connections 2024-09-10T14:32:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 --2- 172.21.15.52:0/1620311813 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f7fac035db0 0x7f7fac038270 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 --2- 172.21.15.52:0/1620311813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc806f190 0x7f7fc8123b90 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 >> 172.21.15.52:0/1620311813 conn(0x7f7fc8099a50 msgr2=0x7f7fc80913f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 shutdown_connections 2024-09-10T14:32:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.032+0000 7f7fd03e4640 1 -- 172.21.15.52:0/1620311813 wait complete. 2024-09-10T14:32:16.070 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-10T14:32:14.794985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416905,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4892,"num_read_kb":4469,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173832,"kb_used_data":36616,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313528,"statfs":{"total":386547056640,"available":386369052672,"internally_reserved":0,"allocated":37494784,"data_stored":36250830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005956"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786610+0000","last_change":"2024-09-10T14:28:28.910643+0000","last_active":"2024-09-10T14:29:08.786610+0000","last_peered":"2024-09-10T14:29:08.786610+0000","last_clean":"2024-09-10T14:29:08.786610+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:29:08.786610+0000","last_undegraded":"2024-09-10T14:29:08.786610+0000","last_fullsized":"2024-09-10T14:29:08.786610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:48.682064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743959+0000","last_change":"2024-09-10T14:28:30.866892+0000","last_active":"2024-09-10T14:29:15.743959+0000","last_peered":"2024-09-10T14:29:15.743959+0000","last_clean":"2024-09-10T14:29:15.743959+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:29:15.743959+0000","last_undegraded":"2024-09-10T14:29:15.743959+0000","last_fullsized":"2024-09-10T14:29:15.743959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.106885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.900665+0000","last_change":"2024-09-10T14:28:28.880130+0000","last_active":"2024-09-10T14:30:42.900665+0000","last_peered":"2024-09-10T14:30:42.900665+0000","last_clean":"2024-09-10T14:30:42.900665+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:30:42.900665+0000","last_undegraded":"2024-09-10T14:30:42.900665+0000","last_fullsized":"2024-09-10T14:30:42.900665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:27.360132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.874392+0000","last_change":"2024-09-10T14:28:30.882162+0000","last_active":"2024-09-10T14:31:43.874392+0000","last_peered":"2024-09-10T14:31:43.874392+0000","last_clean":"2024-09-10T14:31:43.874392+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:31:43.874392+0000","last_undegraded":"2024-09-10T14:31:43.874392+0000","last_fullsized":"2024-09-10T14:31:43.874392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:58.678590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779170+0000","last_change":"2024-09-10T14:28:28.879906+0000","last_active":"2024-09-10T14:29:08.779170+0000","last_peered":"2024-09-10T14:29:08.779170+0000","last_clean":"2024-09-10T14:29:08.779170+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:29:08.779170+0000","last_undegraded":"2024-09-10T14:29:08.779170+0000","last_fullsized":"2024-09-10T14:29:08.779170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:53.690949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072389+0000","last_change":"2024-09-10T14:28:30.882676+0000","last_active":"2024-09-10T14:31:44.072389+0000","last_peered":"2024-09-10T14:31:44.072389+0000","last_clean":"2024-09-10T14:31:44.072389+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:31:44.072389+0000","last_undegraded":"2024-09-10T14:31:44.072389+0000","last_fullsized":"2024-09-10T14:31:44.072389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:24.078737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.014030+0000","last_change":"2024-09-10T14:28:28.893233+0000","last_active":"2024-09-10T14:29:15.014030+0000","last_peered":"2024-09-10T14:29:15.014030+0000","last_clean":"2024-09-10T14:29:15.014030+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:29:15.014030+0000","last_undegraded":"2024-09-10T14:29:15.014030+0000","last_fullsized":"2024-09-10T14:29:15.014030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:11.076894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.045939+0000","last_change":"2024-09-10T14:28:30.881166+0000","last_active":"2024-09-10T14:30:39.045939+0000","last_peered":"2024-09-10T14:30:39.045939+0000","last_clean":"2024-09-10T14:30:39.045939+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:30:39.045939+0000","last_undegraded":"2024-09-10T14:30:39.045939+0000","last_fullsized":"2024-09-10T14:30:39.045939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:52.006581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770599+0000","last_change":"2024-09-10T14:28:28.883653+0000","last_active":"2024-09-10T14:29:08.770599+0000","last_peered":"2024-09-10T14:29:08.770599+0000","last_clean":"2024-09-10T14:29:08.770599+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:29:08.770599+0000","last_undegraded":"2024-09-10T14:29:08.770599+0000","last_fullsized":"2024-09-10T14:29:08.770599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:29.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.174109+0000","last_change":"2024-09-10T14:28:30.890087+0000","last_active":"2024-09-10T14:31:44.174109+0000","last_peered":"2024-09-10T14:31:44.174109+0000","last_clean":"2024-09-10T14:31:44.174109+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:31:44.174109+0000","last_undegraded":"2024-09-10T14:31:44.174109+0000","last_fullsized":"2024-09-10T14:31:44.174109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:24.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777518+0000","last_change":"2024-09-10T14:28:28.910148+0000","last_active":"2024-09-10T14:29:08.777518+0000","last_peered":"2024-09-10T14:29:08.777518+0000","last_clean":"2024-09-10T14:29:08.777518+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:29:08.777518+0000","last_undegraded":"2024-09-10T14:29:08.777518+0000","last_fullsized":"2024-09-10T14:29:08.777518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:47.128454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.736734+0000","last_change":"2024-09-10T14:28:30.875024+0000","last_active":"2024-09-10T14:31:43.736734+0000","last_peered":"2024-09-10T14:31:43.736734+0000","last_clean":"2024-09-10T14:31:43.736734+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:31:43.736734+0000","last_undegraded":"2024-09-10T14:31:43.736734+0000","last_fullsized":"2024-09-10T14:31:43.736734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:47.679026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770570+0000","last_change":"2024-09-10T14:28:28.890726+0000","last_active":"2024-09-10T14:29:08.770570+0000","last_peered":"2024-09-10T14:29:08.770570+0000","last_clean":"2024-09-10T14:29:08.770570+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:29:08.770570+0000","last_undegraded":"2024-09-10T14:29:08.770570+0000","last_fullsized":"2024-09-10T14:29:08.770570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:31.814715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'7","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.774452+0000","last_change":"2024-09-10T14:28:30.863498+0000","last_active":"2024-09-10T14:30:39.774452+0000","last_peered":"2024-09-10T14:30:39.774452+0000","last_clean":"2024-09-10T14:30:39.774452+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:30:39.774452+0000","last_undegraded":"2024-09-10T14:30:39.774452+0000","last_fullsized":"2024-09-10T14:30:39.774452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:34.818610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.089975+0000","last_change":"2024-09-10T14:28:28.876209+0000","last_active":"2024-09-10T14:29:09.089975+0000","last_peered":"2024-09-10T14:29:09.089975+0000","last_clean":"2024-09-10T14:29:09.089975+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:29:09.089975+0000","last_undegraded":"2024-09-10T14:29:09.089975+0000","last_fullsized":"2024-09-10T14:29:09.089975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:23.440776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.735816+0000","last_change":"2024-09-10T14:28:30.870535+0000","last_active":"2024-09-10T14:31:43.735816+0000","last_peered":"2024-09-10T14:31:43.735816+0000","last_clean":"2024-09-10T14:31:43.735816+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:31:43.735816+0000","last_undegraded":"2024-09-10T14:31:43.735816+0000","last_fullsized":"2024-09-10T14:31:43.735816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:16.469019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158427+0000","last_change":"2024-09-10T14:28:30.875126+0000","last_active":"2024-09-10T14:31:44.158427+0000","last_peered":"2024-09-10T14:31:44.158427+0000","last_clean":"2024-09-10T14:31:44.158427+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:31:44.158427+0000","last_undegraded":"2024-09-10T14:31:44.158427+0000","last_fullsized":"2024-09-10T14:31:44.158427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:31.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.790246+0000","last_change":"2024-09-10T14:28:28.902646+0000","last_active":"2024-09-10T14:29:08.790246+0000","last_peered":"2024-09-10T14:29:08.790246+0000","last_clean":"2024-09-10T14:29:08.790246+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:29:08.790246+0000","last_undegraded":"2024-09-10T14:29:08.790246+0000","last_fullsized":"2024-09-10T14:29:08.790246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:06.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071851+0000","last_change":"2024-09-10T14:28:30.871743+0000","last_active":"2024-09-10T14:31:44.071851+0000","last_peered":"2024-09-10T14:31:44.071851+0000","last_clean":"2024-09-10T14:31:44.071851+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:31:44.071851+0000","last_undegraded":"2024-09-10T14:31:44.071851+0000","last_fullsized":"2024-09-10T14:31:44.071851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:02.612612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788313+0000","last_change":"2024-09-10T14:28:28.913772+0000","last_active":"2024-09-10T14:29:08.788313+0000","last_peered":"2024-09-10T14:29:08.788313+0000","last_clean":"2024-09-10T14:29:08.788313+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:29:08.788313+0000","last_undegraded":"2024-09-10T14:29:08.788313+0000","last_fullsized":"2024-09-10T14:29:08.788313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:33.401745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.731033+0000","last_change":"2024-09-10T14:28:30.866947+0000","last_active":"2024-09-10T14:31:43.731033+0000","last_peered":"2024-09-10T14:31:43.731033+0000","last_clean":"2024-09-10T14:31:43.731033+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:31:43.731033+0000","last_undegraded":"2024-09-10T14:31:43.731033+0000","last_fullsized":"2024-09-10T14:31:43.731033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:33.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787811+0000","last_change":"2024-09-10T14:28:28.904198+0000","last_active":"2024-09-10T14:29:08.787811+0000","last_peered":"2024-09-10T14:29:08.787811+0000","last_clean":"2024-09-10T14:29:08.787811+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:29:08.787811+0000","last_undegraded":"2024-09-10T14:29:08.787811+0000","last_fullsized":"2024-09-10T14:29:08.787811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.028308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071682+0000","last_change":"2024-09-10T14:28:30.886686+0000","last_active":"2024-09-10T14:31:44.071682+0000","last_peered":"2024-09-10T14:31:44.071682+0000","last_clean":"2024-09-10T14:31:44.071682+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:44.071682+0000","last_undegraded":"2024-09-10T14:31:44.071682+0000","last_fullsized":"2024-09-10T14:31:44.071682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:43.469877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.020496+0000","last_change":"2024-09-10T14:28:28.888634+0000","last_active":"2024-09-10T14:29:15.020496+0000","last_peered":"2024-09-10T14:29:15.020496+0000","last_clean":"2024-09-10T14:29:15.020496+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:29:15.020496+0000","last_undegraded":"2024-09-10T14:29:15.020496+0000","last_fullsized":"2024-09-10T14:29:15.020496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:53.922561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158256+0000","last_change":"2024-09-10T14:28:30.870293+0000","last_active":"2024-09-10T14:31:44.158256+0000","last_peered":"2024-09-10T14:31:44.158256+0000","last_clean":"2024-09-10T14:31:44.158256+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:31:44.158256+0000","last_undegraded":"2024-09-10T14:31:44.158256+0000","last_fullsized":"2024-09-10T14:31:44.158256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:43.141173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.026158+0000","last_change":"2024-09-10T14:28:28.880689+0000","last_active":"2024-09-10T14:29:15.026158+0000","last_peered":"2024-09-10T14:29:15.026158+0000","last_clean":"2024-09-10T14:29:15.026158+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:29:15.026158+0000","last_undegraded":"2024-09-10T14:29:15.026158+0000","last_fullsized":"2024-09-10T14:29:15.026158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:06.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.046094+0000","last_change":"2024-09-10T14:28:30.889817+0000","last_active":"2024-09-10T14:30:39.046094+0000","last_peered":"2024-09-10T14:30:39.046094+0000","last_clean":"2024-09-10T14:30:39.046094+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:30:39.046094+0000","last_undegraded":"2024-09-10T14:30:39.046094+0000","last_fullsized":"2024-09-10T14:30:39.046094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:39.111758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770582+0000","last_change":"2024-09-10T14:28:28.891649+0000","last_active":"2024-09-10T14:29:08.770582+0000","last_peered":"2024-09-10T14:29:08.770582+0000","last_clean":"2024-09-10T14:29:08.770582+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:29:08.770582+0000","last_undegraded":"2024-09-10T14:29:08.770582+0000","last_fullsized":"2024-09-10T14:29:08.770582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:27.536920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.117237+0000","last_change":"2024-09-10T14:28:38.936524+0000","last_active":"2024-09-10T14:31:44.117237+0000","last_peered":"2024-09-10T14:31:44.117237+0000","last_clean":"2024-09-10T14:31:44.117237+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:31:44.117237+0000","last_undegraded":"2024-09-10T14:31:44.117237+0000","last_fullsized":"2024-09-10T14:31:44.117237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:46.216225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.756204+0000","last_change":"2024-09-10T14:29:07.798075+0000","last_active":"2024-09-10T14:29:09.756204+0000","last_peered":"2024-09-10T14:29:09.756204+0000","last_clean":"2024-09-10T14:29:09.756204+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:29:09.756204+0000","last_undegraded":"2024-09-10T14:29:09.756204+0000","last_fullsized":"2024-09-10T14:29:09.756204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:42.171906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770128+0000","last_change":"2024-09-10T14:28:28.894485+0000","last_active":"2024-09-10T14:29:08.770128+0000","last_peered":"2024-09-10T14:29:08.770128+0000","last_clean":"2024-09-10T14:29:08.770128+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:29:08.770128+0000","last_undegraded":"2024-09-10T14:29:08.770128+0000","last_fullsized":"2024-09-10T14:29:08.770128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:00.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776839+0000","last_change":"2024-09-10T14:28:32.888789+0000","last_active":"2024-09-10T14:29:08.776839+0000","last_peered":"2024-09-10T14:29:08.776839+0000","last_clean":"2024-09-10T14:29:08.776839+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:29:08.776839+0000","last_undegraded":"2024-09-10T14:29:08.776839+0000","last_fullsized":"2024-09-10T14:29:08.776839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:23.555023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'31","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.122649+0000","last_change":"2024-09-10T14:28:34.924424+0000","last_active":"2024-09-10T14:30:41.122649+0000","last_peered":"2024-09-10T14:30:41.122649+0000","last_clean":"2024-09-10T14:30:41.122649+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:30:41.122649+0000","last_undegraded":"2024-09-10T14:30:41.122649+0000","last_fullsized":"2024-09-10T14:30:41.122649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:02.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.790013+0000","last_change":"2024-09-10T14:28:36.938810+0000","last_active":"2024-09-10T14:29:08.790013+0000","last_peered":"2024-09-10T14:29:08.790013+0000","last_clean":"2024-09-10T14:29:08.790013+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:29:08.790013+0000","last_undegraded":"2024-09-10T14:29:08.790013+0000","last_fullsized":"2024-09-10T14:29:08.790013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:28.542198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.081040+0000","last_change":"2024-09-10T14:28:38.938155+0000","last_active":"2024-09-10T14:29:58.081040+0000","last_peered":"2024-09-10T14:29:58.081040+0000","last_clean":"2024-09-10T14:29:58.081040+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:29:58.081040+0000","last_undegraded":"2024-09-10T14:29:58.081040+0000","last_fullsized":"2024-09-10T14:29:58.081040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:16.961180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.731924+0000","last_change":"2024-09-10T14:28:30.876193+0000","last_active":"2024-09-10T14:31:43.731924+0000","last_peered":"2024-09-10T14:31:43.731924+0000","last_clean":"2024-09-10T14:31:43.731924+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:31:43.731924+0000","last_undegraded":"2024-09-10T14:31:43.731924+0000","last_fullsized":"2024-09-10T14:31:43.731924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.676792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776547+0000","last_change":"2024-09-10T14:28:28.895357+0000","last_active":"2024-09-10T14:30:49.776547+0000","last_peered":"2024-09-10T14:30:49.776547+0000","last_clean":"2024-09-10T14:30:49.776547+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:30:49.776547+0000","last_undegraded":"2024-09-10T14:30:49.776547+0000","last_fullsized":"2024-09-10T14:30:49.776547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.503117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099939+0000","last_change":"2024-09-10T14:28:32.878643+0000","last_active":"2024-09-10T14:29:09.099939+0000","last_peered":"2024-09-10T14:29:09.099939+0000","last_clean":"2024-09-10T14:29:09.099939+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:29:09.099939+0000","last_undegraded":"2024-09-10T14:29:09.099939+0000","last_fullsized":"2024-09-10T14:29:09.099939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:40.671350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788992+0000","last_change":"2024-09-10T14:28:34.889859+0000","last_active":"2024-09-10T14:29:08.788992+0000","last_peered":"2024-09-10T14:29:08.788992+0000","last_clean":"2024-09-10T14:29:08.788992+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:29:08.788992+0000","last_undegraded":"2024-09-10T14:29:08.788992+0000","last_fullsized":"2024-09-10T14:29:08.788992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:01.183310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788847+0000","last_change":"2024-09-10T14:28:36.934864+0000","last_active":"2024-09-10T14:29:08.788847+0000","last_peered":"2024-09-10T14:29:08.788847+0000","last_clean":"2024-09-10T14:29:08.788847+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:29:08.788847+0000","last_undegraded":"2024-09-10T14:29:08.788847+0000","last_fullsized":"2024-09-10T14:29:08.788847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.099079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095653+0000","last_change":"2024-09-10T14:28:38.928569+0000","last_active":"2024-09-10T14:29:09.095653+0000","last_peered":"2024-09-10T14:29:09.095653+0000","last_clean":"2024-09-10T14:29:09.095653+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:29:09.095653+0000","last_undegraded":"2024-09-10T14:29:09.095653+0000","last_fullsized":"2024-09-10T14:29:09.095653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:44.292475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787199+0000","last_change":"2024-09-10T14:28:30.879918+0000","last_active":"2024-09-10T14:30:58.787199+0000","last_peered":"2024-09-10T14:30:58.787199+0000","last_clean":"2024-09-10T14:30:58.787199+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:30:58.787199+0000","last_undegraded":"2024-09-10T14:30:58.787199+0000","last_fullsized":"2024-09-10T14:30:58.787199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:58.593808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784157+0000","last_change":"2024-09-10T14:28:28.890448+0000","last_active":"2024-09-10T14:30:48.784157+0000","last_peered":"2024-09-10T14:30:48.784157+0000","last_clean":"2024-09-10T14:30:48.784157+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:30:48.784157+0000","last_undegraded":"2024-09-10T14:30:48.784157+0000","last_fullsized":"2024-09-10T14:30:48.784157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:42.170026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.105820+0000","last_change":"2024-09-10T14:28:32.878770+0000","last_active":"2024-09-10T14:29:09.105820+0000","last_peered":"2024-09-10T14:29:09.105820+0000","last_clean":"2024-09-10T14:29:09.105820+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:29:09.105820+0000","last_undegraded":"2024-09-10T14:29:09.105820+0000","last_fullsized":"2024-09-10T14:29:09.105820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.818547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.780586+0000","last_change":"2024-09-10T14:28:34.899375+0000","last_active":"2024-09-10T14:29:08.780586+0000","last_peered":"2024-09-10T14:29:08.780586+0000","last_clean":"2024-09-10T14:29:08.780586+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:29:08.780586+0000","last_undegraded":"2024-09-10T14:29:08.780586+0000","last_fullsized":"2024-09-10T14:29:08.780586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:14.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120357+0000","last_change":"2024-09-10T14:28:36.944400+0000","last_active":"2024-09-10T14:31:43.120357+0000","last_peered":"2024-09-10T14:31:43.120357+0000","last_clean":"2024-09-10T14:31:43.120357+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:31:43.120357+0000","last_undegraded":"2024-09-10T14:31:43.120357+0000","last_fullsized":"2024-09-10T14:31:43.120357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:47.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.039826+0000","last_change":"2024-09-10T14:28:38.944662+0000","last_active":"2024-09-10T14:29:15.039826+0000","last_peered":"2024-09-10T14:29:15.039826+0000","last_clean":"2024-09-10T14:29:15.039826+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:29:15.039826+0000","last_undegraded":"2024-09-10T14:29:15.039826+0000","last_fullsized":"2024-09-10T14:29:15.039826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:11.695801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.888919+0000","last_change":"2024-09-10T14:28:30.884927+0000","last_active":"2024-09-10T14:31:43.888919+0000","last_peered":"2024-09-10T14:31:43.888919+0000","last_clean":"2024-09-10T14:31:43.888919+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:31:43.888919+0000","last_undegraded":"2024-09-10T14:31:43.888919+0000","last_fullsized":"2024-09-10T14:31:43.888919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:44.179281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.775615+0000","last_change":"2024-09-10T14:28:28.898609+0000","last_active":"2024-09-10T14:29:08.775615+0000","last_peered":"2024-09-10T14:29:08.775615+0000","last_clean":"2024-09-10T14:29:08.775615+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:29:08.775615+0000","last_undegraded":"2024-09-10T14:29:08.775615+0000","last_fullsized":"2024-09-10T14:29:08.775615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:14.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'4","reported_seq":228,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.577706+0000","last_change":"2024-09-10T14:28:32.888011+0000","last_active":"2024-09-10T14:30:42.577706+0000","last_peered":"2024-09-10T14:30:42.577706+0000","last_clean":"2024-09-10T14:30:42.577706+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:30:42.577706+0000","last_undegraded":"2024-09-10T14:30:42.577706+0000","last_fullsized":"2024-09-10T14:30:42.577706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:37.315922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.114910+0000","last_change":"2024-09-10T14:28:34.904591+0000","last_active":"2024-09-10T14:30:41.114910+0000","last_peered":"2024-09-10T14:30:41.114910+0000","last_clean":"2024-09-10T14:30:41.114910+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:30:41.114910+0000","last_undegraded":"2024-09-10T14:30:41.114910+0000","last_fullsized":"2024-09-10T14:30:41.114910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:15.929628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.235240+0000","last_change":"2024-09-10T14:28:36.902535+0000","last_active":"2024-09-10T14:31:44.235240+0000","last_peered":"2024-09-10T14:31:44.235240+0000","last_clean":"2024-09-10T14:31:44.235240+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:31:44.235240+0000","last_undegraded":"2024-09-10T14:31:44.235240+0000","last_fullsized":"2024-09-10T14:31:44.235240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:44.147166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.731663+0000","last_change":"2024-09-10T14:28:30.870811+0000","last_active":"2024-09-10T14:29:14.731663+0000","last_peered":"2024-09-10T14:29:14.731663+0000","last_clean":"2024-09-10T14:29:14.731663+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:29:14.731663+0000","last_undegraded":"2024-09-10T14:29:14.731663+0000","last_fullsized":"2024-09-10T14:29:14.731663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:38.431813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786131+0000","last_change":"2024-09-10T14:28:28.910600+0000","last_active":"2024-09-10T14:29:08.786131+0000","last_peered":"2024-09-10T14:29:08.786131+0000","last_clean":"2024-09-10T14:29:08.786131+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:29:08.786131+0000","last_undegraded":"2024-09-10T14:29:08.786131+0000","last_fullsized":"2024-09-10T14:29:08.786131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:28.271184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776997+0000","last_change":"2024-09-10T14:28:32.888462+0000","last_active":"2024-09-10T14:29:08.776997+0000","last_peered":"2024-09-10T14:29:08.776997+0000","last_clean":"2024-09-10T14:29:08.776997+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:29:08.776997+0000","last_undegraded":"2024-09-10T14:29:08.776997+0000","last_fullsized":"2024-09-10T14:29:08.776997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.818547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.128780+0000","last_change":"2024-09-10T14:28:34.891163+0000","last_active":"2024-09-10T14:30:41.128780+0000","last_peered":"2024-09-10T14:30:41.128780+0000","last_clean":"2024-09-10T14:30:41.128780+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:30:41.128780+0000","last_undegraded":"2024-09-10T14:30:41.128780+0000","last_fullsized":"2024-09-10T14:30:41.128780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:43.916591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095295+0000","last_change":"2024-09-10T14:28:36.914343+0000","last_active":"2024-09-10T14:29:09.095295+0000","last_peered":"2024-09-10T14:29:09.095295+0000","last_clean":"2024-09-10T14:29:09.095295+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:29:09.095295+0000","last_undegraded":"2024-09-10T14:29:09.095295+0000","last_fullsized":"2024-09-10T14:29:09.095295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:44.165530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.084003+0000","last_change":"2024-09-10T14:28:38.934568+0000","last_active":"2024-09-10T14:29:58.084003+0000","last_peered":"2024-09-10T14:29:58.084003+0000","last_clean":"2024-09-10T14:29:58.084003+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:29:58.084003+0000","last_undegraded":"2024-09-10T14:29:58.084003+0000","last_fullsized":"2024-09-10T14:29:58.084003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:16.561899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.781133+0000","last_change":"2024-09-10T14:28:30.867445+0000","last_active":"2024-09-10T14:30:43.781133+0000","last_peered":"2024-09-10T14:30:43.781133+0000","last_clean":"2024-09-10T14:30:43.781133+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:30:43.781133+0000","last_undegraded":"2024-09-10T14:30:43.781133+0000","last_fullsized":"2024-09-10T14:30:43.781133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:43.469877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786715+0000","last_change":"2024-09-10T14:28:28.895275+0000","last_active":"2024-09-10T14:29:08.786715+0000","last_peered":"2024-09-10T14:29:08.786715+0000","last_clean":"2024-09-10T14:29:08.786715+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:29:08.786715+0000","last_undegraded":"2024-09-10T14:29:08.786715+0000","last_fullsized":"2024-09-10T14:29:08.786715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.143838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096657+0000","last_change":"2024-09-10T14:28:32.877092+0000","last_active":"2024-09-10T14:29:09.096657+0000","last_peered":"2024-09-10T14:29:09.096657+0000","last_clean":"2024-09-10T14:29:09.096657+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:29:09.096657+0000","last_undegraded":"2024-09-10T14:29:09.096657+0000","last_fullsized":"2024-09-10T14:29:09.096657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:27.977679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.100623+0000","last_change":"2024-09-10T14:28:34.915801+0000","last_active":"2024-09-10T14:30:41.100623+0000","last_peered":"2024-09-10T14:30:41.100623+0000","last_clean":"2024-09-10T14:30:41.100623+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:30:41.100623+0000","last_undegraded":"2024-09-10T14:30:41.100623+0000","last_fullsized":"2024-09-10T14:30:41.100623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:45.906678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.090834+0000","last_change":"2024-09-10T14:28:36.924324+0000","last_active":"2024-09-10T14:29:09.090834+0000","last_peered":"2024-09-10T14:29:09.090834+0000","last_clean":"2024-09-10T14:29:09.090834+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:29:09.090834+0000","last_undegraded":"2024-09-10T14:29:09.090834+0000","last_fullsized":"2024-09-10T14:29:09.090834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:03.128287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'5","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:52.401551+0000","last_change":"2024-09-10T14:28:38.933258+0000","last_active":"2024-09-10T14:29:52.401551+0000","last_peered":"2024-09-10T14:29:52.401551+0000","last_clean":"2024-09-10T14:29:52.401551+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:29:52.401551+0000","last_undegraded":"2024-09-10T14:29:52.401551+0000","last_fullsized":"2024-09-10T14:29:52.401551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:44.292475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.156496+0000","last_change":"2024-09-10T14:29:07.803940+0000","last_active":"2024-09-10T14:31:44.156496+0000","last_peered":"2024-09-10T14:31:44.156496+0000","last_clean":"2024-09-10T14:31:44.156496+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:31:44.156496+0000","last_undegraded":"2024-09-10T14:31:44.156496+0000","last_fullsized":"2024-09-10T14:31:44.156496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:14.995711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778671+0000","last_change":"2024-09-10T14:28:28.889610+0000","last_active":"2024-09-10T14:29:08.778671+0000","last_peered":"2024-09-10T14:29:08.778671+0000","last_clean":"2024-09-10T14:29:08.778671+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:29:08.778671+0000","last_undegraded":"2024-09-10T14:29:08.778671+0000","last_fullsized":"2024-09-10T14:29:08.778671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:27.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099744+0000","last_change":"2024-09-10T14:28:32.877306+0000","last_active":"2024-09-10T14:29:09.099744+0000","last_peered":"2024-09-10T14:29:09.099744+0000","last_clean":"2024-09-10T14:29:09.099744+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:29:09.099744+0000","last_undegraded":"2024-09-10T14:29:09.099744+0000","last_fullsized":"2024-09-10T14:29:09.099744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:59.002429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.130848+0000","last_change":"2024-09-10T14:28:34.910458+0000","last_active":"2024-09-10T14:30:41.130848+0000","last_peered":"2024-09-10T14:30:41.130848+0000","last_clean":"2024-09-10T14:30:41.130848+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:30:41.130848+0000","last_undegraded":"2024-09-10T14:30:41.130848+0000","last_fullsized":"2024-09-10T14:30:41.130848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:11.614047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":357,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.421931+0000","last_change":"2024-09-10T14:28:36.924500+0000","last_active":"2024-09-10T14:31:44.421931+0000","last_peered":"2024-09-10T14:31:44.421931+0000","last_clean":"2024-09-10T14:31:44.421931+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:31:44.421931+0000","last_undegraded":"2024-09-10T14:31:44.421931+0000","last_fullsized":"2024-09-10T14:31:44.421931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:18.061873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.102731+0000","last_change":"2024-09-10T14:28:38.936021+0000","last_active":"2024-09-10T14:29:09.102731+0000","last_peered":"2024-09-10T14:29:09.102731+0000","last_clean":"2024-09-10T14:29:09.102731+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:29:09.102731+0000","last_undegraded":"2024-09-10T14:29:09.102731+0000","last_fullsized":"2024-09-10T14:29:09.102731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'11","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776609+0000","last_change":"2024-09-10T14:28:30.859489+0000","last_active":"2024-09-10T14:30:49.776609+0000","last_peered":"2024-09-10T14:30:49.776609+0000","last_clean":"2024-09-10T14:30:49.776609+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:30:49.776609+0000","last_undegraded":"2024-09-10T14:30:49.776609+0000","last_fullsized":"2024-09-10T14:30:49.776609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:12.219239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770620+0000","last_change":"2024-09-10T14:28:28.884739+0000","last_active":"2024-09-10T14:29:08.770620+0000","last_peered":"2024-09-10T14:29:08.770620+0000","last_clean":"2024-09-10T14:29:08.770620+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:29:08.770620+0000","last_undegraded":"2024-09-10T14:29:08.770620+0000","last_fullsized":"2024-09-10T14:29:08.770620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:09.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"26'1","reported_seq":220,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.591860+0000","last_change":"2024-09-10T14:28:32.883434+0000","last_active":"2024-09-10T14:30:42.591860+0000","last_peered":"2024-09-10T14:30:42.591860+0000","last_clean":"2024-09-10T14:30:42.591860+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:30:42.591860+0000","last_undegraded":"2024-09-10T14:30:42.591860+0000","last_fullsized":"2024-09-10T14:30:42.591860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:15.866979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'55","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.132850+0000","last_change":"2024-09-10T14:28:34.914638+0000","last_active":"2024-09-10T14:30:41.132850+0000","last_peered":"2024-09-10T14:30:41.132850+0000","last_clean":"2024-09-10T14:30:41.132850+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:30:41.132850+0000","last_undegraded":"2024-09-10T14:30:41.132850+0000","last_fullsized":"2024-09-10T14:30:41.132850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:09.979440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.092054+0000","last_change":"2024-09-10T14:28:36.903930+0000","last_active":"2024-09-10T14:29:09.092054+0000","last_peered":"2024-09-10T14:29:09.092054+0000","last_clean":"2024-09-10T14:29:09.092054+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:29:09.092054+0000","last_undegraded":"2024-09-10T14:29:09.092054+0000","last_fullsized":"2024-09-10T14:29:09.092054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:07.331691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'20","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.381980+0000","last_change":"2024-09-10T14:28:38.919907+0000","last_active":"2024-09-10T14:31:44.381980+0000","last_peered":"2024-09-10T14:31:44.381980+0000","last_clean":"2024-09-10T14:31:44.381980+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:31:44.381980+0000","last_undegraded":"2024-09-10T14:31:44.381980+0000","last_fullsized":"2024-09-10T14:31:44.381980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:42:57.760263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.889287+0000","last_change":"2024-09-10T14:28:30.878590+0000","last_active":"2024-09-10T14:31:43.889287+0000","last_peered":"2024-09-10T14:31:43.889287+0000","last_clean":"2024-09-10T14:31:43.889287+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:31:43.889287+0000","last_undegraded":"2024-09-10T14:31:43.889287+0000","last_fullsized":"2024-09-10T14:31:43.889287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:43.722443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096578+0000","last_change":"2024-09-10T14:28:28.877127+0000","last_active":"2024-09-10T14:29:09.096578+0000","last_peered":"2024-09-10T14:29:09.096578+0000","last_clean":"2024-09-10T14:29:09.096578+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:29:09.096578+0000","last_undegraded":"2024-09-10T14:29:09.096578+0000","last_fullsized":"2024-09-10T14:29:09.096578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:00.704953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.785811+0000","last_change":"2024-09-10T14:28:32.878178+0000","last_active":"2024-09-10T14:29:08.785811+0000","last_peered":"2024-09-10T14:29:08.785811+0000","last_clean":"2024-09-10T14:29:08.785811+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:29:08.785811+0000","last_undegraded":"2024-09-10T14:29:08.785811+0000","last_fullsized":"2024-09-10T14:29:08.785811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:56.990523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.105783+0000","last_change":"2024-09-10T14:28:34.889384+0000","last_active":"2024-09-10T14:30:41.105783+0000","last_peered":"2024-09-10T14:30:41.105783+0000","last_clean":"2024-09-10T14:30:41.105783+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:30:41.105783+0000","last_undegraded":"2024-09-10T14:30:41.105783+0000","last_fullsized":"2024-09-10T14:30:41.105783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:56.353841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779998+0000","last_change":"2024-09-10T14:28:36.946071+0000","last_active":"2024-09-10T14:29:08.779998+0000","last_peered":"2024-09-10T14:29:08.779998+0000","last_clean":"2024-09-10T14:29:08.779998+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:29:08.779998+0000","last_undegraded":"2024-09-10T14:29:08.779998+0000","last_fullsized":"2024-09-10T14:29:08.779998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:45.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:40.722091+0000","last_change":"2024-09-10T14:28:38.941887+0000","last_active":"2024-09-10T14:30:40.722091+0000","last_peered":"2024-09-10T14:30:40.722091+0000","last_clean":"2024-09-10T14:30:40.722091+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:30:40.722091+0000","last_undegraded":"2024-09-10T14:30:40.722091+0000","last_fullsized":"2024-09-10T14:30:40.722091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:09.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.376108+0000","last_change":"2024-09-10T14:28:30.890869+0000","last_active":"2024-09-10T14:29:58.376108+0000","last_peered":"2024-09-10T14:29:58.376108+0000","last_clean":"2024-09-10T14:29:58.376108+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:29:58.376108+0000","last_undegraded":"2024-09-10T14:29:58.376108+0000","last_fullsized":"2024-09-10T14:29:58.376108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:33.087704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.490899+0000","last_change":"2024-09-10T14:28:28.891910+0000","last_active":"2024-09-10T14:29:13.490899+0000","last_peered":"2024-09-10T14:29:13.490899+0000","last_clean":"2024-09-10T14:29:13.490899+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:29:13.490899+0000","last_undegraded":"2024-09-10T14:29:13.490899+0000","last_fullsized":"2024-09-10T14:29:13.490899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:44.681521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099970+0000","last_change":"2024-09-10T14:28:32.877582+0000","last_active":"2024-09-10T14:29:09.099970+0000","last_peered":"2024-09-10T14:29:09.099970+0000","last_clean":"2024-09-10T14:29:09.099970+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:29:09.099970+0000","last_undegraded":"2024-09-10T14:29:09.099970+0000","last_fullsized":"2024-09-10T14:29:09.099970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:31.749719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.144934+0000","last_change":"2024-09-10T14:28:34.898334+0000","last_active":"2024-09-10T14:30:41.144934+0000","last_peered":"2024-09-10T14:30:41.144934+0000","last_clean":"2024-09-10T14:30:41.144934+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:30:41.144934+0000","last_undegraded":"2024-09-10T14:30:41.144934+0000","last_fullsized":"2024-09-10T14:30:41.144934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:56.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.408033+0000","last_change":"2024-09-10T14:28:36.937021+0000","last_active":"2024-09-10T14:31:44.408033+0000","last_peered":"2024-09-10T14:31:44.408033+0000","last_clean":"2024-09-10T14:31:44.408033+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:31:44.408033+0000","last_undegraded":"2024-09-10T14:31:44.408033+0000","last_fullsized":"2024-09-10T14:31:44.408033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:41.213212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776838+0000","last_change":"2024-09-10T14:28:38.936015+0000","last_active":"2024-09-10T14:30:47.776838+0000","last_peered":"2024-09-10T14:30:47.776838+0000","last_clean":"2024-09-10T14:30:47.776838+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:30:47.776838+0000","last_undegraded":"2024-09-10T14:30:47.776838+0000","last_fullsized":"2024-09-10T14:30:47.776838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:08.718072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.734924+0000","last_change":"2024-09-10T14:28:30.869152+0000","last_active":"2024-09-10T14:31:43.734924+0000","last_peered":"2024-09-10T14:31:43.734924+0000","last_clean":"2024-09-10T14:31:43.734924+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:31:43.734924+0000","last_undegraded":"2024-09-10T14:31:43.734924+0000","last_fullsized":"2024-09-10T14:31:43.734924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:29.230753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.213357+0000","last_change":"2024-09-10T14:28:28.890431+0000","last_active":"2024-09-10T14:31:44.213357+0000","last_peered":"2024-09-10T14:31:44.213357+0000","last_clean":"2024-09-10T14:31:44.213357+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:31:44.213357+0000","last_undegraded":"2024-09-10T14:31:44.213357+0000","last_fullsized":"2024-09-10T14:31:44.213357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:22.573383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.590739+0000","last_change":"2024-09-10T14:28:32.884446+0000","last_active":"2024-09-10T14:30:42.590739+0000","last_peered":"2024-09-10T14:30:42.590739+0000","last_clean":"2024-09-10T14:30:42.590739+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:30:42.590739+0000","last_undegraded":"2024-09-10T14:30:42.590739+0000","last_fullsized":"2024-09-10T14:30:42.590739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:15.273266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777108+0000","last_change":"2024-09-10T14:28:34.926311+0000","last_active":"2024-09-10T14:29:08.777108+0000","last_peered":"2024-09-10T14:29:08.777108+0000","last_clean":"2024-09-10T14:29:08.777108+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:29:08.777108+0000","last_undegraded":"2024-09-10T14:29:08.777108+0000","last_fullsized":"2024-09-10T14:29:08.777108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:40.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.335621+0000","last_change":"2024-09-10T14:28:36.922620+0000","last_active":"2024-09-10T14:31:44.335621+0000","last_peered":"2024-09-10T14:31:44.335621+0000","last_clean":"2024-09-10T14:31:44.335621+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:31:44.335621+0000","last_undegraded":"2024-09-10T14:31:44.335621+0000","last_fullsized":"2024-09-10T14:31:44.335621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:18.061873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.752153+0000","last_change":"2024-09-10T14:28:38.929142+0000","last_active":"2024-09-10T14:30:42.752153+0000","last_peered":"2024-09-10T14:30:42.752153+0000","last_clean":"2024-09-10T14:30:42.752153+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:30:42.752153+0000","last_undegraded":"2024-09-10T14:30:42.752153+0000","last_fullsized":"2024-09-10T14:30:42.752153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:15.327806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.324515+0000","last_change":"2024-09-10T14:28:30.889847+0000","last_active":"2024-09-10T14:31:44.324515+0000","last_peered":"2024-09-10T14:31:44.324515+0000","last_clean":"2024-09-10T14:31:44.324515+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:31:44.324515+0000","last_undegraded":"2024-09-10T14:31:44.324515+0000","last_fullsized":"2024-09-10T14:31:44.324515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:48.295547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768939+0000","last_change":"2024-09-10T14:28:28.894339+0000","last_active":"2024-09-10T14:29:08.768939+0000","last_peered":"2024-09-10T14:29:08.768939+0000","last_clean":"2024-09-10T14:29:08.768939+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:29:08.768939+0000","last_undegraded":"2024-09-10T14:29:08.768939+0000","last_fullsized":"2024-09-10T14:29:08.768939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:03.473546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779727+0000","last_change":"2024-09-10T14:28:32.891418+0000","last_active":"2024-09-10T14:29:08.779727+0000","last_peered":"2024-09-10T14:29:08.779727+0000","last_clean":"2024-09-10T14:29:08.779727+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:29:08.779727+0000","last_undegraded":"2024-09-10T14:29:08.779727+0000","last_fullsized":"2024-09-10T14:29:08.779727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:11.007860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'39","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783888+0000","last_change":"2024-09-10T14:28:34.889216+0000","last_active":"2024-09-10T14:30:53.783888+0000","last_peered":"2024-09-10T14:30:53.783888+0000","last_clean":"2024-09-10T14:30:53.783888+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:30:53.783888+0000","last_undegraded":"2024-09-10T14:30:53.783888+0000","last_fullsized":"2024-09-10T14:30:53.783888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:53.887819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778786+0000","last_change":"2024-09-10T14:28:36.938371+0000","last_active":"2024-09-10T14:29:08.778786+0000","last_peered":"2024-09-10T14:29:08.778786+0000","last_clean":"2024-09-10T14:29:08.778786+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:29:08.778786+0000","last_undegraded":"2024-09-10T14:29:08.778786+0000","last_fullsized":"2024-09-10T14:29:08.778786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:53.099481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.294156+0000","last_change":"2024-09-10T14:28:38.912768+0000","last_active":"2024-09-10T14:31:44.294156+0000","last_peered":"2024-09-10T14:31:44.294156+0000","last_clean":"2024-09-10T14:31:44.294156+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:31:44.294156+0000","last_undegraded":"2024-09-10T14:31:44.294156+0000","last_fullsized":"2024-09-10T14:31:44.294156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:20.861557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158954+0000","last_change":"2024-09-10T14:28:30.890682+0000","last_active":"2024-09-10T14:31:44.158954+0000","last_peered":"2024-09-10T14:31:44.158954+0000","last_clean":"2024-09-10T14:31:44.158954+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:31:44.158954+0000","last_undegraded":"2024-09-10T14:31:44.158954+0000","last_fullsized":"2024-09-10T14:31:44.158954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:17.279062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774963+0000","last_change":"2024-09-10T14:28:16.789816+0000","last_active":"2024-09-10T14:29:08.774963+0000","last_peered":"2024-09-10T14:29:08.774963+0000","last_clean":"2024-09-10T14:29:08.774963+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:29:08.774963+0000","last_undegraded":"2024-09-10T14:29:08.774963+0000","last_fullsized":"2024-09-10T14:29:08.774963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_clean_scrub_stamp":"2024-09-10T14:28:14.781430+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:16.536869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770870+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:29:08.770870+0000","last_peered":"2024-09-10T14:29:08.770870+0000","last_clean":"2024-09-10T14:29:08.770870+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:29:08.770870+0000","last_undegraded":"2024-09-10T14:29:08.770870+0000","last_fullsized":"2024-09-10T14:29:08.770870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:14.334391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.049324+0000","last_change":"2024-09-10T14:28:28.892198+0000","last_active":"2024-09-10T14:30:43.049324+0000","last_peered":"2024-09-10T14:30:43.049324+0000","last_clean":"2024-09-10T14:30:43.049324+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:30:43.049324+0000","last_undegraded":"2024-09-10T14:30:43.049324+0000","last_fullsized":"2024-09-10T14:30:43.049324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:02.556246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782315+0000","last_change":"2024-09-10T14:28:32.883286+0000","last_active":"2024-09-10T14:29:08.782315+0000","last_peered":"2024-09-10T14:29:08.782315+0000","last_clean":"2024-09-10T14:29:08.782315+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:29:08.782315+0000","last_undegraded":"2024-09-10T14:29:08.782315+0000","last_fullsized":"2024-09-10T14:29:08.782315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:49.691689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.140053+0000","last_change":"2024-09-10T14:28:34.925793+0000","last_active":"2024-09-10T14:30:41.140053+0000","last_peered":"2024-09-10T14:30:41.140053+0000","last_clean":"2024-09-10T14:30:41.140053+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:30:41.140053+0000","last_undegraded":"2024-09-10T14:30:41.140053+0000","last_fullsized":"2024-09-10T14:30:41.140053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:01.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095816+0000","last_change":"2024-09-10T14:28:36.925074+0000","last_active":"2024-09-10T14:29:09.095816+0000","last_peered":"2024-09-10T14:29:09.095816+0000","last_clean":"2024-09-10T14:29:09.095816+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:29:09.095816+0000","last_undegraded":"2024-09-10T14:29:09.095816+0000","last_fullsized":"2024-09-10T14:29:09.095816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:41.342463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.251835+0000","last_change":"2024-09-10T14:28:38.925950+0000","last_active":"2024-09-10T14:31:44.251835+0000","last_peered":"2024-09-10T14:31:44.251835+0000","last_clean":"2024-09-10T14:31:44.251835+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:31:44.251835+0000","last_undegraded":"2024-09-10T14:31:44.251835+0000","last_fullsized":"2024-09-10T14:31:44.251835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:06.497323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.378012+0000","last_change":"2024-09-10T14:28:30.878284+0000","last_active":"2024-09-10T14:29:58.378012+0000","last_peered":"2024-09-10T14:29:58.378012+0000","last_clean":"2024-09-10T14:29:58.378012+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:29:58.378012+0000","last_undegraded":"2024-09-10T14:29:58.378012+0000","last_fullsized":"2024-09-10T14:29:58.378012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:59.147562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768179+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:29:08.768179+0000","last_peered":"2024-09-10T14:29:08.768179+0000","last_clean":"2024-09-10T14:29:08.768179+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:29:08.768179+0000","last_undegraded":"2024-09-10T14:29:08.768179+0000","last_fullsized":"2024-09-10T14:29:08.768179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:11.168974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.041052+0000","last_change":"2024-09-10T14:28:28.873736+0000","last_active":"2024-09-10T14:31:44.041052+0000","last_peered":"2024-09-10T14:31:44.041052+0000","last_clean":"2024-09-10T14:31:44.041052+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:31:44.041052+0000","last_undegraded":"2024-09-10T14:31:44.041052+0000","last_fullsized":"2024-09-10T14:31:44.041052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:43.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782694+0000","last_change":"2024-09-10T14:28:32.888517+0000","last_active":"2024-09-10T14:29:08.782694+0000","last_peered":"2024-09-10T14:29:08.782694+0000","last_clean":"2024-09-10T14:29:08.782694+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:29:08.782694+0000","last_undegraded":"2024-09-10T14:29:08.782694+0000","last_fullsized":"2024-09-10T14:29:08.782694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:38.805133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'275","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.095600+0000","last_change":"2024-09-10T14:28:34.894665+0000","last_active":"2024-09-10T14:31:44.095600+0000","last_peered":"2024-09-10T14:31:44.095600+0000","last_clean":"2024-09-10T14:31:44.095600+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:31:44.095600+0000","last_undegraded":"2024-09-10T14:31:44.095600+0000","last_fullsized":"2024-09-10T14:31:44.095600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.418477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772230+0000","last_change":"2024-09-10T14:28:36.943974+0000","last_active":"2024-09-10T14:29:08.772230+0000","last_peered":"2024-09-10T14:29:08.772230+0000","last_clean":"2024-09-10T14:29:08.772230+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:29:08.772230+0000","last_undegraded":"2024-09-10T14:29:08.772230+0000","last_fullsized":"2024-09-10T14:29:08.772230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:48.045691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.777348+0000","last_change":"2024-09-10T14:28:38.943158+0000","last_active":"2024-09-10T14:31:43.777348+0000","last_peered":"2024-09-10T14:31:43.777348+0000","last_clean":"2024-09-10T14:31:43.777348+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:31:43.777348+0000","last_undegraded":"2024-09-10T14:31:43.777348+0000","last_fullsized":"2024-09-10T14:31:43.777348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:00.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.730417+0000","last_change":"2024-09-10T14:28:30.884260+0000","last_active":"2024-09-10T14:29:14.730417+0000","last_peered":"2024-09-10T14:29:14.730417+0000","last_clean":"2024-09-10T14:29:14.730417+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:29:14.730417+0000","last_undegraded":"2024-09-10T14:29:14.730417+0000","last_fullsized":"2024-09-10T14:29:14.730417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:55.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774556+0000","last_change":"2024-09-10T14:28:21.859213+0000","last_active":"2024-09-10T14:29:08.774556+0000","last_peered":"2024-09-10T14:29:08.774556+0000","last_clean":"2024-09-10T14:29:08.774556+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:29:08.774556+0000","last_undegraded":"2024-09-10T14:29:08.774556+0000","last_fullsized":"2024-09-10T14:29:08.774556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:49.580804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.058535+0000","last_change":"2024-09-10T14:28:28.874080+0000","last_active":"2024-09-10T14:31:44.058535+0000","last_peered":"2024-09-10T14:31:44.058535+0000","last_clean":"2024-09-10T14:31:44.058535+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:31:44.058535+0000","last_undegraded":"2024-09-10T14:31:44.058535+0000","last_fullsized":"2024-09-10T14:31:44.058535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:55.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786046+0000","last_change":"2024-09-10T14:28:32.871141+0000","last_active":"2024-09-10T14:29:08.786046+0000","last_peered":"2024-09-10T14:29:08.786046+0000","last_clean":"2024-09-10T14:29:08.786046+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:29:08.786046+0000","last_undegraded":"2024-09-10T14:29:08.786046+0000","last_fullsized":"2024-09-10T14:29:08.786046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:19.367394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120964+0000","last_change":"2024-09-10T14:28:34.884708+0000","last_active":"2024-09-10T14:31:43.120964+0000","last_peered":"2024-09-10T14:31:43.120964+0000","last_clean":"2024-09-10T14:31:43.120964+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:31:43.120964+0000","last_undegraded":"2024-09-10T14:31:43.120964+0000","last_fullsized":"2024-09-10T14:31:43.120964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:58.578905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093499+0000","last_change":"2024-09-10T14:28:36.924713+0000","last_active":"2024-09-10T14:29:09.093499+0000","last_peered":"2024-09-10T14:29:09.093499+0000","last_clean":"2024-09-10T14:29:09.093499+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:29:09.093499+0000","last_undegraded":"2024-09-10T14:29:09.093499+0000","last_fullsized":"2024-09-10T14:29:09.093499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:20.981089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768748+0000","last_change":"2024-09-10T14:28:38.943308+0000","last_active":"2024-09-10T14:29:08.768748+0000","last_peered":"2024-09-10T14:29:08.768748+0000","last_clean":"2024-09-10T14:29:08.768748+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:29:08.768748+0000","last_undegraded":"2024-09-10T14:29:08.768748+0000","last_fullsized":"2024-09-10T14:29:08.768748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:31.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227454+0000","last_change":"2024-09-10T14:28:30.863131+0000","last_active":"2024-09-10T14:31:44.227454+0000","last_peered":"2024-09-10T14:31:44.227454+0000","last_clean":"2024-09-10T14:31:44.227454+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:31:44.227454+0000","last_undegraded":"2024-09-10T14:31:44.227454+0000","last_fullsized":"2024-09-10T14:31:44.227454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:11.379786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769438+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:29:08.769438+0000","last_peered":"2024-09-10T14:29:08.769438+0000","last_clean":"2024-09-10T14:29:08.769438+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:29:08.769438+0000","last_undegraded":"2024-09-10T14:29:08.769438+0000","last_fullsized":"2024-09-10T14:29:08.769438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:08.712711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779372+0000","last_change":"2024-09-10T14:28:28.892687+0000","last_active":"2024-09-10T14:29:08.779372+0000","last_peered":"2024-09-10T14:29:08.779372+0000","last_clean":"2024-09-10T14:29:08.779372+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:29:08.779372+0000","last_undegraded":"2024-09-10T14:29:08.779372+0000","last_fullsized":"2024-09-10T14:29:08.779372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:29.232546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.102198+0000","last_change":"2024-09-10T14:28:32.885999+0000","last_active":"2024-09-10T14:29:09.102198+0000","last_peered":"2024-09-10T14:29:09.102198+0000","last_clean":"2024-09-10T14:29:09.102198+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:29:09.102198+0000","last_undegraded":"2024-09-10T14:29:09.102198+0000","last_fullsized":"2024-09-10T14:29:09.102198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.742700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.142906+0000","last_change":"2024-09-10T14:28:34.924692+0000","last_active":"2024-09-10T14:31:43.142906+0000","last_peered":"2024-09-10T14:31:43.142906+0000","last_clean":"2024-09-10T14:31:43.142906+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:31:43.142906+0000","last_undegraded":"2024-09-10T14:31:43.142906+0000","last_fullsized":"2024-09-10T14:31:43.142906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:53.353299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782310+0000","last_change":"2024-09-10T14:28:36.943077+0000","last_active":"2024-09-10T14:29:08.782310+0000","last_peered":"2024-09-10T14:29:08.782310+0000","last_clean":"2024-09-10T14:29:08.782310+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:29:08.782310+0000","last_undegraded":"2024-09-10T14:29:08.782310+0000","last_fullsized":"2024-09-10T14:29:08.782310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:11.353120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.729145+0000","last_change":"2024-09-10T14:28:38.927597+0000","last_active":"2024-09-10T14:30:42.729145+0000","last_peered":"2024-09-10T14:30:42.729145+0000","last_clean":"2024-09-10T14:30:42.729145+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:30:42.729145+0000","last_undegraded":"2024-09-10T14:30:42.729145+0000","last_fullsized":"2024-09-10T14:30:42.729145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:59.259272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777851+0000","last_change":"2024-09-10T14:28:30.886735+0000","last_active":"2024-09-10T14:29:08.777851+0000","last_peered":"2024-09-10T14:29:08.777851+0000","last_clean":"2024-09-10T14:29:08.777851+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:29:08.777851+0000","last_undegraded":"2024-09-10T14:29:08.777851+0000","last_fullsized":"2024-09-10T14:29:08.777851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:55.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:34.773656+0000","last_change":"2024-09-10T14:28:28.911271+0000","last_active":"2024-09-10T14:30:34.773656+0000","last_peered":"2024-09-10T14:30:34.773656+0000","last_clean":"2024-09-10T14:30:34.773656+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:30:34.773656+0000","last_undegraded":"2024-09-10T14:30:34.773656+0000","last_fullsized":"2024-09-10T14:30:34.773656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:46.166561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.100259+0000","last_change":"2024-09-10T14:28:21.327700+0000","last_active":"2024-09-10T14:29:09.100259+0000","last_peered":"2024-09-10T14:29:09.100259+0000","last_clean":"2024-09-10T14:29:09.100259+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:29:09.100259+0000","last_undegraded":"2024-09-10T14:29:09.100259+0000","last_fullsized":"2024-09-10T14:29:09.100259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:52.160130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:14.782591+0000","last_change":"2024-09-10T14:29:07.784812+0000","last_active":"2024-09-10T14:31:14.782591+0000","last_peered":"2024-09-10T14:31:14.782591+0000","last_clean":"2024-09-10T14:31:14.782591+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:31:14.782591+0000","last_undegraded":"2024-09-10T14:31:14.782591+0000","last_fullsized":"2024-09-10T14:31:14.782591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:59.688011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.143022+0000","last_change":"2024-09-10T14:28:34.893626+0000","last_active":"2024-09-10T14:30:41.143022+0000","last_peered":"2024-09-10T14:30:41.143022+0000","last_clean":"2024-09-10T14:30:41.143022+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:30:41.143022+0000","last_undegraded":"2024-09-10T14:30:41.143022+0000","last_fullsized":"2024-09-10T14:30:41.143022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:28.104547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772307+0000","last_change":"2024-09-10T14:28:36.918342+0000","last_active":"2024-09-10T14:29:08.772307+0000","last_peered":"2024-09-10T14:29:08.772307+0000","last_clean":"2024-09-10T14:29:08.772307+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:29:08.772307+0000","last_undegraded":"2024-09-10T14:29:08.772307+0000","last_fullsized":"2024-09-10T14:29:08.772307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:03.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.974036+0000","last_change":"2024-09-10T14:28:38.924566+0000","last_active":"2024-09-10T14:30:42.974036+0000","last_peered":"2024-09-10T14:30:42.974036+0000","last_clean":"2024-09-10T14:30:42.974036+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:30:42.974036+0000","last_undegraded":"2024-09-10T14:30:42.974036+0000","last_fullsized":"2024-09-10T14:30:42.974036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:23.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227882+0000","last_change":"2024-09-10T14:28:30.889728+0000","last_active":"2024-09-10T14:31:44.227882+0000","last_peered":"2024-09-10T14:31:44.227882+0000","last_clean":"2024-09-10T14:31:44.227882+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:31:44.227882+0000","last_undegraded":"2024-09-10T14:31:44.227882+0000","last_fullsized":"2024-09-10T14:31:44.227882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:49.183418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093061+0000","last_change":"2024-09-10T14:28:28.907627+0000","last_active":"2024-09-10T14:29:09.093061+0000","last_peered":"2024-09-10T14:29:09.093061+0000","last_clean":"2024-09-10T14:29:09.093061+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:29:09.093061+0000","last_undegraded":"2024-09-10T14:29:09.093061+0000","last_fullsized":"2024-09-10T14:29:09.093061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:11.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777696+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:29:08.777696+0000","last_peered":"2024-09-10T14:29:08.777696+0000","last_clean":"2024-09-10T14:29:08.777696+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:29:08.777696+0000","last_undegraded":"2024-09-10T14:29:08.777696+0000","last_fullsized":"2024-09-10T14:29:08.777696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:21.647103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768826+0000","last_change":"2024-09-10T14:28:32.882261+0000","last_active":"2024-09-10T14:29:08.768826+0000","last_peered":"2024-09-10T14:29:08.768826+0000","last_clean":"2024-09-10T14:29:08.768826+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:29:08.768826+0000","last_undegraded":"2024-09-10T14:29:08.768826+0000","last_fullsized":"2024-09-10T14:29:08.768826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:59.101746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.075406+0000","last_change":"2024-09-10T14:28:34.901236+0000","last_active":"2024-09-10T14:29:58.075406+0000","last_peered":"2024-09-10T14:29:58.075406+0000","last_clean":"2024-09-10T14:29:58.075406+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:29:58.075406+0000","last_undegraded":"2024-09-10T14:29:58.075406+0000","last_fullsized":"2024-09-10T14:29:58.075406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:02.704400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":377,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.238990+0000","last_change":"2024-09-10T14:28:36.904472+0000","last_active":"2024-09-10T14:31:44.238990+0000","last_peered":"2024-09-10T14:31:44.238990+0000","last_clean":"2024-09-10T14:31:44.238990+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:31:44.238990+0000","last_undegraded":"2024-09-10T14:31:44.238990+0000","last_fullsized":"2024-09-10T14:31:44.238990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:07.331691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.268320+0000","last_change":"2024-09-10T14:28:38.937953+0000","last_active":"2024-09-10T14:31:43.268320+0000","last_peered":"2024-09-10T14:31:43.268320+0000","last_clean":"2024-09-10T14:31:43.268320+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:31:43.268320+0000","last_undegraded":"2024-09-10T14:31:43.268320+0000","last_fullsized":"2024-09-10T14:31:43.268320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:24.662394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743534+0000","last_change":"2024-09-10T14:28:30.888495+0000","last_active":"2024-09-10T14:29:15.743534+0000","last_peered":"2024-09-10T14:29:15.743534+0000","last_clean":"2024-09-10T14:29:15.743534+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:29:15.743534+0000","last_undegraded":"2024-09-10T14:29:15.743534+0000","last_fullsized":"2024-09-10T14:29:15.743534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:49.862009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.684814+0000","last_change":"2024-09-10T14:28:28.891219+0000","last_active":"2024-09-10T14:31:43.684814+0000","last_peered":"2024-09-10T14:31:43.684814+0000","last_clean":"2024-09-10T14:31:43.684814+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:31:43.684814+0000","last_undegraded":"2024-09-10T14:31:43.684814+0000","last_fullsized":"2024-09-10T14:31:43.684814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:24.892549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.103352+0000","last_change":"2024-09-10T14:28:21.327784+0000","last_active":"2024-09-10T14:29:09.103352+0000","last_peered":"2024-09-10T14:29:09.103352+0000","last_clean":"2024-09-10T14:29:09.103352+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:29:09.103352+0000","last_undegraded":"2024-09-10T14:29:09.103352+0000","last_fullsized":"2024-09-10T14:29:09.103352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:00.563029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769359+0000","last_change":"2024-09-10T14:28:32.881624+0000","last_active":"2024-09-10T14:29:08.769359+0000","last_peered":"2024-09-10T14:29:08.769359+0000","last_clean":"2024-09-10T14:29:08.769359+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:29:08.769359+0000","last_undegraded":"2024-09-10T14:29:08.769359+0000","last_fullsized":"2024-09-10T14:29:08.769359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:40.120625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.771369+0000","last_change":"2024-09-10T14:28:34.914868+0000","last_active":"2024-09-10T14:29:08.771369+0000","last_peered":"2024-09-10T14:29:08.771369+0000","last_clean":"2024-09-10T14:29:08.771369+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:29:08.771369+0000","last_undegraded":"2024-09-10T14:29:08.771369+0000","last_fullsized":"2024-09-10T14:29:08.771369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:28.103142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":392,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.383887+0000","last_change":"2024-09-10T14:28:36.902307+0000","last_active":"2024-09-10T14:31:44.383887+0000","last_peered":"2024-09-10T14:31:44.383887+0000","last_clean":"2024-09-10T14:31:44.383887+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:31:44.383887+0000","last_undegraded":"2024-09-10T14:31:44.383887+0000","last_fullsized":"2024-09-10T14:31:44.383887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:28.542198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781543+0000","last_change":"2024-09-10T14:28:38.934660+0000","last_active":"2024-09-10T14:29:08.781543+0000","last_peered":"2024-09-10T14:29:08.781543+0000","last_clean":"2024-09-10T14:29:08.781543+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:29:08.781543+0000","last_undegraded":"2024-09-10T14:29:08.781543+0000","last_fullsized":"2024-09-10T14:29:08.781543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:08.718072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227593+0000","last_change":"2024-09-10T14:28:30.872139+0000","last_active":"2024-09-10T14:31:44.227593+0000","last_peered":"2024-09-10T14:31:44.227593+0000","last_clean":"2024-09-10T14:31:44.227593+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:31:44.227593+0000","last_undegraded":"2024-09-10T14:31:44.227593+0000","last_fullsized":"2024-09-10T14:31:44.227593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:13.634815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.023364+0000","last_change":"2024-09-10T14:28:28.904513+0000","last_active":"2024-09-10T14:31:44.023364+0000","last_peered":"2024-09-10T14:31:44.023364+0000","last_clean":"2024-09-10T14:31:44.023364+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:31:44.023364+0000","last_undegraded":"2024-09-10T14:31:44.023364+0000","last_fullsized":"2024-09-10T14:31:44.023364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:05.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782794+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:29:08.782794+0000","last_peered":"2024-09-10T14:29:08.782794+0000","last_clean":"2024-09-10T14:29:08.782794+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:29:08.782794+0000","last_undegraded":"2024-09-10T14:29:08.782794+0000","last_fullsized":"2024-09-10T14:29:08.782794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:58.045195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.767895+0000","last_change":"2024-09-10T14:28:32.878971+0000","last_active":"2024-09-10T14:29:08.767895+0000","last_peered":"2024-09-10T14:29:08.767895+0000","last_clean":"2024-09-10T14:29:08.767895+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:29:08.767895+0000","last_undegraded":"2024-09-10T14:29:08.767895+0000","last_fullsized":"2024-09-10T14:29:08.767895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:24.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'83","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.111766+0000","last_change":"2024-09-10T14:28:34.903982+0000","last_active":"2024-09-10T14:30:41.111766+0000","last_peered":"2024-09-10T14:30:41.111766+0000","last_clean":"2024-09-10T14:30:41.111766+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:30:41.111766+0000","last_undegraded":"2024-09-10T14:30:41.111766+0000","last_fullsized":"2024-09-10T14:30:41.111766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:45.622257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095336+0000","last_change":"2024-09-10T14:28:36.903264+0000","last_active":"2024-09-10T14:29:09.095336+0000","last_peered":"2024-09-10T14:29:09.095336+0000","last_clean":"2024-09-10T14:29:09.095336+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:29:09.095336+0000","last_undegraded":"2024-09-10T14:29:09.095336+0000","last_fullsized":"2024-09-10T14:29:09.095336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:26.562499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786817+0000","last_change":"2024-09-10T14:28:38.930196+0000","last_active":"2024-09-10T14:29:08.786817+0000","last_peered":"2024-09-10T14:29:08.786817+0000","last_clean":"2024-09-10T14:29:08.786817+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:29:08.786817+0000","last_undegraded":"2024-09-10T14:29:08.786817+0000","last_fullsized":"2024-09-10T14:29:08.786817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:55.481810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.069321+0000","last_change":"2024-09-10T14:28:38.944786+0000","last_active":"2024-09-10T14:29:58.069321+0000","last_peered":"2024-09-10T14:29:58.069321+0000","last_clean":"2024-09-10T14:29:58.069321+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:29:58.069321+0000","last_undegraded":"2024-09-10T14:29:58.069321+0000","last_fullsized":"2024-09-10T14:29:58.069321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:23.466063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071514+0000","last_change":"2024-09-10T14:28:30.877107+0000","last_active":"2024-09-10T14:31:44.071514+0000","last_peered":"2024-09-10T14:31:44.071514+0000","last_clean":"2024-09-10T14:31:44.071514+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:31:44.071514+0000","last_undegraded":"2024-09-10T14:31:44.071514+0000","last_fullsized":"2024-09-10T14:31:44.071514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:01.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.032703+0000","last_change":"2024-09-10T14:28:28.890437+0000","last_active":"2024-09-10T14:31:44.032703+0000","last_peered":"2024-09-10T14:31:44.032703+0000","last_clean":"2024-09-10T14:31:44.032703+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:31:44.032703+0000","last_undegraded":"2024-09-10T14:31:44.032703+0000","last_fullsized":"2024-09-10T14:31:44.032703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.203261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777010+0000","last_change":"2024-09-10T14:28:32.883682+0000","last_active":"2024-09-10T14:29:08.777010+0000","last_peered":"2024-09-10T14:29:08.777010+0000","last_clean":"2024-09-10T14:29:08.777010+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:29:08.777010+0000","last_undegraded":"2024-09-10T14:29:08.777010+0000","last_fullsized":"2024-09-10T14:29:08.777010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:49.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786759+0000","last_change":"2024-09-10T14:28:34.909586+0000","last_active":"2024-09-10T14:30:58.786759+0000","last_peered":"2024-09-10T14:30:58.786759+0000","last_clean":"2024-09-10T14:30:58.786759+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:30:58.786759+0000","last_undegraded":"2024-09-10T14:30:58.786759+0000","last_fullsized":"2024-09-10T14:30:58.786759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:41.169418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772384+0000","last_change":"2024-09-10T14:28:36.937985+0000","last_active":"2024-09-10T14:29:08.772384+0000","last_peered":"2024-09-10T14:29:08.772384+0000","last_clean":"2024-09-10T14:29:08.772384+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:29:08.772384+0000","last_undegraded":"2024-09-10T14:29:08.772384+0000","last_fullsized":"2024-09-10T14:29:08.772384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:38.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:40.727074+0000","last_change":"2024-09-10T14:28:38.919940+0000","last_active":"2024-09-10T14:30:40.727074+0000","last_peered":"2024-09-10T14:30:40.727074+0000","last_clean":"2024-09-10T14:30:40.727074+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:30:40.727074+0000","last_undegraded":"2024-09-10T14:30:40.727074+0000","last_fullsized":"2024-09-10T14:30:40.727074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:50.182914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227269+0000","last_change":"2024-09-10T14:29:07.783673+0000","last_active":"2024-09-10T14:31:44.227269+0000","last_peered":"2024-09-10T14:31:44.227269+0000","last_clean":"2024-09-10T14:31:44.227269+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:31:44.227269+0000","last_undegraded":"2024-09-10T14:31:44.227269+0000","last_fullsized":"2024-09-10T14:31:44.227269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:50.089510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.784173+0000","last_change":"2024-09-10T14:28:28.897051+0000","last_active":"2024-09-10T14:29:08.784173+0000","last_peered":"2024-09-10T14:29:08.784173+0000","last_clean":"2024-09-10T14:29:08.784173+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:29:08.784173+0000","last_undegraded":"2024-09-10T14:29:08.784173+0000","last_fullsized":"2024-09-10T14:29:08.784173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:35.896977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769214+0000","last_change":"2024-09-10T14:28:32.889469+0000","last_active":"2024-09-10T14:29:08.769214+0000","last_peered":"2024-09-10T14:29:08.769214+0000","last_clean":"2024-09-10T14:29:08.769214+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:29:08.769214+0000","last_undegraded":"2024-09-10T14:29:08.769214+0000","last_fullsized":"2024-09-10T14:29:08.769214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:16.954547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.151756+0000","last_change":"2024-09-10T14:28:34.883314+0000","last_active":"2024-09-10T14:31:43.151756+0000","last_peered":"2024-09-10T14:31:43.151756+0000","last_clean":"2024-09-10T14:31:43.151756+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:31:43.151756+0000","last_undegraded":"2024-09-10T14:31:43.151756+0000","last_fullsized":"2024-09-10T14:31:43.151756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:55.702602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774240+0000","last_change":"2024-09-10T14:28:36.942744+0000","last_active":"2024-09-10T14:29:08.774240+0000","last_peered":"2024-09-10T14:29:08.774240+0000","last_clean":"2024-09-10T14:29:08.774240+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:29:08.774240+0000","last_undegraded":"2024-09-10T14:29:08.774240+0000","last_fullsized":"2024-09-10T14:29:08.774240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:27.947825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.100255+0000","last_change":"2024-09-10T14:28:38.936365+0000","last_active":"2024-09-10T14:29:09.100255+0000","last_peered":"2024-09-10T14:29:09.100255+0000","last_clean":"2024-09-10T14:29:09.100255+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:29:09.100255+0000","last_undegraded":"2024-09-10T14:29:09.100255+0000","last_fullsized":"2024-09-10T14:29:09.100255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:06.472831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.730616+0000","last_change":"2024-09-10T14:28:30.876200+0000","last_active":"2024-09-10T14:29:14.730616+0000","last_peered":"2024-09-10T14:29:14.730616+0000","last_clean":"2024-09-10T14:29:14.730616+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:29:14.730616+0000","last_undegraded":"2024-09-10T14:29:14.730616+0000","last_fullsized":"2024-09-10T14:29:14.730616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.106885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.232528+0000","last_change":"2024-09-10T14:28:28.895847+0000","last_active":"2024-09-10T14:29:14.232528+0000","last_peered":"2024-09-10T14:29:14.232528+0000","last_clean":"2024-09-10T14:29:14.232528+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:29:14.232528+0000","last_undegraded":"2024-09-10T14:29:14.232528+0000","last_fullsized":"2024-09-10T14:29:14.232528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:09.693064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774392+0000","last_change":"2024-09-10T14:28:32.872799+0000","last_active":"2024-09-10T14:29:08.774392+0000","last_peered":"2024-09-10T14:29:08.774392+0000","last_clean":"2024-09-10T14:29:08.774392+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:29:08.774392+0000","last_undegraded":"2024-09-10T14:29:08.774392+0000","last_fullsized":"2024-09-10T14:29:08.774392+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:03.562600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'40","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.238443+0000","last_change":"2024-09-10T14:28:34.883528+0000","last_active":"2024-09-10T14:31:43.238443+0000","last_peered":"2024-09-10T14:31:43.238443+0000","last_clean":"2024-09-10T14:31:43.238443+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:31:43.238443+0000","last_undegraded":"2024-09-10T14:31:43.238443+0000","last_fullsized":"2024-09-10T14:31:43.238443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:37.113514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776303+0000","last_change":"2024-09-10T14:28:36.903239+0000","last_active":"2024-09-10T14:29:08.776303+0000","last_peered":"2024-09-10T14:29:08.776303+0000","last_clean":"2024-09-10T14:29:08.776303+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:29:08.776303+0000","last_undegraded":"2024-09-10T14:29:08.776303+0000","last_fullsized":"2024-09-10T14:29:08.776303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:10.158060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769658+0000","last_change":"2024-09-10T14:28:38.937605+0000","last_active":"2024-09-10T14:29:08.769658+0000","last_peered":"2024-09-10T14:29:08.769658+0000","last_clean":"2024-09-10T14:29:08.769658+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:29:08.769658+0000","last_undegraded":"2024-09-10T14:29:08.769658+0000","last_fullsized":"2024-09-10T14:29:08.769658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:51.383935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743397+0000","last_change":"2024-09-10T14:29:07.787878+0000","last_active":"2024-09-10T14:29:15.743397+0000","last_peered":"2024-09-10T14:29:15.743397+0000","last_clean":"2024-09-10T14:29:15.743397+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:29:15.743397+0000","last_undegraded":"2024-09-10T14:29:15.743397+0000","last_fullsized":"2024-09-10T14:29:15.743397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:39.937327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.827599+0000","last_change":"2024-09-10T14:28:28.902985+0000","last_active":"2024-09-10T14:30:42.827599+0000","last_peered":"2024-09-10T14:30:42.827599+0000","last_clean":"2024-09-10T14:30:42.827599+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:30:42.827599+0000","last_undegraded":"2024-09-10T14:30:42.827599+0000","last_fullsized":"2024-09-10T14:30:42.827599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:52.358354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769090+0000","last_change":"2024-09-10T14:28:32.882402+0000","last_active":"2024-09-10T14:29:08.769090+0000","last_peered":"2024-09-10T14:29:08.769090+0000","last_clean":"2024-09-10T14:29:08.769090+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:29:08.769090+0000","last_undegraded":"2024-09-10T14:29:08.769090+0000","last_fullsized":"2024-09-10T14:29:08.769090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:40.138989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'32","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.777771+0000","last_change":"2024-09-10T14:28:34.898884+0000","last_active":"2024-09-10T14:30:54.777771+0000","last_peered":"2024-09-10T14:30:54.777771+0000","last_clean":"2024-09-10T14:30:54.777771+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:30:54.777771+0000","last_undegraded":"2024-09-10T14:30:54.777771+0000","last_fullsized":"2024-09-10T14:30:54.777771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:00.691071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778374+0000","last_change":"2024-09-10T14:28:36.914261+0000","last_active":"2024-09-10T14:29:08.778374+0000","last_peered":"2024-09-10T14:29:08.778374+0000","last_clean":"2024-09-10T14:29:08.778374+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:29:08.778374+0000","last_undegraded":"2024-09-10T14:29:08.778374+0000","last_fullsized":"2024-09-10T14:29:08.778374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:53.185791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.731755+0000","last_change":"2024-09-10T14:28:30.877889+0000","last_active":"2024-09-10T14:29:14.731755+0000","last_peered":"2024-09-10T14:29:14.731755+0000","last_clean":"2024-09-10T14:29:14.731755+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:29:14.731755+0000","last_undegraded":"2024-09-10T14:29:14.731755+0000","last_fullsized":"2024-09-10T14:29:14.731755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:50.100814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768203+0000","last_change":"2024-09-10T14:28:28.893360+0000","last_active":"2024-09-10T14:29:08.768203+0000","last_peered":"2024-09-10T14:29:08.768203+0000","last_clean":"2024-09-10T14:29:08.768203+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:29:08.768203+0000","last_undegraded":"2024-09-10T14:29:08.768203+0000","last_fullsized":"2024-09-10T14:29:08.768203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:07.284771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.756273+0000","last_change":"2024-09-10T14:29:08.790434+0000","last_active":"2024-09-10T14:29:09.756273+0000","last_peered":"2024-09-10T14:29:09.756273+0000","last_clean":"2024-09-10T14:29:09.756273+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:29:09.756273+0000","last_undegraded":"2024-09-10T14:29:09.756273+0000","last_fullsized":"2024-09-10T14:29:09.756273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:57.151248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.138592+0000","last_change":"2024-09-10T14:28:34.883522+0000","last_active":"2024-09-10T14:30:41.138592+0000","last_peered":"2024-09-10T14:30:41.138592+0000","last_clean":"2024-09-10T14:30:41.138592+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:30:41.138592+0000","last_undegraded":"2024-09-10T14:30:41.138592+0000","last_fullsized":"2024-09-10T14:30:41.138592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:16.061284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778501+0000","last_change":"2024-09-10T14:28:36.910017+0000","last_active":"2024-09-10T14:29:08.778501+0000","last_peered":"2024-09-10T14:29:08.778501+0000","last_clean":"2024-09-10T14:29:08.778501+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:29:08.778501+0000","last_undegraded":"2024-09-10T14:29:08.778501+0000","last_fullsized":"2024-09-10T14:29:08.778501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:51.066667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.964268+0000","last_change":"2024-09-10T14:28:38.928679+0000","last_active":"2024-09-10T14:30:42.964268+0000","last_peered":"2024-09-10T14:30:42.964268+0000","last_clean":"2024-09-10T14:30:42.964268+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:30:42.964268+0000","last_undegraded":"2024-09-10T14:30:42.964268+0000","last_fullsized":"2024-09-10T14:30:42.964268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:20.861557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.873676+0000","last_change":"2024-09-10T14:28:30.881385+0000","last_active":"2024-09-10T14:31:43.873676+0000","last_peered":"2024-09-10T14:31:43.873676+0000","last_clean":"2024-09-10T14:31:43.873676+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:31:43.873676+0000","last_undegraded":"2024-09-10T14:31:43.873676+0000","last_fullsized":"2024-09-10T14:31:43.873676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.775827+0000","last_change":"2024-09-10T14:28:28.906793+0000","last_active":"2024-09-10T14:29:08.775827+0000","last_peered":"2024-09-10T14:29:08.775827+0000","last_clean":"2024-09-10T14:29:08.775827+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:29:08.775827+0000","last_undegraded":"2024-09-10T14:29:08.775827+0000","last_fullsized":"2024-09-10T14:29:08.775827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:45.691675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786646+0000","last_change":"2024-09-10T14:28:32.880162+0000","last_active":"2024-09-10T14:29:08.786646+0000","last_peered":"2024-09-10T14:29:08.786646+0000","last_clean":"2024-09-10T14:29:08.786646+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:29:08.786646+0000","last_undegraded":"2024-09-10T14:29:08.786646+0000","last_fullsized":"2024-09-10T14:29:08.786646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:19.866288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.110766+0000","last_change":"2024-09-10T14:28:34.922844+0000","last_active":"2024-09-10T14:30:41.110766+0000","last_peered":"2024-09-10T14:30:41.110766+0000","last_clean":"2024-09-10T14:30:41.110766+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:30:41.110766+0000","last_undegraded":"2024-09-10T14:30:41.110766+0000","last_fullsized":"2024-09-10T14:30:41.110766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:55.366020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782945+0000","last_change":"2024-09-10T14:28:36.940467+0000","last_active":"2024-09-10T14:29:08.782945+0000","last_peered":"2024-09-10T14:29:08.782945+0000","last_clean":"2024-09-10T14:29:08.782945+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:29:08.782945+0000","last_undegraded":"2024-09-10T14:29:08.782945+0000","last_fullsized":"2024-09-10T14:29:08.782945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:26.562499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.113319+0000","last_change":"2024-09-10T14:28:38.943738+0000","last_active":"2024-09-10T14:30:43.113319+0000","last_peered":"2024-09-10T14:30:43.113319+0000","last_clean":"2024-09-10T14:30:43.113319+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:30:43.113319+0000","last_undegraded":"2024-09-10T14:30:43.113319+0000","last_fullsized":"2024-09-10T14:30:43.113319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:23.582530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.176038+0000","last_change":"2024-09-10T14:28:30.890718+0000","last_active":"2024-09-10T14:31:44.176038+0000","last_peered":"2024-09-10T14:31:44.176038+0000","last_clean":"2024-09-10T14:31:44.176038+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:31:44.176038+0000","last_undegraded":"2024-09-10T14:31:44.176038+0000","last_fullsized":"2024-09-10T14:31:44.176038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:12.035474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777261+0000","last_change":"2024-09-10T14:28:28.904304+0000","last_active":"2024-09-10T14:29:08.777261+0000","last_peered":"2024-09-10T14:29:08.777261+0000","last_clean":"2024-09-10T14:29:08.777261+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:29:08.777261+0000","last_undegraded":"2024-09-10T14:29:08.777261+0000","last_fullsized":"2024-09-10T14:29:08.777261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:05.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.784823+0000","last_change":"2024-09-10T14:28:32.881286+0000","last_active":"2024-09-10T14:29:08.784823+0000","last_peered":"2024-09-10T14:29:08.784823+0000","last_clean":"2024-09-10T14:29:08.784823+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:29:08.784823+0000","last_undegraded":"2024-09-10T14:29:08.784823+0000","last_fullsized":"2024-09-10T14:29:08.784823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.999469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'32","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.135619+0000","last_change":"2024-09-10T14:28:34.894052+0000","last_active":"2024-09-10T14:30:41.135619+0000","last_peered":"2024-09-10T14:30:41.135619+0000","last_clean":"2024-09-10T14:30:41.135619+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:30:41.135619+0000","last_undegraded":"2024-09-10T14:30:41.135619+0000","last_fullsized":"2024-09-10T14:30:41.135619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:42.457623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096104+0000","last_change":"2024-09-10T14:28:36.914374+0000","last_active":"2024-09-10T14:29:09.096104+0000","last_peered":"2024-09-10T14:29:09.096104+0000","last_clean":"2024-09-10T14:29:09.096104+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:29:09.096104+0000","last_undegraded":"2024-09-10T14:29:09.096104+0000","last_fullsized":"2024-09-10T14:29:09.096104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:27.581565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.878132+0000","last_change":"2024-09-10T14:28:38.940779+0000","last_active":"2024-09-10T14:31:43.878132+0000","last_peered":"2024-09-10T14:31:43.878132+0000","last_clean":"2024-09-10T14:31:43.878132+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:31:43.878132+0000","last_undegraded":"2024-09-10T14:31:43.878132+0000","last_fullsized":"2024-09-10T14:31:43.878132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:01.962705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072247+0000","last_change":"2024-09-10T14:28:30.863566+0000","last_active":"2024-09-10T14:31:44.072247+0000","last_peered":"2024-09-10T14:31:44.072247+0000","last_clean":"2024-09-10T14:31:44.072247+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:31:44.072247+0000","last_undegraded":"2024-09-10T14:31:44.072247+0000","last_fullsized":"2024-09-10T14:31:44.072247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:33.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.004264+0000","last_change":"2024-09-10T14:28:28.890479+0000","last_active":"2024-09-10T14:29:15.004264+0000","last_peered":"2024-09-10T14:29:15.004264+0000","last_clean":"2024-09-10T14:29:15.004264+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:29:15.004264+0000","last_undegraded":"2024-09-10T14:29:15.004264+0000","last_fullsized":"2024-09-10T14:29:15.004264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:41.460622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.793988+0000","last_change":"2024-09-10T14:29:08.793243+0000","last_active":"2024-09-10T14:29:08.793988+0000","last_peered":"2024-09-10T14:29:08.793988+0000","last_clean":"2024-09-10T14:29:08.793988+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:29:08.793988+0000","last_undegraded":"2024-09-10T14:29:08.793988+0000","last_fullsized":"2024-09-10T14:29:08.793988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.893530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781141+0000","last_change":"2024-09-10T14:28:34.927446+0000","last_active":"2024-09-10T14:29:08.781141+0000","last_peered":"2024-09-10T14:29:08.781141+0000","last_clean":"2024-09-10T14:29:08.781141+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:29:08.781141+0000","last_undegraded":"2024-09-10T14:29:08.781141+0000","last_fullsized":"2024-09-10T14:29:08.781141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:11.151127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":409,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120415+0000","last_change":"2024-09-10T14:28:36.941280+0000","last_active":"2024-09-10T14:31:43.120415+0000","last_peered":"2024-09-10T14:31:43.120415+0000","last_clean":"2024-09-10T14:31:43.120415+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:31:43.120415+0000","last_undegraded":"2024-09-10T14:31:43.120415+0000","last_fullsized":"2024-09-10T14:31:43.120415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:56.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.767087+0000","last_change":"2024-09-10T14:28:38.938263+0000","last_active":"2024-09-10T14:29:08.767087+0000","last_peered":"2024-09-10T14:29:08.767087+0000","last_clean":"2024-09-10T14:29:08.767087+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:29:08.767087+0000","last_undegraded":"2024-09-10T14:29:08.767087+0000","last_fullsized":"2024-09-10T14:29:08.767087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:24.663593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227129+0000","last_change":"2024-09-10T14:28:30.861357+0000","last_active":"2024-09-10T14:31:44.227129+0000","last_peered":"2024-09-10T14:31:44.227129+0000","last_clean":"2024-09-10T14:31:44.227129+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:31:44.227129+0000","last_undegraded":"2024-09-10T14:31:44.227129+0000","last_fullsized":"2024-09-10T14:31:44.227129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:51.916826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782831+0000","last_change":"2024-09-10T14:28:28.885941+0000","last_active":"2024-09-10T14:29:08.782831+0000","last_peered":"2024-09-10T14:29:08.782831+0000","last_clean":"2024-09-10T14:29:08.782831+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:29:08.782831+0000","last_undegraded":"2024-09-10T14:29:08.782831+0000","last_fullsized":"2024-09-10T14:29:08.782831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:23.440776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776786+0000","last_change":"2024-09-10T14:28:32.883472+0000","last_active":"2024-09-10T14:29:08.776786+0000","last_peered":"2024-09-10T14:29:08.776786+0000","last_clean":"2024-09-10T14:29:08.776786+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:29:08.776786+0000","last_undegraded":"2024-09-10T14:29:08.776786+0000","last_fullsized":"2024-09-10T14:29:08.776786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:16.905282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.097227+0000","last_change":"2024-09-10T14:28:34.894279+0000","last_active":"2024-09-10T14:30:41.097227+0000","last_peered":"2024-09-10T14:30:41.097227+0000","last_clean":"2024-09-10T14:30:41.097227+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:30:41.097227+0000","last_undegraded":"2024-09-10T14:30:41.097227+0000","last_fullsized":"2024-09-10T14:30:41.097227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:42.457623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.092515+0000","last_change":"2024-09-10T14:28:36.924051+0000","last_active":"2024-09-10T14:29:09.092515+0000","last_peered":"2024-09-10T14:29:09.092515+0000","last_clean":"2024-09-10T14:29:09.092515+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:29:09.092515+0000","last_undegraded":"2024-09-10T14:29:09.092515+0000","last_fullsized":"2024-09-10T14:29:09.092515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:10.158060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.180558+0000","last_change":"2024-09-10T14:28:38.931948+0000","last_active":"2024-09-10T14:31:44.180558+0000","last_peered":"2024-09-10T14:31:44.180558+0000","last_clean":"2024-09-10T14:31:44.180558+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:31:44.180558+0000","last_undegraded":"2024-09-10T14:31:44.180558+0000","last_fullsized":"2024-09-10T14:31:44.180558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.156721+0000","last_change":"2024-09-10T14:28:30.857116+0000","last_active":"2024-09-10T14:31:44.156721+0000","last_peered":"2024-09-10T14:31:44.156721+0000","last_clean":"2024-09-10T14:31:44.156721+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:31:44.156721+0000","last_undegraded":"2024-09-10T14:31:44.156721+0000","last_fullsized":"2024-09-10T14:31:44.156721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:21.150726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787090+0000","last_change":"2024-09-10T14:28:28.889060+0000","last_active":"2024-09-10T14:30:58.787090+0000","last_peered":"2024-09-10T14:30:58.787090+0000","last_clean":"2024-09-10T14:30:58.787090+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:30:58.787090+0000","last_undegraded":"2024-09-10T14:30:58.787090+0000","last_fullsized":"2024-09-10T14:30:58.787090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:04.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":15,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781204+0000","last_change":"2024-09-10T14:28:32.886513+0000","last_active":"2024-09-10T14:29:08.781204+0000","last_peered":"2024-09-10T14:29:08.781204+0000","last_clean":"2024-09-10T14:29:08.781204+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:29:08.781204+0000","last_undegraded":"2024-09-10T14:29:08.781204+0000","last_fullsized":"2024-09-10T14:29:08.781204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:36.827270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.099907+0000","last_change":"2024-09-10T14:28:34.895458+0000","last_active":"2024-09-10T14:30:41.099907+0000","last_peered":"2024-09-10T14:30:41.099907+0000","last_clean":"2024-09-10T14:30:41.099907+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:30:41.099907+0000","last_undegraded":"2024-09-10T14:30:41.099907+0000","last_fullsized":"2024-09-10T14:30:41.099907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.304872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768221+0000","last_change":"2024-09-10T14:28:36.939560+0000","last_active":"2024-09-10T14:29:08.768221+0000","last_peered":"2024-09-10T14:29:08.768221+0000","last_clean":"2024-09-10T14:29:08.768221+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:29:08.768221+0000","last_undegraded":"2024-09-10T14:29:08.768221+0000","last_fullsized":"2024-09-10T14:29:08.768221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:17.208670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781377+0000","last_change":"2024-09-10T14:28:38.950672+0000","last_active":"2024-09-10T14:29:08.781377+0000","last_peered":"2024-09-10T14:29:08.781377+0000","last_clean":"2024-09-10T14:29:08.781377+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:29:08.781377+0000","last_undegraded":"2024-09-10T14:29:08.781377+0000","last_fullsized":"2024-09-10T14:29:08.781377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:51.478025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072298+0000","last_change":"2024-09-10T14:28:30.877715+0000","last_active":"2024-09-10T14:31:44.072298+0000","last_peered":"2024-09-10T14:31:44.072298+0000","last_clean":"2024-09-10T14:31:44.072298+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:31:44.072298+0000","last_undegraded":"2024-09-10T14:31:44.072298+0000","last_fullsized":"2024-09-10T14:31:44.072298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:47.874293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093159+0000","last_change":"2024-09-10T14:28:28.876685+0000","last_active":"2024-09-10T14:29:09.093159+0000","last_peered":"2024-09-10T14:29:09.093159+0000","last_clean":"2024-09-10T14:29:09.093159+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:29:09.093159+0000","last_undegraded":"2024-09-10T14:29:09.093159+0000","last_fullsized":"2024-09-10T14:29:09.093159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.417731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774563+0000","last_change":"2024-09-10T14:28:32.884054+0000","last_active":"2024-09-10T14:29:08.774563+0000","last_peered":"2024-09-10T14:29:08.774563+0000","last_clean":"2024-09-10T14:29:08.774563+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:29:08.774563+0000","last_undegraded":"2024-09-10T14:29:08.774563+0000","last_fullsized":"2024-09-10T14:29:08.774563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.742700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.131887+0000","last_change":"2024-09-10T14:28:34.914074+0000","last_active":"2024-09-10T14:30:41.131887+0000","last_peered":"2024-09-10T14:30:41.131887+0000","last_clean":"2024-09-10T14:30:41.131887+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:30:41.131887+0000","last_undegraded":"2024-09-10T14:30:41.131887+0000","last_fullsized":"2024-09-10T14:30:41.131887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:12.635701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769265+0000","last_change":"2024-09-10T14:28:36.945615+0000","last_active":"2024-09-10T14:29:08.769265+0000","last_peered":"2024-09-10T14:29:08.769265+0000","last_clean":"2024-09-10T14:29:08.769265+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:29:08.769265+0000","last_undegraded":"2024-09-10T14:29:08.769265+0000","last_fullsized":"2024-09-10T14:29:08.769265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:28.372594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.329350+0000","last_change":"2024-09-10T14:28:38.949225+0000","last_active":"2024-09-10T14:31:44.329350+0000","last_peered":"2024-09-10T14:31:44.329350+0000","last_clean":"2024-09-10T14:31:44.329350+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:31:44.329350+0000","last_undegraded":"2024-09-10T14:31:44.329350+0000","last_fullsized":"2024-09-10T14:31:44.329350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:30.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227695+0000","last_change":"2024-09-10T14:28:30.857745+0000","last_active":"2024-09-10T14:31:44.227695+0000","last_peered":"2024-09-10T14:31:44.227695+0000","last_clean":"2024-09-10T14:31:44.227695+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:31:44.227695+0000","last_undegraded":"2024-09-10T14:31:44.227695+0000","last_fullsized":"2024-09-10T14:31:44.227695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:20.516570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.049736+0000","last_change":"2024-09-10T14:28:28.904511+0000","last_active":"2024-09-10T14:31:44.049736+0000","last_peered":"2024-09-10T14:31:44.049736+0000","last_clean":"2024-09-10T14:31:44.049736+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:31:44.049736+0000","last_undegraded":"2024-09-10T14:31:44.049736+0000","last_fullsized":"2024-09-10T14:31:44.049736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:55.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.533136+0000","last_change":"2024-09-10T14:28:32.889332+0000","last_active":"2024-09-10T14:30:39.533136+0000","last_peered":"2024-09-10T14:30:39.533136+0000","last_clean":"2024-09-10T14:30:39.533136+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:30:39.533136+0000","last_undegraded":"2024-09-10T14:30:39.533136+0000","last_fullsized":"2024-09-10T14:30:39.533136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:50.606255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.153147+0000","last_change":"2024-09-10T14:28:34.914339+0000","last_active":"2024-09-10T14:31:43.153147+0000","last_peered":"2024-09-10T14:31:43.153147+0000","last_clean":"2024-09-10T14:31:43.153147+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:31:43.153147+0000","last_undegraded":"2024-09-10T14:31:43.153147+0000","last_fullsized":"2024-09-10T14:31:43.153147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:00.676530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.098628+0000","last_change":"2024-09-10T14:28:36.924970+0000","last_active":"2024-09-10T14:29:09.098628+0000","last_peered":"2024-09-10T14:29:09.098628+0000","last_clean":"2024-09-10T14:29:09.098628+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:29:09.098628+0000","last_undegraded":"2024-09-10T14:29:09.098628+0000","last_fullsized":"2024-09-10T14:29:09.098628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.099079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.152719+0000","last_change":"2024-09-10T14:28:38.949254+0000","last_active":"2024-09-10T14:30:41.152719+0000","last_peered":"2024-09-10T14:30:41.152719+0000","last_clean":"2024-09-10T14:30:41.152719+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:30:41.152719+0000","last_undegraded":"2024-09-10T14:30:41.152719+0000","last_fullsized":"2024-09-10T14:30:41.152719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:37.882075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071743+0000","last_change":"2024-09-10T14:28:30.890252+0000","last_active":"2024-09-10T14:31:44.071743+0000","last_peered":"2024-09-10T14:31:44.071743+0000","last_clean":"2024-09-10T14:31:44.071743+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:31:44.071743+0000","last_undegraded":"2024-09-10T14:31:44.071743+0000","last_fullsized":"2024-09-10T14:31:44.071743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:36.092002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.023557+0000","last_change":"2024-09-10T14:28:28.876974+0000","last_active":"2024-09-10T14:30:39.023557+0000","last_peered":"2024-09-10T14:30:39.023557+0000","last_clean":"2024-09-10T14:30:39.023557+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:30:39.023557+0000","last_undegraded":"2024-09-10T14:30:39.023557+0000","last_fullsized":"2024-09-10T14:30:39.023557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:56.895016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.105167+0000","last_change":"2024-09-10T14:28:30.861035+0000","last_active":"2024-09-10T14:29:09.105167+0000","last_peered":"2024-09-10T14:29:09.105167+0000","last_clean":"2024-09-10T14:29:09.105167+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:29:09.105167+0000","last_undegraded":"2024-09-10T14:29:09.105167+0000","last_fullsized":"2024-09-10T14:29:09.105167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:11.237117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.995691+0000","last_change":"2024-09-10T14:28:28.880673+0000","last_active":"2024-09-10T14:30:42.995691+0000","last_peered":"2024-09-10T14:30:42.995691+0000","last_clean":"2024-09-10T14:30:42.995691+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:30:42.995691+0000","last_undegraded":"2024-09-10T14:30:42.995691+0000","last_fullsized":"2024-09-10T14:30:42.995691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:05.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'9","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.242990+0000","last_change":"2024-09-10T14:28:30.876383+0000","last_active":"2024-09-10T14:31:44.242990+0000","last_peered":"2024-09-10T14:31:44.242990+0000","last_clean":"2024-09-10T14:31:44.242990+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:31:44.242990+0000","last_undegraded":"2024-09-10T14:31:44.242990+0000","last_fullsized":"2024-09-10T14:31:44.242990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:27.003138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.358756+0000","last_change":"2024-09-10T14:28:28.892938+0000","last_active":"2024-09-10T14:29:58.358756+0000","last_peered":"2024-09-10T14:29:58.358756+0000","last_clean":"2024-09-10T14:29:58.358756+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:29:58.358756+0000","last_undegraded":"2024-09-10T14:29:58.358756+0000","last_fullsized":"2024-09-10T14:29:58.358756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:31.835408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.073511+0000","last_change":"2024-09-10T14:28:30.863758+0000","last_active":"2024-09-10T14:29:58.073511+0000","last_peered":"2024-09-10T14:29:58.073511+0000","last_clean":"2024-09-10T14:29:58.073511+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:29:58.073511+0000","last_undegraded":"2024-09-10T14:29:58.073511+0000","last_fullsized":"2024-09-10T14:29:58.073511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:55.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.494361+0000","last_change":"2024-09-10T14:28:28.880499+0000","last_active":"2024-09-10T14:29:13.494361+0000","last_peered":"2024-09-10T14:29:13.494361+0000","last_clean":"2024-09-10T14:29:13.494361+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:29:13.494361+0000","last_undegraded":"2024-09-10T14:29:13.494361+0000","last_fullsized":"2024-09-10T14:29:13.494361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:45.094407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.739142+0000","last_change":"2024-09-10T14:28:30.886667+0000","last_active":"2024-09-10T14:31:43.739142+0000","last_peered":"2024-09-10T14:31:43.739142+0000","last_clean":"2024-09-10T14:31:43.739142+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:43.739142+0000","last_undegraded":"2024-09-10T14:31:43.739142+0000","last_fullsized":"2024-09-10T14:31:43.739142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:02.612612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.491902+0000","last_change":"2024-09-10T14:28:28.908422+0000","last_active":"2024-09-10T14:29:13.491902+0000","last_peered":"2024-09-10T14:29:13.491902+0000","last_clean":"2024-09-10T14:29:13.491902+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:29:13.491902+0000","last_undegraded":"2024-09-10T14:29:13.491902+0000","last_fullsized":"2024-09-10T14:29:13.491902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:18.554945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.783600+0000","last_change":"2024-09-10T14:28:30.886359+0000","last_active":"2024-09-10T14:29:08.783600+0000","last_peered":"2024-09-10T14:29:08.783600+0000","last_clean":"2024-09-10T14:29:08.783600+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:29:08.783600+0000","last_undegraded":"2024-09-10T14:29:08.783600+0000","last_fullsized":"2024-09-10T14:29:08.783600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:11.237117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787165+0000","last_change":"2024-09-10T14:28:28.899480+0000","last_active":"2024-09-10T14:29:08.787165+0000","last_peered":"2024-09-10T14:29:08.787165+0000","last_clean":"2024-09-10T14:29:08.787165+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:29:08.787165+0000","last_undegraded":"2024-09-10T14:29:08.787165+0000","last_fullsized":"2024-09-10T14:29:08.787165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:43.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.175804+0000","last_change":"2024-09-10T14:28:30.881839+0000","last_active":"2024-09-10T14:31:44.175804+0000","last_peered":"2024-09-10T14:31:44.175804+0000","last_clean":"2024-09-10T14:31:44.175804+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:31:44.175804+0000","last_undegraded":"2024-09-10T14:31:44.175804+0000","last_fullsized":"2024-09-10T14:31:44.175804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:06.988787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787432+0000","last_change":"2024-09-10T14:28:28.913505+0000","last_active":"2024-09-10T14:29:08.787432+0000","last_peered":"2024-09-10T14:29:08.787432+0000","last_clean":"2024-09-10T14:29:08.787432+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:29:08.787432+0000","last_undegraded":"2024-09-10T14:29:08.787432+0000","last_fullsized":"2024-09-10T14:29:08.787432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:11.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071529+0000","last_change":"2024-09-10T14:28:30.887181+0000","last_active":"2024-09-10T14:31:44.071529+0000","last_peered":"2024-09-10T14:31:44.071529+0000","last_clean":"2024-09-10T14:31:44.071529+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:31:44.071529+0000","last_undegraded":"2024-09-10T14:31:44.071529+0000","last_fullsized":"2024-09-10T14:31:44.071529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:11.379786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096944+0000","last_change":"2024-09-10T14:28:28.878802+0000","last_active":"2024-09-10T14:29:09.096944+0000","last_peered":"2024-09-10T14:29:09.096944+0000","last_clean":"2024-09-10T14:29:09.096944+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:29:09.096944+0000","last_undegraded":"2024-09-10T14:29:09.096944+0000","last_fullsized":"2024-09-10T14:29:09.096944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:26.929099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.875049+0000","last_change":"2024-09-10T14:28:30.873038+0000","last_active":"2024-09-10T14:31:43.875049+0000","last_peered":"2024-09-10T14:31:43.875049+0000","last_clean":"2024-09-10T14:31:43.875049+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:31:43.875049+0000","last_undegraded":"2024-09-10T14:31:43.875049+0000","last_fullsized":"2024-09-10T14:31:43.875049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:24.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768501+0000","last_change":"2024-09-10T14:28:28.893263+0000","last_active":"2024-09-10T14:29:08.768501+0000","last_peered":"2024-09-10T14:29:08.768501+0000","last_clean":"2024-09-10T14:29:08.768501+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:29:08.768501+0000","last_undegraded":"2024-09-10T14:29:08.768501+0000","last_fullsized":"2024-09-10T14:29:08.768501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:14.670209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072636+0000","last_change":"2024-09-10T14:28:30.885304+0000","last_active":"2024-09-10T14:31:44.072636+0000","last_peered":"2024-09-10T14:31:44.072636+0000","last_clean":"2024-09-10T14:31:44.072636+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:31:44.072636+0000","last_undegraded":"2024-09-10T14:31:44.072636+0000","last_fullsized":"2024-09-10T14:31:44.072636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:52.328031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.489629+0000","last_change":"2024-09-10T14:28:28.879959+0000","last_active":"2024-09-10T14:29:13.489629+0000","last_peered":"2024-09-10T14:29:13.489629+0000","last_clean":"2024-09-10T14:29:13.489629+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:29:13.489629+0000","last_undegraded":"2024-09-10T14:29:13.489629+0000","last_fullsized":"2024-09-10T14:29:13.489629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.028308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071788+0000","last_change":"2024-09-10T14:28:30.875900+0000","last_active":"2024-09-10T14:31:44.071788+0000","last_peered":"2024-09-10T14:31:44.071788+0000","last_clean":"2024-09-10T14:31:44.071788+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:31:44.071788+0000","last_undegraded":"2024-09-10T14:31:44.071788+0000","last_fullsized":"2024-09-10T14:31:44.071788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:33.823970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777667+0000","last_change":"2024-09-10T14:28:28.888402+0000","last_active":"2024-09-10T14:29:08.777667+0000","last_peered":"2024-09-10T14:29:08.777667+0000","last_clean":"2024-09-10T14:29:08.777667+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:29:08.777667+0000","last_undegraded":"2024-09-10T14:29:08.777667+0000","last_fullsized":"2024-09-10T14:29:08.777667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:04.011779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.732962+0000","last_change":"2024-09-10T14:28:30.883269+0000","last_active":"2024-09-10T14:31:43.732962+0000","last_peered":"2024-09-10T14:31:43.732962+0000","last_clean":"2024-09-10T14:31:43.732962+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:31:43.732962+0000","last_undegraded":"2024-09-10T14:31:43.732962+0000","last_fullsized":"2024-09-10T14:31:43.732962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.305094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781430+0000","last_change":"2024-09-10T14:28:28.906234+0000","last_active":"2024-09-10T14:29:08.781430+0000","last_peered":"2024-09-10T14:29:08.781430+0000","last_clean":"2024-09-10T14:29:08.781430+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:29:08.781430+0000","last_undegraded":"2024-09-10T14:29:08.781430+0000","last_fullsized":"2024-09-10T14:29:08.781430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:39.391774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227328+0000","last_change":"2024-09-10T14:28:30.886081+0000","last_active":"2024-09-10T14:31:44.227328+0000","last_peered":"2024-09-10T14:31:44.227328+0000","last_clean":"2024-09-10T14:31:44.227328+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:31:44.227328+0000","last_undegraded":"2024-09-10T14:31:44.227328+0000","last_fullsized":"2024-09-10T14:31:44.227328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.771512+0000","last_change":"2024-09-10T14:28:28.890888+0000","last_active":"2024-09-10T14:29:08.771512+0000","last_peered":"2024-09-10T14:29:08.771512+0000","last_clean":"2024-09-10T14:29:08.771512+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:29:08.771512+0000","last_undegraded":"2024-09-10T14:29:08.771512+0000","last_fullsized":"2024-09-10T14:29:08.771512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:40.510621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158665+0000","last_change":"2024-09-10T14:28:30.866941+0000","last_active":"2024-09-10T14:31:44.158665+0000","last_peered":"2024-09-10T14:31:44.158665+0000","last_clean":"2024-09-10T14:31:44.158665+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:31:44.158665+0000","last_undegraded":"2024-09-10T14:31:44.158665+0000","last_fullsized":"2024-09-10T14:31:44.158665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:44.179281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778431+0000","last_change":"2024-09-10T14:28:28.880438+0000","last_active":"2024-09-10T14:29:08.778431+0000","last_peered":"2024-09-10T14:29:08.778431+0000","last_clean":"2024-09-10T14:29:08.778431+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:29:08.778431+0000","last_undegraded":"2024-09-10T14:29:08.778431+0000","last_fullsized":"2024-09-10T14:29:08.778431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:26.888320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'13","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784209+0000","last_change":"2024-09-10T14:28:30.887810+0000","last_active":"2024-09-10T14:30:48.784209+0000","last_peered":"2024-09-10T14:30:48.784209+0000","last_clean":"2024-09-10T14:30:48.784209+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:30:48.784209+0000","last_undegraded":"2024-09-10T14:30:48.784209+0000","last_fullsized":"2024-09-10T14:30:48.784209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:57.157500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788071+0000","last_change":"2024-09-10T14:28:28.914161+0000","last_active":"2024-09-10T14:29:08.788071+0000","last_peered":"2024-09-10T14:29:08.788071+0000","last_clean":"2024-09-10T14:29:08.788071+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:29:08.788071+0000","last_undegraded":"2024-09-10T14:29:08.788071+0000","last_fullsized":"2024-09-10T14:29:08.788071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:57.354096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244157+0000","last_change":"2024-09-10T14:28:30.862241+0000","last_active":"2024-09-10T14:31:44.244157+0000","last_peered":"2024-09-10T14:31:44.244157+0000","last_clean":"2024-09-10T14:31:44.244157+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:31:44.244157+0000","last_undegraded":"2024-09-10T14:31:44.244157+0000","last_fullsized":"2024-09-10T14:31:44.244157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:33.823970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.646886+0000","last_change":"2024-09-10T14:28:28.879289+0000","last_active":"2024-09-10T14:31:43.646886+0000","last_peered":"2024-09-10T14:31:43.646886+0000","last_clean":"2024-09-10T14:31:43.646886+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:31:43.646886+0000","last_undegraded":"2024-09-10T14:31:43.646886+0000","last_fullsized":"2024-09-10T14:31:43.646886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:09.227862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770986+0000","last_change":"2024-09-10T14:28:28.892314+0000","last_active":"2024-09-10T14:29:08.770986+0000","last_peered":"2024-09-10T14:29:08.770986+0000","last_clean":"2024-09-10T14:29:08.770986+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:29:08.770986+0000","last_undegraded":"2024-09-10T14:29:08.770986+0000","last_fullsized":"2024-09-10T14:29:08.770986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:13.058159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227341+0000","last_change":"2024-09-10T14:28:30.891092+0000","last_active":"2024-09-10T14:31:44.227341+0000","last_peered":"2024-09-10T14:31:44.227341+0000","last_clean":"2024-09-10T14:31:44.227341+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:31:44.227341+0000","last_undegraded":"2024-09-10T14:31:44.227341+0000","last_fullsized":"2024-09-10T14:31:44.227341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:24.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:52.777958+0000","last_change":"2024-09-10T14:28:28.881653+0000","last_active":"2024-09-10T14:30:52.777958+0000","last_peered":"2024-09-10T14:30:52.777958+0000","last_clean":"2024-09-10T14:30:52.777958+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:30:52.777958+0000","last_undegraded":"2024-09-10T14:30:52.777958+0000","last_fullsized":"2024-09-10T14:30:52.777958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:53.922561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.791605+0000","last_change":"2024-09-10T14:28:30.887038+0000","last_active":"2024-09-10T14:29:08.791605+0000","last_peered":"2024-09-10T14:29:08.791605+0000","last_clean":"2024-09-10T14:29:08.791605+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:29:08.791605+0000","last_undegraded":"2024-09-10T14:29:08.791605+0000","last_fullsized":"2024-09-10T14:29:08.791605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:55.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640308,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48920,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322920,"statfs":{"total":96636764160,"available":96586670080,"internally_reserved":0,"allocated":9641984,"data_stored":9357446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673013,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":8900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":9113600,"data_stored":8768463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673013,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44776,"kb_used_data":9432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327064,"statfs":{"total":96636764160,"available":96590913536,"internally_reserved":0,"allocated":9658368,"data_stored":9355915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35892,"kb_used_data":8868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335948,"statfs":{"total":96636764160,"available":96600010752,"internally_reserved":0,"allocated":9080832,"data_stored":8769006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:32:16.082 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:32:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.236+0000 7f593ae64640 1 Processor -- start 2024-09-10T14:32:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.236+0000 7f593ae64640 1 -- start start 2024-09-10T14:32:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f593ae64640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5934073290 0x7f5934095600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f593ae64640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5934096880 con 0x7f5934095b40 2024-09-10T14:32:16.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f593ae64640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f593409df00 con 0x7f5934073290 2024-09-10T14:32:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f5938c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5934073290 0x7f5934095600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f5938c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5934073290 0x7f5934095600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40552/0 (socket says 172.21.15.52:40552) 2024-09-10T14:32:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f5938c00640 1 -- 172.21.15.52:0/1389619569 learned_addr learned my addr 172.21.15.52:0/1389619569 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f59337fe640 1 -- 172.21.15.52:0/1389619569 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2739068582 0 0) 0x7f5934096880 con 0x7f5934095b40 2024-09-10T14:32:16.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f59337fe640 1 -- 172.21.15.52:0/1389619569 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f591c003530 con 0x7f5934095b40 2024-09-10T14:32:16.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f5938c00640 1 -- 172.21.15.52:0/1389619569 >> v1:172.21.15.52:6789/0 conn(0x7f5934095b40 legacy=0x7f5934131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f5938c00640 1 -- 172.21.15.52:0/1389619569 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5934096ca0 con 0x7f5934073290 2024-09-10T14:32:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f5938c00640 1 --2- 172.21.15.52:0/1389619569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f5934095600 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f59240097f0 tx=0x7f592401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10a41b4cc990e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f59337fe640 1 -- 172.21.15.52:0/1389619569 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59240ab580 con 0x7f5934073290 2024-09-10T14:32:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f59337fe640 1 -- 172.21.15.52:0/1389619569 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59240b0070 con 0x7f5934073290 2024-09-10T14:32:16.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f59337fe640 1 -- 172.21.15.52:0/1389619569 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59240ab870 con 0x7f5934073290 2024-09-10T14:32:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f593ae64640 1 -- 172.21.15.52:0/1389619569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 msgr2=0x7f5934095600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.240+0000 7f593ae64640 1 --2- 172.21.15.52:0/1389619569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f5934095600 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f59240097f0 tx=0x7f592401c430 comp rx=0 tx=0).stop 2024-09-10T14:32:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- 172.21.15.52:0/1389619569 shutdown_connections 2024-09-10T14:32:16.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 --2- 172.21.15.52:0/1389619569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f5934095600 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- 172.21.15.52:0/1389619569 >> 172.21.15.52:0/1389619569 conn(0x7f593409d6f0 msgr2=0x7f5934099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- 172.21.15.52:0/1389619569 shutdown_connections 2024-09-10T14:32:16.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- 172.21.15.52:0/1389619569 wait complete. 2024-09-10T14:32:16.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 Processor -- start 2024-09-10T14:32:16.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- start start 2024-09-10T14:32:16.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f593412ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:16.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5934074fe0 con 0x7f5934073290 2024-09-10T14:32:16.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f5938c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f593412ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:16.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f5938c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f593412ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40564/0 (socket says 172.21.15.52:40564) 2024-09-10T14:32:16.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f5938c00640 1 -- 172.21.15.52:0/3402244817 learned_addr learned my addr 172.21.15.52:0/3402244817 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:16.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f5938c00640 1 -- 172.21.15.52:0/3402244817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5934092e90 con 0x7f5934073290 2024-09-10T14:32:16.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f5938c00640 1 --2- 172.21.15.52:0/3402244817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f593412ec20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f592401a060 tx=0x7f592401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:16.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f59317fa640 1 -- 172.21.15.52:0/3402244817 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59240abe50 con 0x7f5934073290 2024-09-10T14:32:16.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f59317fa640 1 -- 172.21.15.52:0/3402244817 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59240be3f0 con 0x7f5934073290 2024-09-10T14:32:16.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f59317fa640 1 -- 172.21.15.52:0/3402244817 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59240be6f0 con 0x7f5934073290 2024-09-10T14:32:16.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59340929f0 con 0x7f5934073290 2024-09-10T14:32:16.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5934093cf0 con 0x7f5934073290 2024-09-10T14:32:16.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5934122550 con 0x7f5934073290 2024-09-10T14:32:16.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.244+0000 7f59317fa640 1 -- 172.21.15.52:0/3402244817 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f59240c7440 con 0x7f5934073290 2024-09-10T14:32:16.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.248+0000 7f59317fa640 1 --2- 172.21.15.52:0/3402244817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5920035f50 0x7f5920038410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:16.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.248+0000 7f59317fa640 1 -- 172.21.15.52:0/3402244817 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f59240e3a40 con 0x7f5934073290 2024-09-10T14:32:16.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.248+0000 7f5933fff640 1 --2- 172.21.15.52:0/3402244817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5920035f50 0x7f5920038410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:16.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.248+0000 7f5933fff640 1 --2- 172.21.15.52:0/3402244817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5920035f50 0x7f5920038410 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5928001570 tx=0x7f5928007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:16.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.252+0000 7f59317fa640 1 -- 172.21.15.52:0/3402244817 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59240160b0 con 0x7f5934073290 2024-09-10T14:32:16.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.412+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5934095600 con 0x7f5920035f50 2024-09-10T14:32:16.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.460+0000 7f59317fa640 1 -- 172.21.15.52:0/3402244817 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666056 (secure 0 0 0) 0x7f5934095600 con 0x7f5920035f50 2024-09-10T14:32:16.465 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:32:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5920035f50 msgr2=0x7f5920038410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 --2- 172.21.15.52:0/3402244817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5920035f50 0x7f5920038410 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5928001570 tx=0x7f5928007c90 comp rx=0 tx=0).stop 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 msgr2=0x7f593412ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 --2- 172.21.15.52:0/3402244817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f593412ec20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f592401a060 tx=0x7f592401ac70 comp rx=0 tx=0).stop 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 shutdown_connections 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 --2- 172.21.15.52:0/3402244817 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5920035f50 0x7f5920038410 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 --2- 172.21.15.52:0/3402244817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934073290 0x7f593412ec20 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 >> 172.21.15.52:0/3402244817 conn(0x7f593409d6f0 msgr2=0x7f5934098980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 shutdown_connections 2024-09-10T14:32:16.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.468+0000 7f593ae64640 1 -- 172.21.15.52:0/3402244817 wait complete. 2024-09-10T14:32:16.492 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-10T14:32:14.794985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416905,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4892,"num_read_kb":4469,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173832,"kb_used_data":36616,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313528,"statfs":{"total":386547056640,"available":386369052672,"internally_reserved":0,"allocated":37494784,"data_stored":36250830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005956"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786610+0000","last_change":"2024-09-10T14:28:28.910643+0000","last_active":"2024-09-10T14:29:08.786610+0000","last_peered":"2024-09-10T14:29:08.786610+0000","last_clean":"2024-09-10T14:29:08.786610+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:29:08.786610+0000","last_undegraded":"2024-09-10T14:29:08.786610+0000","last_fullsized":"2024-09-10T14:29:08.786610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:48.682064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743959+0000","last_change":"2024-09-10T14:28:30.866892+0000","last_active":"2024-09-10T14:29:15.743959+0000","last_peered":"2024-09-10T14:29:15.743959+0000","last_clean":"2024-09-10T14:29:15.743959+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:29:15.743959+0000","last_undegraded":"2024-09-10T14:29:15.743959+0000","last_fullsized":"2024-09-10T14:29:15.743959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.106885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.900665+0000","last_change":"2024-09-10T14:28:28.880130+0000","last_active":"2024-09-10T14:30:42.900665+0000","last_peered":"2024-09-10T14:30:42.900665+0000","last_clean":"2024-09-10T14:30:42.900665+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:30:42.900665+0000","last_undegraded":"2024-09-10T14:30:42.900665+0000","last_fullsized":"2024-09-10T14:30:42.900665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:27.360132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.874392+0000","last_change":"2024-09-10T14:28:30.882162+0000","last_active":"2024-09-10T14:31:43.874392+0000","last_peered":"2024-09-10T14:31:43.874392+0000","last_clean":"2024-09-10T14:31:43.874392+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:31:43.874392+0000","last_undegraded":"2024-09-10T14:31:43.874392+0000","last_fullsized":"2024-09-10T14:31:43.874392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:58.678590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779170+0000","last_change":"2024-09-10T14:28:28.879906+0000","last_active":"2024-09-10T14:29:08.779170+0000","last_peered":"2024-09-10T14:29:08.779170+0000","last_clean":"2024-09-10T14:29:08.779170+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:29:08.779170+0000","last_undegraded":"2024-09-10T14:29:08.779170+0000","last_fullsized":"2024-09-10T14:29:08.779170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:53.690949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072389+0000","last_change":"2024-09-10T14:28:30.882676+0000","last_active":"2024-09-10T14:31:44.072389+0000","last_peered":"2024-09-10T14:31:44.072389+0000","last_clean":"2024-09-10T14:31:44.072389+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:31:44.072389+0000","last_undegraded":"2024-09-10T14:31:44.072389+0000","last_fullsized":"2024-09-10T14:31:44.072389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:24.078737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.014030+0000","last_change":"2024-09-10T14:28:28.893233+0000","last_active":"2024-09-10T14:29:15.014030+0000","last_peered":"2024-09-10T14:29:15.014030+0000","last_clean":"2024-09-10T14:29:15.014030+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:29:15.014030+0000","last_undegraded":"2024-09-10T14:29:15.014030+0000","last_fullsized":"2024-09-10T14:29:15.014030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:11.076894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.045939+0000","last_change":"2024-09-10T14:28:30.881166+0000","last_active":"2024-09-10T14:30:39.045939+0000","last_peered":"2024-09-10T14:30:39.045939+0000","last_clean":"2024-09-10T14:30:39.045939+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:30:39.045939+0000","last_undegraded":"2024-09-10T14:30:39.045939+0000","last_fullsized":"2024-09-10T14:30:39.045939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:52.006581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770599+0000","last_change":"2024-09-10T14:28:28.883653+0000","last_active":"2024-09-10T14:29:08.770599+0000","last_peered":"2024-09-10T14:29:08.770599+0000","last_clean":"2024-09-10T14:29:08.770599+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:29:08.770599+0000","last_undegraded":"2024-09-10T14:29:08.770599+0000","last_fullsized":"2024-09-10T14:29:08.770599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:29.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.174109+0000","last_change":"2024-09-10T14:28:30.890087+0000","last_active":"2024-09-10T14:31:44.174109+0000","last_peered":"2024-09-10T14:31:44.174109+0000","last_clean":"2024-09-10T14:31:44.174109+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:31:44.174109+0000","last_undegraded":"2024-09-10T14:31:44.174109+0000","last_fullsized":"2024-09-10T14:31:44.174109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:24.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777518+0000","last_change":"2024-09-10T14:28:28.910148+0000","last_active":"2024-09-10T14:29:08.777518+0000","last_peered":"2024-09-10T14:29:08.777518+0000","last_clean":"2024-09-10T14:29:08.777518+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:29:08.777518+0000","last_undegraded":"2024-09-10T14:29:08.777518+0000","last_fullsized":"2024-09-10T14:29:08.777518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:47.128454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.736734+0000","last_change":"2024-09-10T14:28:30.875024+0000","last_active":"2024-09-10T14:31:43.736734+0000","last_peered":"2024-09-10T14:31:43.736734+0000","last_clean":"2024-09-10T14:31:43.736734+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:31:43.736734+0000","last_undegraded":"2024-09-10T14:31:43.736734+0000","last_fullsized":"2024-09-10T14:31:43.736734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:47.679026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770570+0000","last_change":"2024-09-10T14:28:28.890726+0000","last_active":"2024-09-10T14:29:08.770570+0000","last_peered":"2024-09-10T14:29:08.770570+0000","last_clean":"2024-09-10T14:29:08.770570+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:29:08.770570+0000","last_undegraded":"2024-09-10T14:29:08.770570+0000","last_fullsized":"2024-09-10T14:29:08.770570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:31.814715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'7","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.774452+0000","last_change":"2024-09-10T14:28:30.863498+0000","last_active":"2024-09-10T14:30:39.774452+0000","last_peered":"2024-09-10T14:30:39.774452+0000","last_clean":"2024-09-10T14:30:39.774452+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:30:39.774452+0000","last_undegraded":"2024-09-10T14:30:39.774452+0000","last_fullsized":"2024-09-10T14:30:39.774452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:34.818610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.089975+0000","last_change":"2024-09-10T14:28:28.876209+0000","last_active":"2024-09-10T14:29:09.089975+0000","last_peered":"2024-09-10T14:29:09.089975+0000","last_clean":"2024-09-10T14:29:09.089975+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:29:09.089975+0000","last_undegraded":"2024-09-10T14:29:09.089975+0000","last_fullsized":"2024-09-10T14:29:09.089975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:23.440776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.735816+0000","last_change":"2024-09-10T14:28:30.870535+0000","last_active":"2024-09-10T14:31:43.735816+0000","last_peered":"2024-09-10T14:31:43.735816+0000","last_clean":"2024-09-10T14:31:43.735816+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:31:43.735816+0000","last_undegraded":"2024-09-10T14:31:43.735816+0000","last_fullsized":"2024-09-10T14:31:43.735816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:16.469019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158427+0000","last_change":"2024-09-10T14:28:30.875126+0000","last_active":"2024-09-10T14:31:44.158427+0000","last_peered":"2024-09-10T14:31:44.158427+0000","last_clean":"2024-09-10T14:31:44.158427+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:31:44.158427+0000","last_undegraded":"2024-09-10T14:31:44.158427+0000","last_fullsized":"2024-09-10T14:31:44.158427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:31.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.790246+0000","last_change":"2024-09-10T14:28:28.902646+0000","last_active":"2024-09-10T14:29:08.790246+0000","last_peered":"2024-09-10T14:29:08.790246+0000","last_clean":"2024-09-10T14:29:08.790246+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:29:08.790246+0000","last_undegraded":"2024-09-10T14:29:08.790246+0000","last_fullsized":"2024-09-10T14:29:08.790246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:06.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071851+0000","last_change":"2024-09-10T14:28:30.871743+0000","last_active":"2024-09-10T14:31:44.071851+0000","last_peered":"2024-09-10T14:31:44.071851+0000","last_clean":"2024-09-10T14:31:44.071851+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:31:44.071851+0000","last_undegraded":"2024-09-10T14:31:44.071851+0000","last_fullsized":"2024-09-10T14:31:44.071851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:02.612612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788313+0000","last_change":"2024-09-10T14:28:28.913772+0000","last_active":"2024-09-10T14:29:08.788313+0000","last_peered":"2024-09-10T14:29:08.788313+0000","last_clean":"2024-09-10T14:29:08.788313+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:29:08.788313+0000","last_undegraded":"2024-09-10T14:29:08.788313+0000","last_fullsized":"2024-09-10T14:29:08.788313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:33.401745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.731033+0000","last_change":"2024-09-10T14:28:30.866947+0000","last_active":"2024-09-10T14:31:43.731033+0000","last_peered":"2024-09-10T14:31:43.731033+0000","last_clean":"2024-09-10T14:31:43.731033+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:31:43.731033+0000","last_undegraded":"2024-09-10T14:31:43.731033+0000","last_fullsized":"2024-09-10T14:31:43.731033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:33.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787811+0000","last_change":"2024-09-10T14:28:28.904198+0000","last_active":"2024-09-10T14:29:08.787811+0000","last_peered":"2024-09-10T14:29:08.787811+0000","last_clean":"2024-09-10T14:29:08.787811+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:29:08.787811+0000","last_undegraded":"2024-09-10T14:29:08.787811+0000","last_fullsized":"2024-09-10T14:29:08.787811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.028308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071682+0000","last_change":"2024-09-10T14:28:30.886686+0000","last_active":"2024-09-10T14:31:44.071682+0000","last_peered":"2024-09-10T14:31:44.071682+0000","last_clean":"2024-09-10T14:31:44.071682+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:44.071682+0000","last_undegraded":"2024-09-10T14:31:44.071682+0000","last_fullsized":"2024-09-10T14:31:44.071682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:43.469877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.020496+0000","last_change":"2024-09-10T14:28:28.888634+0000","last_active":"2024-09-10T14:29:15.020496+0000","last_peered":"2024-09-10T14:29:15.020496+0000","last_clean":"2024-09-10T14:29:15.020496+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:29:15.020496+0000","last_undegraded":"2024-09-10T14:29:15.020496+0000","last_fullsized":"2024-09-10T14:29:15.020496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:53.922561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158256+0000","last_change":"2024-09-10T14:28:30.870293+0000","last_active":"2024-09-10T14:31:44.158256+0000","last_peered":"2024-09-10T14:31:44.158256+0000","last_clean":"2024-09-10T14:31:44.158256+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:31:44.158256+0000","last_undegraded":"2024-09-10T14:31:44.158256+0000","last_fullsized":"2024-09-10T14:31:44.158256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:43.141173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.026158+0000","last_change":"2024-09-10T14:28:28.880689+0000","last_active":"2024-09-10T14:29:15.026158+0000","last_peered":"2024-09-10T14:29:15.026158+0000","last_clean":"2024-09-10T14:29:15.026158+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:29:15.026158+0000","last_undegraded":"2024-09-10T14:29:15.026158+0000","last_fullsized":"2024-09-10T14:29:15.026158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:06.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.046094+0000","last_change":"2024-09-10T14:28:30.889817+0000","last_active":"2024-09-10T14:30:39.046094+0000","last_peered":"2024-09-10T14:30:39.046094+0000","last_clean":"2024-09-10T14:30:39.046094+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:30:39.046094+0000","last_undegraded":"2024-09-10T14:30:39.046094+0000","last_fullsized":"2024-09-10T14:30:39.046094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:39.111758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770582+0000","last_change":"2024-09-10T14:28:28.891649+0000","last_active":"2024-09-10T14:29:08.770582+0000","last_peered":"2024-09-10T14:29:08.770582+0000","last_clean":"2024-09-10T14:29:08.770582+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:29:08.770582+0000","last_undegraded":"2024-09-10T14:29:08.770582+0000","last_fullsized":"2024-09-10T14:29:08.770582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:27.536920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.117237+0000","last_change":"2024-09-10T14:28:38.936524+0000","last_active":"2024-09-10T14:31:44.117237+0000","last_peered":"2024-09-10T14:31:44.117237+0000","last_clean":"2024-09-10T14:31:44.117237+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:31:44.117237+0000","last_undegraded":"2024-09-10T14:31:44.117237+0000","last_fullsized":"2024-09-10T14:31:44.117237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:46.216225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.756204+0000","last_change":"2024-09-10T14:29:07.798075+0000","last_active":"2024-09-10T14:29:09.756204+0000","last_peered":"2024-09-10T14:29:09.756204+0000","last_clean":"2024-09-10T14:29:09.756204+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:29:09.756204+0000","last_undegraded":"2024-09-10T14:29:09.756204+0000","last_fullsized":"2024-09-10T14:29:09.756204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:42.171906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770128+0000","last_change":"2024-09-10T14:28:28.894485+0000","last_active":"2024-09-10T14:29:08.770128+0000","last_peered":"2024-09-10T14:29:08.770128+0000","last_clean":"2024-09-10T14:29:08.770128+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:29:08.770128+0000","last_undegraded":"2024-09-10T14:29:08.770128+0000","last_fullsized":"2024-09-10T14:29:08.770128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:00.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776839+0000","last_change":"2024-09-10T14:28:32.888789+0000","last_active":"2024-09-10T14:29:08.776839+0000","last_peered":"2024-09-10T14:29:08.776839+0000","last_clean":"2024-09-10T14:29:08.776839+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:29:08.776839+0000","last_undegraded":"2024-09-10T14:29:08.776839+0000","last_fullsized":"2024-09-10T14:29:08.776839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:23.555023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'31","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.122649+0000","last_change":"2024-09-10T14:28:34.924424+0000","last_active":"2024-09-10T14:30:41.122649+0000","last_peered":"2024-09-10T14:30:41.122649+0000","last_clean":"2024-09-10T14:30:41.122649+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:30:41.122649+0000","last_undegraded":"2024-09-10T14:30:41.122649+0000","last_fullsized":"2024-09-10T14:30:41.122649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:02.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.790013+0000","last_change":"2024-09-10T14:28:36.938810+0000","last_active":"2024-09-10T14:29:08.790013+0000","last_peered":"2024-09-10T14:29:08.790013+0000","last_clean":"2024-09-10T14:29:08.790013+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:29:08.790013+0000","last_undegraded":"2024-09-10T14:29:08.790013+0000","last_fullsized":"2024-09-10T14:29:08.790013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:28.542198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.081040+0000","last_change":"2024-09-10T14:28:38.938155+0000","last_active":"2024-09-10T14:29:58.081040+0000","last_peered":"2024-09-10T14:29:58.081040+0000","last_clean":"2024-09-10T14:29:58.081040+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:29:58.081040+0000","last_undegraded":"2024-09-10T14:29:58.081040+0000","last_fullsized":"2024-09-10T14:29:58.081040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:16.961180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.731924+0000","last_change":"2024-09-10T14:28:30.876193+0000","last_active":"2024-09-10T14:31:43.731924+0000","last_peered":"2024-09-10T14:31:43.731924+0000","last_clean":"2024-09-10T14:31:43.731924+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:31:43.731924+0000","last_undegraded":"2024-09-10T14:31:43.731924+0000","last_fullsized":"2024-09-10T14:31:43.731924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.676792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776547+0000","last_change":"2024-09-10T14:28:28.895357+0000","last_active":"2024-09-10T14:30:49.776547+0000","last_peered":"2024-09-10T14:30:49.776547+0000","last_clean":"2024-09-10T14:30:49.776547+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:30:49.776547+0000","last_undegraded":"2024-09-10T14:30:49.776547+0000","last_fullsized":"2024-09-10T14:30:49.776547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.503117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099939+0000","last_change":"2024-09-10T14:28:32.878643+0000","last_active":"2024-09-10T14:29:09.099939+0000","last_peered":"2024-09-10T14:29:09.099939+0000","last_clean":"2024-09-10T14:29:09.099939+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:29:09.099939+0000","last_undegraded":"2024-09-10T14:29:09.099939+0000","last_fullsized":"2024-09-10T14:29:09.099939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:40.671350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788992+0000","last_change":"2024-09-10T14:28:34.889859+0000","last_active":"2024-09-10T14:29:08.788992+0000","last_peered":"2024-09-10T14:29:08.788992+0000","last_clean":"2024-09-10T14:29:08.788992+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:29:08.788992+0000","last_undegraded":"2024-09-10T14:29:08.788992+0000","last_fullsized":"2024-09-10T14:29:08.788992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:01.183310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788847+0000","last_change":"2024-09-10T14:28:36.934864+0000","last_active":"2024-09-10T14:29:08.788847+0000","last_peered":"2024-09-10T14:29:08.788847+0000","last_clean":"2024-09-10T14:29:08.788847+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:29:08.788847+0000","last_undegraded":"2024-09-10T14:29:08.788847+0000","last_fullsized":"2024-09-10T14:29:08.788847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.099079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095653+0000","last_change":"2024-09-10T14:28:38.928569+0000","last_active":"2024-09-10T14:29:09.095653+0000","last_peered":"2024-09-10T14:29:09.095653+0000","last_clean":"2024-09-10T14:29:09.095653+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:29:09.095653+0000","last_undegraded":"2024-09-10T14:29:09.095653+0000","last_fullsized":"2024-09-10T14:29:09.095653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:44.292475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787199+0000","last_change":"2024-09-10T14:28:30.879918+0000","last_active":"2024-09-10T14:30:58.787199+0000","last_peered":"2024-09-10T14:30:58.787199+0000","last_clean":"2024-09-10T14:30:58.787199+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:30:58.787199+0000","last_undegraded":"2024-09-10T14:30:58.787199+0000","last_fullsized":"2024-09-10T14:30:58.787199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:58.593808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784157+0000","last_change":"2024-09-10T14:28:28.890448+0000","last_active":"2024-09-10T14:30:48.784157+0000","last_peered":"2024-09-10T14:30:48.784157+0000","last_clean":"2024-09-10T14:30:48.784157+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:30:48.784157+0000","last_undegraded":"2024-09-10T14:30:48.784157+0000","last_fullsized":"2024-09-10T14:30:48.784157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:42.170026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.105820+0000","last_change":"2024-09-10T14:28:32.878770+0000","last_active":"2024-09-10T14:29:09.105820+0000","last_peered":"2024-09-10T14:29:09.105820+0000","last_clean":"2024-09-10T14:29:09.105820+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:29:09.105820+0000","last_undegraded":"2024-09-10T14:29:09.105820+0000","last_fullsized":"2024-09-10T14:29:09.105820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.818547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.780586+0000","last_change":"2024-09-10T14:28:34.899375+0000","last_active":"2024-09-10T14:29:08.780586+0000","last_peered":"2024-09-10T14:29:08.780586+0000","last_clean":"2024-09-10T14:29:08.780586+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:29:08.780586+0000","last_undegraded":"2024-09-10T14:29:08.780586+0000","last_fullsized":"2024-09-10T14:29:08.780586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:14.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120357+0000","last_change":"2024-09-10T14:28:36.944400+0000","last_active":"2024-09-10T14:31:43.120357+0000","last_peered":"2024-09-10T14:31:43.120357+0000","last_clean":"2024-09-10T14:31:43.120357+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:31:43.120357+0000","last_undegraded":"2024-09-10T14:31:43.120357+0000","last_fullsized":"2024-09-10T14:31:43.120357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:47.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.039826+0000","last_change":"2024-09-10T14:28:38.944662+0000","last_active":"2024-09-10T14:29:15.039826+0000","last_peered":"2024-09-10T14:29:15.039826+0000","last_clean":"2024-09-10T14:29:15.039826+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:29:15.039826+0000","last_undegraded":"2024-09-10T14:29:15.039826+0000","last_fullsized":"2024-09-10T14:29:15.039826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:11.695801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.888919+0000","last_change":"2024-09-10T14:28:30.884927+0000","last_active":"2024-09-10T14:31:43.888919+0000","last_peered":"2024-09-10T14:31:43.888919+0000","last_clean":"2024-09-10T14:31:43.888919+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:31:43.888919+0000","last_undegraded":"2024-09-10T14:31:43.888919+0000","last_fullsized":"2024-09-10T14:31:43.888919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:44.179281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.775615+0000","last_change":"2024-09-10T14:28:28.898609+0000","last_active":"2024-09-10T14:29:08.775615+0000","last_peered":"2024-09-10T14:29:08.775615+0000","last_clean":"2024-09-10T14:29:08.775615+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:29:08.775615+0000","last_undegraded":"2024-09-10T14:29:08.775615+0000","last_fullsized":"2024-09-10T14:29:08.775615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:14.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'4","reported_seq":228,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.577706+0000","last_change":"2024-09-10T14:28:32.888011+0000","last_active":"2024-09-10T14:30:42.577706+0000","last_peered":"2024-09-10T14:30:42.577706+0000","last_clean":"2024-09-10T14:30:42.577706+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:30:42.577706+0000","last_undegraded":"2024-09-10T14:30:42.577706+0000","last_fullsized":"2024-09-10T14:30:42.577706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:37.315922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.114910+0000","last_change":"2024-09-10T14:28:34.904591+0000","last_active":"2024-09-10T14:30:41.114910+0000","last_peered":"2024-09-10T14:30:41.114910+0000","last_clean":"2024-09-10T14:30:41.114910+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:30:41.114910+0000","last_undegraded":"2024-09-10T14:30:41.114910+0000","last_fullsized":"2024-09-10T14:30:41.114910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:15.929628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.235240+0000","last_change":"2024-09-10T14:28:36.902535+0000","last_active":"2024-09-10T14:31:44.235240+0000","last_peered":"2024-09-10T14:31:44.235240+0000","last_clean":"2024-09-10T14:31:44.235240+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:31:44.235240+0000","last_undegraded":"2024-09-10T14:31:44.235240+0000","last_fullsized":"2024-09-10T14:31:44.235240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:44.147166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.731663+0000","last_change":"2024-09-10T14:28:30.870811+0000","last_active":"2024-09-10T14:29:14.731663+0000","last_peered":"2024-09-10T14:29:14.731663+0000","last_clean":"2024-09-10T14:29:14.731663+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:29:14.731663+0000","last_undegraded":"2024-09-10T14:29:14.731663+0000","last_fullsized":"2024-09-10T14:29:14.731663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:38.431813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786131+0000","last_change":"2024-09-10T14:28:28.910600+0000","last_active":"2024-09-10T14:29:08.786131+0000","last_peered":"2024-09-10T14:29:08.786131+0000","last_clean":"2024-09-10T14:29:08.786131+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:29:08.786131+0000","last_undegraded":"2024-09-10T14:29:08.786131+0000","last_fullsized":"2024-09-10T14:29:08.786131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:28.271184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776997+0000","last_change":"2024-09-10T14:28:32.888462+0000","last_active":"2024-09-10T14:29:08.776997+0000","last_peered":"2024-09-10T14:29:08.776997+0000","last_clean":"2024-09-10T14:29:08.776997+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:29:08.776997+0000","last_undegraded":"2024-09-10T14:29:08.776997+0000","last_fullsized":"2024-09-10T14:29:08.776997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.818547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.128780+0000","last_change":"2024-09-10T14:28:34.891163+0000","last_active":"2024-09-10T14:30:41.128780+0000","last_peered":"2024-09-10T14:30:41.128780+0000","last_clean":"2024-09-10T14:30:41.128780+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:30:41.128780+0000","last_undegraded":"2024-09-10T14:30:41.128780+0000","last_fullsized":"2024-09-10T14:30:41.128780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:43.916591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095295+0000","last_change":"2024-09-10T14:28:36.914343+0000","last_active":"2024-09-10T14:29:09.095295+0000","last_peered":"2024-09-10T14:29:09.095295+0000","last_clean":"2024-09-10T14:29:09.095295+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:29:09.095295+0000","last_undegraded":"2024-09-10T14:29:09.095295+0000","last_fullsized":"2024-09-10T14:29:09.095295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:44.165530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.084003+0000","last_change":"2024-09-10T14:28:38.934568+0000","last_active":"2024-09-10T14:29:58.084003+0000","last_peered":"2024-09-10T14:29:58.084003+0000","last_clean":"2024-09-10T14:29:58.084003+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:29:58.084003+0000","last_undegraded":"2024-09-10T14:29:58.084003+0000","last_fullsized":"2024-09-10T14:29:58.084003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:16.561899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.781133+0000","last_change":"2024-09-10T14:28:30.867445+0000","last_active":"2024-09-10T14:30:43.781133+0000","last_peered":"2024-09-10T14:30:43.781133+0000","last_clean":"2024-09-10T14:30:43.781133+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:30:43.781133+0000","last_undegraded":"2024-09-10T14:30:43.781133+0000","last_fullsized":"2024-09-10T14:30:43.781133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:43.469877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786715+0000","last_change":"2024-09-10T14:28:28.895275+0000","last_active":"2024-09-10T14:29:08.786715+0000","last_peered":"2024-09-10T14:29:08.786715+0000","last_clean":"2024-09-10T14:29:08.786715+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:29:08.786715+0000","last_undegraded":"2024-09-10T14:29:08.786715+0000","last_fullsized":"2024-09-10T14:29:08.786715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.143838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096657+0000","last_change":"2024-09-10T14:28:32.877092+0000","last_active":"2024-09-10T14:29:09.096657+0000","last_peered":"2024-09-10T14:29:09.096657+0000","last_clean":"2024-09-10T14:29:09.096657+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:29:09.096657+0000","last_undegraded":"2024-09-10T14:29:09.096657+0000","last_fullsized":"2024-09-10T14:29:09.096657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:27.977679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.100623+0000","last_change":"2024-09-10T14:28:34.915801+0000","last_active":"2024-09-10T14:30:41.100623+0000","last_peered":"2024-09-10T14:30:41.100623+0000","last_clean":"2024-09-10T14:30:41.100623+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:30:41.100623+0000","last_undegraded":"2024-09-10T14:30:41.100623+0000","last_fullsized":"2024-09-10T14:30:41.100623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:45.906678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.090834+0000","last_change":"2024-09-10T14:28:36.924324+0000","last_active":"2024-09-10T14:29:09.090834+0000","last_peered":"2024-09-10T14:29:09.090834+0000","last_clean":"2024-09-10T14:29:09.090834+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:29:09.090834+0000","last_undegraded":"2024-09-10T14:29:09.090834+0000","last_fullsized":"2024-09-10T14:29:09.090834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:03.128287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'5","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:52.401551+0000","last_change":"2024-09-10T14:28:38.933258+0000","last_active":"2024-09-10T14:29:52.401551+0000","last_peered":"2024-09-10T14:29:52.401551+0000","last_clean":"2024-09-10T14:29:52.401551+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:29:52.401551+0000","last_undegraded":"2024-09-10T14:29:52.401551+0000","last_fullsized":"2024-09-10T14:29:52.401551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:44.292475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.156496+0000","last_change":"2024-09-10T14:29:07.803940+0000","last_active":"2024-09-10T14:31:44.156496+0000","last_peered":"2024-09-10T14:31:44.156496+0000","last_clean":"2024-09-10T14:31:44.156496+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:31:44.156496+0000","last_undegraded":"2024-09-10T14:31:44.156496+0000","last_fullsized":"2024-09-10T14:31:44.156496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:14.995711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778671+0000","last_change":"2024-09-10T14:28:28.889610+0000","last_active":"2024-09-10T14:29:08.778671+0000","last_peered":"2024-09-10T14:29:08.778671+0000","last_clean":"2024-09-10T14:29:08.778671+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:29:08.778671+0000","last_undegraded":"2024-09-10T14:29:08.778671+0000","last_fullsized":"2024-09-10T14:29:08.778671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:27.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099744+0000","last_change":"2024-09-10T14:28:32.877306+0000","last_active":"2024-09-10T14:29:09.099744+0000","last_peered":"2024-09-10T14:29:09.099744+0000","last_clean":"2024-09-10T14:29:09.099744+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:29:09.099744+0000","last_undegraded":"2024-09-10T14:29:09.099744+0000","last_fullsized":"2024-09-10T14:29:09.099744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:59.002429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.130848+0000","last_change":"2024-09-10T14:28:34.910458+0000","last_active":"2024-09-10T14:30:41.130848+0000","last_peered":"2024-09-10T14:30:41.130848+0000","last_clean":"2024-09-10T14:30:41.130848+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:30:41.130848+0000","last_undegraded":"2024-09-10T14:30:41.130848+0000","last_fullsized":"2024-09-10T14:30:41.130848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:11.614047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":357,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.421931+0000","last_change":"2024-09-10T14:28:36.924500+0000","last_active":"2024-09-10T14:31:44.421931+0000","last_peered":"2024-09-10T14:31:44.421931+0000","last_clean":"2024-09-10T14:31:44.421931+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:31:44.421931+0000","last_undegraded":"2024-09-10T14:31:44.421931+0000","last_fullsized":"2024-09-10T14:31:44.421931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:18.061873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.102731+0000","last_change":"2024-09-10T14:28:38.936021+0000","last_active":"2024-09-10T14:29:09.102731+0000","last_peered":"2024-09-10T14:29:09.102731+0000","last_clean":"2024-09-10T14:29:09.102731+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:29:09.102731+0000","last_undegraded":"2024-09-10T14:29:09.102731+0000","last_fullsized":"2024-09-10T14:29:09.102731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'11","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776609+0000","last_change":"2024-09-10T14:28:30.859489+0000","last_active":"2024-09-10T14:30:49.776609+0000","last_peered":"2024-09-10T14:30:49.776609+0000","last_clean":"2024-09-10T14:30:49.776609+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:30:49.776609+0000","last_undegraded":"2024-09-10T14:30:49.776609+0000","last_fullsized":"2024-09-10T14:30:49.776609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:12.219239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770620+0000","last_change":"2024-09-10T14:28:28.884739+0000","last_active":"2024-09-10T14:29:08.770620+0000","last_peered":"2024-09-10T14:29:08.770620+0000","last_clean":"2024-09-10T14:29:08.770620+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:29:08.770620+0000","last_undegraded":"2024-09-10T14:29:08.770620+0000","last_fullsized":"2024-09-10T14:29:08.770620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:09.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"26'1","reported_seq":220,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.591860+0000","last_change":"2024-09-10T14:28:32.883434+0000","last_active":"2024-09-10T14:30:42.591860+0000","last_peered":"2024-09-10T14:30:42.591860+0000","last_clean":"2024-09-10T14:30:42.591860+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:30:42.591860+0000","last_undegraded":"2024-09-10T14:30:42.591860+0000","last_fullsized":"2024-09-10T14:30:42.591860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:15.866979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'55","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.132850+0000","last_change":"2024-09-10T14:28:34.914638+0000","last_active":"2024-09-10T14:30:41.132850+0000","last_peered":"2024-09-10T14:30:41.132850+0000","last_clean":"2024-09-10T14:30:41.132850+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:30:41.132850+0000","last_undegraded":"2024-09-10T14:30:41.132850+0000","last_fullsized":"2024-09-10T14:30:41.132850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:09.979440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.092054+0000","last_change":"2024-09-10T14:28:36.903930+0000","last_active":"2024-09-10T14:29:09.092054+0000","last_peered":"2024-09-10T14:29:09.092054+0000","last_clean":"2024-09-10T14:29:09.092054+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:29:09.092054+0000","last_undegraded":"2024-09-10T14:29:09.092054+0000","last_fullsized":"2024-09-10T14:29:09.092054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:07.331691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'20","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.381980+0000","last_change":"2024-09-10T14:28:38.919907+0000","last_active":"2024-09-10T14:31:44.381980+0000","last_peered":"2024-09-10T14:31:44.381980+0000","last_clean":"2024-09-10T14:31:44.381980+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:31:44.381980+0000","last_undegraded":"2024-09-10T14:31:44.381980+0000","last_fullsized":"2024-09-10T14:31:44.381980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:42:57.760263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.889287+0000","last_change":"2024-09-10T14:28:30.878590+0000","last_active":"2024-09-10T14:31:43.889287+0000","last_peered":"2024-09-10T14:31:43.889287+0000","last_clean":"2024-09-10T14:31:43.889287+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:31:43.889287+0000","last_undegraded":"2024-09-10T14:31:43.889287+0000","last_fullsized":"2024-09-10T14:31:43.889287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:43.722443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096578+0000","last_change":"2024-09-10T14:28:28.877127+0000","last_active":"2024-09-10T14:29:09.096578+0000","last_peered":"2024-09-10T14:29:09.096578+0000","last_clean":"2024-09-10T14:29:09.096578+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:29:09.096578+0000","last_undegraded":"2024-09-10T14:29:09.096578+0000","last_fullsized":"2024-09-10T14:29:09.096578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:00.704953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.785811+0000","last_change":"2024-09-10T14:28:32.878178+0000","last_active":"2024-09-10T14:29:08.785811+0000","last_peered":"2024-09-10T14:29:08.785811+0000","last_clean":"2024-09-10T14:29:08.785811+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:29:08.785811+0000","last_undegraded":"2024-09-10T14:29:08.785811+0000","last_fullsized":"2024-09-10T14:29:08.785811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:56.990523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.105783+0000","last_change":"2024-09-10T14:28:34.889384+0000","last_active":"2024-09-10T14:30:41.105783+0000","last_peered":"2024-09-10T14:30:41.105783+0000","last_clean":"2024-09-10T14:30:41.105783+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:30:41.105783+0000","last_undegraded":"2024-09-10T14:30:41.105783+0000","last_fullsized":"2024-09-10T14:30:41.105783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:56.353841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779998+0000","last_change":"2024-09-10T14:28:36.946071+0000","last_active":"2024-09-10T14:29:08.779998+0000","last_peered":"2024-09-10T14:29:08.779998+0000","last_clean":"2024-09-10T14:29:08.779998+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:29:08.779998+0000","last_undegraded":"2024-09-10T14:29:08.779998+0000","last_fullsized":"2024-09-10T14:29:08.779998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:45.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:40.722091+0000","last_change":"2024-09-10T14:28:38.941887+0000","last_active":"2024-09-10T14:30:40.722091+0000","last_peered":"2024-09-10T14:30:40.722091+0000","last_clean":"2024-09-10T14:30:40.722091+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:30:40.722091+0000","last_undegraded":"2024-09-10T14:30:40.722091+0000","last_fullsized":"2024-09-10T14:30:40.722091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:09.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.376108+0000","last_change":"2024-09-10T14:28:30.890869+0000","last_active":"2024-09-10T14:29:58.376108+0000","last_peered":"2024-09-10T14:29:58.376108+0000","last_clean":"2024-09-10T14:29:58.376108+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:29:58.376108+0000","last_undegraded":"2024-09-10T14:29:58.376108+0000","last_fullsized":"2024-09-10T14:29:58.376108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:33.087704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.490899+0000","last_change":"2024-09-10T14:28:28.891910+0000","last_active":"2024-09-10T14:29:13.490899+0000","last_peered":"2024-09-10T14:29:13.490899+0000","last_clean":"2024-09-10T14:29:13.490899+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:29:13.490899+0000","last_undegraded":"2024-09-10T14:29:13.490899+0000","last_fullsized":"2024-09-10T14:29:13.490899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:44.681521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099970+0000","last_change":"2024-09-10T14:28:32.877582+0000","last_active":"2024-09-10T14:29:09.099970+0000","last_peered":"2024-09-10T14:29:09.099970+0000","last_clean":"2024-09-10T14:29:09.099970+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:29:09.099970+0000","last_undegraded":"2024-09-10T14:29:09.099970+0000","last_fullsized":"2024-09-10T14:29:09.099970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:31.749719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.144934+0000","last_change":"2024-09-10T14:28:34.898334+0000","last_active":"2024-09-10T14:30:41.144934+0000","last_peered":"2024-09-10T14:30:41.144934+0000","last_clean":"2024-09-10T14:30:41.144934+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:30:41.144934+0000","last_undegraded":"2024-09-10T14:30:41.144934+0000","last_fullsized":"2024-09-10T14:30:41.144934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:56.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.408033+0000","last_change":"2024-09-10T14:28:36.937021+0000","last_active":"2024-09-10T14:31:44.408033+0000","last_peered":"2024-09-10T14:31:44.408033+0000","last_clean":"2024-09-10T14:31:44.408033+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:31:44.408033+0000","last_undegraded":"2024-09-10T14:31:44.408033+0000","last_fullsized":"2024-09-10T14:31:44.408033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:41.213212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776838+0000","last_change":"2024-09-10T14:28:38.936015+0000","last_active":"2024-09-10T14:30:47.776838+0000","last_peered":"2024-09-10T14:30:47.776838+0000","last_clean":"2024-09-10T14:30:47.776838+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:30:47.776838+0000","last_undegraded":"2024-09-10T14:30:47.776838+0000","last_fullsized":"2024-09-10T14:30:47.776838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:08.718072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.734924+0000","last_change":"2024-09-10T14:28:30.869152+0000","last_active":"2024-09-10T14:31:43.734924+0000","last_peered":"2024-09-10T14:31:43.734924+0000","last_clean":"2024-09-10T14:31:43.734924+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:31:43.734924+0000","last_undegraded":"2024-09-10T14:31:43.734924+0000","last_fullsized":"2024-09-10T14:31:43.734924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:29.230753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.213357+0000","last_change":"2024-09-10T14:28:28.890431+0000","last_active":"2024-09-10T14:31:44.213357+0000","last_peered":"2024-09-10T14:31:44.213357+0000","last_clean":"2024-09-10T14:31:44.213357+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:31:44.213357+0000","last_undegraded":"2024-09-10T14:31:44.213357+0000","last_fullsized":"2024-09-10T14:31:44.213357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:22.573383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.590739+0000","last_change":"2024-09-10T14:28:32.884446+0000","last_active":"2024-09-10T14:30:42.590739+0000","last_peered":"2024-09-10T14:30:42.590739+0000","last_clean":"2024-09-10T14:30:42.590739+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:30:42.590739+0000","last_undegraded":"2024-09-10T14:30:42.590739+0000","last_fullsized":"2024-09-10T14:30:42.590739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:15.273266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777108+0000","last_change":"2024-09-10T14:28:34.926311+0000","last_active":"2024-09-10T14:29:08.777108+0000","last_peered":"2024-09-10T14:29:08.777108+0000","last_clean":"2024-09-10T14:29:08.777108+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:29:08.777108+0000","last_undegraded":"2024-09-10T14:29:08.777108+0000","last_fullsized":"2024-09-10T14:29:08.777108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:40.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.335621+0000","last_change":"2024-09-10T14:28:36.922620+0000","last_active":"2024-09-10T14:31:44.335621+0000","last_peered":"2024-09-10T14:31:44.335621+0000","last_clean":"2024-09-10T14:31:44.335621+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:31:44.335621+0000","last_undegraded":"2024-09-10T14:31:44.335621+0000","last_fullsized":"2024-09-10T14:31:44.335621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:18.061873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.752153+0000","last_change":"2024-09-10T14:28:38.929142+0000","last_active":"2024-09-10T14:30:42.752153+0000","last_peered":"2024-09-10T14:30:42.752153+0000","last_clean":"2024-09-10T14:30:42.752153+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:30:42.752153+0000","last_undegraded":"2024-09-10T14:30:42.752153+0000","last_fullsized":"2024-09-10T14:30:42.752153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:15.327806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.324515+0000","last_change":"2024-09-10T14:28:30.889847+0000","last_active":"2024-09-10T14:31:44.324515+0000","last_peered":"2024-09-10T14:31:44.324515+0000","last_clean":"2024-09-10T14:31:44.324515+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:31:44.324515+0000","last_undegraded":"2024-09-10T14:31:44.324515+0000","last_fullsized":"2024-09-10T14:31:44.324515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:48.295547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768939+0000","last_change":"2024-09-10T14:28:28.894339+0000","last_active":"2024-09-10T14:29:08.768939+0000","last_peered":"2024-09-10T14:29:08.768939+0000","last_clean":"2024-09-10T14:29:08.768939+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:29:08.768939+0000","last_undegraded":"2024-09-10T14:29:08.768939+0000","last_fullsized":"2024-09-10T14:29:08.768939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:03.473546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779727+0000","last_change":"2024-09-10T14:28:32.891418+0000","last_active":"2024-09-10T14:29:08.779727+0000","last_peered":"2024-09-10T14:29:08.779727+0000","last_clean":"2024-09-10T14:29:08.779727+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:29:08.779727+0000","last_undegraded":"2024-09-10T14:29:08.779727+0000","last_fullsized":"2024-09-10T14:29:08.779727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:11.007860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'39","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783888+0000","last_change":"2024-09-10T14:28:34.889216+0000","last_active":"2024-09-10T14:30:53.783888+0000","last_peered":"2024-09-10T14:30:53.783888+0000","last_clean":"2024-09-10T14:30:53.783888+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:30:53.783888+0000","last_undegraded":"2024-09-10T14:30:53.783888+0000","last_fullsized":"2024-09-10T14:30:53.783888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:53.887819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778786+0000","last_change":"2024-09-10T14:28:36.938371+0000","last_active":"2024-09-10T14:29:08.778786+0000","last_peered":"2024-09-10T14:29:08.778786+0000","last_clean":"2024-09-10T14:29:08.778786+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:29:08.778786+0000","last_undegraded":"2024-09-10T14:29:08.778786+0000","last_fullsized":"2024-09-10T14:29:08.778786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:53.099481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.294156+0000","last_change":"2024-09-10T14:28:38.912768+0000","last_active":"2024-09-10T14:31:44.294156+0000","last_peered":"2024-09-10T14:31:44.294156+0000","last_clean":"2024-09-10T14:31:44.294156+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:31:44.294156+0000","last_undegraded":"2024-09-10T14:31:44.294156+0000","last_fullsized":"2024-09-10T14:31:44.294156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:20.861557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158954+0000","last_change":"2024-09-10T14:28:30.890682+0000","last_active":"2024-09-10T14:31:44.158954+0000","last_peered":"2024-09-10T14:31:44.158954+0000","last_clean":"2024-09-10T14:31:44.158954+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:31:44.158954+0000","last_undegraded":"2024-09-10T14:31:44.158954+0000","last_fullsized":"2024-09-10T14:31:44.158954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:17.279062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774963+0000","last_change":"2024-09-10T14:28:16.789816+0000","last_active":"2024-09-10T14:29:08.774963+0000","last_peered":"2024-09-10T14:29:08.774963+0000","last_clean":"2024-09-10T14:29:08.774963+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:29:08.774963+0000","last_undegraded":"2024-09-10T14:29:08.774963+0000","last_fullsized":"2024-09-10T14:29:08.774963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_clean_scrub_stamp":"2024-09-10T14:28:14.781430+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:16.536869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770870+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:29:08.770870+0000","last_peered":"2024-09-10T14:29:08.770870+0000","last_clean":"2024-09-10T14:29:08.770870+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:29:08.770870+0000","last_undegraded":"2024-09-10T14:29:08.770870+0000","last_fullsized":"2024-09-10T14:29:08.770870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:14.334391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.049324+0000","last_change":"2024-09-10T14:28:28.892198+0000","last_active":"2024-09-10T14:30:43.049324+0000","last_peered":"2024-09-10T14:30:43.049324+0000","last_clean":"2024-09-10T14:30:43.049324+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:30:43.049324+0000","last_undegraded":"2024-09-10T14:30:43.049324+0000","last_fullsized":"2024-09-10T14:30:43.049324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:02.556246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782315+0000","last_change":"2024-09-10T14:28:32.883286+0000","last_active":"2024-09-10T14:29:08.782315+0000","last_peered":"2024-09-10T14:29:08.782315+0000","last_clean":"2024-09-10T14:29:08.782315+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:29:08.782315+0000","last_undegraded":"2024-09-10T14:29:08.782315+0000","last_fullsized":"2024-09-10T14:29:08.782315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:49.691689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.140053+0000","last_change":"2024-09-10T14:28:34.925793+0000","last_active":"2024-09-10T14:30:41.140053+0000","last_peered":"2024-09-10T14:30:41.140053+0000","last_clean":"2024-09-10T14:30:41.140053+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:30:41.140053+0000","last_undegraded":"2024-09-10T14:30:41.140053+0000","last_fullsized":"2024-09-10T14:30:41.140053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:01.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095816+0000","last_change":"2024-09-10T14:28:36.925074+0000","last_active":"2024-09-10T14:29:09.095816+0000","last_peered":"2024-09-10T14:29:09.095816+0000","last_clean":"2024-09-10T14:29:09.095816+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:29:09.095816+0000","last_undegraded":"2024-09-10T14:29:09.095816+0000","last_fullsized":"2024-09-10T14:29:09.095816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:41.342463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.251835+0000","last_change":"2024-09-10T14:28:38.925950+0000","last_active":"2024-09-10T14:31:44.251835+0000","last_peered":"2024-09-10T14:31:44.251835+0000","last_clean":"2024-09-10T14:31:44.251835+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:31:44.251835+0000","last_undegraded":"2024-09-10T14:31:44.251835+0000","last_fullsized":"2024-09-10T14:31:44.251835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:06.497323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.378012+0000","last_change":"2024-09-10T14:28:30.878284+0000","last_active":"2024-09-10T14:29:58.378012+0000","last_peered":"2024-09-10T14:29:58.378012+0000","last_clean":"2024-09-10T14:29:58.378012+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:29:58.378012+0000","last_undegraded":"2024-09-10T14:29:58.378012+0000","last_fullsized":"2024-09-10T14:29:58.378012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:59.147562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768179+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:29:08.768179+0000","last_peered":"2024-09-10T14:29:08.768179+0000","last_clean":"2024-09-10T14:29:08.768179+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:29:08.768179+0000","last_undegraded":"2024-09-10T14:29:08.768179+0000","last_fullsized":"2024-09-10T14:29:08.768179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:11.168974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.041052+0000","last_change":"2024-09-10T14:28:28.873736+0000","last_active":"2024-09-10T14:31:44.041052+0000","last_peered":"2024-09-10T14:31:44.041052+0000","last_clean":"2024-09-10T14:31:44.041052+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:31:44.041052+0000","last_undegraded":"2024-09-10T14:31:44.041052+0000","last_fullsized":"2024-09-10T14:31:44.041052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:43.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782694+0000","last_change":"2024-09-10T14:28:32.888517+0000","last_active":"2024-09-10T14:29:08.782694+0000","last_peered":"2024-09-10T14:29:08.782694+0000","last_clean":"2024-09-10T14:29:08.782694+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:29:08.782694+0000","last_undegraded":"2024-09-10T14:29:08.782694+0000","last_fullsized":"2024-09-10T14:29:08.782694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:38.805133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'275","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.095600+0000","last_change":"2024-09-10T14:28:34.894665+0000","last_active":"2024-09-10T14:31:44.095600+0000","last_peered":"2024-09-10T14:31:44.095600+0000","last_clean":"2024-09-10T14:31:44.095600+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:31:44.095600+0000","last_undegraded":"2024-09-10T14:31:44.095600+0000","last_fullsized":"2024-09-10T14:31:44.095600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.418477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772230+0000","last_change":"2024-09-10T14:28:36.943974+0000","last_active":"2024-09-10T14:29:08.772230+0000","last_peered":"2024-09-10T14:29:08.772230+0000","last_clean":"2024-09-10T14:29:08.772230+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:29:08.772230+0000","last_undegraded":"2024-09-10T14:29:08.772230+0000","last_fullsized":"2024-09-10T14:29:08.772230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:48.045691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.777348+0000","last_change":"2024-09-10T14:28:38.943158+0000","last_active":"2024-09-10T14:31:43.777348+0000","last_peered":"2024-09-10T14:31:43.777348+0000","last_clean":"2024-09-10T14:31:43.777348+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:31:43.777348+0000","last_undegraded":"2024-09-10T14:31:43.777348+0000","last_fullsized":"2024-09-10T14:31:43.777348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:00.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.730417+0000","last_change":"2024-09-10T14:28:30.884260+0000","last_active":"2024-09-10T14:29:14.730417+0000","last_peered":"2024-09-10T14:29:14.730417+0000","last_clean":"2024-09-10T14:29:14.730417+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:29:14.730417+0000","last_undegraded":"2024-09-10T14:29:14.730417+0000","last_fullsized":"2024-09-10T14:29:14.730417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:55.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774556+0000","last_change":"2024-09-10T14:28:21.859213+0000","last_active":"2024-09-10T14:29:08.774556+0000","last_peered":"2024-09-10T14:29:08.774556+0000","last_clean":"2024-09-10T14:29:08.774556+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:29:08.774556+0000","last_undegraded":"2024-09-10T14:29:08.774556+0000","last_fullsized":"2024-09-10T14:29:08.774556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:49.580804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.058535+0000","last_change":"2024-09-10T14:28:28.874080+0000","last_active":"2024-09-10T14:31:44.058535+0000","last_peered":"2024-09-10T14:31:44.058535+0000","last_clean":"2024-09-10T14:31:44.058535+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:31:44.058535+0000","last_undegraded":"2024-09-10T14:31:44.058535+0000","last_fullsized":"2024-09-10T14:31:44.058535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:55.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786046+0000","last_change":"2024-09-10T14:28:32.871141+0000","last_active":"2024-09-10T14:29:08.786046+0000","last_peered":"2024-09-10T14:29:08.786046+0000","last_clean":"2024-09-10T14:29:08.786046+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:29:08.786046+0000","last_undegraded":"2024-09-10T14:29:08.786046+0000","last_fullsized":"2024-09-10T14:29:08.786046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:19.367394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120964+0000","last_change":"2024-09-10T14:28:34.884708+0000","last_active":"2024-09-10T14:31:43.120964+0000","last_peered":"2024-09-10T14:31:43.120964+0000","last_clean":"2024-09-10T14:31:43.120964+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:31:43.120964+0000","last_undegraded":"2024-09-10T14:31:43.120964+0000","last_fullsized":"2024-09-10T14:31:43.120964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:58.578905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093499+0000","last_change":"2024-09-10T14:28:36.924713+0000","last_active":"2024-09-10T14:29:09.093499+0000","last_peered":"2024-09-10T14:29:09.093499+0000","last_clean":"2024-09-10T14:29:09.093499+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:29:09.093499+0000","last_undegraded":"2024-09-10T14:29:09.093499+0000","last_fullsized":"2024-09-10T14:29:09.093499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:20.981089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768748+0000","last_change":"2024-09-10T14:28:38.943308+0000","last_active":"2024-09-10T14:29:08.768748+0000","last_peered":"2024-09-10T14:29:08.768748+0000","last_clean":"2024-09-10T14:29:08.768748+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:29:08.768748+0000","last_undegraded":"2024-09-10T14:29:08.768748+0000","last_fullsized":"2024-09-10T14:29:08.768748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:31.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227454+0000","last_change":"2024-09-10T14:28:30.863131+0000","last_active":"2024-09-10T14:31:44.227454+0000","last_peered":"2024-09-10T14:31:44.227454+0000","last_clean":"2024-09-10T14:31:44.227454+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:31:44.227454+0000","last_undegraded":"2024-09-10T14:31:44.227454+0000","last_fullsized":"2024-09-10T14:31:44.227454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:11.379786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769438+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:29:08.769438+0000","last_peered":"2024-09-10T14:29:08.769438+0000","last_clean":"2024-09-10T14:29:08.769438+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:29:08.769438+0000","last_undegraded":"2024-09-10T14:29:08.769438+0000","last_fullsized":"2024-09-10T14:29:08.769438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:08.712711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779372+0000","last_change":"2024-09-10T14:28:28.892687+0000","last_active":"2024-09-10T14:29:08.779372+0000","last_peered":"2024-09-10T14:29:08.779372+0000","last_clean":"2024-09-10T14:29:08.779372+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:29:08.779372+0000","last_undegraded":"2024-09-10T14:29:08.779372+0000","last_fullsized":"2024-09-10T14:29:08.779372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:29.232546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.102198+0000","last_change":"2024-09-10T14:28:32.885999+0000","last_active":"2024-09-10T14:29:09.102198+0000","last_peered":"2024-09-10T14:29:09.102198+0000","last_clean":"2024-09-10T14:29:09.102198+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:29:09.102198+0000","last_undegraded":"2024-09-10T14:29:09.102198+0000","last_fullsized":"2024-09-10T14:29:09.102198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.742700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.142906+0000","last_change":"2024-09-10T14:28:34.924692+0000","last_active":"2024-09-10T14:31:43.142906+0000","last_peered":"2024-09-10T14:31:43.142906+0000","last_clean":"2024-09-10T14:31:43.142906+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:31:43.142906+0000","last_undegraded":"2024-09-10T14:31:43.142906+0000","last_fullsized":"2024-09-10T14:31:43.142906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:53.353299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782310+0000","last_change":"2024-09-10T14:28:36.943077+0000","last_active":"2024-09-10T14:29:08.782310+0000","last_peered":"2024-09-10T14:29:08.782310+0000","last_clean":"2024-09-10T14:29:08.782310+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:29:08.782310+0000","last_undegraded":"2024-09-10T14:29:08.782310+0000","last_fullsized":"2024-09-10T14:29:08.782310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:11.353120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.729145+0000","last_change":"2024-09-10T14:28:38.927597+0000","last_active":"2024-09-10T14:30:42.729145+0000","last_peered":"2024-09-10T14:30:42.729145+0000","last_clean":"2024-09-10T14:30:42.729145+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:30:42.729145+0000","last_undegraded":"2024-09-10T14:30:42.729145+0000","last_fullsized":"2024-09-10T14:30:42.729145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:59.259272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777851+0000","last_change":"2024-09-10T14:28:30.886735+0000","last_active":"2024-09-10T14:29:08.777851+0000","last_peered":"2024-09-10T14:29:08.777851+0000","last_clean":"2024-09-10T14:29:08.777851+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:29:08.777851+0000","last_undegraded":"2024-09-10T14:29:08.777851+0000","last_fullsized":"2024-09-10T14:29:08.777851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:55.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:34.773656+0000","last_change":"2024-09-10T14:28:28.911271+0000","last_active":"2024-09-10T14:30:34.773656+0000","last_peered":"2024-09-10T14:30:34.773656+0000","last_clean":"2024-09-10T14:30:34.773656+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:30:34.773656+0000","last_undegraded":"2024-09-10T14:30:34.773656+0000","last_fullsized":"2024-09-10T14:30:34.773656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:46.166561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.100259+0000","last_change":"2024-09-10T14:28:21.327700+0000","last_active":"2024-09-10T14:29:09.100259+0000","last_peered":"2024-09-10T14:29:09.100259+0000","last_clean":"2024-09-10T14:29:09.100259+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:29:09.100259+0000","last_undegraded":"2024-09-10T14:29:09.100259+0000","last_fullsized":"2024-09-10T14:29:09.100259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:52.160130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:14.782591+0000","last_change":"2024-09-10T14:29:07.784812+0000","last_active":"2024-09-10T14:31:14.782591+0000","last_peered":"2024-09-10T14:31:14.782591+0000","last_clean":"2024-09-10T14:31:14.782591+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:31:14.782591+0000","last_undegraded":"2024-09-10T14:31:14.782591+0000","last_fullsized":"2024-09-10T14:31:14.782591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:59.688011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.143022+0000","last_change":"2024-09-10T14:28:34.893626+0000","last_active":"2024-09-10T14:30:41.143022+0000","last_peered":"2024-09-10T14:30:41.143022+0000","last_clean":"2024-09-10T14:30:41.143022+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:30:41.143022+0000","last_undegraded":"2024-09-10T14:30:41.143022+0000","last_fullsized":"2024-09-10T14:30:41.143022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:28.104547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772307+0000","last_change":"2024-09-10T14:28:36.918342+0000","last_active":"2024-09-10T14:29:08.772307+0000","last_peered":"2024-09-10T14:29:08.772307+0000","last_clean":"2024-09-10T14:29:08.772307+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:29:08.772307+0000","last_undegraded":"2024-09-10T14:29:08.772307+0000","last_fullsized":"2024-09-10T14:29:08.772307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:03.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.974036+0000","last_change":"2024-09-10T14:28:38.924566+0000","last_active":"2024-09-10T14:30:42.974036+0000","last_peered":"2024-09-10T14:30:42.974036+0000","last_clean":"2024-09-10T14:30:42.974036+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:30:42.974036+0000","last_undegraded":"2024-09-10T14:30:42.974036+0000","last_fullsized":"2024-09-10T14:30:42.974036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:23.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227882+0000","last_change":"2024-09-10T14:28:30.889728+0000","last_active":"2024-09-10T14:31:44.227882+0000","last_peered":"2024-09-10T14:31:44.227882+0000","last_clean":"2024-09-10T14:31:44.227882+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:31:44.227882+0000","last_undegraded":"2024-09-10T14:31:44.227882+0000","last_fullsized":"2024-09-10T14:31:44.227882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:49.183418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093061+0000","last_change":"2024-09-10T14:28:28.907627+0000","last_active":"2024-09-10T14:29:09.093061+0000","last_peered":"2024-09-10T14:29:09.093061+0000","last_clean":"2024-09-10T14:29:09.093061+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:29:09.093061+0000","last_undegraded":"2024-09-10T14:29:09.093061+0000","last_fullsized":"2024-09-10T14:29:09.093061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:11.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777696+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:29:08.777696+0000","last_peered":"2024-09-10T14:29:08.777696+0000","last_clean":"2024-09-10T14:29:08.777696+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:29:08.777696+0000","last_undegraded":"2024-09-10T14:29:08.777696+0000","last_fullsized":"2024-09-10T14:29:08.777696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:21.647103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768826+0000","last_change":"2024-09-10T14:28:32.882261+0000","last_active":"2024-09-10T14:29:08.768826+0000","last_peered":"2024-09-10T14:29:08.768826+0000","last_clean":"2024-09-10T14:29:08.768826+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:29:08.768826+0000","last_undegraded":"2024-09-10T14:29:08.768826+0000","last_fullsized":"2024-09-10T14:29:08.768826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:59.101746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.075406+0000","last_change":"2024-09-10T14:28:34.901236+0000","last_active":"2024-09-10T14:29:58.075406+0000","last_peered":"2024-09-10T14:29:58.075406+0000","last_clean":"2024-09-10T14:29:58.075406+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:29:58.075406+0000","last_undegraded":"2024-09-10T14:29:58.075406+0000","last_fullsized":"2024-09-10T14:29:58.075406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:02.704400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":377,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.238990+0000","last_change":"2024-09-10T14:28:36.904472+0000","last_active":"2024-09-10T14:31:44.238990+0000","last_peered":"2024-09-10T14:31:44.238990+0000","last_clean":"2024-09-10T14:31:44.238990+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:31:44.238990+0000","last_undegraded":"2024-09-10T14:31:44.238990+0000","last_fullsized":"2024-09-10T14:31:44.238990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:07.331691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.268320+0000","last_change":"2024-09-10T14:28:38.937953+0000","last_active":"2024-09-10T14:31:43.268320+0000","last_peered":"2024-09-10T14:31:43.268320+0000","last_clean":"2024-09-10T14:31:43.268320+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:31:43.268320+0000","last_undegraded":"2024-09-10T14:31:43.268320+0000","last_fullsized":"2024-09-10T14:31:43.268320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:24.662394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743534+0000","last_change":"2024-09-10T14:28:30.888495+0000","last_active":"2024-09-10T14:29:15.743534+0000","last_peered":"2024-09-10T14:29:15.743534+0000","last_clean":"2024-09-10T14:29:15.743534+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:29:15.743534+0000","last_undegraded":"2024-09-10T14:29:15.743534+0000","last_fullsized":"2024-09-10T14:29:15.743534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:49.862009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.684814+0000","last_change":"2024-09-10T14:28:28.891219+0000","last_active":"2024-09-10T14:31:43.684814+0000","last_peered":"2024-09-10T14:31:43.684814+0000","last_clean":"2024-09-10T14:31:43.684814+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:31:43.684814+0000","last_undegraded":"2024-09-10T14:31:43.684814+0000","last_fullsized":"2024-09-10T14:31:43.684814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:24.892549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.103352+0000","last_change":"2024-09-10T14:28:21.327784+0000","last_active":"2024-09-10T14:29:09.103352+0000","last_peered":"2024-09-10T14:29:09.103352+0000","last_clean":"2024-09-10T14:29:09.103352+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:29:09.103352+0000","last_undegraded":"2024-09-10T14:29:09.103352+0000","last_fullsized":"2024-09-10T14:29:09.103352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:00.563029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769359+0000","last_change":"2024-09-10T14:28:32.881624+0000","last_active":"2024-09-10T14:29:08.769359+0000","last_peered":"2024-09-10T14:29:08.769359+0000","last_clean":"2024-09-10T14:29:08.769359+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:29:08.769359+0000","last_undegraded":"2024-09-10T14:29:08.769359+0000","last_fullsized":"2024-09-10T14:29:08.769359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:40.120625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.771369+0000","last_change":"2024-09-10T14:28:34.914868+0000","last_active":"2024-09-10T14:29:08.771369+0000","last_peered":"2024-09-10T14:29:08.771369+0000","last_clean":"2024-09-10T14:29:08.771369+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:29:08.771369+0000","last_undegraded":"2024-09-10T14:29:08.771369+0000","last_fullsized":"2024-09-10T14:29:08.771369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:28.103142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":392,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.383887+0000","last_change":"2024-09-10T14:28:36.902307+0000","last_active":"2024-09-10T14:31:44.383887+0000","last_peered":"2024-09-10T14:31:44.383887+0000","last_clean":"2024-09-10T14:31:44.383887+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:31:44.383887+0000","last_undegraded":"2024-09-10T14:31:44.383887+0000","last_fullsized":"2024-09-10T14:31:44.383887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:28.542198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781543+0000","last_change":"2024-09-10T14:28:38.934660+0000","last_active":"2024-09-10T14:29:08.781543+0000","last_peered":"2024-09-10T14:29:08.781543+0000","last_clean":"2024-09-10T14:29:08.781543+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:29:08.781543+0000","last_undegraded":"2024-09-10T14:29:08.781543+0000","last_fullsized":"2024-09-10T14:29:08.781543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:08.718072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227593+0000","last_change":"2024-09-10T14:28:30.872139+0000","last_active":"2024-09-10T14:31:44.227593+0000","last_peered":"2024-09-10T14:31:44.227593+0000","last_clean":"2024-09-10T14:31:44.227593+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:31:44.227593+0000","last_undegraded":"2024-09-10T14:31:44.227593+0000","last_fullsized":"2024-09-10T14:31:44.227593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:13.634815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.023364+0000","last_change":"2024-09-10T14:28:28.904513+0000","last_active":"2024-09-10T14:31:44.023364+0000","last_peered":"2024-09-10T14:31:44.023364+0000","last_clean":"2024-09-10T14:31:44.023364+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:31:44.023364+0000","last_undegraded":"2024-09-10T14:31:44.023364+0000","last_fullsized":"2024-09-10T14:31:44.023364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:05.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782794+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:29:08.782794+0000","last_peered":"2024-09-10T14:29:08.782794+0000","last_clean":"2024-09-10T14:29:08.782794+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:29:08.782794+0000","last_undegraded":"2024-09-10T14:29:08.782794+0000","last_fullsized":"2024-09-10T14:29:08.782794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:58.045195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.767895+0000","last_change":"2024-09-10T14:28:32.878971+0000","last_active":"2024-09-10T14:29:08.767895+0000","last_peered":"2024-09-10T14:29:08.767895+0000","last_clean":"2024-09-10T14:29:08.767895+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:29:08.767895+0000","last_undegraded":"2024-09-10T14:29:08.767895+0000","last_fullsized":"2024-09-10T14:29:08.767895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:24.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'83","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.111766+0000","last_change":"2024-09-10T14:28:34.903982+0000","last_active":"2024-09-10T14:30:41.111766+0000","last_peered":"2024-09-10T14:30:41.111766+0000","last_clean":"2024-09-10T14:30:41.111766+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:30:41.111766+0000","last_undegraded":"2024-09-10T14:30:41.111766+0000","last_fullsized":"2024-09-10T14:30:41.111766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:45.622257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095336+0000","last_change":"2024-09-10T14:28:36.903264+0000","last_active":"2024-09-10T14:29:09.095336+0000","last_peered":"2024-09-10T14:29:09.095336+0000","last_clean":"2024-09-10T14:29:09.095336+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:29:09.095336+0000","last_undegraded":"2024-09-10T14:29:09.095336+0000","last_fullsized":"2024-09-10T14:29:09.095336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:26.562499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786817+0000","last_change":"2024-09-10T14:28:38.930196+0000","last_active":"2024-09-10T14:29:08.786817+0000","last_peered":"2024-09-10T14:29:08.786817+0000","last_clean":"2024-09-10T14:29:08.786817+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:29:08.786817+0000","last_undegraded":"2024-09-10T14:29:08.786817+0000","last_fullsized":"2024-09-10T14:29:08.786817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:55.481810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.069321+0000","last_change":"2024-09-10T14:28:38.944786+0000","last_active":"2024-09-10T14:29:58.069321+0000","last_peered":"2024-09-10T14:29:58.069321+0000","last_clean":"2024-09-10T14:29:58.069321+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:29:58.069321+0000","last_undegraded":"2024-09-10T14:29:58.069321+0000","last_fullsized":"2024-09-10T14:29:58.069321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:23.466063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071514+0000","last_change":"2024-09-10T14:28:30.877107+0000","last_active":"2024-09-10T14:31:44.071514+0000","last_peered":"2024-09-10T14:31:44.071514+0000","last_clean":"2024-09-10T14:31:44.071514+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:31:44.071514+0000","last_undegraded":"2024-09-10T14:31:44.071514+0000","last_fullsized":"2024-09-10T14:31:44.071514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:01.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.032703+0000","last_change":"2024-09-10T14:28:28.890437+0000","last_active":"2024-09-10T14:31:44.032703+0000","last_peered":"2024-09-10T14:31:44.032703+0000","last_clean":"2024-09-10T14:31:44.032703+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:31:44.032703+0000","last_undegraded":"2024-09-10T14:31:44.032703+0000","last_fullsized":"2024-09-10T14:31:44.032703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.203261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777010+0000","last_change":"2024-09-10T14:28:32.883682+0000","last_active":"2024-09-10T14:29:08.777010+0000","last_peered":"2024-09-10T14:29:08.777010+0000","last_clean":"2024-09-10T14:29:08.777010+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:29:08.777010+0000","last_undegraded":"2024-09-10T14:29:08.777010+0000","last_fullsized":"2024-09-10T14:29:08.777010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:49.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786759+0000","last_change":"2024-09-10T14:28:34.909586+0000","last_active":"2024-09-10T14:30:58.786759+0000","last_peered":"2024-09-10T14:30:58.786759+0000","last_clean":"2024-09-10T14:30:58.786759+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:30:58.786759+0000","last_undegraded":"2024-09-10T14:30:58.786759+0000","last_fullsized":"2024-09-10T14:30:58.786759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:41.169418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772384+0000","last_change":"2024-09-10T14:28:36.937985+0000","last_active":"2024-09-10T14:29:08.772384+0000","last_peered":"2024-09-10T14:29:08.772384+0000","last_clean":"2024-09-10T14:29:08.772384+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:29:08.772384+0000","last_undegraded":"2024-09-10T14:29:08.772384+0000","last_fullsized":"2024-09-10T14:29:08.772384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:38.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:40.727074+0000","last_change":"2024-09-10T14:28:38.919940+0000","last_active":"2024-09-10T14:30:40.727074+0000","last_peered":"2024-09-10T14:30:40.727074+0000","last_clean":"2024-09-10T14:30:40.727074+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:30:40.727074+0000","last_undegraded":"2024-09-10T14:30:40.727074+0000","last_fullsized":"2024-09-10T14:30:40.727074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:50.182914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227269+0000","last_change":"2024-09-10T14:29:07.783673+0000","last_active":"2024-09-10T14:31:44.227269+0000","last_peered":"2024-09-10T14:31:44.227269+0000","last_clean":"2024-09-10T14:31:44.227269+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:31:44.227269+0000","last_undegraded":"2024-09-10T14:31:44.227269+0000","last_fullsized":"2024-09-10T14:31:44.227269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:50.089510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.784173+0000","last_change":"2024-09-10T14:28:28.897051+0000","last_active":"2024-09-10T14:29:08.784173+0000","last_peered":"2024-09-10T14:29:08.784173+0000","last_clean":"2024-09-10T14:29:08.784173+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:29:08.784173+0000","last_undegraded":"2024-09-10T14:29:08.784173+0000","last_fullsized":"2024-09-10T14:29:08.784173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:35.896977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769214+0000","last_change":"2024-09-10T14:28:32.889469+0000","last_active":"2024-09-10T14:29:08.769214+0000","last_peered":"2024-09-10T14:29:08.769214+0000","last_clean":"2024-09-10T14:29:08.769214+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:29:08.769214+0000","last_undegraded":"2024-09-10T14:29:08.769214+0000","last_fullsized":"2024-09-10T14:29:08.769214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:16.954547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.151756+0000","last_change":"2024-09-10T14:28:34.883314+0000","last_active":"2024-09-10T14:31:43.151756+0000","last_peered":"2024-09-10T14:31:43.151756+0000","last_clean":"2024-09-10T14:31:43.151756+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:31:43.151756+0000","last_undegraded":"2024-09-10T14:31:43.151756+0000","last_fullsized":"2024-09-10T14:31:43.151756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:55.702602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774240+0000","last_change":"2024-09-10T14:28:36.942744+0000","last_active":"2024-09-10T14:29:08.774240+0000","last_peered":"2024-09-10T14:29:08.774240+0000","last_clean":"2024-09-10T14:29:08.774240+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:29:08.774240+0000","last_undegraded":"2024-09-10T14:29:08.774240+0000","last_fullsized":"2024-09-10T14:29:08.774240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:27.947825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.100255+0000","last_change":"2024-09-10T14:28:38.936365+0000","last_active":"2024-09-10T14:29:09.100255+0000","last_peered":"2024-09-10T14:29:09.100255+0000","last_clean":"2024-09-10T14:29:09.100255+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:29:09.100255+0000","last_undegraded":"2024-09-10T14:29:09.100255+0000","last_fullsized":"2024-09-10T14:29:09.100255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:06.472831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.730616+0000","last_change":"2024-09-10T14:28:30.876200+0000","last_active":"2024-09-10T14:29:14.730616+0000","last_peered":"2024-09-10T14:29:14.730616+0000","last_clean":"2024-09-10T14:29:14.730616+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:29:14.730616+0000","last_undegraded":"2024-09-10T14:29:14.730616+0000","last_fullsized":"2024-09-10T14:29:14.730616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.106885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.232528+0000","last_change":"2024-09-10T14:28:28.895847+0000","last_active":"2024-09-10T14:29:14.232528+0000","last_peered":"2024-09-10T14:29:14.232528+0000","last_clean":"2024-09-10T14:29:14.232528+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:29:14.232528+0000","last_undegraded":"2024-09-10T14:29:14.232528+0000","last_fullsized":"2024-09-10T14:29:14.232528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:09.693064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774392+0000","last_change":"2024-09-10T14:28:32.872799+0000","last_active":"2024-09-10T14:29:08.774392+0000","last_peered":"2024-09-10T14:29:08.774392+0000","last_clean":"2024-09-10T14:29:08.774392+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:29:08.774392+0000","last_undegraded":"2024-09-10T14:29:08.774392+0000","last_fullsized":"2024-09-10T14:29:08.774392+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:03.562600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'40","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.238443+0000","last_change":"2024-09-10T14:28:34.883528+0000","last_active":"2024-09-10T14:31:43.238443+0000","last_peered":"2024-09-10T14:31:43.238443+0000","last_clean":"2024-09-10T14:31:43.238443+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:31:43.238443+0000","last_undegraded":"2024-09-10T14:31:43.238443+0000","last_fullsized":"2024-09-10T14:31:43.238443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:37.113514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776303+0000","last_change":"2024-09-10T14:28:36.903239+0000","last_active":"2024-09-10T14:29:08.776303+0000","last_peered":"2024-09-10T14:29:08.776303+0000","last_clean":"2024-09-10T14:29:08.776303+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:29:08.776303+0000","last_undegraded":"2024-09-10T14:29:08.776303+0000","last_fullsized":"2024-09-10T14:29:08.776303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:10.158060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769658+0000","last_change":"2024-09-10T14:28:38.937605+0000","last_active":"2024-09-10T14:29:08.769658+0000","last_peered":"2024-09-10T14:29:08.769658+0000","last_clean":"2024-09-10T14:29:08.769658+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:29:08.769658+0000","last_undegraded":"2024-09-10T14:29:08.769658+0000","last_fullsized":"2024-09-10T14:29:08.769658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:51.383935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743397+0000","last_change":"2024-09-10T14:29:07.787878+0000","last_active":"2024-09-10T14:29:15.743397+0000","last_peered":"2024-09-10T14:29:15.743397+0000","last_clean":"2024-09-10T14:29:15.743397+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:29:15.743397+0000","last_undegraded":"2024-09-10T14:29:15.743397+0000","last_fullsized":"2024-09-10T14:29:15.743397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:39.937327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.827599+0000","last_change":"2024-09-10T14:28:28.902985+0000","last_active":"2024-09-10T14:30:42.827599+0000","last_peered":"2024-09-10T14:30:42.827599+0000","last_clean":"2024-09-10T14:30:42.827599+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:30:42.827599+0000","last_undegraded":"2024-09-10T14:30:42.827599+0000","last_fullsized":"2024-09-10T14:30:42.827599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:52.358354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769090+0000","last_change":"2024-09-10T14:28:32.882402+0000","last_active":"2024-09-10T14:29:08.769090+0000","last_peered":"2024-09-10T14:29:08.769090+0000","last_clean":"2024-09-10T14:29:08.769090+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:29:08.769090+0000","last_undegraded":"2024-09-10T14:29:08.769090+0000","last_fullsized":"2024-09-10T14:29:08.769090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:40.138989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'32","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.777771+0000","last_change":"2024-09-10T14:28:34.898884+0000","last_active":"2024-09-10T14:30:54.777771+0000","last_peered":"2024-09-10T14:30:54.777771+0000","last_clean":"2024-09-10T14:30:54.777771+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:30:54.777771+0000","last_undegraded":"2024-09-10T14:30:54.777771+0000","last_fullsized":"2024-09-10T14:30:54.777771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:00.691071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778374+0000","last_change":"2024-09-10T14:28:36.914261+0000","last_active":"2024-09-10T14:29:08.778374+0000","last_peered":"2024-09-10T14:29:08.778374+0000","last_clean":"2024-09-10T14:29:08.778374+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:29:08.778374+0000","last_undegraded":"2024-09-10T14:29:08.778374+0000","last_fullsized":"2024-09-10T14:29:08.778374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:53.185791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.731755+0000","last_change":"2024-09-10T14:28:30.877889+0000","last_active":"2024-09-10T14:29:14.731755+0000","last_peered":"2024-09-10T14:29:14.731755+0000","last_clean":"2024-09-10T14:29:14.731755+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:29:14.731755+0000","last_undegraded":"2024-09-10T14:29:14.731755+0000","last_fullsized":"2024-09-10T14:29:14.731755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:50.100814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768203+0000","last_change":"2024-09-10T14:28:28.893360+0000","last_active":"2024-09-10T14:29:08.768203+0000","last_peered":"2024-09-10T14:29:08.768203+0000","last_clean":"2024-09-10T14:29:08.768203+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:29:08.768203+0000","last_undegraded":"2024-09-10T14:29:08.768203+0000","last_fullsized":"2024-09-10T14:29:08.768203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:07.284771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.756273+0000","last_change":"2024-09-10T14:29:08.790434+0000","last_active":"2024-09-10T14:29:09.756273+0000","last_peered":"2024-09-10T14:29:09.756273+0000","last_clean":"2024-09-10T14:29:09.756273+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:29:09.756273+0000","last_undegraded":"2024-09-10T14:29:09.756273+0000","last_fullsized":"2024-09-10T14:29:09.756273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:57.151248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.138592+0000","last_change":"2024-09-10T14:28:34.883522+0000","last_active":"2024-09-10T14:30:41.138592+0000","last_peered":"2024-09-10T14:30:41.138592+0000","last_clean":"2024-09-10T14:30:41.138592+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:30:41.138592+0000","last_undegraded":"2024-09-10T14:30:41.138592+0000","last_fullsized":"2024-09-10T14:30:41.138592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:16.061284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778501+0000","last_change":"2024-09-10T14:28:36.910017+0000","last_active":"2024-09-10T14:29:08.778501+0000","last_peered":"2024-09-10T14:29:08.778501+0000","last_clean":"2024-09-10T14:29:08.778501+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:29:08.778501+0000","last_undegraded":"2024-09-10T14:29:08.778501+0000","last_fullsized":"2024-09-10T14:29:08.778501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:51.066667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.964268+0000","last_change":"2024-09-10T14:28:38.928679+0000","last_active":"2024-09-10T14:30:42.964268+0000","last_peered":"2024-09-10T14:30:42.964268+0000","last_clean":"2024-09-10T14:30:42.964268+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:30:42.964268+0000","last_undegraded":"2024-09-10T14:30:42.964268+0000","last_fullsized":"2024-09-10T14:30:42.964268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:20.861557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.873676+0000","last_change":"2024-09-10T14:28:30.881385+0000","last_active":"2024-09-10T14:31:43.873676+0000","last_peered":"2024-09-10T14:31:43.873676+0000","last_clean":"2024-09-10T14:31:43.873676+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:31:43.873676+0000","last_undegraded":"2024-09-10T14:31:43.873676+0000","last_fullsized":"2024-09-10T14:31:43.873676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.775827+0000","last_change":"2024-09-10T14:28:28.906793+0000","last_active":"2024-09-10T14:29:08.775827+0000","last_peered":"2024-09-10T14:29:08.775827+0000","last_clean":"2024-09-10T14:29:08.775827+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:29:08.775827+0000","last_undegraded":"2024-09-10T14:29:08.775827+0000","last_fullsized":"2024-09-10T14:29:08.775827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:45.691675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786646+0000","last_change":"2024-09-10T14:28:32.880162+0000","last_active":"2024-09-10T14:29:08.786646+0000","last_peered":"2024-09-10T14:29:08.786646+0000","last_clean":"2024-09-10T14:29:08.786646+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:29:08.786646+0000","last_undegraded":"2024-09-10T14:29:08.786646+0000","last_fullsized":"2024-09-10T14:29:08.786646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:19.866288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.110766+0000","last_change":"2024-09-10T14:28:34.922844+0000","last_active":"2024-09-10T14:30:41.110766+0000","last_peered":"2024-09-10T14:30:41.110766+0000","last_clean":"2024-09-10T14:30:41.110766+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:30:41.110766+0000","last_undegraded":"2024-09-10T14:30:41.110766+0000","last_fullsized":"2024-09-10T14:30:41.110766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:55.366020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782945+0000","last_change":"2024-09-10T14:28:36.940467+0000","last_active":"2024-09-10T14:29:08.782945+0000","last_peered":"2024-09-10T14:29:08.782945+0000","last_clean":"2024-09-10T14:29:08.782945+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:29:08.782945+0000","last_undegraded":"2024-09-10T14:29:08.782945+0000","last_fullsized":"2024-09-10T14:29:08.782945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:26.562499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.113319+0000","last_change":"2024-09-10T14:28:38.943738+0000","last_active":"2024-09-10T14:30:43.113319+0000","last_peered":"2024-09-10T14:30:43.113319+0000","last_clean":"2024-09-10T14:30:43.113319+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:30:43.113319+0000","last_undegraded":"2024-09-10T14:30:43.113319+0000","last_fullsized":"2024-09-10T14:30:43.113319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:23.582530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.176038+0000","last_change":"2024-09-10T14:28:30.890718+0000","last_active":"2024-09-10T14:31:44.176038+0000","last_peered":"2024-09-10T14:31:44.176038+0000","last_clean":"2024-09-10T14:31:44.176038+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:31:44.176038+0000","last_undegraded":"2024-09-10T14:31:44.176038+0000","last_fullsized":"2024-09-10T14:31:44.176038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:12.035474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777261+0000","last_change":"2024-09-10T14:28:28.904304+0000","last_active":"2024-09-10T14:29:08.777261+0000","last_peered":"2024-09-10T14:29:08.777261+0000","last_clean":"2024-09-10T14:29:08.777261+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:29:08.777261+0000","last_undegraded":"2024-09-10T14:29:08.777261+0000","last_fullsized":"2024-09-10T14:29:08.777261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:05.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.784823+0000","last_change":"2024-09-10T14:28:32.881286+0000","last_active":"2024-09-10T14:29:08.784823+0000","last_peered":"2024-09-10T14:29:08.784823+0000","last_clean":"2024-09-10T14:29:08.784823+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:29:08.784823+0000","last_undegraded":"2024-09-10T14:29:08.784823+0000","last_fullsized":"2024-09-10T14:29:08.784823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.999469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'32","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.135619+0000","last_change":"2024-09-10T14:28:34.894052+0000","last_active":"2024-09-10T14:30:41.135619+0000","last_peered":"2024-09-10T14:30:41.135619+0000","last_clean":"2024-09-10T14:30:41.135619+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:30:41.135619+0000","last_undegraded":"2024-09-10T14:30:41.135619+0000","last_fullsized":"2024-09-10T14:30:41.135619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:42.457623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096104+0000","last_change":"2024-09-10T14:28:36.914374+0000","last_active":"2024-09-10T14:29:09.096104+0000","last_peered":"2024-09-10T14:29:09.096104+0000","last_clean":"2024-09-10T14:29:09.096104+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:29:09.096104+0000","last_undegraded":"2024-09-10T14:29:09.096104+0000","last_fullsized":"2024-09-10T14:29:09.096104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:27.581565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.878132+0000","last_change":"2024-09-10T14:28:38.940779+0000","last_active":"2024-09-10T14:31:43.878132+0000","last_peered":"2024-09-10T14:31:43.878132+0000","last_clean":"2024-09-10T14:31:43.878132+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:31:43.878132+0000","last_undegraded":"2024-09-10T14:31:43.878132+0000","last_fullsized":"2024-09-10T14:31:43.878132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:01.962705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072247+0000","last_change":"2024-09-10T14:28:30.863566+0000","last_active":"2024-09-10T14:31:44.072247+0000","last_peered":"2024-09-10T14:31:44.072247+0000","last_clean":"2024-09-10T14:31:44.072247+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:31:44.072247+0000","last_undegraded":"2024-09-10T14:31:44.072247+0000","last_fullsized":"2024-09-10T14:31:44.072247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:33.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.004264+0000","last_change":"2024-09-10T14:28:28.890479+0000","last_active":"2024-09-10T14:29:15.004264+0000","last_peered":"2024-09-10T14:29:15.004264+0000","last_clean":"2024-09-10T14:29:15.004264+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:29:15.004264+0000","last_undegraded":"2024-09-10T14:29:15.004264+0000","last_fullsized":"2024-09-10T14:29:15.004264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:41.460622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.793988+0000","last_change":"2024-09-10T14:29:08.793243+0000","last_active":"2024-09-10T14:29:08.793988+0000","last_peered":"2024-09-10T14:29:08.793988+0000","last_clean":"2024-09-10T14:29:08.793988+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:29:08.793988+0000","last_undegraded":"2024-09-10T14:29:08.793988+0000","last_fullsized":"2024-09-10T14:29:08.793988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.893530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781141+0000","last_change":"2024-09-10T14:28:34.927446+0000","last_active":"2024-09-10T14:29:08.781141+0000","last_peered":"2024-09-10T14:29:08.781141+0000","last_clean":"2024-09-10T14:29:08.781141+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:29:08.781141+0000","last_undegraded":"2024-09-10T14:29:08.781141+0000","last_fullsized":"2024-09-10T14:29:08.781141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:11.151127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":409,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120415+0000","last_change":"2024-09-10T14:28:36.941280+0000","last_active":"2024-09-10T14:31:43.120415+0000","last_peered":"2024-09-10T14:31:43.120415+0000","last_clean":"2024-09-10T14:31:43.120415+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:31:43.120415+0000","last_undegraded":"2024-09-10T14:31:43.120415+0000","last_fullsized":"2024-09-10T14:31:43.120415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:56.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.767087+0000","last_change":"2024-09-10T14:28:38.938263+0000","last_active":"2024-09-10T14:29:08.767087+0000","last_peered":"2024-09-10T14:29:08.767087+0000","last_clean":"2024-09-10T14:29:08.767087+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:29:08.767087+0000","last_undegraded":"2024-09-10T14:29:08.767087+0000","last_fullsized":"2024-09-10T14:29:08.767087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:24.663593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227129+0000","last_change":"2024-09-10T14:28:30.861357+0000","last_active":"2024-09-10T14:31:44.227129+0000","last_peered":"2024-09-10T14:31:44.227129+0000","last_clean":"2024-09-10T14:31:44.227129+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:31:44.227129+0000","last_undegraded":"2024-09-10T14:31:44.227129+0000","last_fullsized":"2024-09-10T14:31:44.227129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:51.916826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782831+0000","last_change":"2024-09-10T14:28:28.885941+0000","last_active":"2024-09-10T14:29:08.782831+0000","last_peered":"2024-09-10T14:29:08.782831+0000","last_clean":"2024-09-10T14:29:08.782831+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:29:08.782831+0000","last_undegraded":"2024-09-10T14:29:08.782831+0000","last_fullsized":"2024-09-10T14:29:08.782831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:23.440776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776786+0000","last_change":"2024-09-10T14:28:32.883472+0000","last_active":"2024-09-10T14:29:08.776786+0000","last_peered":"2024-09-10T14:29:08.776786+0000","last_clean":"2024-09-10T14:29:08.776786+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:29:08.776786+0000","last_undegraded":"2024-09-10T14:29:08.776786+0000","last_fullsized":"2024-09-10T14:29:08.776786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:16.905282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.097227+0000","last_change":"2024-09-10T14:28:34.894279+0000","last_active":"2024-09-10T14:30:41.097227+0000","last_peered":"2024-09-10T14:30:41.097227+0000","last_clean":"2024-09-10T14:30:41.097227+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:30:41.097227+0000","last_undegraded":"2024-09-10T14:30:41.097227+0000","last_fullsized":"2024-09-10T14:30:41.097227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:42.457623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.092515+0000","last_change":"2024-09-10T14:28:36.924051+0000","last_active":"2024-09-10T14:29:09.092515+0000","last_peered":"2024-09-10T14:29:09.092515+0000","last_clean":"2024-09-10T14:29:09.092515+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:29:09.092515+0000","last_undegraded":"2024-09-10T14:29:09.092515+0000","last_fullsized":"2024-09-10T14:29:09.092515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:10.158060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.180558+0000","last_change":"2024-09-10T14:28:38.931948+0000","last_active":"2024-09-10T14:31:44.180558+0000","last_peered":"2024-09-10T14:31:44.180558+0000","last_clean":"2024-09-10T14:31:44.180558+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:31:44.180558+0000","last_undegraded":"2024-09-10T14:31:44.180558+0000","last_fullsized":"2024-09-10T14:31:44.180558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.156721+0000","last_change":"2024-09-10T14:28:30.857116+0000","last_active":"2024-09-10T14:31:44.156721+0000","last_peered":"2024-09-10T14:31:44.156721+0000","last_clean":"2024-09-10T14:31:44.156721+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:31:44.156721+0000","last_undegraded":"2024-09-10T14:31:44.156721+0000","last_fullsized":"2024-09-10T14:31:44.156721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:21.150726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787090+0000","last_change":"2024-09-10T14:28:28.889060+0000","last_active":"2024-09-10T14:30:58.787090+0000","last_peered":"2024-09-10T14:30:58.787090+0000","last_clean":"2024-09-10T14:30:58.787090+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:30:58.787090+0000","last_undegraded":"2024-09-10T14:30:58.787090+0000","last_fullsized":"2024-09-10T14:30:58.787090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:04.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":15,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781204+0000","last_change":"2024-09-10T14:28:32.886513+0000","last_active":"2024-09-10T14:29:08.781204+0000","last_peered":"2024-09-10T14:29:08.781204+0000","last_clean":"2024-09-10T14:29:08.781204+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:29:08.781204+0000","last_undegraded":"2024-09-10T14:29:08.781204+0000","last_fullsized":"2024-09-10T14:29:08.781204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:36.827270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.099907+0000","last_change":"2024-09-10T14:28:34.895458+0000","last_active":"2024-09-10T14:30:41.099907+0000","last_peered":"2024-09-10T14:30:41.099907+0000","last_clean":"2024-09-10T14:30:41.099907+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:30:41.099907+0000","last_undegraded":"2024-09-10T14:30:41.099907+0000","last_fullsized":"2024-09-10T14:30:41.099907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.304872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768221+0000","last_change":"2024-09-10T14:28:36.939560+0000","last_active":"2024-09-10T14:29:08.768221+0000","last_peered":"2024-09-10T14:29:08.768221+0000","last_clean":"2024-09-10T14:29:08.768221+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:29:08.768221+0000","last_undegraded":"2024-09-10T14:29:08.768221+0000","last_fullsized":"2024-09-10T14:29:08.768221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:17.208670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781377+0000","last_change":"2024-09-10T14:28:38.950672+0000","last_active":"2024-09-10T14:29:08.781377+0000","last_peered":"2024-09-10T14:29:08.781377+0000","last_clean":"2024-09-10T14:29:08.781377+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:29:08.781377+0000","last_undegraded":"2024-09-10T14:29:08.781377+0000","last_fullsized":"2024-09-10T14:29:08.781377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:51.478025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072298+0000","last_change":"2024-09-10T14:28:30.877715+0000","last_active":"2024-09-10T14:31:44.072298+0000","last_peered":"2024-09-10T14:31:44.072298+0000","last_clean":"2024-09-10T14:31:44.072298+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:31:44.072298+0000","last_undegraded":"2024-09-10T14:31:44.072298+0000","last_fullsized":"2024-09-10T14:31:44.072298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:47.874293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093159+0000","last_change":"2024-09-10T14:28:28.876685+0000","last_active":"2024-09-10T14:29:09.093159+0000","last_peered":"2024-09-10T14:29:09.093159+0000","last_clean":"2024-09-10T14:29:09.093159+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:29:09.093159+0000","last_undegraded":"2024-09-10T14:29:09.093159+0000","last_fullsized":"2024-09-10T14:29:09.093159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.417731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774563+0000","last_change":"2024-09-10T14:28:32.884054+0000","last_active":"2024-09-10T14:29:08.774563+0000","last_peered":"2024-09-10T14:29:08.774563+0000","last_clean":"2024-09-10T14:29:08.774563+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:29:08.774563+0000","last_undegraded":"2024-09-10T14:29:08.774563+0000","last_fullsized":"2024-09-10T14:29:08.774563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.742700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.131887+0000","last_change":"2024-09-10T14:28:34.914074+0000","last_active":"2024-09-10T14:30:41.131887+0000","last_peered":"2024-09-10T14:30:41.131887+0000","last_clean":"2024-09-10T14:30:41.131887+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:30:41.131887+0000","last_undegraded":"2024-09-10T14:30:41.131887+0000","last_fullsized":"2024-09-10T14:30:41.131887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:12.635701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769265+0000","last_change":"2024-09-10T14:28:36.945615+0000","last_active":"2024-09-10T14:29:08.769265+0000","last_peered":"2024-09-10T14:29:08.769265+0000","last_clean":"2024-09-10T14:29:08.769265+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:29:08.769265+0000","last_undegraded":"2024-09-10T14:29:08.769265+0000","last_fullsized":"2024-09-10T14:29:08.769265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:28.372594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.329350+0000","last_change":"2024-09-10T14:28:38.949225+0000","last_active":"2024-09-10T14:31:44.329350+0000","last_peered":"2024-09-10T14:31:44.329350+0000","last_clean":"2024-09-10T14:31:44.329350+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:31:44.329350+0000","last_undegraded":"2024-09-10T14:31:44.329350+0000","last_fullsized":"2024-09-10T14:31:44.329350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:30.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227695+0000","last_change":"2024-09-10T14:28:30.857745+0000","last_active":"2024-09-10T14:31:44.227695+0000","last_peered":"2024-09-10T14:31:44.227695+0000","last_clean":"2024-09-10T14:31:44.227695+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:31:44.227695+0000","last_undegraded":"2024-09-10T14:31:44.227695+0000","last_fullsized":"2024-09-10T14:31:44.227695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:20.516570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.049736+0000","last_change":"2024-09-10T14:28:28.904511+0000","last_active":"2024-09-10T14:31:44.049736+0000","last_peered":"2024-09-10T14:31:44.049736+0000","last_clean":"2024-09-10T14:31:44.049736+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:31:44.049736+0000","last_undegraded":"2024-09-10T14:31:44.049736+0000","last_fullsized":"2024-09-10T14:31:44.049736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:55.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.533136+0000","last_change":"2024-09-10T14:28:32.889332+0000","last_active":"2024-09-10T14:30:39.533136+0000","last_peered":"2024-09-10T14:30:39.533136+0000","last_clean":"2024-09-10T14:30:39.533136+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:30:39.533136+0000","last_undegraded":"2024-09-10T14:30:39.533136+0000","last_fullsized":"2024-09-10T14:30:39.533136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:50.606255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.153147+0000","last_change":"2024-09-10T14:28:34.914339+0000","last_active":"2024-09-10T14:31:43.153147+0000","last_peered":"2024-09-10T14:31:43.153147+0000","last_clean":"2024-09-10T14:31:43.153147+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:31:43.153147+0000","last_undegraded":"2024-09-10T14:31:43.153147+0000","last_fullsized":"2024-09-10T14:31:43.153147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:00.676530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.098628+0000","last_change":"2024-09-10T14:28:36.924970+0000","last_active":"2024-09-10T14:29:09.098628+0000","last_peered":"2024-09-10T14:29:09.098628+0000","last_clean":"2024-09-10T14:29:09.098628+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:29:09.098628+0000","last_undegraded":"2024-09-10T14:29:09.098628+0000","last_fullsized":"2024-09-10T14:29:09.098628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.099079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.152719+0000","last_change":"2024-09-10T14:28:38.949254+0000","last_active":"2024-09-10T14:30:41.152719+0000","last_peered":"2024-09-10T14:30:41.152719+0000","last_clean":"2024-09-10T14:30:41.152719+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:30:41.152719+0000","last_undegraded":"2024-09-10T14:30:41.152719+0000","last_fullsized":"2024-09-10T14:30:41.152719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:37.882075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071743+0000","last_change":"2024-09-10T14:28:30.890252+0000","last_active":"2024-09-10T14:31:44.071743+0000","last_peered":"2024-09-10T14:31:44.071743+0000","last_clean":"2024-09-10T14:31:44.071743+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:31:44.071743+0000","last_undegraded":"2024-09-10T14:31:44.071743+0000","last_fullsized":"2024-09-10T14:31:44.071743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:36.092002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.023557+0000","last_change":"2024-09-10T14:28:28.876974+0000","last_active":"2024-09-10T14:30:39.023557+0000","last_peered":"2024-09-10T14:30:39.023557+0000","last_clean":"2024-09-10T14:30:39.023557+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:30:39.023557+0000","last_undegraded":"2024-09-10T14:30:39.023557+0000","last_fullsized":"2024-09-10T14:30:39.023557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:56.895016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.105167+0000","last_change":"2024-09-10T14:28:30.861035+0000","last_active":"2024-09-10T14:29:09.105167+0000","last_peered":"2024-09-10T14:29:09.105167+0000","last_clean":"2024-09-10T14:29:09.105167+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:29:09.105167+0000","last_undegraded":"2024-09-10T14:29:09.105167+0000","last_fullsized":"2024-09-10T14:29:09.105167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:11.237117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.995691+0000","last_change":"2024-09-10T14:28:28.880673+0000","last_active":"2024-09-10T14:30:42.995691+0000","last_peered":"2024-09-10T14:30:42.995691+0000","last_clean":"2024-09-10T14:30:42.995691+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:30:42.995691+0000","last_undegraded":"2024-09-10T14:30:42.995691+0000","last_fullsized":"2024-09-10T14:30:42.995691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:05.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'9","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.242990+0000","last_change":"2024-09-10T14:28:30.876383+0000","last_active":"2024-09-10T14:31:44.242990+0000","last_peered":"2024-09-10T14:31:44.242990+0000","last_clean":"2024-09-10T14:31:44.242990+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:31:44.242990+0000","last_undegraded":"2024-09-10T14:31:44.242990+0000","last_fullsized":"2024-09-10T14:31:44.242990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:27.003138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.358756+0000","last_change":"2024-09-10T14:28:28.892938+0000","last_active":"2024-09-10T14:29:58.358756+0000","last_peered":"2024-09-10T14:29:58.358756+0000","last_clean":"2024-09-10T14:29:58.358756+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:29:58.358756+0000","last_undegraded":"2024-09-10T14:29:58.358756+0000","last_fullsized":"2024-09-10T14:29:58.358756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:31.835408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.073511+0000","last_change":"2024-09-10T14:28:30.863758+0000","last_active":"2024-09-10T14:29:58.073511+0000","last_peered":"2024-09-10T14:29:58.073511+0000","last_clean":"2024-09-10T14:29:58.073511+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:29:58.073511+0000","last_undegraded":"2024-09-10T14:29:58.073511+0000","last_fullsized":"2024-09-10T14:29:58.073511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:55.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.494361+0000","last_change":"2024-09-10T14:28:28.880499+0000","last_active":"2024-09-10T14:29:13.494361+0000","last_peered":"2024-09-10T14:29:13.494361+0000","last_clean":"2024-09-10T14:29:13.494361+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:29:13.494361+0000","last_undegraded":"2024-09-10T14:29:13.494361+0000","last_fullsized":"2024-09-10T14:29:13.494361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:45.094407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.739142+0000","last_change":"2024-09-10T14:28:30.886667+0000","last_active":"2024-09-10T14:31:43.739142+0000","last_peered":"2024-09-10T14:31:43.739142+0000","last_clean":"2024-09-10T14:31:43.739142+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:43.739142+0000","last_undegraded":"2024-09-10T14:31:43.739142+0000","last_fullsized":"2024-09-10T14:31:43.739142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:02.612612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.491902+0000","last_change":"2024-09-10T14:28:28.908422+0000","last_active":"2024-09-10T14:29:13.491902+0000","last_peered":"2024-09-10T14:29:13.491902+0000","last_clean":"2024-09-10T14:29:13.491902+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:29:13.491902+0000","last_undegraded":"2024-09-10T14:29:13.491902+0000","last_fullsized":"2024-09-10T14:29:13.491902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:18.554945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.783600+0000","last_change":"2024-09-10T14:28:30.886359+0000","last_active":"2024-09-10T14:29:08.783600+0000","last_peered":"2024-09-10T14:29:08.783600+0000","last_clean":"2024-09-10T14:29:08.783600+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:29:08.783600+0000","last_undegraded":"2024-09-10T14:29:08.783600+0000","last_fullsized":"2024-09-10T14:29:08.783600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:11.237117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787165+0000","last_change":"2024-09-10T14:28:28.899480+0000","last_active":"2024-09-10T14:29:08.787165+0000","last_peered":"2024-09-10T14:29:08.787165+0000","last_clean":"2024-09-10T14:29:08.787165+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:29:08.787165+0000","last_undegraded":"2024-09-10T14:29:08.787165+0000","last_fullsized":"2024-09-10T14:29:08.787165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:43.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.175804+0000","last_change":"2024-09-10T14:28:30.881839+0000","last_active":"2024-09-10T14:31:44.175804+0000","last_peered":"2024-09-10T14:31:44.175804+0000","last_clean":"2024-09-10T14:31:44.175804+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:31:44.175804+0000","last_undegraded":"2024-09-10T14:31:44.175804+0000","last_fullsized":"2024-09-10T14:31:44.175804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:06.988787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787432+0000","last_change":"2024-09-10T14:28:28.913505+0000","last_active":"2024-09-10T14:29:08.787432+0000","last_peered":"2024-09-10T14:29:08.787432+0000","last_clean":"2024-09-10T14:29:08.787432+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:29:08.787432+0000","last_undegraded":"2024-09-10T14:29:08.787432+0000","last_fullsized":"2024-09-10T14:29:08.787432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:11.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071529+0000","last_change":"2024-09-10T14:28:30.887181+0000","last_active":"2024-09-10T14:31:44.071529+0000","last_peered":"2024-09-10T14:31:44.071529+0000","last_clean":"2024-09-10T14:31:44.071529+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:31:44.071529+0000","last_undegraded":"2024-09-10T14:31:44.071529+0000","last_fullsized":"2024-09-10T14:31:44.071529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:11.379786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096944+0000","last_change":"2024-09-10T14:28:28.878802+0000","last_active":"2024-09-10T14:29:09.096944+0000","last_peered":"2024-09-10T14:29:09.096944+0000","last_clean":"2024-09-10T14:29:09.096944+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:29:09.096944+0000","last_undegraded":"2024-09-10T14:29:09.096944+0000","last_fullsized":"2024-09-10T14:29:09.096944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:26.929099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.875049+0000","last_change":"2024-09-10T14:28:30.873038+0000","last_active":"2024-09-10T14:31:43.875049+0000","last_peered":"2024-09-10T14:31:43.875049+0000","last_clean":"2024-09-10T14:31:43.875049+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:31:43.875049+0000","last_undegraded":"2024-09-10T14:31:43.875049+0000","last_fullsized":"2024-09-10T14:31:43.875049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:24.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768501+0000","last_change":"2024-09-10T14:28:28.893263+0000","last_active":"2024-09-10T14:29:08.768501+0000","last_peered":"2024-09-10T14:29:08.768501+0000","last_clean":"2024-09-10T14:29:08.768501+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:29:08.768501+0000","last_undegraded":"2024-09-10T14:29:08.768501+0000","last_fullsized":"2024-09-10T14:29:08.768501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:14.670209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072636+0000","last_change":"2024-09-10T14:28:30.885304+0000","last_active":"2024-09-10T14:31:44.072636+0000","last_peered":"2024-09-10T14:31:44.072636+0000","last_clean":"2024-09-10T14:31:44.072636+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:31:44.072636+0000","last_undegraded":"2024-09-10T14:31:44.072636+0000","last_fullsized":"2024-09-10T14:31:44.072636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:52.328031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.489629+0000","last_change":"2024-09-10T14:28:28.879959+0000","last_active":"2024-09-10T14:29:13.489629+0000","last_peered":"2024-09-10T14:29:13.489629+0000","last_clean":"2024-09-10T14:29:13.489629+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:29:13.489629+0000","last_undegraded":"2024-09-10T14:29:13.489629+0000","last_fullsized":"2024-09-10T14:29:13.489629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.028308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071788+0000","last_change":"2024-09-10T14:28:30.875900+0000","last_active":"2024-09-10T14:31:44.071788+0000","last_peered":"2024-09-10T14:31:44.071788+0000","last_clean":"2024-09-10T14:31:44.071788+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:31:44.071788+0000","last_undegraded":"2024-09-10T14:31:44.071788+0000","last_fullsized":"2024-09-10T14:31:44.071788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:33.823970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777667+0000","last_change":"2024-09-10T14:28:28.888402+0000","last_active":"2024-09-10T14:29:08.777667+0000","last_peered":"2024-09-10T14:29:08.777667+0000","last_clean":"2024-09-10T14:29:08.777667+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:29:08.777667+0000","last_undegraded":"2024-09-10T14:29:08.777667+0000","last_fullsized":"2024-09-10T14:29:08.777667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:04.011779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.732962+0000","last_change":"2024-09-10T14:28:30.883269+0000","last_active":"2024-09-10T14:31:43.732962+0000","last_peered":"2024-09-10T14:31:43.732962+0000","last_clean":"2024-09-10T14:31:43.732962+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:31:43.732962+0000","last_undegraded":"2024-09-10T14:31:43.732962+0000","last_fullsized":"2024-09-10T14:31:43.732962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.305094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781430+0000","last_change":"2024-09-10T14:28:28.906234+0000","last_active":"2024-09-10T14:29:08.781430+0000","last_peered":"2024-09-10T14:29:08.781430+0000","last_clean":"2024-09-10T14:29:08.781430+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:29:08.781430+0000","last_undegraded":"2024-09-10T14:29:08.781430+0000","last_fullsized":"2024-09-10T14:29:08.781430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:39.391774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227328+0000","last_change":"2024-09-10T14:28:30.886081+0000","last_active":"2024-09-10T14:31:44.227328+0000","last_peered":"2024-09-10T14:31:44.227328+0000","last_clean":"2024-09-10T14:31:44.227328+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:31:44.227328+0000","last_undegraded":"2024-09-10T14:31:44.227328+0000","last_fullsized":"2024-09-10T14:31:44.227328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.771512+0000","last_change":"2024-09-10T14:28:28.890888+0000","last_active":"2024-09-10T14:29:08.771512+0000","last_peered":"2024-09-10T14:29:08.771512+0000","last_clean":"2024-09-10T14:29:08.771512+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:29:08.771512+0000","last_undegraded":"2024-09-10T14:29:08.771512+0000","last_fullsized":"2024-09-10T14:29:08.771512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:40.510621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158665+0000","last_change":"2024-09-10T14:28:30.866941+0000","last_active":"2024-09-10T14:31:44.158665+0000","last_peered":"2024-09-10T14:31:44.158665+0000","last_clean":"2024-09-10T14:31:44.158665+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:31:44.158665+0000","last_undegraded":"2024-09-10T14:31:44.158665+0000","last_fullsized":"2024-09-10T14:31:44.158665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:44.179281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778431+0000","last_change":"2024-09-10T14:28:28.880438+0000","last_active":"2024-09-10T14:29:08.778431+0000","last_peered":"2024-09-10T14:29:08.778431+0000","last_clean":"2024-09-10T14:29:08.778431+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:29:08.778431+0000","last_undegraded":"2024-09-10T14:29:08.778431+0000","last_fullsized":"2024-09-10T14:29:08.778431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:26.888320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'13","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784209+0000","last_change":"2024-09-10T14:28:30.887810+0000","last_active":"2024-09-10T14:30:48.784209+0000","last_peered":"2024-09-10T14:30:48.784209+0000","last_clean":"2024-09-10T14:30:48.784209+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:30:48.784209+0000","last_undegraded":"2024-09-10T14:30:48.784209+0000","last_fullsized":"2024-09-10T14:30:48.784209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:57.157500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788071+0000","last_change":"2024-09-10T14:28:28.914161+0000","last_active":"2024-09-10T14:29:08.788071+0000","last_peered":"2024-09-10T14:29:08.788071+0000","last_clean":"2024-09-10T14:29:08.788071+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:29:08.788071+0000","last_undegraded":"2024-09-10T14:29:08.788071+0000","last_fullsized":"2024-09-10T14:29:08.788071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:57.354096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244157+0000","last_change":"2024-09-10T14:28:30.862241+0000","last_active":"2024-09-10T14:31:44.244157+0000","last_peered":"2024-09-10T14:31:44.244157+0000","last_clean":"2024-09-10T14:31:44.244157+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:31:44.244157+0000","last_undegraded":"2024-09-10T14:31:44.244157+0000","last_fullsized":"2024-09-10T14:31:44.244157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:33.823970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.646886+0000","last_change":"2024-09-10T14:28:28.879289+0000","last_active":"2024-09-10T14:31:43.646886+0000","last_peered":"2024-09-10T14:31:43.646886+0000","last_clean":"2024-09-10T14:31:43.646886+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:31:43.646886+0000","last_undegraded":"2024-09-10T14:31:43.646886+0000","last_fullsized":"2024-09-10T14:31:43.646886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:09.227862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770986+0000","last_change":"2024-09-10T14:28:28.892314+0000","last_active":"2024-09-10T14:29:08.770986+0000","last_peered":"2024-09-10T14:29:08.770986+0000","last_clean":"2024-09-10T14:29:08.770986+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:29:08.770986+0000","last_undegraded":"2024-09-10T14:29:08.770986+0000","last_fullsized":"2024-09-10T14:29:08.770986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:13.058159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227341+0000","last_change":"2024-09-10T14:28:30.891092+0000","last_active":"2024-09-10T14:31:44.227341+0000","last_peered":"2024-09-10T14:31:44.227341+0000","last_clean":"2024-09-10T14:31:44.227341+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:31:44.227341+0000","last_undegraded":"2024-09-10T14:31:44.227341+0000","last_fullsized":"2024-09-10T14:31:44.227341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:24.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:52.777958+0000","last_change":"2024-09-10T14:28:28.881653+0000","last_active":"2024-09-10T14:30:52.777958+0000","last_peered":"2024-09-10T14:30:52.777958+0000","last_clean":"2024-09-10T14:30:52.777958+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:30:52.777958+0000","last_undegraded":"2024-09-10T14:30:52.777958+0000","last_fullsized":"2024-09-10T14:30:52.777958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:53.922561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.791605+0000","last_change":"2024-09-10T14:28:30.887038+0000","last_active":"2024-09-10T14:29:08.791605+0000","last_peered":"2024-09-10T14:29:08.791605+0000","last_clean":"2024-09-10T14:29:08.791605+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:29:08.791605+0000","last_undegraded":"2024-09-10T14:29:08.791605+0000","last_fullsized":"2024-09-10T14:29:08.791605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:55.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640308,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48920,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322920,"statfs":{"total":96636764160,"available":96586670080,"internally_reserved":0,"allocated":9641984,"data_stored":9357446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673013,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":8900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":9113600,"data_stored":8768463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673013,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44776,"kb_used_data":9432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327064,"statfs":{"total":96636764160,"available":96590913536,"internally_reserved":0,"allocated":9658368,"data_stored":9355915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35892,"kb_used_data":8868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335948,"statfs":{"total":96636764160,"available":96600010752,"internally_reserved":0,"allocated":9080832,"data_stored":8769006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:32:16.502 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T14:32:16.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:32:16.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.656+0000 7f4540d56640 1 Processor -- start 2024-09-10T14:32:16.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.656+0000 7f4540d56640 1 -- start start 2024-09-10T14:32:16.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f4540d56640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f453c12f390 0x7f453c133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f4540d56640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453c0984f0 con 0x7f453c12e760 2024-09-10T14:32:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f4540d56640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f453c098dc0 con 0x7f453c12f390 2024-09-10T14:32:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f453a59c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f453c12e760 0x7f453c12ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45726/0 (socket says 172.21.15.52:45726) 2024-09-10T14:32:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f453a59c640 1 -- 172.21.15.52:0/3036644500 learned_addr learned my addr 172.21.15.52:0/3036644500 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f4539d9b640 1 --2- 172.21.15.52:0/3036644500 >> v2:172.21.15.52:3300/0 conn(0x7f453c12f390 0x7f453c133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f453959a640 1 -- 172.21.15.52:0/3036644500 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112712685 0 0) 0x7f453c0984f0 con 0x7f453c12e760 2024-09-10T14:32:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f453959a640 1 -- 172.21.15.52:0/3036644500 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4524003530 con 0x7f453c12e760 2024-09-10T14:32:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f4539d9b640 1 -- 172.21.15.52:0/3036644500 >> v1:172.21.15.52:6789/0 conn(0x7f453c12e760 legacy=0x7f453c12ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f4539d9b640 1 -- 172.21.15.52:0/3036644500 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c0981a0 con 0x7f453c12f390 2024-09-10T14:32:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f4539d9b640 1 --2- 172.21.15.52:0/3036644500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12f390 0x7f453c133a80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4530009740 tx=0x7f453001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b82d040448c969 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f453959a640 1 -- 172.21.15.52:0/3036644500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300b1070 con 0x7f453c12f390 2024-09-10T14:32:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f453959a640 1 -- 172.21.15.52:0/3036644500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45300ac570 con 0x7f453c12f390 2024-09-10T14:32:16.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.660+0000 7f453959a640 1 -- 172.21.15.52:0/3036644500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45300ac870 con 0x7f453c12f390 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- 172.21.15.52:0/3036644500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12f390 msgr2=0x7f453c133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 --2- 172.21.15.52:0/3036644500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12f390 0x7f453c133a80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4530009740 tx=0x7f453001c400 comp rx=0 tx=0).stop 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- 172.21.15.52:0/3036644500 shutdown_connections 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 --2- 172.21.15.52:0/3036644500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12f390 0x7f453c133a80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- 172.21.15.52:0/3036644500 >> 172.21.15.52:0/3036644500 conn(0x7f453c0a10a0 msgr2=0x7f453c0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- 172.21.15.52:0/3036644500 shutdown_connections 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- 172.21.15.52:0/3036644500 wait complete. 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 Processor -- start 2024-09-10T14:32:16.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- start start 2024-09-10T14:32:16.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12e760 0x7f453c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:16.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f453c136b70 con 0x7f453c12e760 2024-09-10T14:32:16.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f453a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12e760 0x7f453c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:16.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f453a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12e760 0x7f453c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40586/0 (socket says 172.21.15.52:40586) 2024-09-10T14:32:16.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f453a59c640 1 -- 172.21.15.52:0/3226845519 learned_addr learned my addr 172.21.15.52:0/3226845519 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:16.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f453a59c640 1 -- 172.21.15.52:0/3226845519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c132930 con 0x7f453c12e760 2024-09-10T14:32:16.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f453a59c640 1 --2- 172.21.15.52:0/3226845519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12e760 0x7f453c12fd20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f452c00c450 tx=0x7f452c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:16.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f452affd640 1 -- 172.21.15.52:0/3226845519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f452c017070 con 0x7f453c12e760 2024-09-10T14:32:16.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f452affd640 1 -- 172.21.15.52:0/3226845519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f452c005c20 con 0x7f453c12e760 2024-09-10T14:32:16.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f452affd640 1 -- 172.21.15.52:0/3226845519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f452c007070 con 0x7f453c12e760 2024-09-10T14:32:16.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453c1314b0 con 0x7f453c12e760 2024-09-10T14:32:16.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f453c130260 con 0x7f453c12e760 2024-09-10T14:32:16.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f453c12ec80 con 0x7f453c12e760 2024-09-10T14:32:16.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.664+0000 7f452affd640 1 -- 172.21.15.52:0/3226845519 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f452c01a070 con 0x7f453c12e760 2024-09-10T14:32:16.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.668+0000 7f452affd640 1 --2- 172.21.15.52:0/3226845519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f451c035db0 0x7f451c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:16.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.668+0000 7f452affd640 1 -- 172.21.15.52:0/3226845519 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f452c048470 con 0x7f453c12e760 2024-09-10T14:32:16.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.668+0000 7f4539d9b640 1 --2- 172.21.15.52:0/3226845519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f451c035db0 0x7f451c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:16.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.668+0000 7f4539d9b640 1 --2- 172.21.15.52:0/3226845519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f451c035db0 0x7f451c038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f45300ae000 tx=0x7f4530008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:16.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.672+0000 7f452affd640 1 -- 172.21.15.52:0/3226845519 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f452c007210 con 0x7f453c12e760 2024-09-10T14:32:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.832+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f453c128f50 con 0x7f451c035db0 2024-09-10T14:32:16.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.876+0000 7f452affd640 1 -- 172.21.15.52:0/3226845519 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666056 (secure 0 0 0) 0x7f453c128f50 con 0x7f451c035db0 2024-09-10T14:32:16.885 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:32:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f451c035db0 msgr2=0x7f451c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 --2- 172.21.15.52:0/3226845519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f451c035db0 0x7f451c038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f45300ae000 tx=0x7f4530008040 comp rx=0 tx=0).stop 2024-09-10T14:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12e760 msgr2=0x7f453c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 --2- 172.21.15.52:0/3226845519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12e760 0x7f453c12fd20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f452c00c450 tx=0x7f452c00c910 comp rx=0 tx=0).stop 2024-09-10T14:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 shutdown_connections 2024-09-10T14:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 --2- 172.21.15.52:0/3226845519 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f451c035db0 0x7f451c038270 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 --2- 172.21.15.52:0/3226845519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f453c12e760 0x7f453c12fd20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 >> 172.21.15.52:0/3226845519 conn(0x7f453c0a10a0 msgr2=0x7f453c1280b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 shutdown_connections 2024-09-10T14:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:16.880+0000 7f4540d56640 1 -- 172.21.15.52:0/3226845519 wait complete. 2024-09-10T14:32:16.903 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-10T14:32:16.796713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416905,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4892,"num_read_kb":4469,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173832,"kb_used_data":36616,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313528,"statfs":{"total":386547056640,"available":386369052672,"internally_reserved":0,"allocated":37494784,"data_stored":36250830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007110"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786610+0000","last_change":"2024-09-10T14:28:28.910643+0000","last_active":"2024-09-10T14:29:08.786610+0000","last_peered":"2024-09-10T14:29:08.786610+0000","last_clean":"2024-09-10T14:29:08.786610+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:29:08.786610+0000","last_undegraded":"2024-09-10T14:29:08.786610+0000","last_fullsized":"2024-09-10T14:29:08.786610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:48.682064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743959+0000","last_change":"2024-09-10T14:28:30.866892+0000","last_active":"2024-09-10T14:29:15.743959+0000","last_peered":"2024-09-10T14:29:15.743959+0000","last_clean":"2024-09-10T14:29:15.743959+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:29:15.743959+0000","last_undegraded":"2024-09-10T14:29:15.743959+0000","last_fullsized":"2024-09-10T14:29:15.743959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.106885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.900665+0000","last_change":"2024-09-10T14:28:28.880130+0000","last_active":"2024-09-10T14:30:42.900665+0000","last_peered":"2024-09-10T14:30:42.900665+0000","last_clean":"2024-09-10T14:30:42.900665+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:30:42.900665+0000","last_undegraded":"2024-09-10T14:30:42.900665+0000","last_fullsized":"2024-09-10T14:30:42.900665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:27.360132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.874392+0000","last_change":"2024-09-10T14:28:30.882162+0000","last_active":"2024-09-10T14:31:43.874392+0000","last_peered":"2024-09-10T14:31:43.874392+0000","last_clean":"2024-09-10T14:31:43.874392+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:31:43.874392+0000","last_undegraded":"2024-09-10T14:31:43.874392+0000","last_fullsized":"2024-09-10T14:31:43.874392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:58.678590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779170+0000","last_change":"2024-09-10T14:28:28.879906+0000","last_active":"2024-09-10T14:29:08.779170+0000","last_peered":"2024-09-10T14:29:08.779170+0000","last_clean":"2024-09-10T14:29:08.779170+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:29:08.779170+0000","last_undegraded":"2024-09-10T14:29:08.779170+0000","last_fullsized":"2024-09-10T14:29:08.779170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:53.690949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072389+0000","last_change":"2024-09-10T14:28:30.882676+0000","last_active":"2024-09-10T14:31:44.072389+0000","last_peered":"2024-09-10T14:31:44.072389+0000","last_clean":"2024-09-10T14:31:44.072389+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:31:44.072389+0000","last_undegraded":"2024-09-10T14:31:44.072389+0000","last_fullsized":"2024-09-10T14:31:44.072389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:24.078737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.014030+0000","last_change":"2024-09-10T14:28:28.893233+0000","last_active":"2024-09-10T14:29:15.014030+0000","last_peered":"2024-09-10T14:29:15.014030+0000","last_clean":"2024-09-10T14:29:15.014030+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:29:15.014030+0000","last_undegraded":"2024-09-10T14:29:15.014030+0000","last_fullsized":"2024-09-10T14:29:15.014030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:11.076894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.045939+0000","last_change":"2024-09-10T14:28:30.881166+0000","last_active":"2024-09-10T14:30:39.045939+0000","last_peered":"2024-09-10T14:30:39.045939+0000","last_clean":"2024-09-10T14:30:39.045939+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:30:39.045939+0000","last_undegraded":"2024-09-10T14:30:39.045939+0000","last_fullsized":"2024-09-10T14:30:39.045939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:52.006581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770599+0000","last_change":"2024-09-10T14:28:28.883653+0000","last_active":"2024-09-10T14:29:08.770599+0000","last_peered":"2024-09-10T14:29:08.770599+0000","last_clean":"2024-09-10T14:29:08.770599+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:29:08.770599+0000","last_undegraded":"2024-09-10T14:29:08.770599+0000","last_fullsized":"2024-09-10T14:29:08.770599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:29.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.174109+0000","last_change":"2024-09-10T14:28:30.890087+0000","last_active":"2024-09-10T14:31:44.174109+0000","last_peered":"2024-09-10T14:31:44.174109+0000","last_clean":"2024-09-10T14:31:44.174109+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:31:44.174109+0000","last_undegraded":"2024-09-10T14:31:44.174109+0000","last_fullsized":"2024-09-10T14:31:44.174109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:24.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777518+0000","last_change":"2024-09-10T14:28:28.910148+0000","last_active":"2024-09-10T14:29:08.777518+0000","last_peered":"2024-09-10T14:29:08.777518+0000","last_clean":"2024-09-10T14:29:08.777518+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:29:08.777518+0000","last_undegraded":"2024-09-10T14:29:08.777518+0000","last_fullsized":"2024-09-10T14:29:08.777518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:47.128454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.736734+0000","last_change":"2024-09-10T14:28:30.875024+0000","last_active":"2024-09-10T14:31:43.736734+0000","last_peered":"2024-09-10T14:31:43.736734+0000","last_clean":"2024-09-10T14:31:43.736734+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:31:43.736734+0000","last_undegraded":"2024-09-10T14:31:43.736734+0000","last_fullsized":"2024-09-10T14:31:43.736734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:47.679026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770570+0000","last_change":"2024-09-10T14:28:28.890726+0000","last_active":"2024-09-10T14:29:08.770570+0000","last_peered":"2024-09-10T14:29:08.770570+0000","last_clean":"2024-09-10T14:29:08.770570+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:29:08.770570+0000","last_undegraded":"2024-09-10T14:29:08.770570+0000","last_fullsized":"2024-09-10T14:29:08.770570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:31.814715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'7","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.774452+0000","last_change":"2024-09-10T14:28:30.863498+0000","last_active":"2024-09-10T14:30:39.774452+0000","last_peered":"2024-09-10T14:30:39.774452+0000","last_clean":"2024-09-10T14:30:39.774452+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:30:39.774452+0000","last_undegraded":"2024-09-10T14:30:39.774452+0000","last_fullsized":"2024-09-10T14:30:39.774452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:34.818610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.089975+0000","last_change":"2024-09-10T14:28:28.876209+0000","last_active":"2024-09-10T14:29:09.089975+0000","last_peered":"2024-09-10T14:29:09.089975+0000","last_clean":"2024-09-10T14:29:09.089975+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:29:09.089975+0000","last_undegraded":"2024-09-10T14:29:09.089975+0000","last_fullsized":"2024-09-10T14:29:09.089975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:23.440776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.735816+0000","last_change":"2024-09-10T14:28:30.870535+0000","last_active":"2024-09-10T14:31:43.735816+0000","last_peered":"2024-09-10T14:31:43.735816+0000","last_clean":"2024-09-10T14:31:43.735816+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:31:43.735816+0000","last_undegraded":"2024-09-10T14:31:43.735816+0000","last_fullsized":"2024-09-10T14:31:43.735816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:16.469019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158427+0000","last_change":"2024-09-10T14:28:30.875126+0000","last_active":"2024-09-10T14:31:44.158427+0000","last_peered":"2024-09-10T14:31:44.158427+0000","last_clean":"2024-09-10T14:31:44.158427+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:31:44.158427+0000","last_undegraded":"2024-09-10T14:31:44.158427+0000","last_fullsized":"2024-09-10T14:31:44.158427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:31.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.790246+0000","last_change":"2024-09-10T14:28:28.902646+0000","last_active":"2024-09-10T14:29:08.790246+0000","last_peered":"2024-09-10T14:29:08.790246+0000","last_clean":"2024-09-10T14:29:08.790246+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:29:08.790246+0000","last_undegraded":"2024-09-10T14:29:08.790246+0000","last_fullsized":"2024-09-10T14:29:08.790246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:06.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071851+0000","last_change":"2024-09-10T14:28:30.871743+0000","last_active":"2024-09-10T14:31:44.071851+0000","last_peered":"2024-09-10T14:31:44.071851+0000","last_clean":"2024-09-10T14:31:44.071851+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:31:44.071851+0000","last_undegraded":"2024-09-10T14:31:44.071851+0000","last_fullsized":"2024-09-10T14:31:44.071851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:02.612612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788313+0000","last_change":"2024-09-10T14:28:28.913772+0000","last_active":"2024-09-10T14:29:08.788313+0000","last_peered":"2024-09-10T14:29:08.788313+0000","last_clean":"2024-09-10T14:29:08.788313+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:29:08.788313+0000","last_undegraded":"2024-09-10T14:29:08.788313+0000","last_fullsized":"2024-09-10T14:29:08.788313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:33.401745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.731033+0000","last_change":"2024-09-10T14:28:30.866947+0000","last_active":"2024-09-10T14:31:43.731033+0000","last_peered":"2024-09-10T14:31:43.731033+0000","last_clean":"2024-09-10T14:31:43.731033+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:31:43.731033+0000","last_undegraded":"2024-09-10T14:31:43.731033+0000","last_fullsized":"2024-09-10T14:31:43.731033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:33.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787811+0000","last_change":"2024-09-10T14:28:28.904198+0000","last_active":"2024-09-10T14:29:08.787811+0000","last_peered":"2024-09-10T14:29:08.787811+0000","last_clean":"2024-09-10T14:29:08.787811+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:29:08.787811+0000","last_undegraded":"2024-09-10T14:29:08.787811+0000","last_fullsized":"2024-09-10T14:29:08.787811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.028308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071682+0000","last_change":"2024-09-10T14:28:30.886686+0000","last_active":"2024-09-10T14:31:44.071682+0000","last_peered":"2024-09-10T14:31:44.071682+0000","last_clean":"2024-09-10T14:31:44.071682+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:44.071682+0000","last_undegraded":"2024-09-10T14:31:44.071682+0000","last_fullsized":"2024-09-10T14:31:44.071682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:43.469877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.020496+0000","last_change":"2024-09-10T14:28:28.888634+0000","last_active":"2024-09-10T14:29:15.020496+0000","last_peered":"2024-09-10T14:29:15.020496+0000","last_clean":"2024-09-10T14:29:15.020496+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:29:15.020496+0000","last_undegraded":"2024-09-10T14:29:15.020496+0000","last_fullsized":"2024-09-10T14:29:15.020496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:53.922561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158256+0000","last_change":"2024-09-10T14:28:30.870293+0000","last_active":"2024-09-10T14:31:44.158256+0000","last_peered":"2024-09-10T14:31:44.158256+0000","last_clean":"2024-09-10T14:31:44.158256+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:31:44.158256+0000","last_undegraded":"2024-09-10T14:31:44.158256+0000","last_fullsized":"2024-09-10T14:31:44.158256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:43.141173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.026158+0000","last_change":"2024-09-10T14:28:28.880689+0000","last_active":"2024-09-10T14:29:15.026158+0000","last_peered":"2024-09-10T14:29:15.026158+0000","last_clean":"2024-09-10T14:29:15.026158+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:29:15.026158+0000","last_undegraded":"2024-09-10T14:29:15.026158+0000","last_fullsized":"2024-09-10T14:29:15.026158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:06.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.046094+0000","last_change":"2024-09-10T14:28:30.889817+0000","last_active":"2024-09-10T14:30:39.046094+0000","last_peered":"2024-09-10T14:30:39.046094+0000","last_clean":"2024-09-10T14:30:39.046094+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:30:39.046094+0000","last_undegraded":"2024-09-10T14:30:39.046094+0000","last_fullsized":"2024-09-10T14:30:39.046094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:39.111758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770582+0000","last_change":"2024-09-10T14:28:28.891649+0000","last_active":"2024-09-10T14:29:08.770582+0000","last_peered":"2024-09-10T14:29:08.770582+0000","last_clean":"2024-09-10T14:29:08.770582+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:29:08.770582+0000","last_undegraded":"2024-09-10T14:29:08.770582+0000","last_fullsized":"2024-09-10T14:29:08.770582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:27.536920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.117237+0000","last_change":"2024-09-10T14:28:38.936524+0000","last_active":"2024-09-10T14:31:44.117237+0000","last_peered":"2024-09-10T14:31:44.117237+0000","last_clean":"2024-09-10T14:31:44.117237+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:31:44.117237+0000","last_undegraded":"2024-09-10T14:31:44.117237+0000","last_fullsized":"2024-09-10T14:31:44.117237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:46.216225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.756204+0000","last_change":"2024-09-10T14:29:07.798075+0000","last_active":"2024-09-10T14:29:09.756204+0000","last_peered":"2024-09-10T14:29:09.756204+0000","last_clean":"2024-09-10T14:29:09.756204+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:29:09.756204+0000","last_undegraded":"2024-09-10T14:29:09.756204+0000","last_fullsized":"2024-09-10T14:29:09.756204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:42.171906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770128+0000","last_change":"2024-09-10T14:28:28.894485+0000","last_active":"2024-09-10T14:29:08.770128+0000","last_peered":"2024-09-10T14:29:08.770128+0000","last_clean":"2024-09-10T14:29:08.770128+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:29:08.770128+0000","last_undegraded":"2024-09-10T14:29:08.770128+0000","last_fullsized":"2024-09-10T14:29:08.770128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:00.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776839+0000","last_change":"2024-09-10T14:28:32.888789+0000","last_active":"2024-09-10T14:29:08.776839+0000","last_peered":"2024-09-10T14:29:08.776839+0000","last_clean":"2024-09-10T14:29:08.776839+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:29:08.776839+0000","last_undegraded":"2024-09-10T14:29:08.776839+0000","last_fullsized":"2024-09-10T14:29:08.776839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:23.555023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'31","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.122649+0000","last_change":"2024-09-10T14:28:34.924424+0000","last_active":"2024-09-10T14:30:41.122649+0000","last_peered":"2024-09-10T14:30:41.122649+0000","last_clean":"2024-09-10T14:30:41.122649+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:30:41.122649+0000","last_undegraded":"2024-09-10T14:30:41.122649+0000","last_fullsized":"2024-09-10T14:30:41.122649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:02.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.790013+0000","last_change":"2024-09-10T14:28:36.938810+0000","last_active":"2024-09-10T14:29:08.790013+0000","last_peered":"2024-09-10T14:29:08.790013+0000","last_clean":"2024-09-10T14:29:08.790013+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:29:08.790013+0000","last_undegraded":"2024-09-10T14:29:08.790013+0000","last_fullsized":"2024-09-10T14:29:08.790013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:28.542198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.081040+0000","last_change":"2024-09-10T14:28:38.938155+0000","last_active":"2024-09-10T14:29:58.081040+0000","last_peered":"2024-09-10T14:29:58.081040+0000","last_clean":"2024-09-10T14:29:58.081040+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:29:58.081040+0000","last_undegraded":"2024-09-10T14:29:58.081040+0000","last_fullsized":"2024-09-10T14:29:58.081040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:16.961180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.731924+0000","last_change":"2024-09-10T14:28:30.876193+0000","last_active":"2024-09-10T14:31:43.731924+0000","last_peered":"2024-09-10T14:31:43.731924+0000","last_clean":"2024-09-10T14:31:43.731924+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:31:43.731924+0000","last_undegraded":"2024-09-10T14:31:43.731924+0000","last_fullsized":"2024-09-10T14:31:43.731924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.676792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776547+0000","last_change":"2024-09-10T14:28:28.895357+0000","last_active":"2024-09-10T14:30:49.776547+0000","last_peered":"2024-09-10T14:30:49.776547+0000","last_clean":"2024-09-10T14:30:49.776547+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:30:49.776547+0000","last_undegraded":"2024-09-10T14:30:49.776547+0000","last_fullsized":"2024-09-10T14:30:49.776547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.503117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099939+0000","last_change":"2024-09-10T14:28:32.878643+0000","last_active":"2024-09-10T14:29:09.099939+0000","last_peered":"2024-09-10T14:29:09.099939+0000","last_clean":"2024-09-10T14:29:09.099939+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:29:09.099939+0000","last_undegraded":"2024-09-10T14:29:09.099939+0000","last_fullsized":"2024-09-10T14:29:09.099939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:40.671350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788992+0000","last_change":"2024-09-10T14:28:34.889859+0000","last_active":"2024-09-10T14:29:08.788992+0000","last_peered":"2024-09-10T14:29:08.788992+0000","last_clean":"2024-09-10T14:29:08.788992+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:29:08.788992+0000","last_undegraded":"2024-09-10T14:29:08.788992+0000","last_fullsized":"2024-09-10T14:29:08.788992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:01.183310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788847+0000","last_change":"2024-09-10T14:28:36.934864+0000","last_active":"2024-09-10T14:29:08.788847+0000","last_peered":"2024-09-10T14:29:08.788847+0000","last_clean":"2024-09-10T14:29:08.788847+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:29:08.788847+0000","last_undegraded":"2024-09-10T14:29:08.788847+0000","last_fullsized":"2024-09-10T14:29:08.788847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.099079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095653+0000","last_change":"2024-09-10T14:28:38.928569+0000","last_active":"2024-09-10T14:29:09.095653+0000","last_peered":"2024-09-10T14:29:09.095653+0000","last_clean":"2024-09-10T14:29:09.095653+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:29:09.095653+0000","last_undegraded":"2024-09-10T14:29:09.095653+0000","last_fullsized":"2024-09-10T14:29:09.095653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:44.292475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787199+0000","last_change":"2024-09-10T14:28:30.879918+0000","last_active":"2024-09-10T14:30:58.787199+0000","last_peered":"2024-09-10T14:30:58.787199+0000","last_clean":"2024-09-10T14:30:58.787199+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:30:58.787199+0000","last_undegraded":"2024-09-10T14:30:58.787199+0000","last_fullsized":"2024-09-10T14:30:58.787199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:58.593808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784157+0000","last_change":"2024-09-10T14:28:28.890448+0000","last_active":"2024-09-10T14:30:48.784157+0000","last_peered":"2024-09-10T14:30:48.784157+0000","last_clean":"2024-09-10T14:30:48.784157+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:30:48.784157+0000","last_undegraded":"2024-09-10T14:30:48.784157+0000","last_fullsized":"2024-09-10T14:30:48.784157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:42.170026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.105820+0000","last_change":"2024-09-10T14:28:32.878770+0000","last_active":"2024-09-10T14:29:09.105820+0000","last_peered":"2024-09-10T14:29:09.105820+0000","last_clean":"2024-09-10T14:29:09.105820+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:29:09.105820+0000","last_undegraded":"2024-09-10T14:29:09.105820+0000","last_fullsized":"2024-09-10T14:29:09.105820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.818547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.780586+0000","last_change":"2024-09-10T14:28:34.899375+0000","last_active":"2024-09-10T14:29:08.780586+0000","last_peered":"2024-09-10T14:29:08.780586+0000","last_clean":"2024-09-10T14:29:08.780586+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:29:08.780586+0000","last_undegraded":"2024-09-10T14:29:08.780586+0000","last_fullsized":"2024-09-10T14:29:08.780586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:14.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120357+0000","last_change":"2024-09-10T14:28:36.944400+0000","last_active":"2024-09-10T14:31:43.120357+0000","last_peered":"2024-09-10T14:31:43.120357+0000","last_clean":"2024-09-10T14:31:43.120357+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:31:43.120357+0000","last_undegraded":"2024-09-10T14:31:43.120357+0000","last_fullsized":"2024-09-10T14:31:43.120357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:47.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.039826+0000","last_change":"2024-09-10T14:28:38.944662+0000","last_active":"2024-09-10T14:29:15.039826+0000","last_peered":"2024-09-10T14:29:15.039826+0000","last_clean":"2024-09-10T14:29:15.039826+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:29:15.039826+0000","last_undegraded":"2024-09-10T14:29:15.039826+0000","last_fullsized":"2024-09-10T14:29:15.039826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:11.695801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.888919+0000","last_change":"2024-09-10T14:28:30.884927+0000","last_active":"2024-09-10T14:31:43.888919+0000","last_peered":"2024-09-10T14:31:43.888919+0000","last_clean":"2024-09-10T14:31:43.888919+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:31:43.888919+0000","last_undegraded":"2024-09-10T14:31:43.888919+0000","last_fullsized":"2024-09-10T14:31:43.888919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:44.179281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.775615+0000","last_change":"2024-09-10T14:28:28.898609+0000","last_active":"2024-09-10T14:29:08.775615+0000","last_peered":"2024-09-10T14:29:08.775615+0000","last_clean":"2024-09-10T14:29:08.775615+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:29:08.775615+0000","last_undegraded":"2024-09-10T14:29:08.775615+0000","last_fullsized":"2024-09-10T14:29:08.775615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:14.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'4","reported_seq":228,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.577706+0000","last_change":"2024-09-10T14:28:32.888011+0000","last_active":"2024-09-10T14:30:42.577706+0000","last_peered":"2024-09-10T14:30:42.577706+0000","last_clean":"2024-09-10T14:30:42.577706+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:30:42.577706+0000","last_undegraded":"2024-09-10T14:30:42.577706+0000","last_fullsized":"2024-09-10T14:30:42.577706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:37.315922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.114910+0000","last_change":"2024-09-10T14:28:34.904591+0000","last_active":"2024-09-10T14:30:41.114910+0000","last_peered":"2024-09-10T14:30:41.114910+0000","last_clean":"2024-09-10T14:30:41.114910+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:30:41.114910+0000","last_undegraded":"2024-09-10T14:30:41.114910+0000","last_fullsized":"2024-09-10T14:30:41.114910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:15.929628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.235240+0000","last_change":"2024-09-10T14:28:36.902535+0000","last_active":"2024-09-10T14:31:44.235240+0000","last_peered":"2024-09-10T14:31:44.235240+0000","last_clean":"2024-09-10T14:31:44.235240+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:31:44.235240+0000","last_undegraded":"2024-09-10T14:31:44.235240+0000","last_fullsized":"2024-09-10T14:31:44.235240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:44.147166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.731663+0000","last_change":"2024-09-10T14:28:30.870811+0000","last_active":"2024-09-10T14:29:14.731663+0000","last_peered":"2024-09-10T14:29:14.731663+0000","last_clean":"2024-09-10T14:29:14.731663+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:29:14.731663+0000","last_undegraded":"2024-09-10T14:29:14.731663+0000","last_fullsized":"2024-09-10T14:29:14.731663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:38.431813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786131+0000","last_change":"2024-09-10T14:28:28.910600+0000","last_active":"2024-09-10T14:29:08.786131+0000","last_peered":"2024-09-10T14:29:08.786131+0000","last_clean":"2024-09-10T14:29:08.786131+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:29:08.786131+0000","last_undegraded":"2024-09-10T14:29:08.786131+0000","last_fullsized":"2024-09-10T14:29:08.786131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:28.271184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776997+0000","last_change":"2024-09-10T14:28:32.888462+0000","last_active":"2024-09-10T14:29:08.776997+0000","last_peered":"2024-09-10T14:29:08.776997+0000","last_clean":"2024-09-10T14:29:08.776997+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:29:08.776997+0000","last_undegraded":"2024-09-10T14:29:08.776997+0000","last_fullsized":"2024-09-10T14:29:08.776997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.818547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.128780+0000","last_change":"2024-09-10T14:28:34.891163+0000","last_active":"2024-09-10T14:30:41.128780+0000","last_peered":"2024-09-10T14:30:41.128780+0000","last_clean":"2024-09-10T14:30:41.128780+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:30:41.128780+0000","last_undegraded":"2024-09-10T14:30:41.128780+0000","last_fullsized":"2024-09-10T14:30:41.128780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:43.916591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095295+0000","last_change":"2024-09-10T14:28:36.914343+0000","last_active":"2024-09-10T14:29:09.095295+0000","last_peered":"2024-09-10T14:29:09.095295+0000","last_clean":"2024-09-10T14:29:09.095295+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:29:09.095295+0000","last_undegraded":"2024-09-10T14:29:09.095295+0000","last_fullsized":"2024-09-10T14:29:09.095295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:44.165530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.084003+0000","last_change":"2024-09-10T14:28:38.934568+0000","last_active":"2024-09-10T14:29:58.084003+0000","last_peered":"2024-09-10T14:29:58.084003+0000","last_clean":"2024-09-10T14:29:58.084003+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:29:58.084003+0000","last_undegraded":"2024-09-10T14:29:58.084003+0000","last_fullsized":"2024-09-10T14:29:58.084003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:16.561899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.781133+0000","last_change":"2024-09-10T14:28:30.867445+0000","last_active":"2024-09-10T14:30:43.781133+0000","last_peered":"2024-09-10T14:30:43.781133+0000","last_clean":"2024-09-10T14:30:43.781133+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:30:43.781133+0000","last_undegraded":"2024-09-10T14:30:43.781133+0000","last_fullsized":"2024-09-10T14:30:43.781133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:43.469877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786715+0000","last_change":"2024-09-10T14:28:28.895275+0000","last_active":"2024-09-10T14:29:08.786715+0000","last_peered":"2024-09-10T14:29:08.786715+0000","last_clean":"2024-09-10T14:29:08.786715+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:29:08.786715+0000","last_undegraded":"2024-09-10T14:29:08.786715+0000","last_fullsized":"2024-09-10T14:29:08.786715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.143838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096657+0000","last_change":"2024-09-10T14:28:32.877092+0000","last_active":"2024-09-10T14:29:09.096657+0000","last_peered":"2024-09-10T14:29:09.096657+0000","last_clean":"2024-09-10T14:29:09.096657+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:29:09.096657+0000","last_undegraded":"2024-09-10T14:29:09.096657+0000","last_fullsized":"2024-09-10T14:29:09.096657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:27.977679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.100623+0000","last_change":"2024-09-10T14:28:34.915801+0000","last_active":"2024-09-10T14:30:41.100623+0000","last_peered":"2024-09-10T14:30:41.100623+0000","last_clean":"2024-09-10T14:30:41.100623+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:30:41.100623+0000","last_undegraded":"2024-09-10T14:30:41.100623+0000","last_fullsized":"2024-09-10T14:30:41.100623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:45.906678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.090834+0000","last_change":"2024-09-10T14:28:36.924324+0000","last_active":"2024-09-10T14:29:09.090834+0000","last_peered":"2024-09-10T14:29:09.090834+0000","last_clean":"2024-09-10T14:29:09.090834+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:29:09.090834+0000","last_undegraded":"2024-09-10T14:29:09.090834+0000","last_fullsized":"2024-09-10T14:29:09.090834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:03.128287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'5","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:52.401551+0000","last_change":"2024-09-10T14:28:38.933258+0000","last_active":"2024-09-10T14:29:52.401551+0000","last_peered":"2024-09-10T14:29:52.401551+0000","last_clean":"2024-09-10T14:29:52.401551+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:29:52.401551+0000","last_undegraded":"2024-09-10T14:29:52.401551+0000","last_fullsized":"2024-09-10T14:29:52.401551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:44.292475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.156496+0000","last_change":"2024-09-10T14:29:07.803940+0000","last_active":"2024-09-10T14:31:44.156496+0000","last_peered":"2024-09-10T14:31:44.156496+0000","last_clean":"2024-09-10T14:31:44.156496+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:31:44.156496+0000","last_undegraded":"2024-09-10T14:31:44.156496+0000","last_fullsized":"2024-09-10T14:31:44.156496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:14.995711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778671+0000","last_change":"2024-09-10T14:28:28.889610+0000","last_active":"2024-09-10T14:29:08.778671+0000","last_peered":"2024-09-10T14:29:08.778671+0000","last_clean":"2024-09-10T14:29:08.778671+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:29:08.778671+0000","last_undegraded":"2024-09-10T14:29:08.778671+0000","last_fullsized":"2024-09-10T14:29:08.778671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:27.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099744+0000","last_change":"2024-09-10T14:28:32.877306+0000","last_active":"2024-09-10T14:29:09.099744+0000","last_peered":"2024-09-10T14:29:09.099744+0000","last_clean":"2024-09-10T14:29:09.099744+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:29:09.099744+0000","last_undegraded":"2024-09-10T14:29:09.099744+0000","last_fullsized":"2024-09-10T14:29:09.099744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:59.002429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.130848+0000","last_change":"2024-09-10T14:28:34.910458+0000","last_active":"2024-09-10T14:30:41.130848+0000","last_peered":"2024-09-10T14:30:41.130848+0000","last_clean":"2024-09-10T14:30:41.130848+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:30:41.130848+0000","last_undegraded":"2024-09-10T14:30:41.130848+0000","last_fullsized":"2024-09-10T14:30:41.130848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:11.614047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":357,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.421931+0000","last_change":"2024-09-10T14:28:36.924500+0000","last_active":"2024-09-10T14:31:44.421931+0000","last_peered":"2024-09-10T14:31:44.421931+0000","last_clean":"2024-09-10T14:31:44.421931+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:31:44.421931+0000","last_undegraded":"2024-09-10T14:31:44.421931+0000","last_fullsized":"2024-09-10T14:31:44.421931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:18.061873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.102731+0000","last_change":"2024-09-10T14:28:38.936021+0000","last_active":"2024-09-10T14:29:09.102731+0000","last_peered":"2024-09-10T14:29:09.102731+0000","last_clean":"2024-09-10T14:29:09.102731+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:29:09.102731+0000","last_undegraded":"2024-09-10T14:29:09.102731+0000","last_fullsized":"2024-09-10T14:29:09.102731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'11","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776609+0000","last_change":"2024-09-10T14:28:30.859489+0000","last_active":"2024-09-10T14:30:49.776609+0000","last_peered":"2024-09-10T14:30:49.776609+0000","last_clean":"2024-09-10T14:30:49.776609+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:30:49.776609+0000","last_undegraded":"2024-09-10T14:30:49.776609+0000","last_fullsized":"2024-09-10T14:30:49.776609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:12.219239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770620+0000","last_change":"2024-09-10T14:28:28.884739+0000","last_active":"2024-09-10T14:29:08.770620+0000","last_peered":"2024-09-10T14:29:08.770620+0000","last_clean":"2024-09-10T14:29:08.770620+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:29:08.770620+0000","last_undegraded":"2024-09-10T14:29:08.770620+0000","last_fullsized":"2024-09-10T14:29:08.770620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:09.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"26'1","reported_seq":220,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.591860+0000","last_change":"2024-09-10T14:28:32.883434+0000","last_active":"2024-09-10T14:30:42.591860+0000","last_peered":"2024-09-10T14:30:42.591860+0000","last_clean":"2024-09-10T14:30:42.591860+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:30:42.591860+0000","last_undegraded":"2024-09-10T14:30:42.591860+0000","last_fullsized":"2024-09-10T14:30:42.591860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:15.866979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'55","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.132850+0000","last_change":"2024-09-10T14:28:34.914638+0000","last_active":"2024-09-10T14:30:41.132850+0000","last_peered":"2024-09-10T14:30:41.132850+0000","last_clean":"2024-09-10T14:30:41.132850+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:30:41.132850+0000","last_undegraded":"2024-09-10T14:30:41.132850+0000","last_fullsized":"2024-09-10T14:30:41.132850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:09.979440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.092054+0000","last_change":"2024-09-10T14:28:36.903930+0000","last_active":"2024-09-10T14:29:09.092054+0000","last_peered":"2024-09-10T14:29:09.092054+0000","last_clean":"2024-09-10T14:29:09.092054+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:29:09.092054+0000","last_undegraded":"2024-09-10T14:29:09.092054+0000","last_fullsized":"2024-09-10T14:29:09.092054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:07.331691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'20","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.381980+0000","last_change":"2024-09-10T14:28:38.919907+0000","last_active":"2024-09-10T14:31:44.381980+0000","last_peered":"2024-09-10T14:31:44.381980+0000","last_clean":"2024-09-10T14:31:44.381980+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:31:44.381980+0000","last_undegraded":"2024-09-10T14:31:44.381980+0000","last_fullsized":"2024-09-10T14:31:44.381980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:42:57.760263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.889287+0000","last_change":"2024-09-10T14:28:30.878590+0000","last_active":"2024-09-10T14:31:43.889287+0000","last_peered":"2024-09-10T14:31:43.889287+0000","last_clean":"2024-09-10T14:31:43.889287+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:31:43.889287+0000","last_undegraded":"2024-09-10T14:31:43.889287+0000","last_fullsized":"2024-09-10T14:31:43.889287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:43.722443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096578+0000","last_change":"2024-09-10T14:28:28.877127+0000","last_active":"2024-09-10T14:29:09.096578+0000","last_peered":"2024-09-10T14:29:09.096578+0000","last_clean":"2024-09-10T14:29:09.096578+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:29:09.096578+0000","last_undegraded":"2024-09-10T14:29:09.096578+0000","last_fullsized":"2024-09-10T14:29:09.096578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:00.704953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.785811+0000","last_change":"2024-09-10T14:28:32.878178+0000","last_active":"2024-09-10T14:29:08.785811+0000","last_peered":"2024-09-10T14:29:08.785811+0000","last_clean":"2024-09-10T14:29:08.785811+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:29:08.785811+0000","last_undegraded":"2024-09-10T14:29:08.785811+0000","last_fullsized":"2024-09-10T14:29:08.785811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:56.990523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.105783+0000","last_change":"2024-09-10T14:28:34.889384+0000","last_active":"2024-09-10T14:30:41.105783+0000","last_peered":"2024-09-10T14:30:41.105783+0000","last_clean":"2024-09-10T14:30:41.105783+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:30:41.105783+0000","last_undegraded":"2024-09-10T14:30:41.105783+0000","last_fullsized":"2024-09-10T14:30:41.105783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:56.353841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779998+0000","last_change":"2024-09-10T14:28:36.946071+0000","last_active":"2024-09-10T14:29:08.779998+0000","last_peered":"2024-09-10T14:29:08.779998+0000","last_clean":"2024-09-10T14:29:08.779998+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:29:08.779998+0000","last_undegraded":"2024-09-10T14:29:08.779998+0000","last_fullsized":"2024-09-10T14:29:08.779998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:45.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:40.722091+0000","last_change":"2024-09-10T14:28:38.941887+0000","last_active":"2024-09-10T14:30:40.722091+0000","last_peered":"2024-09-10T14:30:40.722091+0000","last_clean":"2024-09-10T14:30:40.722091+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:30:40.722091+0000","last_undegraded":"2024-09-10T14:30:40.722091+0000","last_fullsized":"2024-09-10T14:30:40.722091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:09.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.376108+0000","last_change":"2024-09-10T14:28:30.890869+0000","last_active":"2024-09-10T14:29:58.376108+0000","last_peered":"2024-09-10T14:29:58.376108+0000","last_clean":"2024-09-10T14:29:58.376108+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:29:58.376108+0000","last_undegraded":"2024-09-10T14:29:58.376108+0000","last_fullsized":"2024-09-10T14:29:58.376108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:33.087704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.490899+0000","last_change":"2024-09-10T14:28:28.891910+0000","last_active":"2024-09-10T14:29:13.490899+0000","last_peered":"2024-09-10T14:29:13.490899+0000","last_clean":"2024-09-10T14:29:13.490899+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:29:13.490899+0000","last_undegraded":"2024-09-10T14:29:13.490899+0000","last_fullsized":"2024-09-10T14:29:13.490899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:44.681521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099970+0000","last_change":"2024-09-10T14:28:32.877582+0000","last_active":"2024-09-10T14:29:09.099970+0000","last_peered":"2024-09-10T14:29:09.099970+0000","last_clean":"2024-09-10T14:29:09.099970+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:29:09.099970+0000","last_undegraded":"2024-09-10T14:29:09.099970+0000","last_fullsized":"2024-09-10T14:29:09.099970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:31.749719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.144934+0000","last_change":"2024-09-10T14:28:34.898334+0000","last_active":"2024-09-10T14:30:41.144934+0000","last_peered":"2024-09-10T14:30:41.144934+0000","last_clean":"2024-09-10T14:30:41.144934+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:30:41.144934+0000","last_undegraded":"2024-09-10T14:30:41.144934+0000","last_fullsized":"2024-09-10T14:30:41.144934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:56.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.408033+0000","last_change":"2024-09-10T14:28:36.937021+0000","last_active":"2024-09-10T14:31:44.408033+0000","last_peered":"2024-09-10T14:31:44.408033+0000","last_clean":"2024-09-10T14:31:44.408033+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:31:44.408033+0000","last_undegraded":"2024-09-10T14:31:44.408033+0000","last_fullsized":"2024-09-10T14:31:44.408033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:41.213212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776838+0000","last_change":"2024-09-10T14:28:38.936015+0000","last_active":"2024-09-10T14:30:47.776838+0000","last_peered":"2024-09-10T14:30:47.776838+0000","last_clean":"2024-09-10T14:30:47.776838+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:30:47.776838+0000","last_undegraded":"2024-09-10T14:30:47.776838+0000","last_fullsized":"2024-09-10T14:30:47.776838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:08.718072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.734924+0000","last_change":"2024-09-10T14:28:30.869152+0000","last_active":"2024-09-10T14:31:43.734924+0000","last_peered":"2024-09-10T14:31:43.734924+0000","last_clean":"2024-09-10T14:31:43.734924+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:31:43.734924+0000","last_undegraded":"2024-09-10T14:31:43.734924+0000","last_fullsized":"2024-09-10T14:31:43.734924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:29.230753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.213357+0000","last_change":"2024-09-10T14:28:28.890431+0000","last_active":"2024-09-10T14:31:44.213357+0000","last_peered":"2024-09-10T14:31:44.213357+0000","last_clean":"2024-09-10T14:31:44.213357+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:31:44.213357+0000","last_undegraded":"2024-09-10T14:31:44.213357+0000","last_fullsized":"2024-09-10T14:31:44.213357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:22.573383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.590739+0000","last_change":"2024-09-10T14:28:32.884446+0000","last_active":"2024-09-10T14:30:42.590739+0000","last_peered":"2024-09-10T14:30:42.590739+0000","last_clean":"2024-09-10T14:30:42.590739+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:30:42.590739+0000","last_undegraded":"2024-09-10T14:30:42.590739+0000","last_fullsized":"2024-09-10T14:30:42.590739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:15.273266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777108+0000","last_change":"2024-09-10T14:28:34.926311+0000","last_active":"2024-09-10T14:29:08.777108+0000","last_peered":"2024-09-10T14:29:08.777108+0000","last_clean":"2024-09-10T14:29:08.777108+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:29:08.777108+0000","last_undegraded":"2024-09-10T14:29:08.777108+0000","last_fullsized":"2024-09-10T14:29:08.777108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:40.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.335621+0000","last_change":"2024-09-10T14:28:36.922620+0000","last_active":"2024-09-10T14:31:44.335621+0000","last_peered":"2024-09-10T14:31:44.335621+0000","last_clean":"2024-09-10T14:31:44.335621+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:31:44.335621+0000","last_undegraded":"2024-09-10T14:31:44.335621+0000","last_fullsized":"2024-09-10T14:31:44.335621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:18.061873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.752153+0000","last_change":"2024-09-10T14:28:38.929142+0000","last_active":"2024-09-10T14:30:42.752153+0000","last_peered":"2024-09-10T14:30:42.752153+0000","last_clean":"2024-09-10T14:30:42.752153+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:30:42.752153+0000","last_undegraded":"2024-09-10T14:30:42.752153+0000","last_fullsized":"2024-09-10T14:30:42.752153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:15.327806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.324515+0000","last_change":"2024-09-10T14:28:30.889847+0000","last_active":"2024-09-10T14:31:44.324515+0000","last_peered":"2024-09-10T14:31:44.324515+0000","last_clean":"2024-09-10T14:31:44.324515+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:31:44.324515+0000","last_undegraded":"2024-09-10T14:31:44.324515+0000","last_fullsized":"2024-09-10T14:31:44.324515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:48.295547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768939+0000","last_change":"2024-09-10T14:28:28.894339+0000","last_active":"2024-09-10T14:29:08.768939+0000","last_peered":"2024-09-10T14:29:08.768939+0000","last_clean":"2024-09-10T14:29:08.768939+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:29:08.768939+0000","last_undegraded":"2024-09-10T14:29:08.768939+0000","last_fullsized":"2024-09-10T14:29:08.768939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:03.473546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779727+0000","last_change":"2024-09-10T14:28:32.891418+0000","last_active":"2024-09-10T14:29:08.779727+0000","last_peered":"2024-09-10T14:29:08.779727+0000","last_clean":"2024-09-10T14:29:08.779727+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:29:08.779727+0000","last_undegraded":"2024-09-10T14:29:08.779727+0000","last_fullsized":"2024-09-10T14:29:08.779727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:11.007860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'39","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783888+0000","last_change":"2024-09-10T14:28:34.889216+0000","last_active":"2024-09-10T14:30:53.783888+0000","last_peered":"2024-09-10T14:30:53.783888+0000","last_clean":"2024-09-10T14:30:53.783888+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:30:53.783888+0000","last_undegraded":"2024-09-10T14:30:53.783888+0000","last_fullsized":"2024-09-10T14:30:53.783888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:53.887819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778786+0000","last_change":"2024-09-10T14:28:36.938371+0000","last_active":"2024-09-10T14:29:08.778786+0000","last_peered":"2024-09-10T14:29:08.778786+0000","last_clean":"2024-09-10T14:29:08.778786+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:29:08.778786+0000","last_undegraded":"2024-09-10T14:29:08.778786+0000","last_fullsized":"2024-09-10T14:29:08.778786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:53.099481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.294156+0000","last_change":"2024-09-10T14:28:38.912768+0000","last_active":"2024-09-10T14:31:44.294156+0000","last_peered":"2024-09-10T14:31:44.294156+0000","last_clean":"2024-09-10T14:31:44.294156+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:31:44.294156+0000","last_undegraded":"2024-09-10T14:31:44.294156+0000","last_fullsized":"2024-09-10T14:31:44.294156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:20.861557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158954+0000","last_change":"2024-09-10T14:28:30.890682+0000","last_active":"2024-09-10T14:31:44.158954+0000","last_peered":"2024-09-10T14:31:44.158954+0000","last_clean":"2024-09-10T14:31:44.158954+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:31:44.158954+0000","last_undegraded":"2024-09-10T14:31:44.158954+0000","last_fullsized":"2024-09-10T14:31:44.158954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:17.279062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774963+0000","last_change":"2024-09-10T14:28:16.789816+0000","last_active":"2024-09-10T14:29:08.774963+0000","last_peered":"2024-09-10T14:29:08.774963+0000","last_clean":"2024-09-10T14:29:08.774963+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:29:08.774963+0000","last_undegraded":"2024-09-10T14:29:08.774963+0000","last_fullsized":"2024-09-10T14:29:08.774963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_clean_scrub_stamp":"2024-09-10T14:28:14.781430+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:16.536869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770870+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:29:08.770870+0000","last_peered":"2024-09-10T14:29:08.770870+0000","last_clean":"2024-09-10T14:29:08.770870+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:29:08.770870+0000","last_undegraded":"2024-09-10T14:29:08.770870+0000","last_fullsized":"2024-09-10T14:29:08.770870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:14.334391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.049324+0000","last_change":"2024-09-10T14:28:28.892198+0000","last_active":"2024-09-10T14:30:43.049324+0000","last_peered":"2024-09-10T14:30:43.049324+0000","last_clean":"2024-09-10T14:30:43.049324+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:30:43.049324+0000","last_undegraded":"2024-09-10T14:30:43.049324+0000","last_fullsized":"2024-09-10T14:30:43.049324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:02.556246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782315+0000","last_change":"2024-09-10T14:28:32.883286+0000","last_active":"2024-09-10T14:29:08.782315+0000","last_peered":"2024-09-10T14:29:08.782315+0000","last_clean":"2024-09-10T14:29:08.782315+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:29:08.782315+0000","last_undegraded":"2024-09-10T14:29:08.782315+0000","last_fullsized":"2024-09-10T14:29:08.782315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:49.691689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.140053+0000","last_change":"2024-09-10T14:28:34.925793+0000","last_active":"2024-09-10T14:30:41.140053+0000","last_peered":"2024-09-10T14:30:41.140053+0000","last_clean":"2024-09-10T14:30:41.140053+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:30:41.140053+0000","last_undegraded":"2024-09-10T14:30:41.140053+0000","last_fullsized":"2024-09-10T14:30:41.140053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:01.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095816+0000","last_change":"2024-09-10T14:28:36.925074+0000","last_active":"2024-09-10T14:29:09.095816+0000","last_peered":"2024-09-10T14:29:09.095816+0000","last_clean":"2024-09-10T14:29:09.095816+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:29:09.095816+0000","last_undegraded":"2024-09-10T14:29:09.095816+0000","last_fullsized":"2024-09-10T14:29:09.095816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:41.342463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.251835+0000","last_change":"2024-09-10T14:28:38.925950+0000","last_active":"2024-09-10T14:31:44.251835+0000","last_peered":"2024-09-10T14:31:44.251835+0000","last_clean":"2024-09-10T14:31:44.251835+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:31:44.251835+0000","last_undegraded":"2024-09-10T14:31:44.251835+0000","last_fullsized":"2024-09-10T14:31:44.251835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:06.497323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.378012+0000","last_change":"2024-09-10T14:28:30.878284+0000","last_active":"2024-09-10T14:29:58.378012+0000","last_peered":"2024-09-10T14:29:58.378012+0000","last_clean":"2024-09-10T14:29:58.378012+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:29:58.378012+0000","last_undegraded":"2024-09-10T14:29:58.378012+0000","last_fullsized":"2024-09-10T14:29:58.378012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:59.147562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768179+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:29:08.768179+0000","last_peered":"2024-09-10T14:29:08.768179+0000","last_clean":"2024-09-10T14:29:08.768179+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:29:08.768179+0000","last_undegraded":"2024-09-10T14:29:08.768179+0000","last_fullsized":"2024-09-10T14:29:08.768179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:11.168974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.041052+0000","last_change":"2024-09-10T14:28:28.873736+0000","last_active":"2024-09-10T14:31:44.041052+0000","last_peered":"2024-09-10T14:31:44.041052+0000","last_clean":"2024-09-10T14:31:44.041052+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:31:44.041052+0000","last_undegraded":"2024-09-10T14:31:44.041052+0000","last_fullsized":"2024-09-10T14:31:44.041052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:43.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782694+0000","last_change":"2024-09-10T14:28:32.888517+0000","last_active":"2024-09-10T14:29:08.782694+0000","last_peered":"2024-09-10T14:29:08.782694+0000","last_clean":"2024-09-10T14:29:08.782694+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:29:08.782694+0000","last_undegraded":"2024-09-10T14:29:08.782694+0000","last_fullsized":"2024-09-10T14:29:08.782694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:38.805133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'275","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.095600+0000","last_change":"2024-09-10T14:28:34.894665+0000","last_active":"2024-09-10T14:31:44.095600+0000","last_peered":"2024-09-10T14:31:44.095600+0000","last_clean":"2024-09-10T14:31:44.095600+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:31:44.095600+0000","last_undegraded":"2024-09-10T14:31:44.095600+0000","last_fullsized":"2024-09-10T14:31:44.095600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.418477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772230+0000","last_change":"2024-09-10T14:28:36.943974+0000","last_active":"2024-09-10T14:29:08.772230+0000","last_peered":"2024-09-10T14:29:08.772230+0000","last_clean":"2024-09-10T14:29:08.772230+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:29:08.772230+0000","last_undegraded":"2024-09-10T14:29:08.772230+0000","last_fullsized":"2024-09-10T14:29:08.772230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:48.045691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.777348+0000","last_change":"2024-09-10T14:28:38.943158+0000","last_active":"2024-09-10T14:31:43.777348+0000","last_peered":"2024-09-10T14:31:43.777348+0000","last_clean":"2024-09-10T14:31:43.777348+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:31:43.777348+0000","last_undegraded":"2024-09-10T14:31:43.777348+0000","last_fullsized":"2024-09-10T14:31:43.777348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:00.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.730417+0000","last_change":"2024-09-10T14:28:30.884260+0000","last_active":"2024-09-10T14:29:14.730417+0000","last_peered":"2024-09-10T14:29:14.730417+0000","last_clean":"2024-09-10T14:29:14.730417+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:29:14.730417+0000","last_undegraded":"2024-09-10T14:29:14.730417+0000","last_fullsized":"2024-09-10T14:29:14.730417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:55.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774556+0000","last_change":"2024-09-10T14:28:21.859213+0000","last_active":"2024-09-10T14:29:08.774556+0000","last_peered":"2024-09-10T14:29:08.774556+0000","last_clean":"2024-09-10T14:29:08.774556+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:29:08.774556+0000","last_undegraded":"2024-09-10T14:29:08.774556+0000","last_fullsized":"2024-09-10T14:29:08.774556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:49.580804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.058535+0000","last_change":"2024-09-10T14:28:28.874080+0000","last_active":"2024-09-10T14:31:44.058535+0000","last_peered":"2024-09-10T14:31:44.058535+0000","last_clean":"2024-09-10T14:31:44.058535+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:31:44.058535+0000","last_undegraded":"2024-09-10T14:31:44.058535+0000","last_fullsized":"2024-09-10T14:31:44.058535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:55.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786046+0000","last_change":"2024-09-10T14:28:32.871141+0000","last_active":"2024-09-10T14:29:08.786046+0000","last_peered":"2024-09-10T14:29:08.786046+0000","last_clean":"2024-09-10T14:29:08.786046+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:29:08.786046+0000","last_undegraded":"2024-09-10T14:29:08.786046+0000","last_fullsized":"2024-09-10T14:29:08.786046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:19.367394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120964+0000","last_change":"2024-09-10T14:28:34.884708+0000","last_active":"2024-09-10T14:31:43.120964+0000","last_peered":"2024-09-10T14:31:43.120964+0000","last_clean":"2024-09-10T14:31:43.120964+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:31:43.120964+0000","last_undegraded":"2024-09-10T14:31:43.120964+0000","last_fullsized":"2024-09-10T14:31:43.120964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:58.578905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093499+0000","last_change":"2024-09-10T14:28:36.924713+0000","last_active":"2024-09-10T14:29:09.093499+0000","last_peered":"2024-09-10T14:29:09.093499+0000","last_clean":"2024-09-10T14:29:09.093499+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:29:09.093499+0000","last_undegraded":"2024-09-10T14:29:09.093499+0000","last_fullsized":"2024-09-10T14:29:09.093499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:20.981089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768748+0000","last_change":"2024-09-10T14:28:38.943308+0000","last_active":"2024-09-10T14:29:08.768748+0000","last_peered":"2024-09-10T14:29:08.768748+0000","last_clean":"2024-09-10T14:29:08.768748+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:29:08.768748+0000","last_undegraded":"2024-09-10T14:29:08.768748+0000","last_fullsized":"2024-09-10T14:29:08.768748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:31.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227454+0000","last_change":"2024-09-10T14:28:30.863131+0000","last_active":"2024-09-10T14:31:44.227454+0000","last_peered":"2024-09-10T14:31:44.227454+0000","last_clean":"2024-09-10T14:31:44.227454+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:31:44.227454+0000","last_undegraded":"2024-09-10T14:31:44.227454+0000","last_fullsized":"2024-09-10T14:31:44.227454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:11.379786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769438+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:29:08.769438+0000","last_peered":"2024-09-10T14:29:08.769438+0000","last_clean":"2024-09-10T14:29:08.769438+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:29:08.769438+0000","last_undegraded":"2024-09-10T14:29:08.769438+0000","last_fullsized":"2024-09-10T14:29:08.769438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:08.712711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779372+0000","last_change":"2024-09-10T14:28:28.892687+0000","last_active":"2024-09-10T14:29:08.779372+0000","last_peered":"2024-09-10T14:29:08.779372+0000","last_clean":"2024-09-10T14:29:08.779372+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:29:08.779372+0000","last_undegraded":"2024-09-10T14:29:08.779372+0000","last_fullsized":"2024-09-10T14:29:08.779372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:29.232546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.102198+0000","last_change":"2024-09-10T14:28:32.885999+0000","last_active":"2024-09-10T14:29:09.102198+0000","last_peered":"2024-09-10T14:29:09.102198+0000","last_clean":"2024-09-10T14:29:09.102198+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:29:09.102198+0000","last_undegraded":"2024-09-10T14:29:09.102198+0000","last_fullsized":"2024-09-10T14:29:09.102198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.742700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.142906+0000","last_change":"2024-09-10T14:28:34.924692+0000","last_active":"2024-09-10T14:31:43.142906+0000","last_peered":"2024-09-10T14:31:43.142906+0000","last_clean":"2024-09-10T14:31:43.142906+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:31:43.142906+0000","last_undegraded":"2024-09-10T14:31:43.142906+0000","last_fullsized":"2024-09-10T14:31:43.142906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:53.353299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782310+0000","last_change":"2024-09-10T14:28:36.943077+0000","last_active":"2024-09-10T14:29:08.782310+0000","last_peered":"2024-09-10T14:29:08.782310+0000","last_clean":"2024-09-10T14:29:08.782310+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:29:08.782310+0000","last_undegraded":"2024-09-10T14:29:08.782310+0000","last_fullsized":"2024-09-10T14:29:08.782310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:11.353120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.729145+0000","last_change":"2024-09-10T14:28:38.927597+0000","last_active":"2024-09-10T14:30:42.729145+0000","last_peered":"2024-09-10T14:30:42.729145+0000","last_clean":"2024-09-10T14:30:42.729145+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:30:42.729145+0000","last_undegraded":"2024-09-10T14:30:42.729145+0000","last_fullsized":"2024-09-10T14:30:42.729145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:59.259272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777851+0000","last_change":"2024-09-10T14:28:30.886735+0000","last_active":"2024-09-10T14:29:08.777851+0000","last_peered":"2024-09-10T14:29:08.777851+0000","last_clean":"2024-09-10T14:29:08.777851+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:29:08.777851+0000","last_undegraded":"2024-09-10T14:29:08.777851+0000","last_fullsized":"2024-09-10T14:29:08.777851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:55.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:34.773656+0000","last_change":"2024-09-10T14:28:28.911271+0000","last_active":"2024-09-10T14:30:34.773656+0000","last_peered":"2024-09-10T14:30:34.773656+0000","last_clean":"2024-09-10T14:30:34.773656+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:30:34.773656+0000","last_undegraded":"2024-09-10T14:30:34.773656+0000","last_fullsized":"2024-09-10T14:30:34.773656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:46.166561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.100259+0000","last_change":"2024-09-10T14:28:21.327700+0000","last_active":"2024-09-10T14:29:09.100259+0000","last_peered":"2024-09-10T14:29:09.100259+0000","last_clean":"2024-09-10T14:29:09.100259+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:29:09.100259+0000","last_undegraded":"2024-09-10T14:29:09.100259+0000","last_fullsized":"2024-09-10T14:29:09.100259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:52.160130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:14.782591+0000","last_change":"2024-09-10T14:29:07.784812+0000","last_active":"2024-09-10T14:31:14.782591+0000","last_peered":"2024-09-10T14:31:14.782591+0000","last_clean":"2024-09-10T14:31:14.782591+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:31:14.782591+0000","last_undegraded":"2024-09-10T14:31:14.782591+0000","last_fullsized":"2024-09-10T14:31:14.782591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:59.688011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'61","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.143022+0000","last_change":"2024-09-10T14:28:34.893626+0000","last_active":"2024-09-10T14:30:41.143022+0000","last_peered":"2024-09-10T14:30:41.143022+0000","last_clean":"2024-09-10T14:30:41.143022+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:30:41.143022+0000","last_undegraded":"2024-09-10T14:30:41.143022+0000","last_fullsized":"2024-09-10T14:30:41.143022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:28.104547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772307+0000","last_change":"2024-09-10T14:28:36.918342+0000","last_active":"2024-09-10T14:29:08.772307+0000","last_peered":"2024-09-10T14:29:08.772307+0000","last_clean":"2024-09-10T14:29:08.772307+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:29:08.772307+0000","last_undegraded":"2024-09-10T14:29:08.772307+0000","last_fullsized":"2024-09-10T14:29:08.772307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:03.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.974036+0000","last_change":"2024-09-10T14:28:38.924566+0000","last_active":"2024-09-10T14:30:42.974036+0000","last_peered":"2024-09-10T14:30:42.974036+0000","last_clean":"2024-09-10T14:30:42.974036+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:30:42.974036+0000","last_undegraded":"2024-09-10T14:30:42.974036+0000","last_fullsized":"2024-09-10T14:30:42.974036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:23.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227882+0000","last_change":"2024-09-10T14:28:30.889728+0000","last_active":"2024-09-10T14:31:44.227882+0000","last_peered":"2024-09-10T14:31:44.227882+0000","last_clean":"2024-09-10T14:31:44.227882+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:31:44.227882+0000","last_undegraded":"2024-09-10T14:31:44.227882+0000","last_fullsized":"2024-09-10T14:31:44.227882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:49.183418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093061+0000","last_change":"2024-09-10T14:28:28.907627+0000","last_active":"2024-09-10T14:29:09.093061+0000","last_peered":"2024-09-10T14:29:09.093061+0000","last_clean":"2024-09-10T14:29:09.093061+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:29:09.093061+0000","last_undegraded":"2024-09-10T14:29:09.093061+0000","last_fullsized":"2024-09-10T14:29:09.093061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:11.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777696+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:29:08.777696+0000","last_peered":"2024-09-10T14:29:08.777696+0000","last_clean":"2024-09-10T14:29:08.777696+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:29:08.777696+0000","last_undegraded":"2024-09-10T14:29:08.777696+0000","last_fullsized":"2024-09-10T14:29:08.777696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:21.647103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768826+0000","last_change":"2024-09-10T14:28:32.882261+0000","last_active":"2024-09-10T14:29:08.768826+0000","last_peered":"2024-09-10T14:29:08.768826+0000","last_clean":"2024-09-10T14:29:08.768826+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:29:08.768826+0000","last_undegraded":"2024-09-10T14:29:08.768826+0000","last_fullsized":"2024-09-10T14:29:08.768826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:59.101746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.075406+0000","last_change":"2024-09-10T14:28:34.901236+0000","last_active":"2024-09-10T14:29:58.075406+0000","last_peered":"2024-09-10T14:29:58.075406+0000","last_clean":"2024-09-10T14:29:58.075406+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:29:58.075406+0000","last_undegraded":"2024-09-10T14:29:58.075406+0000","last_fullsized":"2024-09-10T14:29:58.075406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:02.704400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":377,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.238990+0000","last_change":"2024-09-10T14:28:36.904472+0000","last_active":"2024-09-10T14:31:44.238990+0000","last_peered":"2024-09-10T14:31:44.238990+0000","last_clean":"2024-09-10T14:31:44.238990+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:31:44.238990+0000","last_undegraded":"2024-09-10T14:31:44.238990+0000","last_fullsized":"2024-09-10T14:31:44.238990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:07.331691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.268320+0000","last_change":"2024-09-10T14:28:38.937953+0000","last_active":"2024-09-10T14:31:43.268320+0000","last_peered":"2024-09-10T14:31:43.268320+0000","last_clean":"2024-09-10T14:31:43.268320+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:31:43.268320+0000","last_undegraded":"2024-09-10T14:31:43.268320+0000","last_fullsized":"2024-09-10T14:31:43.268320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:24.662394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743534+0000","last_change":"2024-09-10T14:28:30.888495+0000","last_active":"2024-09-10T14:29:15.743534+0000","last_peered":"2024-09-10T14:29:15.743534+0000","last_clean":"2024-09-10T14:29:15.743534+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:29:15.743534+0000","last_undegraded":"2024-09-10T14:29:15.743534+0000","last_fullsized":"2024-09-10T14:29:15.743534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:49.862009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.684814+0000","last_change":"2024-09-10T14:28:28.891219+0000","last_active":"2024-09-10T14:31:43.684814+0000","last_peered":"2024-09-10T14:31:43.684814+0000","last_clean":"2024-09-10T14:31:43.684814+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:31:43.684814+0000","last_undegraded":"2024-09-10T14:31:43.684814+0000","last_fullsized":"2024-09-10T14:31:43.684814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:24.892549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.103352+0000","last_change":"2024-09-10T14:28:21.327784+0000","last_active":"2024-09-10T14:29:09.103352+0000","last_peered":"2024-09-10T14:29:09.103352+0000","last_clean":"2024-09-10T14:29:09.103352+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:29:09.103352+0000","last_undegraded":"2024-09-10T14:29:09.103352+0000","last_fullsized":"2024-09-10T14:29:09.103352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:00.563029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769359+0000","last_change":"2024-09-10T14:28:32.881624+0000","last_active":"2024-09-10T14:29:08.769359+0000","last_peered":"2024-09-10T14:29:08.769359+0000","last_clean":"2024-09-10T14:29:08.769359+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:29:08.769359+0000","last_undegraded":"2024-09-10T14:29:08.769359+0000","last_fullsized":"2024-09-10T14:29:08.769359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:40.120625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.771369+0000","last_change":"2024-09-10T14:28:34.914868+0000","last_active":"2024-09-10T14:29:08.771369+0000","last_peered":"2024-09-10T14:29:08.771369+0000","last_clean":"2024-09-10T14:29:08.771369+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:29:08.771369+0000","last_undegraded":"2024-09-10T14:29:08.771369+0000","last_fullsized":"2024-09-10T14:29:08.771369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:28.103142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":392,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.383887+0000","last_change":"2024-09-10T14:28:36.902307+0000","last_active":"2024-09-10T14:31:44.383887+0000","last_peered":"2024-09-10T14:31:44.383887+0000","last_clean":"2024-09-10T14:31:44.383887+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:31:44.383887+0000","last_undegraded":"2024-09-10T14:31:44.383887+0000","last_fullsized":"2024-09-10T14:31:44.383887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:28.542198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781543+0000","last_change":"2024-09-10T14:28:38.934660+0000","last_active":"2024-09-10T14:29:08.781543+0000","last_peered":"2024-09-10T14:29:08.781543+0000","last_clean":"2024-09-10T14:29:08.781543+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:29:08.781543+0000","last_undegraded":"2024-09-10T14:29:08.781543+0000","last_fullsized":"2024-09-10T14:29:08.781543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:08.718072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227593+0000","last_change":"2024-09-10T14:28:30.872139+0000","last_active":"2024-09-10T14:31:44.227593+0000","last_peered":"2024-09-10T14:31:44.227593+0000","last_clean":"2024-09-10T14:31:44.227593+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:31:44.227593+0000","last_undegraded":"2024-09-10T14:31:44.227593+0000","last_fullsized":"2024-09-10T14:31:44.227593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:13.634815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.023364+0000","last_change":"2024-09-10T14:28:28.904513+0000","last_active":"2024-09-10T14:31:44.023364+0000","last_peered":"2024-09-10T14:31:44.023364+0000","last_clean":"2024-09-10T14:31:44.023364+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:31:44.023364+0000","last_undegraded":"2024-09-10T14:31:44.023364+0000","last_fullsized":"2024-09-10T14:31:44.023364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:05.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782794+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:29:08.782794+0000","last_peered":"2024-09-10T14:29:08.782794+0000","last_clean":"2024-09-10T14:29:08.782794+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:29:08.782794+0000","last_undegraded":"2024-09-10T14:29:08.782794+0000","last_fullsized":"2024-09-10T14:29:08.782794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:58.045195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.767895+0000","last_change":"2024-09-10T14:28:32.878971+0000","last_active":"2024-09-10T14:29:08.767895+0000","last_peered":"2024-09-10T14:29:08.767895+0000","last_clean":"2024-09-10T14:29:08.767895+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:29:08.767895+0000","last_undegraded":"2024-09-10T14:29:08.767895+0000","last_fullsized":"2024-09-10T14:29:08.767895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:24.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'83","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.111766+0000","last_change":"2024-09-10T14:28:34.903982+0000","last_active":"2024-09-10T14:30:41.111766+0000","last_peered":"2024-09-10T14:30:41.111766+0000","last_clean":"2024-09-10T14:30:41.111766+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:30:41.111766+0000","last_undegraded":"2024-09-10T14:30:41.111766+0000","last_fullsized":"2024-09-10T14:30:41.111766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:45.622257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095336+0000","last_change":"2024-09-10T14:28:36.903264+0000","last_active":"2024-09-10T14:29:09.095336+0000","last_peered":"2024-09-10T14:29:09.095336+0000","last_clean":"2024-09-10T14:29:09.095336+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:29:09.095336+0000","last_undegraded":"2024-09-10T14:29:09.095336+0000","last_fullsized":"2024-09-10T14:29:09.095336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:26.562499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786817+0000","last_change":"2024-09-10T14:28:38.930196+0000","last_active":"2024-09-10T14:29:08.786817+0000","last_peered":"2024-09-10T14:29:08.786817+0000","last_clean":"2024-09-10T14:29:08.786817+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:29:08.786817+0000","last_undegraded":"2024-09-10T14:29:08.786817+0000","last_fullsized":"2024-09-10T14:29:08.786817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:55.481810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.069321+0000","last_change":"2024-09-10T14:28:38.944786+0000","last_active":"2024-09-10T14:29:58.069321+0000","last_peered":"2024-09-10T14:29:58.069321+0000","last_clean":"2024-09-10T14:29:58.069321+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:29:58.069321+0000","last_undegraded":"2024-09-10T14:29:58.069321+0000","last_fullsized":"2024-09-10T14:29:58.069321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:23.466063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071514+0000","last_change":"2024-09-10T14:28:30.877107+0000","last_active":"2024-09-10T14:31:44.071514+0000","last_peered":"2024-09-10T14:31:44.071514+0000","last_clean":"2024-09-10T14:31:44.071514+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:31:44.071514+0000","last_undegraded":"2024-09-10T14:31:44.071514+0000","last_fullsized":"2024-09-10T14:31:44.071514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:01.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.032703+0000","last_change":"2024-09-10T14:28:28.890437+0000","last_active":"2024-09-10T14:31:44.032703+0000","last_peered":"2024-09-10T14:31:44.032703+0000","last_clean":"2024-09-10T14:31:44.032703+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:31:44.032703+0000","last_undegraded":"2024-09-10T14:31:44.032703+0000","last_fullsized":"2024-09-10T14:31:44.032703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.203261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777010+0000","last_change":"2024-09-10T14:28:32.883682+0000","last_active":"2024-09-10T14:29:08.777010+0000","last_peered":"2024-09-10T14:29:08.777010+0000","last_clean":"2024-09-10T14:29:08.777010+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:29:08.777010+0000","last_undegraded":"2024-09-10T14:29:08.777010+0000","last_fullsized":"2024-09-10T14:29:08.777010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:49.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786759+0000","last_change":"2024-09-10T14:28:34.909586+0000","last_active":"2024-09-10T14:30:58.786759+0000","last_peered":"2024-09-10T14:30:58.786759+0000","last_clean":"2024-09-10T14:30:58.786759+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:30:58.786759+0000","last_undegraded":"2024-09-10T14:30:58.786759+0000","last_fullsized":"2024-09-10T14:30:58.786759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:41.169418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772384+0000","last_change":"2024-09-10T14:28:36.937985+0000","last_active":"2024-09-10T14:29:08.772384+0000","last_peered":"2024-09-10T14:29:08.772384+0000","last_clean":"2024-09-10T14:29:08.772384+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:29:08.772384+0000","last_undegraded":"2024-09-10T14:29:08.772384+0000","last_fullsized":"2024-09-10T14:29:08.772384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:38.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:40.727074+0000","last_change":"2024-09-10T14:28:38.919940+0000","last_active":"2024-09-10T14:30:40.727074+0000","last_peered":"2024-09-10T14:30:40.727074+0000","last_clean":"2024-09-10T14:30:40.727074+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:30:40.727074+0000","last_undegraded":"2024-09-10T14:30:40.727074+0000","last_fullsized":"2024-09-10T14:30:40.727074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:50.182914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227269+0000","last_change":"2024-09-10T14:29:07.783673+0000","last_active":"2024-09-10T14:31:44.227269+0000","last_peered":"2024-09-10T14:31:44.227269+0000","last_clean":"2024-09-10T14:31:44.227269+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:31:44.227269+0000","last_undegraded":"2024-09-10T14:31:44.227269+0000","last_fullsized":"2024-09-10T14:31:44.227269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:50.089510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.784173+0000","last_change":"2024-09-10T14:28:28.897051+0000","last_active":"2024-09-10T14:29:08.784173+0000","last_peered":"2024-09-10T14:29:08.784173+0000","last_clean":"2024-09-10T14:29:08.784173+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:29:08.784173+0000","last_undegraded":"2024-09-10T14:29:08.784173+0000","last_fullsized":"2024-09-10T14:29:08.784173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:35.896977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769214+0000","last_change":"2024-09-10T14:28:32.889469+0000","last_active":"2024-09-10T14:29:08.769214+0000","last_peered":"2024-09-10T14:29:08.769214+0000","last_clean":"2024-09-10T14:29:08.769214+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:29:08.769214+0000","last_undegraded":"2024-09-10T14:29:08.769214+0000","last_fullsized":"2024-09-10T14:29:08.769214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:16.954547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.151756+0000","last_change":"2024-09-10T14:28:34.883314+0000","last_active":"2024-09-10T14:31:43.151756+0000","last_peered":"2024-09-10T14:31:43.151756+0000","last_clean":"2024-09-10T14:31:43.151756+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:31:43.151756+0000","last_undegraded":"2024-09-10T14:31:43.151756+0000","last_fullsized":"2024-09-10T14:31:43.151756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:55.702602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774240+0000","last_change":"2024-09-10T14:28:36.942744+0000","last_active":"2024-09-10T14:29:08.774240+0000","last_peered":"2024-09-10T14:29:08.774240+0000","last_clean":"2024-09-10T14:29:08.774240+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:29:08.774240+0000","last_undegraded":"2024-09-10T14:29:08.774240+0000","last_fullsized":"2024-09-10T14:29:08.774240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:27.947825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.100255+0000","last_change":"2024-09-10T14:28:38.936365+0000","last_active":"2024-09-10T14:29:09.100255+0000","last_peered":"2024-09-10T14:29:09.100255+0000","last_clean":"2024-09-10T14:29:09.100255+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:29:09.100255+0000","last_undegraded":"2024-09-10T14:29:09.100255+0000","last_fullsized":"2024-09-10T14:29:09.100255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:06.472831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.730616+0000","last_change":"2024-09-10T14:28:30.876200+0000","last_active":"2024-09-10T14:29:14.730616+0000","last_peered":"2024-09-10T14:29:14.730616+0000","last_clean":"2024-09-10T14:29:14.730616+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:29:14.730616+0000","last_undegraded":"2024-09-10T14:29:14.730616+0000","last_fullsized":"2024-09-10T14:29:14.730616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.106885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.232528+0000","last_change":"2024-09-10T14:28:28.895847+0000","last_active":"2024-09-10T14:29:14.232528+0000","last_peered":"2024-09-10T14:29:14.232528+0000","last_clean":"2024-09-10T14:29:14.232528+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:29:14.232528+0000","last_undegraded":"2024-09-10T14:29:14.232528+0000","last_fullsized":"2024-09-10T14:29:14.232528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:09.693064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774392+0000","last_change":"2024-09-10T14:28:32.872799+0000","last_active":"2024-09-10T14:29:08.774392+0000","last_peered":"2024-09-10T14:29:08.774392+0000","last_clean":"2024-09-10T14:29:08.774392+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:29:08.774392+0000","last_undegraded":"2024-09-10T14:29:08.774392+0000","last_fullsized":"2024-09-10T14:29:08.774392+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:03.562600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'40","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.238443+0000","last_change":"2024-09-10T14:28:34.883528+0000","last_active":"2024-09-10T14:31:43.238443+0000","last_peered":"2024-09-10T14:31:43.238443+0000","last_clean":"2024-09-10T14:31:43.238443+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:31:43.238443+0000","last_undegraded":"2024-09-10T14:31:43.238443+0000","last_fullsized":"2024-09-10T14:31:43.238443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:37.113514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776303+0000","last_change":"2024-09-10T14:28:36.903239+0000","last_active":"2024-09-10T14:29:08.776303+0000","last_peered":"2024-09-10T14:29:08.776303+0000","last_clean":"2024-09-10T14:29:08.776303+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:29:08.776303+0000","last_undegraded":"2024-09-10T14:29:08.776303+0000","last_fullsized":"2024-09-10T14:29:08.776303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:10.158060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769658+0000","last_change":"2024-09-10T14:28:38.937605+0000","last_active":"2024-09-10T14:29:08.769658+0000","last_peered":"2024-09-10T14:29:08.769658+0000","last_clean":"2024-09-10T14:29:08.769658+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:29:08.769658+0000","last_undegraded":"2024-09-10T14:29:08.769658+0000","last_fullsized":"2024-09-10T14:29:08.769658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:51.383935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743397+0000","last_change":"2024-09-10T14:29:07.787878+0000","last_active":"2024-09-10T14:29:15.743397+0000","last_peered":"2024-09-10T14:29:15.743397+0000","last_clean":"2024-09-10T14:29:15.743397+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:29:15.743397+0000","last_undegraded":"2024-09-10T14:29:15.743397+0000","last_fullsized":"2024-09-10T14:29:15.743397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:39.937327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.827599+0000","last_change":"2024-09-10T14:28:28.902985+0000","last_active":"2024-09-10T14:30:42.827599+0000","last_peered":"2024-09-10T14:30:42.827599+0000","last_clean":"2024-09-10T14:30:42.827599+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:30:42.827599+0000","last_undegraded":"2024-09-10T14:30:42.827599+0000","last_fullsized":"2024-09-10T14:30:42.827599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:52.358354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769090+0000","last_change":"2024-09-10T14:28:32.882402+0000","last_active":"2024-09-10T14:29:08.769090+0000","last_peered":"2024-09-10T14:29:08.769090+0000","last_clean":"2024-09-10T14:29:08.769090+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:29:08.769090+0000","last_undegraded":"2024-09-10T14:29:08.769090+0000","last_fullsized":"2024-09-10T14:29:08.769090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:40.138989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'32","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.777771+0000","last_change":"2024-09-10T14:28:34.898884+0000","last_active":"2024-09-10T14:30:54.777771+0000","last_peered":"2024-09-10T14:30:54.777771+0000","last_clean":"2024-09-10T14:30:54.777771+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:30:54.777771+0000","last_undegraded":"2024-09-10T14:30:54.777771+0000","last_fullsized":"2024-09-10T14:30:54.777771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:00.691071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778374+0000","last_change":"2024-09-10T14:28:36.914261+0000","last_active":"2024-09-10T14:29:08.778374+0000","last_peered":"2024-09-10T14:29:08.778374+0000","last_clean":"2024-09-10T14:29:08.778374+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:29:08.778374+0000","last_undegraded":"2024-09-10T14:29:08.778374+0000","last_fullsized":"2024-09-10T14:29:08.778374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:53.185791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.731755+0000","last_change":"2024-09-10T14:28:30.877889+0000","last_active":"2024-09-10T14:29:14.731755+0000","last_peered":"2024-09-10T14:29:14.731755+0000","last_clean":"2024-09-10T14:29:14.731755+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:29:14.731755+0000","last_undegraded":"2024-09-10T14:29:14.731755+0000","last_fullsized":"2024-09-10T14:29:14.731755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:50.100814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768203+0000","last_change":"2024-09-10T14:28:28.893360+0000","last_active":"2024-09-10T14:29:08.768203+0000","last_peered":"2024-09-10T14:29:08.768203+0000","last_clean":"2024-09-10T14:29:08.768203+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:29:08.768203+0000","last_undegraded":"2024-09-10T14:29:08.768203+0000","last_fullsized":"2024-09-10T14:29:08.768203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:07.284771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.756273+0000","last_change":"2024-09-10T14:29:08.790434+0000","last_active":"2024-09-10T14:29:09.756273+0000","last_peered":"2024-09-10T14:29:09.756273+0000","last_clean":"2024-09-10T14:29:09.756273+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:29:09.756273+0000","last_undegraded":"2024-09-10T14:29:09.756273+0000","last_fullsized":"2024-09-10T14:29:09.756273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:57.151248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.138592+0000","last_change":"2024-09-10T14:28:34.883522+0000","last_active":"2024-09-10T14:30:41.138592+0000","last_peered":"2024-09-10T14:30:41.138592+0000","last_clean":"2024-09-10T14:30:41.138592+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:30:41.138592+0000","last_undegraded":"2024-09-10T14:30:41.138592+0000","last_fullsized":"2024-09-10T14:30:41.138592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:16.061284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778501+0000","last_change":"2024-09-10T14:28:36.910017+0000","last_active":"2024-09-10T14:29:08.778501+0000","last_peered":"2024-09-10T14:29:08.778501+0000","last_clean":"2024-09-10T14:29:08.778501+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:29:08.778501+0000","last_undegraded":"2024-09-10T14:29:08.778501+0000","last_fullsized":"2024-09-10T14:29:08.778501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:51.066667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.964268+0000","last_change":"2024-09-10T14:28:38.928679+0000","last_active":"2024-09-10T14:30:42.964268+0000","last_peered":"2024-09-10T14:30:42.964268+0000","last_clean":"2024-09-10T14:30:42.964268+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:30:42.964268+0000","last_undegraded":"2024-09-10T14:30:42.964268+0000","last_fullsized":"2024-09-10T14:30:42.964268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:20.861557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.873676+0000","last_change":"2024-09-10T14:28:30.881385+0000","last_active":"2024-09-10T14:31:43.873676+0000","last_peered":"2024-09-10T14:31:43.873676+0000","last_clean":"2024-09-10T14:31:43.873676+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:31:43.873676+0000","last_undegraded":"2024-09-10T14:31:43.873676+0000","last_fullsized":"2024-09-10T14:31:43.873676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.775827+0000","last_change":"2024-09-10T14:28:28.906793+0000","last_active":"2024-09-10T14:29:08.775827+0000","last_peered":"2024-09-10T14:29:08.775827+0000","last_clean":"2024-09-10T14:29:08.775827+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:29:08.775827+0000","last_undegraded":"2024-09-10T14:29:08.775827+0000","last_fullsized":"2024-09-10T14:29:08.775827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:45.691675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786646+0000","last_change":"2024-09-10T14:28:32.880162+0000","last_active":"2024-09-10T14:29:08.786646+0000","last_peered":"2024-09-10T14:29:08.786646+0000","last_clean":"2024-09-10T14:29:08.786646+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:29:08.786646+0000","last_undegraded":"2024-09-10T14:29:08.786646+0000","last_fullsized":"2024-09-10T14:29:08.786646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:19.866288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.110766+0000","last_change":"2024-09-10T14:28:34.922844+0000","last_active":"2024-09-10T14:30:41.110766+0000","last_peered":"2024-09-10T14:30:41.110766+0000","last_clean":"2024-09-10T14:30:41.110766+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:30:41.110766+0000","last_undegraded":"2024-09-10T14:30:41.110766+0000","last_fullsized":"2024-09-10T14:30:41.110766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:55.366020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782945+0000","last_change":"2024-09-10T14:28:36.940467+0000","last_active":"2024-09-10T14:29:08.782945+0000","last_peered":"2024-09-10T14:29:08.782945+0000","last_clean":"2024-09-10T14:29:08.782945+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:29:08.782945+0000","last_undegraded":"2024-09-10T14:29:08.782945+0000","last_fullsized":"2024-09-10T14:29:08.782945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:26.562499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.113319+0000","last_change":"2024-09-10T14:28:38.943738+0000","last_active":"2024-09-10T14:30:43.113319+0000","last_peered":"2024-09-10T14:30:43.113319+0000","last_clean":"2024-09-10T14:30:43.113319+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:30:43.113319+0000","last_undegraded":"2024-09-10T14:30:43.113319+0000","last_fullsized":"2024-09-10T14:30:43.113319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:23.582530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.176038+0000","last_change":"2024-09-10T14:28:30.890718+0000","last_active":"2024-09-10T14:31:44.176038+0000","last_peered":"2024-09-10T14:31:44.176038+0000","last_clean":"2024-09-10T14:31:44.176038+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:31:44.176038+0000","last_undegraded":"2024-09-10T14:31:44.176038+0000","last_fullsized":"2024-09-10T14:31:44.176038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:12.035474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777261+0000","last_change":"2024-09-10T14:28:28.904304+0000","last_active":"2024-09-10T14:29:08.777261+0000","last_peered":"2024-09-10T14:29:08.777261+0000","last_clean":"2024-09-10T14:29:08.777261+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:29:08.777261+0000","last_undegraded":"2024-09-10T14:29:08.777261+0000","last_fullsized":"2024-09-10T14:29:08.777261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:05.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.784823+0000","last_change":"2024-09-10T14:28:32.881286+0000","last_active":"2024-09-10T14:29:08.784823+0000","last_peered":"2024-09-10T14:29:08.784823+0000","last_clean":"2024-09-10T14:29:08.784823+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:29:08.784823+0000","last_undegraded":"2024-09-10T14:29:08.784823+0000","last_fullsized":"2024-09-10T14:29:08.784823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.999469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'32","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.135619+0000","last_change":"2024-09-10T14:28:34.894052+0000","last_active":"2024-09-10T14:30:41.135619+0000","last_peered":"2024-09-10T14:30:41.135619+0000","last_clean":"2024-09-10T14:30:41.135619+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:30:41.135619+0000","last_undegraded":"2024-09-10T14:30:41.135619+0000","last_fullsized":"2024-09-10T14:30:41.135619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:42.457623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096104+0000","last_change":"2024-09-10T14:28:36.914374+0000","last_active":"2024-09-10T14:29:09.096104+0000","last_peered":"2024-09-10T14:29:09.096104+0000","last_clean":"2024-09-10T14:29:09.096104+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:29:09.096104+0000","last_undegraded":"2024-09-10T14:29:09.096104+0000","last_fullsized":"2024-09-10T14:29:09.096104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:27.581565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.878132+0000","last_change":"2024-09-10T14:28:38.940779+0000","last_active":"2024-09-10T14:31:43.878132+0000","last_peered":"2024-09-10T14:31:43.878132+0000","last_clean":"2024-09-10T14:31:43.878132+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:31:43.878132+0000","last_undegraded":"2024-09-10T14:31:43.878132+0000","last_fullsized":"2024-09-10T14:31:43.878132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:01.962705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072247+0000","last_change":"2024-09-10T14:28:30.863566+0000","last_active":"2024-09-10T14:31:44.072247+0000","last_peered":"2024-09-10T14:31:44.072247+0000","last_clean":"2024-09-10T14:31:44.072247+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:31:44.072247+0000","last_undegraded":"2024-09-10T14:31:44.072247+0000","last_fullsized":"2024-09-10T14:31:44.072247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:33.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.004264+0000","last_change":"2024-09-10T14:28:28.890479+0000","last_active":"2024-09-10T14:29:15.004264+0000","last_peered":"2024-09-10T14:29:15.004264+0000","last_clean":"2024-09-10T14:29:15.004264+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:29:15.004264+0000","last_undegraded":"2024-09-10T14:29:15.004264+0000","last_fullsized":"2024-09-10T14:29:15.004264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:41.460622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.793988+0000","last_change":"2024-09-10T14:29:08.793243+0000","last_active":"2024-09-10T14:29:08.793988+0000","last_peered":"2024-09-10T14:29:08.793988+0000","last_clean":"2024-09-10T14:29:08.793988+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:29:08.793988+0000","last_undegraded":"2024-09-10T14:29:08.793988+0000","last_fullsized":"2024-09-10T14:29:08.793988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.893530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781141+0000","last_change":"2024-09-10T14:28:34.927446+0000","last_active":"2024-09-10T14:29:08.781141+0000","last_peered":"2024-09-10T14:29:08.781141+0000","last_clean":"2024-09-10T14:29:08.781141+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:29:08.781141+0000","last_undegraded":"2024-09-10T14:29:08.781141+0000","last_fullsized":"2024-09-10T14:29:08.781141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:11.151127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":409,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120415+0000","last_change":"2024-09-10T14:28:36.941280+0000","last_active":"2024-09-10T14:31:43.120415+0000","last_peered":"2024-09-10T14:31:43.120415+0000","last_clean":"2024-09-10T14:31:43.120415+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:31:43.120415+0000","last_undegraded":"2024-09-10T14:31:43.120415+0000","last_fullsized":"2024-09-10T14:31:43.120415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:56.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.767087+0000","last_change":"2024-09-10T14:28:38.938263+0000","last_active":"2024-09-10T14:29:08.767087+0000","last_peered":"2024-09-10T14:29:08.767087+0000","last_clean":"2024-09-10T14:29:08.767087+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:29:08.767087+0000","last_undegraded":"2024-09-10T14:29:08.767087+0000","last_fullsized":"2024-09-10T14:29:08.767087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:24.663593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227129+0000","last_change":"2024-09-10T14:28:30.861357+0000","last_active":"2024-09-10T14:31:44.227129+0000","last_peered":"2024-09-10T14:31:44.227129+0000","last_clean":"2024-09-10T14:31:44.227129+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:31:44.227129+0000","last_undegraded":"2024-09-10T14:31:44.227129+0000","last_fullsized":"2024-09-10T14:31:44.227129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:51.916826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782831+0000","last_change":"2024-09-10T14:28:28.885941+0000","last_active":"2024-09-10T14:29:08.782831+0000","last_peered":"2024-09-10T14:29:08.782831+0000","last_clean":"2024-09-10T14:29:08.782831+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:29:08.782831+0000","last_undegraded":"2024-09-10T14:29:08.782831+0000","last_fullsized":"2024-09-10T14:29:08.782831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:23.440776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776786+0000","last_change":"2024-09-10T14:28:32.883472+0000","last_active":"2024-09-10T14:29:08.776786+0000","last_peered":"2024-09-10T14:29:08.776786+0000","last_clean":"2024-09-10T14:29:08.776786+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:29:08.776786+0000","last_undegraded":"2024-09-10T14:29:08.776786+0000","last_fullsized":"2024-09-10T14:29:08.776786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:16.905282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.097227+0000","last_change":"2024-09-10T14:28:34.894279+0000","last_active":"2024-09-10T14:30:41.097227+0000","last_peered":"2024-09-10T14:30:41.097227+0000","last_clean":"2024-09-10T14:30:41.097227+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:30:41.097227+0000","last_undegraded":"2024-09-10T14:30:41.097227+0000","last_fullsized":"2024-09-10T14:30:41.097227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:42.457623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.092515+0000","last_change":"2024-09-10T14:28:36.924051+0000","last_active":"2024-09-10T14:29:09.092515+0000","last_peered":"2024-09-10T14:29:09.092515+0000","last_clean":"2024-09-10T14:29:09.092515+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:29:09.092515+0000","last_undegraded":"2024-09-10T14:29:09.092515+0000","last_fullsized":"2024-09-10T14:29:09.092515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:10.158060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.180558+0000","last_change":"2024-09-10T14:28:38.931948+0000","last_active":"2024-09-10T14:31:44.180558+0000","last_peered":"2024-09-10T14:31:44.180558+0000","last_clean":"2024-09-10T14:31:44.180558+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:31:44.180558+0000","last_undegraded":"2024-09-10T14:31:44.180558+0000","last_fullsized":"2024-09-10T14:31:44.180558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.156721+0000","last_change":"2024-09-10T14:28:30.857116+0000","last_active":"2024-09-10T14:31:44.156721+0000","last_peered":"2024-09-10T14:31:44.156721+0000","last_clean":"2024-09-10T14:31:44.156721+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:31:44.156721+0000","last_undegraded":"2024-09-10T14:31:44.156721+0000","last_fullsized":"2024-09-10T14:31:44.156721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:21.150726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787090+0000","last_change":"2024-09-10T14:28:28.889060+0000","last_active":"2024-09-10T14:30:58.787090+0000","last_peered":"2024-09-10T14:30:58.787090+0000","last_clean":"2024-09-10T14:30:58.787090+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:30:58.787090+0000","last_undegraded":"2024-09-10T14:30:58.787090+0000","last_fullsized":"2024-09-10T14:30:58.787090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:04.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":15,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781204+0000","last_change":"2024-09-10T14:28:32.886513+0000","last_active":"2024-09-10T14:29:08.781204+0000","last_peered":"2024-09-10T14:29:08.781204+0000","last_clean":"2024-09-10T14:29:08.781204+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:29:08.781204+0000","last_undegraded":"2024-09-10T14:29:08.781204+0000","last_fullsized":"2024-09-10T14:29:08.781204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:36.827270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.099907+0000","last_change":"2024-09-10T14:28:34.895458+0000","last_active":"2024-09-10T14:30:41.099907+0000","last_peered":"2024-09-10T14:30:41.099907+0000","last_clean":"2024-09-10T14:30:41.099907+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:30:41.099907+0000","last_undegraded":"2024-09-10T14:30:41.099907+0000","last_fullsized":"2024-09-10T14:30:41.099907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.304872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768221+0000","last_change":"2024-09-10T14:28:36.939560+0000","last_active":"2024-09-10T14:29:08.768221+0000","last_peered":"2024-09-10T14:29:08.768221+0000","last_clean":"2024-09-10T14:29:08.768221+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:29:08.768221+0000","last_undegraded":"2024-09-10T14:29:08.768221+0000","last_fullsized":"2024-09-10T14:29:08.768221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:17.208670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781377+0000","last_change":"2024-09-10T14:28:38.950672+0000","last_active":"2024-09-10T14:29:08.781377+0000","last_peered":"2024-09-10T14:29:08.781377+0000","last_clean":"2024-09-10T14:29:08.781377+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:29:08.781377+0000","last_undegraded":"2024-09-10T14:29:08.781377+0000","last_fullsized":"2024-09-10T14:29:08.781377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:51.478025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072298+0000","last_change":"2024-09-10T14:28:30.877715+0000","last_active":"2024-09-10T14:31:44.072298+0000","last_peered":"2024-09-10T14:31:44.072298+0000","last_clean":"2024-09-10T14:31:44.072298+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:31:44.072298+0000","last_undegraded":"2024-09-10T14:31:44.072298+0000","last_fullsized":"2024-09-10T14:31:44.072298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:47.874293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093159+0000","last_change":"2024-09-10T14:28:28.876685+0000","last_active":"2024-09-10T14:29:09.093159+0000","last_peered":"2024-09-10T14:29:09.093159+0000","last_clean":"2024-09-10T14:29:09.093159+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:29:09.093159+0000","last_undegraded":"2024-09-10T14:29:09.093159+0000","last_fullsized":"2024-09-10T14:29:09.093159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.417731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774563+0000","last_change":"2024-09-10T14:28:32.884054+0000","last_active":"2024-09-10T14:29:08.774563+0000","last_peered":"2024-09-10T14:29:08.774563+0000","last_clean":"2024-09-10T14:29:08.774563+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:29:08.774563+0000","last_undegraded":"2024-09-10T14:29:08.774563+0000","last_fullsized":"2024-09-10T14:29:08.774563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.742700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.131887+0000","last_change":"2024-09-10T14:28:34.914074+0000","last_active":"2024-09-10T14:30:41.131887+0000","last_peered":"2024-09-10T14:30:41.131887+0000","last_clean":"2024-09-10T14:30:41.131887+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:30:41.131887+0000","last_undegraded":"2024-09-10T14:30:41.131887+0000","last_fullsized":"2024-09-10T14:30:41.131887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:12.635701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769265+0000","last_change":"2024-09-10T14:28:36.945615+0000","last_active":"2024-09-10T14:29:08.769265+0000","last_peered":"2024-09-10T14:29:08.769265+0000","last_clean":"2024-09-10T14:29:08.769265+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:29:08.769265+0000","last_undegraded":"2024-09-10T14:29:08.769265+0000","last_fullsized":"2024-09-10T14:29:08.769265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:28.372594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.329350+0000","last_change":"2024-09-10T14:28:38.949225+0000","last_active":"2024-09-10T14:31:44.329350+0000","last_peered":"2024-09-10T14:31:44.329350+0000","last_clean":"2024-09-10T14:31:44.329350+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:31:44.329350+0000","last_undegraded":"2024-09-10T14:31:44.329350+0000","last_fullsized":"2024-09-10T14:31:44.329350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:30.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227695+0000","last_change":"2024-09-10T14:28:30.857745+0000","last_active":"2024-09-10T14:31:44.227695+0000","last_peered":"2024-09-10T14:31:44.227695+0000","last_clean":"2024-09-10T14:31:44.227695+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:31:44.227695+0000","last_undegraded":"2024-09-10T14:31:44.227695+0000","last_fullsized":"2024-09-10T14:31:44.227695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:20.516570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.049736+0000","last_change":"2024-09-10T14:28:28.904511+0000","last_active":"2024-09-10T14:31:44.049736+0000","last_peered":"2024-09-10T14:31:44.049736+0000","last_clean":"2024-09-10T14:31:44.049736+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:31:44.049736+0000","last_undegraded":"2024-09-10T14:31:44.049736+0000","last_fullsized":"2024-09-10T14:31:44.049736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:55.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.533136+0000","last_change":"2024-09-10T14:28:32.889332+0000","last_active":"2024-09-10T14:30:39.533136+0000","last_peered":"2024-09-10T14:30:39.533136+0000","last_clean":"2024-09-10T14:30:39.533136+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:30:39.533136+0000","last_undegraded":"2024-09-10T14:30:39.533136+0000","last_fullsized":"2024-09-10T14:30:39.533136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:50.606255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.153147+0000","last_change":"2024-09-10T14:28:34.914339+0000","last_active":"2024-09-10T14:31:43.153147+0000","last_peered":"2024-09-10T14:31:43.153147+0000","last_clean":"2024-09-10T14:31:43.153147+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:31:43.153147+0000","last_undegraded":"2024-09-10T14:31:43.153147+0000","last_fullsized":"2024-09-10T14:31:43.153147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:00.676530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.098628+0000","last_change":"2024-09-10T14:28:36.924970+0000","last_active":"2024-09-10T14:29:09.098628+0000","last_peered":"2024-09-10T14:29:09.098628+0000","last_clean":"2024-09-10T14:29:09.098628+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:29:09.098628+0000","last_undegraded":"2024-09-10T14:29:09.098628+0000","last_fullsized":"2024-09-10T14:29:09.098628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.099079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.152719+0000","last_change":"2024-09-10T14:28:38.949254+0000","last_active":"2024-09-10T14:30:41.152719+0000","last_peered":"2024-09-10T14:30:41.152719+0000","last_clean":"2024-09-10T14:30:41.152719+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:30:41.152719+0000","last_undegraded":"2024-09-10T14:30:41.152719+0000","last_fullsized":"2024-09-10T14:30:41.152719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:37.882075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071743+0000","last_change":"2024-09-10T14:28:30.890252+0000","last_active":"2024-09-10T14:31:44.071743+0000","last_peered":"2024-09-10T14:31:44.071743+0000","last_clean":"2024-09-10T14:31:44.071743+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:31:44.071743+0000","last_undegraded":"2024-09-10T14:31:44.071743+0000","last_fullsized":"2024-09-10T14:31:44.071743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:36.092002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.023557+0000","last_change":"2024-09-10T14:28:28.876974+0000","last_active":"2024-09-10T14:30:39.023557+0000","last_peered":"2024-09-10T14:30:39.023557+0000","last_clean":"2024-09-10T14:30:39.023557+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:30:39.023557+0000","last_undegraded":"2024-09-10T14:30:39.023557+0000","last_fullsized":"2024-09-10T14:30:39.023557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:56.895016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.105167+0000","last_change":"2024-09-10T14:28:30.861035+0000","last_active":"2024-09-10T14:29:09.105167+0000","last_peered":"2024-09-10T14:29:09.105167+0000","last_clean":"2024-09-10T14:29:09.105167+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:29:09.105167+0000","last_undegraded":"2024-09-10T14:29:09.105167+0000","last_fullsized":"2024-09-10T14:29:09.105167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:11.237117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.995691+0000","last_change":"2024-09-10T14:28:28.880673+0000","last_active":"2024-09-10T14:30:42.995691+0000","last_peered":"2024-09-10T14:30:42.995691+0000","last_clean":"2024-09-10T14:30:42.995691+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:30:42.995691+0000","last_undegraded":"2024-09-10T14:30:42.995691+0000","last_fullsized":"2024-09-10T14:30:42.995691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:05.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'9","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.242990+0000","last_change":"2024-09-10T14:28:30.876383+0000","last_active":"2024-09-10T14:31:44.242990+0000","last_peered":"2024-09-10T14:31:44.242990+0000","last_clean":"2024-09-10T14:31:44.242990+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:31:44.242990+0000","last_undegraded":"2024-09-10T14:31:44.242990+0000","last_fullsized":"2024-09-10T14:31:44.242990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:27.003138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.358756+0000","last_change":"2024-09-10T14:28:28.892938+0000","last_active":"2024-09-10T14:29:58.358756+0000","last_peered":"2024-09-10T14:29:58.358756+0000","last_clean":"2024-09-10T14:29:58.358756+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:29:58.358756+0000","last_undegraded":"2024-09-10T14:29:58.358756+0000","last_fullsized":"2024-09-10T14:29:58.358756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:31.835408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.073511+0000","last_change":"2024-09-10T14:28:30.863758+0000","last_active":"2024-09-10T14:29:58.073511+0000","last_peered":"2024-09-10T14:29:58.073511+0000","last_clean":"2024-09-10T14:29:58.073511+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:29:58.073511+0000","last_undegraded":"2024-09-10T14:29:58.073511+0000","last_fullsized":"2024-09-10T14:29:58.073511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:55.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.494361+0000","last_change":"2024-09-10T14:28:28.880499+0000","last_active":"2024-09-10T14:29:13.494361+0000","last_peered":"2024-09-10T14:29:13.494361+0000","last_clean":"2024-09-10T14:29:13.494361+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:29:13.494361+0000","last_undegraded":"2024-09-10T14:29:13.494361+0000","last_fullsized":"2024-09-10T14:29:13.494361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:45.094407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.739142+0000","last_change":"2024-09-10T14:28:30.886667+0000","last_active":"2024-09-10T14:31:43.739142+0000","last_peered":"2024-09-10T14:31:43.739142+0000","last_clean":"2024-09-10T14:31:43.739142+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:43.739142+0000","last_undegraded":"2024-09-10T14:31:43.739142+0000","last_fullsized":"2024-09-10T14:31:43.739142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:02.612612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.491902+0000","last_change":"2024-09-10T14:28:28.908422+0000","last_active":"2024-09-10T14:29:13.491902+0000","last_peered":"2024-09-10T14:29:13.491902+0000","last_clean":"2024-09-10T14:29:13.491902+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:29:13.491902+0000","last_undegraded":"2024-09-10T14:29:13.491902+0000","last_fullsized":"2024-09-10T14:29:13.491902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:18.554945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.783600+0000","last_change":"2024-09-10T14:28:30.886359+0000","last_active":"2024-09-10T14:29:08.783600+0000","last_peered":"2024-09-10T14:29:08.783600+0000","last_clean":"2024-09-10T14:29:08.783600+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:29:08.783600+0000","last_undegraded":"2024-09-10T14:29:08.783600+0000","last_fullsized":"2024-09-10T14:29:08.783600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:11.237117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787165+0000","last_change":"2024-09-10T14:28:28.899480+0000","last_active":"2024-09-10T14:29:08.787165+0000","last_peered":"2024-09-10T14:29:08.787165+0000","last_clean":"2024-09-10T14:29:08.787165+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:29:08.787165+0000","last_undegraded":"2024-09-10T14:29:08.787165+0000","last_fullsized":"2024-09-10T14:29:08.787165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:43.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.175804+0000","last_change":"2024-09-10T14:28:30.881839+0000","last_active":"2024-09-10T14:31:44.175804+0000","last_peered":"2024-09-10T14:31:44.175804+0000","last_clean":"2024-09-10T14:31:44.175804+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:31:44.175804+0000","last_undegraded":"2024-09-10T14:31:44.175804+0000","last_fullsized":"2024-09-10T14:31:44.175804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:06.988787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787432+0000","last_change":"2024-09-10T14:28:28.913505+0000","last_active":"2024-09-10T14:29:08.787432+0000","last_peered":"2024-09-10T14:29:08.787432+0000","last_clean":"2024-09-10T14:29:08.787432+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:29:08.787432+0000","last_undegraded":"2024-09-10T14:29:08.787432+0000","last_fullsized":"2024-09-10T14:29:08.787432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:11.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071529+0000","last_change":"2024-09-10T14:28:30.887181+0000","last_active":"2024-09-10T14:31:44.071529+0000","last_peered":"2024-09-10T14:31:44.071529+0000","last_clean":"2024-09-10T14:31:44.071529+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:31:44.071529+0000","last_undegraded":"2024-09-10T14:31:44.071529+0000","last_fullsized":"2024-09-10T14:31:44.071529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:11.379786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096944+0000","last_change":"2024-09-10T14:28:28.878802+0000","last_active":"2024-09-10T14:29:09.096944+0000","last_peered":"2024-09-10T14:29:09.096944+0000","last_clean":"2024-09-10T14:29:09.096944+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:29:09.096944+0000","last_undegraded":"2024-09-10T14:29:09.096944+0000","last_fullsized":"2024-09-10T14:29:09.096944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:26.929099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.875049+0000","last_change":"2024-09-10T14:28:30.873038+0000","last_active":"2024-09-10T14:31:43.875049+0000","last_peered":"2024-09-10T14:31:43.875049+0000","last_clean":"2024-09-10T14:31:43.875049+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:31:43.875049+0000","last_undegraded":"2024-09-10T14:31:43.875049+0000","last_fullsized":"2024-09-10T14:31:43.875049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:24.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768501+0000","last_change":"2024-09-10T14:28:28.893263+0000","last_active":"2024-09-10T14:29:08.768501+0000","last_peered":"2024-09-10T14:29:08.768501+0000","last_clean":"2024-09-10T14:29:08.768501+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:29:08.768501+0000","last_undegraded":"2024-09-10T14:29:08.768501+0000","last_fullsized":"2024-09-10T14:29:08.768501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:14.670209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072636+0000","last_change":"2024-09-10T14:28:30.885304+0000","last_active":"2024-09-10T14:31:44.072636+0000","last_peered":"2024-09-10T14:31:44.072636+0000","last_clean":"2024-09-10T14:31:44.072636+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:31:44.072636+0000","last_undegraded":"2024-09-10T14:31:44.072636+0000","last_fullsized":"2024-09-10T14:31:44.072636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:52.328031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.489629+0000","last_change":"2024-09-10T14:28:28.879959+0000","last_active":"2024-09-10T14:29:13.489629+0000","last_peered":"2024-09-10T14:29:13.489629+0000","last_clean":"2024-09-10T14:29:13.489629+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:29:13.489629+0000","last_undegraded":"2024-09-10T14:29:13.489629+0000","last_fullsized":"2024-09-10T14:29:13.489629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.028308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071788+0000","last_change":"2024-09-10T14:28:30.875900+0000","last_active":"2024-09-10T14:31:44.071788+0000","last_peered":"2024-09-10T14:31:44.071788+0000","last_clean":"2024-09-10T14:31:44.071788+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:31:44.071788+0000","last_undegraded":"2024-09-10T14:31:44.071788+0000","last_fullsized":"2024-09-10T14:31:44.071788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:33.823970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777667+0000","last_change":"2024-09-10T14:28:28.888402+0000","last_active":"2024-09-10T14:29:08.777667+0000","last_peered":"2024-09-10T14:29:08.777667+0000","last_clean":"2024-09-10T14:29:08.777667+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:29:08.777667+0000","last_undegraded":"2024-09-10T14:29:08.777667+0000","last_fullsized":"2024-09-10T14:29:08.777667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:04.011779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.732962+0000","last_change":"2024-09-10T14:28:30.883269+0000","last_active":"2024-09-10T14:31:43.732962+0000","last_peered":"2024-09-10T14:31:43.732962+0000","last_clean":"2024-09-10T14:31:43.732962+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:31:43.732962+0000","last_undegraded":"2024-09-10T14:31:43.732962+0000","last_fullsized":"2024-09-10T14:31:43.732962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.305094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781430+0000","last_change":"2024-09-10T14:28:28.906234+0000","last_active":"2024-09-10T14:29:08.781430+0000","last_peered":"2024-09-10T14:29:08.781430+0000","last_clean":"2024-09-10T14:29:08.781430+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:29:08.781430+0000","last_undegraded":"2024-09-10T14:29:08.781430+0000","last_fullsized":"2024-09-10T14:29:08.781430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:39.391774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227328+0000","last_change":"2024-09-10T14:28:30.886081+0000","last_active":"2024-09-10T14:31:44.227328+0000","last_peered":"2024-09-10T14:31:44.227328+0000","last_clean":"2024-09-10T14:31:44.227328+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:31:44.227328+0000","last_undegraded":"2024-09-10T14:31:44.227328+0000","last_fullsized":"2024-09-10T14:31:44.227328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.771512+0000","last_change":"2024-09-10T14:28:28.890888+0000","last_active":"2024-09-10T14:29:08.771512+0000","last_peered":"2024-09-10T14:29:08.771512+0000","last_clean":"2024-09-10T14:29:08.771512+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:29:08.771512+0000","last_undegraded":"2024-09-10T14:29:08.771512+0000","last_fullsized":"2024-09-10T14:29:08.771512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:40.510621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158665+0000","last_change":"2024-09-10T14:28:30.866941+0000","last_active":"2024-09-10T14:31:44.158665+0000","last_peered":"2024-09-10T14:31:44.158665+0000","last_clean":"2024-09-10T14:31:44.158665+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:31:44.158665+0000","last_undegraded":"2024-09-10T14:31:44.158665+0000","last_fullsized":"2024-09-10T14:31:44.158665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:44.179281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778431+0000","last_change":"2024-09-10T14:28:28.880438+0000","last_active":"2024-09-10T14:29:08.778431+0000","last_peered":"2024-09-10T14:29:08.778431+0000","last_clean":"2024-09-10T14:29:08.778431+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:29:08.778431+0000","last_undegraded":"2024-09-10T14:29:08.778431+0000","last_fullsized":"2024-09-10T14:29:08.778431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:26.888320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'13","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784209+0000","last_change":"2024-09-10T14:28:30.887810+0000","last_active":"2024-09-10T14:30:48.784209+0000","last_peered":"2024-09-10T14:30:48.784209+0000","last_clean":"2024-09-10T14:30:48.784209+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:30:48.784209+0000","last_undegraded":"2024-09-10T14:30:48.784209+0000","last_fullsized":"2024-09-10T14:30:48.784209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:57.157500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788071+0000","last_change":"2024-09-10T14:28:28.914161+0000","last_active":"2024-09-10T14:29:08.788071+0000","last_peered":"2024-09-10T14:29:08.788071+0000","last_clean":"2024-09-10T14:29:08.788071+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:29:08.788071+0000","last_undegraded":"2024-09-10T14:29:08.788071+0000","last_fullsized":"2024-09-10T14:29:08.788071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:57.354096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244157+0000","last_change":"2024-09-10T14:28:30.862241+0000","last_active":"2024-09-10T14:31:44.244157+0000","last_peered":"2024-09-10T14:31:44.244157+0000","last_clean":"2024-09-10T14:31:44.244157+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:31:44.244157+0000","last_undegraded":"2024-09-10T14:31:44.244157+0000","last_fullsized":"2024-09-10T14:31:44.244157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:33.823970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.646886+0000","last_change":"2024-09-10T14:28:28.879289+0000","last_active":"2024-09-10T14:31:43.646886+0000","last_peered":"2024-09-10T14:31:43.646886+0000","last_clean":"2024-09-10T14:31:43.646886+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:31:43.646886+0000","last_undegraded":"2024-09-10T14:31:43.646886+0000","last_fullsized":"2024-09-10T14:31:43.646886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:09.227862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770986+0000","last_change":"2024-09-10T14:28:28.892314+0000","last_active":"2024-09-10T14:29:08.770986+0000","last_peered":"2024-09-10T14:29:08.770986+0000","last_clean":"2024-09-10T14:29:08.770986+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:29:08.770986+0000","last_undegraded":"2024-09-10T14:29:08.770986+0000","last_fullsized":"2024-09-10T14:29:08.770986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:13.058159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227341+0000","last_change":"2024-09-10T14:28:30.891092+0000","last_active":"2024-09-10T14:31:44.227341+0000","last_peered":"2024-09-10T14:31:44.227341+0000","last_clean":"2024-09-10T14:31:44.227341+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:31:44.227341+0000","last_undegraded":"2024-09-10T14:31:44.227341+0000","last_fullsized":"2024-09-10T14:31:44.227341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:24.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:52.777958+0000","last_change":"2024-09-10T14:28:28.881653+0000","last_active":"2024-09-10T14:30:52.777958+0000","last_peered":"2024-09-10T14:30:52.777958+0000","last_clean":"2024-09-10T14:30:52.777958+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:30:52.777958+0000","last_undegraded":"2024-09-10T14:30:52.777958+0000","last_fullsized":"2024-09-10T14:30:52.777958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:53.922561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.791605+0000","last_change":"2024-09-10T14:28:30.887038+0000","last_active":"2024-09-10T14:29:08.791605+0000","last_peered":"2024-09-10T14:29:08.791605+0000","last_clean":"2024-09-10T14:29:08.791605+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:29:08.791605+0000","last_undegraded":"2024-09-10T14:29:08.791605+0000","last_fullsized":"2024-09-10T14:29:08.791605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:55.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640309,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48920,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322920,"statfs":{"total":96636764160,"available":96586670080,"internally_reserved":0,"allocated":9641984,"data_stored":9357446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673013,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":8900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":9113600,"data_stored":8768463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673013,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44776,"kb_used_data":9432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327064,"statfs":{"total":96636764160,"available":96590913536,"internally_reserved":0,"allocated":9658368,"data_stored":9355915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35892,"kb_used_data":8868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335948,"statfs":{"total":96636764160,"available":96600010752,"internally_reserved":0,"allocated":9080832,"data_stored":8769006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:32:16.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T14:32:17.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb480e1640 1 Processor -- start 2024-09-10T14:32:17.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb480e1640 1 -- start start 2024-09-10T14:32:17.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb480e1640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb4012e760 0x7ffb4012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb480e1640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb400984f0 con 0x7ffb4012f1c0 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb480e1640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffb40098dc0 con 0x7ffb4012e760 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb45e7d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb4012e760 0x7ffb4012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb4567c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffb4012f1c0 0x7ffb4012b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45734/0 (socket says 172.21.15.52:45734) 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb4567c640 1 -- 172.21.15.52:0/3378821698 learned_addr learned my addr 172.21.15.52:0/3378821698 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb44e7b640 1 -- 172.21.15.52:0/3378821698 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245397714 0 0) 0x7ffb400984f0 con 0x7ffb4012f1c0 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb44e7b640 1 -- 172.21.15.52:0/3378821698 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb2c003530 con 0x7ffb4012f1c0 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb45e7d640 1 -- 172.21.15.52:0/3378821698 >> v1:172.21.15.52:6789/0 conn(0x7ffb4012f1c0 legacy=0x7ffb4012b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb45e7d640 1 -- 172.21.15.52:0/3378821698 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4012f5a0 con 0x7ffb4012e760 2024-09-10T14:32:17.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb45e7d640 1 --2- 172.21.15.52:0/3378821698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb4012ec80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009740 tx=0x7ffb3c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a50c62bb0c3926e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:17.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb44e7b640 1 -- 172.21.15.52:0/3378821698 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb3c0b0070 con 0x7ffb4012e760 2024-09-10T14:32:17.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb44e7b640 1 -- 172.21.15.52:0/3378821698 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3c0ab530 con 0x7ffb4012e760 2024-09-10T14:32:17.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.068+0000 7ffb44e7b640 1 -- 172.21.15.52:0/3378821698 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb3c0ab810 con 0x7ffb4012e760 2024-09-10T14:32:17.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- 172.21.15.52:0/3378821698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 msgr2=0x7ffb4012ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:17.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 --2- 172.21.15.52:0/3378821698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb4012ec80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009740 tx=0x7ffb3c01c400 comp rx=0 tx=0).stop 2024-09-10T14:32:17.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- 172.21.15.52:0/3378821698 shutdown_connections 2024-09-10T14:32:17.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 --2- 172.21.15.52:0/3378821698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb4012ec80 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:17.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- 172.21.15.52:0/3378821698 >> 172.21.15.52:0/3378821698 conn(0x7ffb400a10a0 msgr2=0x7ffb400a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:17.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- 172.21.15.52:0/3378821698 shutdown_connections 2024-09-10T14:32:17.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- 172.21.15.52:0/3378821698 wait complete. 2024-09-10T14:32:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 Processor -- start 2024-09-10T14:32:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- start start 2024-09-10T14:32:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb401c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb40136e30 con 0x7ffb4012e760 2024-09-10T14:32:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb45e7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb401c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb45e7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb401c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40598/0 (socket says 172.21.15.52:40598) 2024-09-10T14:32:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb45e7d640 1 -- 172.21.15.52:0/3199843604 learned_addr learned my addr 172.21.15.52:0/3199843604 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb45e7d640 1 -- 172.21.15.52:0/3199843604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4009e490 con 0x7ffb4012e760 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb45e7d640 1 --2- 172.21.15.52:0/3199843604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb401c64a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c01a030 tx=0x7ffb3c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb367fc640 1 -- 172.21.15.52:0/3199843604 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb3c0b0050 con 0x7ffb4012e760 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb367fc640 1 -- 172.21.15.52:0/3199843604 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3c0b1040 con 0x7ffb4012e760 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb401321a0 con 0x7ffb4012e760 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb367fc640 1 -- 172.21.15.52:0/3199843604 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb3c0b75a0 con 0x7ffb4012e760 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb4009dc00 con 0x7ffb4012e760 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb367fc640 1 -- 172.21.15.52:0/3199843604 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffb3c0be030 con 0x7ffb4012e760 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.072+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb40131550 con 0x7ffb4012e760 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.076+0000 7ffb367fc640 1 --2- 172.21.15.52:0/3199843604 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb24035db0 0x7ffb24038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:17.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.076+0000 7ffb367fc640 1 -- 172.21.15.52:0/3199843604 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ffb3c0bc070 con 0x7ffb4012e760 2024-09-10T14:32:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.076+0000 7ffb4567c640 1 --2- 172.21.15.52:0/3199843604 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb24035db0 0x7ffb24038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.076+0000 7ffb4567c640 1 --2- 172.21.15.52:0/3199843604 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb24035db0 0x7ffb24038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007fd0 tx=0x7ffb30007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:17.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.080+0000 7ffb367fc640 1 -- 172.21.15.52:0/3199843604 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffb3c0c5060 con 0x7ffb4012e760 2024-09-10T14:32:17.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.244+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb4012ec80 con 0x7ffb4012e760 2024-09-10T14:32:17.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb367fc640 1 -- 172.21.15.52:0/3199843604 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21251 (secure 0 0 0) 0x7ffb3c015ff0 con 0x7ffb4012e760 2024-09-10T14:32:17.251 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:32:17.251 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":36,"fsid":"e936b5de-d383-459c-816e-e37e3a1e8eca","created":"2024-09-10T14:28:01.875404+0000","modified":"2024-09-10T14:29:08.757255+0000","last_up_change":"2024-09-10T14:28:13.779450+0000","last_in_change":"2024-09-10T14:28:03.007882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T14:28:14.755514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T14:28:17.647233+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T14:28:26.860990+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T14:28:29.244610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T14:28:31.127111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T14:28:33.044493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T14:28:34.959658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T14:28:37.104295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45802472-5778-4765-8d57-a58c831fe5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6801","nonce":2968015226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6803","nonce":2968015226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6807","nonce":2968015226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2968015226},{"type":"v1","addr":"172.21.15.52:6805","nonce":2968015226}]},"public_addr":"172.21.15.52:6801/2968015226","cluster_addr":"172.21.15.52:6803/2968015226","heartbeat_back_addr":"172.21.15.52:6807/2968015226","heartbeat_front_addr":"172.21.15.52:6805/2968015226","state":["exists","up"]},{"osd":1,"uuid":"7c018fda-e9f2-4c52-93f6-a59ac120be0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6801","nonce":103268966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6804","nonce":103268966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6812","nonce":103268966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":103268966},{"type":"v1","addr":"172.21.15.151:6808","nonce":103268966}]},"public_addr":"172.21.15.151:6801/103268966","cluster_addr":"172.21.15.151:6804/103268966","heartbeat_back_addr":"172.21.15.151:6812/103268966","heartbeat_front_addr":"172.21.15.151:6808/103268966","state":["exists","up"]},{"osd":2,"uuid":"a41e1739-74f0-4db9-b9f3-99660c90654a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6817","nonce":2885613778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6819","nonce":2885613778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6823","nonce":2885613778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2885613778},{"type":"v1","addr":"172.21.15.151:6821","nonce":2885613778}]},"public_addr":"172.21.15.151:6817/2885613778","cluster_addr":"172.21.15.151:6819/2885613778","heartbeat_back_addr":"172.21.15.151:6823/2885613778","heartbeat_front_addr":"172.21.15.151:6821/2885613778","state":["exists","up"]},{"osd":3,"uuid":"a7ff38f7-1d09-4389-b358-dfbc9302cd16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6803","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6805","nonce":3136276598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6809","nonce":3136276598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6815","nonce":3136276598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6811","nonce":3136276598},{"type":"v1","addr":"172.21.15.151:6813","nonce":3136276598}]},"public_addr":"172.21.15.151:6805/3136276598","cluster_addr":"172.21.15.151:6809/3136276598","heartbeat_back_addr":"172.21.15.151:6815/3136276598","heartbeat_front_addr":"172.21.15.151:6813/3136276598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.162035+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.133963+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.782040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T14:28:10.263429+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"5.3","mappings":[{"from":0,"to":2}]},{"pgid":"5.1d","mappings":[{"from":0,"to":2}]},{"pgid":"5.1e","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T14:32:17.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb24035db0 msgr2=0x7ffb24038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:17.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 --2- 172.21.15.52:0/3199843604 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb24035db0 0x7ffb24038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007fd0 tx=0x7ffb30007980 comp rx=0 tx=0).stop 2024-09-10T14:32:17.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 msgr2=0x7ffb401c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:17.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 --2- 172.21.15.52:0/3199843604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb401c64a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c01a030 tx=0x7ffb3c01ac40 comp rx=0 tx=0).stop 2024-09-10T14:32:17.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 shutdown_connections 2024-09-10T14:32:17.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 --2- 172.21.15.52:0/3199843604 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb24035db0 0x7ffb24038270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:17.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 --2- 172.21.15.52:0/3199843604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb4012e760 0x7ffb401c64a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:17.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 >> 172.21.15.52:0/3199843604 conn(0x7ffb400a10a0 msgr2=0x7ffb4012c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:17.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 shutdown_connections 2024-09-10T14:32:17.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:17.248+0000 7ffb480e1640 1 -- 172.21.15.52:0/3199843604 wait complete. 2024-09-10T14:32:18.334 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T14:32:18.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T14:32:18.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.468+0000 7f8d2399d640 1 Processor -- start 2024-09-10T14:32:18.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.468+0000 7f8d2399d640 1 -- start start 2024-09-10T14:32:18.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.468+0000 7f8d2399d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d1c06be20 0x7f8d1c131780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.468+0000 7f8d2399d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1c06c910 con 0x7f8d1c070f60 2024-09-10T14:32:18.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.468+0000 7f8d2399d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8d1c068400 con 0x7f8d1c06be20 2024-09-10T14:32:18.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.472+0000 7f8d20f38640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d1c06be20 0x7f8d1c131780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.472+0000 7f8d21739640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8d1c070f60 0x7f8d1c071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45744/0 (socket says 172.21.15.52:45744) 2024-09-10T14:32:18.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.472+0000 7f8d21739640 1 -- 172.21.15.52:0/641441656 learned_addr learned my addr 172.21.15.52:0/641441656 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:18.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.472+0000 7f8d20f38640 1 -- 172.21.15.52:0/641441656 >> v1:172.21.15.52:6789/0 conn(0x7f8d1c070f60 legacy=0x7f8d1c071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.472+0000 7f8d13fff640 1 -- 172.21.15.52:0/641441656 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008263702 0 0) 0x7f8d1c06c910 con 0x7f8d1c070f60 2024-09-10T14:32:18.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.472+0000 7f8d20f38640 1 -- 172.21.15.52:0/641441656 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c070aa0 con 0x7f8d1c06be20 2024-09-10T14:32:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d20f38640 1 --2- 172.21.15.52:0/641441656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c131780 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009740 tx=0x7f8d0c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1d7fc4d8ea7517 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d13fff640 1 -- 172.21.15.52:0/641441656 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d0c0b0070 con 0x7f8d1c06be20 2024-09-10T14:32:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d13fff640 1 -- 172.21.15.52:0/641441656 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c0ab530 con 0x7f8d1c06be20 2024-09-10T14:32:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d13fff640 1 -- 172.21.15.52:0/641441656 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d0c0ab830 con 0x7f8d1c06be20 2024-09-10T14:32:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 -- 172.21.15.52:0/641441656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 msgr2=0x7f8d1c131780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 --2- 172.21.15.52:0/641441656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c131780 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009740 tx=0x7f8d0c01c310 comp rx=0 tx=0).stop 2024-09-10T14:32:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 -- 172.21.15.52:0/641441656 shutdown_connections 2024-09-10T14:32:18.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 --2- 172.21.15.52:0/641441656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c131780 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 -- 172.21.15.52:0/641441656 >> 172.21.15.52:0/641441656 conn(0x7f8d1c09ab20 msgr2=0x7f8d1c06d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:18.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 -- 172.21.15.52:0/641441656 shutdown_connections 2024-09-10T14:32:18.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 -- 172.21.15.52:0/641441656 wait complete. 2024-09-10T14:32:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 Processor -- start 2024-09-10T14:32:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 -- start start 2024-09-10T14:32:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c097670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d2399d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c134870 con 0x7f8d1c06be20 2024-09-10T14:32:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d21739640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c097670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d21739640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c097670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40616/0 (socket says 172.21.15.52:40616) 2024-09-10T14:32:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d21739640 1 -- 172.21.15.52:0/3902226553 learned_addr learned my addr 172.21.15.52:0/3902226553 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d21739640 1 -- 172.21.15.52:0/3902226553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c0708a0 con 0x7f8d1c06be20 2024-09-10T14:32:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.476+0000 7f8d21739640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c097670 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c450 tx=0x7f8d1800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d18005c20 con 0x7f8d1c06be20 2024-09-10T14:32:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d18005dc0 con 0x7f8d1c06be20 2024-09-10T14:32:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c126d30 con 0x7f8d1c06be20 2024-09-10T14:32:18.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d180071a0 con 0x7f8d1c06be20 2024-09-10T14:32:18.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c12dc40 con 0x7f8d1c06be20 2024-09-10T14:32:18.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d1c0686b0 con 0x7f8d1c06be20 2024-09-10T14:32:18.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8d18007400 con 0x7f8d1c06be20 2024-09-10T14:32:18.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d00035d60 0x7f8d00038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8d18048e10 con 0x7f8d1c06be20 2024-09-10T14:32:18.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8d000421d0 0x7f8d00044670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d1801ce50 con 0x7f8d000421d0 2024-09-10T14:32:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8d1804b4c0 con 0x7f8d1c06be20 2024-09-10T14:32:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d21f3a640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8d000421d0 0x7f8d00044670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d20f38640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d00035d60 0x7f8d00038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d21f3a640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8d000421d0 0x7f8d00044670 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d20f38640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d00035d60 0x7f8d00038220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0ad000 tx=0x7f8d0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.480+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 <== osd.0 v2:172.21.15.52:6800/2968015226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d1801ce50 con 0x7f8d000421d0 2024-09-10T14:32:18.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.492+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 --> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8d1c097bb0 con 0x7f8d000421d0 2024-09-10T14:32:18.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d11ffb640 1 -- 172.21.15.52:0/3902226553 <== osd.0 v2:172.21.15.52:6800/2968015226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8d1c097bb0 con 0x7f8d000421d0 2024-09-10T14:32:18.498 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T14:32:18.498 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T14:32:18.498 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T14:32:18.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8d000421d0 msgr2=0x7f8d00044670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8d000421d0 0x7f8d00044670 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d00035d60 msgr2=0x7f8d00038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d00035d60 0x7f8d00038220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0ad000 tx=0x7f8d0c008040 comp rx=0 tx=0).stop 2024-09-10T14:32:18.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 msgr2=0x7f8d1c097670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c097670 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c450 tx=0x7f8d1800c910 comp rx=0 tx=0).stop 2024-09-10T14:32:18.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 shutdown_connections 2024-09-10T14:32:18.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:6800/2968015226,v1:172.21.15.52:6801/2968015226] conn(0x7f8d000421d0 0x7f8d00044670 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d00035d60 0x7f8d00038220 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 --2- 172.21.15.52:0/3902226553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d1c06be20 0x7f8d1c097670 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 >> 172.21.15.52:0/3902226553 conn(0x7f8d1c09ab20 msgr2=0x7f8d1c125db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:18.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 shutdown_connections 2024-09-10T14:32:18.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.496+0000 7f8d2399d640 1 -- 172.21.15.52:0/3902226553 wait complete. 2024-09-10T14:32:18.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T14:32:18.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.624+0000 7f2c765dd640 1 Processor -- start 2024-09-10T14:32:18.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c765dd640 1 -- start start 2024-09-10T14:32:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c765dd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c7006dbd0 0x7f2c70131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c765dd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c70071c10 con 0x7f2c7006d0e0 2024-09-10T14:32:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c765dd640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2c70072230 con 0x7f2c7006dbd0 2024-09-10T14:32:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6f7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c7006dbd0 0x7f2c70131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6ffff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2c7006d0e0 0x7f2c7006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45754/0 (socket says 172.21.15.52:45754) 2024-09-10T14:32:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6ffff640 1 -- 172.21.15.52:0/124125759 learned_addr learned my addr 172.21.15.52:0/124125759 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6f7fe640 1 -- 172.21.15.52:0/124125759 >> v1:172.21.15.52:6789/0 conn(0x7f2c7006d0e0 legacy=0x7f2c7006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6f7fe640 1 -- 172.21.15.52:0/124125759 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c700709e0 con 0x7f2c7006dbd0 2024-09-10T14:32:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6f7fe640 1 --2- 172.21.15.52:0/124125759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006dbd0 0x7f2c70131e60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009740 tx=0x7f2c6001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbe65befb1b7e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6effd640 1 -- 172.21.15.52:0/124125759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c600b0070 con 0x7f2c7006dbd0 2024-09-10T14:32:18.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6effd640 1 -- 172.21.15.52:0/124125759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c600ab530 con 0x7f2c7006dbd0 2024-09-10T14:32:18.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.628+0000 7f2c6effd640 1 -- 172.21.15.52:0/124125759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c600ab830 con 0x7f2c7006dbd0 2024-09-10T14:32:18.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- 172.21.15.52:0/124125759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006dbd0 msgr2=0x7f2c70131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 --2- 172.21.15.52:0/124125759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006dbd0 0x7f2c70131e60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009740 tx=0x7f2c6001c370 comp rx=0 tx=0).stop 2024-09-10T14:32:18.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- 172.21.15.52:0/124125759 shutdown_connections 2024-09-10T14:32:18.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 --2- 172.21.15.52:0/124125759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006dbd0 0x7f2c70131e60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- 172.21.15.52:0/124125759 >> 172.21.15.52:0/124125759 conn(0x7f2c70099a50 msgr2=0x7f2c700972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:18.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- 172.21.15.52:0/124125759 shutdown_connections 2024-09-10T14:32:18.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- 172.21.15.52:0/124125759 wait complete. 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 Processor -- start 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- start start 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006d0e0 0x7f2c7006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2c70134d40 con 0x7f2c7006d0e0 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006d0e0 0x7f2c7006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006d0e0 0x7f2c7006e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40632/0 (socket says 172.21.15.52:40632) 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6ffff640 1 -- 172.21.15.52:0/3362626168 learned_addr learned my addr 172.21.15.52:0/3362626168 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6ffff640 1 -- 172.21.15.52:0/3362626168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7008b730 con 0x7f2c7006d0e0 2024-09-10T14:32:18.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6ffff640 1 --2- 172.21.15.52:0/3362626168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006d0e0 0x7f2c7006e1f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800ca90 tx=0x7f2c6800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6cff9640 1 -- 172.21.15.52:0/3362626168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c68018070 con 0x7f2c7006d0e0 2024-09-10T14:32:18.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6cff9640 1 -- 172.21.15.52:0/3362626168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c68004ca0 con 0x7f2c7006d0e0 2024-09-10T14:32:18.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6cff9640 1 -- 172.21.15.52:0/3362626168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6800aa50 con 0x7f2c7006d0e0 2024-09-10T14:32:18.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c70129fd0 con 0x7f2c7006d0e0 2024-09-10T14:32:18.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c7008b9d0 con 0x7f2c7006d0e0 2024-09-10T14:32:18.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c7006d4c0 con 0x7f2c7006d0e0 2024-09-10T14:32:18.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6cff9640 1 -- 172.21.15.52:0/3362626168 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2c6801b070 con 0x7f2c7006d0e0 2024-09-10T14:32:18.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6cff9640 1 --2- 172.21.15.52:0/3362626168 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2c5c035db0 0x7f2c5c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.632+0000 7f2c6cff9640 1 -- 172.21.15.52:0/3362626168 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f2c68048f30 con 0x7f2c7006d0e0 2024-09-10T14:32:18.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.636+0000 7f2c6f7fe640 1 --2- 172.21.15.52:0/3362626168 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2c5c035db0 0x7f2c5c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.636+0000 7f2c6f7fe640 1 --2- 172.21.15.52:0/3362626168 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2c5c035db0 0x7f2c5c038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2c600ad000 tx=0x7f2c600a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.640+0000 7f2c6cff9640 1 -- 172.21.15.52:0/3362626168 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2c7008b730 con 0x7f2c7006d0e0 2024-09-10T14:32:18.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.800+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f2c70073790 con 0x7f2c5c035db0 2024-09-10T14:32:18.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.800+0000 7f2c6cff9640 1 -- 172.21.15.52:0/3362626168 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c70073790 con 0x7f2c5c035db0 2024-09-10T14:32:18.805 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T14:32:18.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2c5c035db0 msgr2=0x7f2c5c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 --2- 172.21.15.52:0/3362626168 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2c5c035db0 0x7f2c5c038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2c600ad000 tx=0x7f2c600a6000 comp rx=0 tx=0).stop 2024-09-10T14:32:18.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006d0e0 msgr2=0x7f2c7006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 --2- 172.21.15.52:0/3362626168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006d0e0 0x7f2c7006e1f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800ca90 tx=0x7f2c6800cf50 comp rx=0 tx=0).stop 2024-09-10T14:32:18.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 shutdown_connections 2024-09-10T14:32:18.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 --2- 172.21.15.52:0/3362626168 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f2c5c035db0 0x7f2c5c038270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 --2- 172.21.15.52:0/3362626168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7006d0e0 0x7f2c7006e1f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 >> 172.21.15.52:0/3362626168 conn(0x7f2c70099a50 msgr2=0x7f2c7009b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:18.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 shutdown_connections 2024-09-10T14:32:18.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.804+0000 7f2c765dd640 1 -- 172.21.15.52:0/3362626168 wait complete. 2024-09-10T14:32:18.825 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T14:32:18.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T14:32:18.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfeff8c640 1 Processor -- start 2024-09-10T14:32:18.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfeff8c640 1 -- start start 2024-09-10T14:32:18.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfeff8c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfe806dc60 0x7fcfe8131b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfeff8c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe8098840 con 0x7fcfe806d170 2024-09-10T14:32:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfeff8c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe80709c0 con 0x7fcfe806dc60 2024-09-10T14:32:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfed527640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfe806dc60 0x7fcfe8131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfedd28640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcfe806d170 0x7fcfe806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45758/0 (socket says 172.21.15.52:45758) 2024-09-10T14:32:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfed527640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfe806dc60 0x7fcfe8131b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40646/0 (socket says 172.21.15.52:40646) 2024-09-10T14:32:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfedd28640 1 -- 172.21.15.52:0/1819336855 learned_addr learned my addr 172.21.15.52:0/1819336855 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfed527640 1 -- 172.21.15.52:0/1819336855 >> v1:172.21.15.52:6789/0 conn(0x7fcfe806d170 legacy=0x7fcfe806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.952+0000 7fcfed527640 1 -- 172.21.15.52:0/1819336855 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe8071e20 con 0x7fcfe806dc60 2024-09-10T14:32:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfed527640 1 --2- 172.21.15.52:0/1819336855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806dc60 0x7fcfe8131b40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009d90 tx=0x7fcfdc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41635107392d4ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfecd26640 1 -- 172.21.15.52:0/1819336855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfdc0b2070 con 0x7fcfe806dc60 2024-09-10T14:32:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfecd26640 1 -- 172.21.15.52:0/1819336855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfdc0a5740 con 0x7fcfe806dc60 2024-09-10T14:32:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfecd26640 1 -- 172.21.15.52:0/1819336855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfdc0a5a40 con 0x7fcfe806dc60 2024-09-10T14:32:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 -- 172.21.15.52:0/1819336855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806dc60 msgr2=0x7fcfe8131b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 --2- 172.21.15.52:0/1819336855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806dc60 0x7fcfe8131b40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009d90 tx=0x7fcfdc01c8c0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 -- 172.21.15.52:0/1819336855 shutdown_connections 2024-09-10T14:32:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 --2- 172.21.15.52:0/1819336855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806dc60 0x7fcfe8131b40 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 -- 172.21.15.52:0/1819336855 >> 172.21.15.52:0/1819336855 conn(0x7fcfe80998a0 msgr2=0x7fcfe8099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 -- 172.21.15.52:0/1819336855 shutdown_connections 2024-09-10T14:32:18.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 -- 172.21.15.52:0/1819336855 wait complete. 2024-09-10T14:32:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 Processor -- start 2024-09-10T14:32:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 -- start start 2024-09-10T14:32:18.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806d170 0x7fcfe80914a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfeff8c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8134c30 con 0x7fcfe806d170 2024-09-10T14:32:18.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfedd28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806d170 0x7fcfe80914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfedd28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806d170 0x7fcfe80914a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40656/0 (socket says 172.21.15.52:40656) 2024-09-10T14:32:18.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.956+0000 7fcfedd28640 1 -- 172.21.15.52:0/2655916474 learned_addr learned my addr 172.21.15.52:0/2655916474 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfedd28640 1 -- 172.21.15.52:0/2655916474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe8092c10 con 0x7fcfe806d170 2024-09-10T14:32:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfedd28640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806d170 0x7fcfe80914a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400c480 tx=0x7fcfe400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe4017070 con 0x7fcfe806d170 2024-09-10T14:32:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe4005c20 con 0x7fcfe806d170 2024-09-10T14:32:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe8092360 con 0x7fcfe806d170 2024-09-10T14:32:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe4007070 con 0x7fcfe806d170 2024-09-10T14:32:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe8094420 con 0x7fcfe806d170 2024-09-10T14:32:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcfe80947c0 con 0x7fcfe806d170 2024-09-10T14:32:18.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcfe401a070 con 0x7fcfe806d170 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcfcc035db0 0x7fcfcc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fcfe40483d0 con 0x7fcfe806d170 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7fcfcc042220 0x7fcfcc0446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfcc044d90 con 0x7fcfcc042220 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcfe404f050 con 0x7fcfe806d170 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfed527640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcfcc035db0 0x7fcfcc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfee529640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7fcfcc042220 0x7fcfcc0446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfee529640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7fcfcc042220 0x7fcfcc0446c0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.960+0000 7fcfed527640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcfcc035db0 0x7fcfcc038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0af000 tx=0x7fcfdc0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:18.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.964+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 <== osd.1 v2:172.21.15.151:6800/103268966 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcfcc044d90 con 0x7fcfcc042220 2024-09-10T14:32:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 --> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcfe8094970 con 0x7fcfcc042220 2024-09-10T14:32:18.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfda7fc640 1 -- 172.21.15.52:0/2655916474 <== osd.1 v2:172.21.15.151:6800/103268966 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcfe8094970 con 0x7fcfcc042220 2024-09-10T14:32:18.981 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T14:32:18.981 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T14:32:18.981 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T14:32:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7fcfcc042220 msgr2=0x7fcfcc0446c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7fcfcc042220 0x7fcfcc0446c0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcfcc035db0 msgr2=0x7fcfcc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcfcc035db0 0x7fcfcc038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0af000 tx=0x7fcfdc0a7070 comp rx=0 tx=0).stop 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806d170 msgr2=0x7fcfe80914a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806d170 0x7fcfe80914a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400c480 tx=0x7fcfe400c940 comp rx=0 tx=0).stop 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 shutdown_connections 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6800/103268966,v1:172.21.15.151:6801/103268966] conn(0x7fcfcc042220 0x7fcfcc0446c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fcfcc035db0 0x7fcfcc038270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 --2- 172.21.15.52:0/2655916474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe806d170 0x7fcfe80914a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 >> 172.21.15.52:0/2655916474 conn(0x7fcfe80998a0 msgr2=0x7fcfe812cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 shutdown_connections 2024-09-10T14:32:18.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:18.976+0000 7fcfeff8c640 1 -- 172.21.15.52:0/2655916474 wait complete. 2024-09-10T14:32:18.997 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T14:32:19.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0fcc2640 1 Processor -- start 2024-09-10T14:32:19.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0fcc2640 1 -- start start 2024-09-10T14:32:19.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0fcc2640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed0806d0e0 0x7fed0806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0fcc2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed08071c10 con 0x7fed0806da00 2024-09-10T14:32:19.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0fcc2640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fed08072230 con 0x7fed0806d0e0 2024-09-10T14:32:19.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0da5e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fed0806d0e0 0x7fed0806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0d25d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fed0806da00 0x7fed0812ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45666/0 (socket says 172.21.15.52:45666) 2024-09-10T14:32:19.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0d25d640 1 -- 172.21.15.52:0/2938662244 learned_addr learned my addr 172.21.15.52:0/2938662244 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:19.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0da5e640 1 -- 172.21.15.52:0/2938662244 >> v1:172.21.15.52:6789/0 conn(0x7fed0806da00 legacy=0x7fed0812ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.108+0000 7fed0da5e640 1 -- 172.21.15.52:0/2938662244 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed080709e0 con 0x7fed0806d0e0 2024-09-10T14:32:19.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0da5e640 1 --2- 172.21.15.52:0/2938662244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0806d4c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009740 tx=0x7fecf801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed396a90f4465e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0ca5c640 1 -- 172.21.15.52:0/2938662244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf80b0070 con 0x7fed0806d0e0 2024-09-10T14:32:19.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0ca5c640 1 -- 172.21.15.52:0/2938662244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf80ab530 con 0x7fed0806d0e0 2024-09-10T14:32:19.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0ca5c640 1 -- 172.21.15.52:0/2938662244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf80ab830 con 0x7fed0806d0e0 2024-09-10T14:32:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2938662244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 msgr2=0x7fed0806d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 --2- 172.21.15.52:0/2938662244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0806d4c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009740 tx=0x7fecf801c370 comp rx=0 tx=0).stop 2024-09-10T14:32:19.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2938662244 shutdown_connections 2024-09-10T14:32:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 --2- 172.21.15.52:0/2938662244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0806d4c0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2938662244 >> 172.21.15.52:0/2938662244 conn(0x7fed08099a50 msgr2=0x7fed080972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2938662244 shutdown_connections 2024-09-10T14:32:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2938662244 wait complete. 2024-09-10T14:32:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 Processor -- start 2024-09-10T14:32:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.112+0000 7fed0fcc2640 1 -- start start 2024-09-10T14:32:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0fcc2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0812b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0fcc2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed08134e80 con 0x7fed0806d0e0 2024-09-10T14:32:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0da5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0812b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0da5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0812b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39776/0 (socket says 172.21.15.52:39776) 2024-09-10T14:32:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0da5e640 1 -- 172.21.15.52:0/2504754963 learned_addr learned my addr 172.21.15.52:0/2504754963 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0da5e640 1 -- 172.21.15.52:0/2504754963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0812a090 con 0x7fed0806d0e0 2024-09-10T14:32:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0da5e640 1 --2- 172.21.15.52:0/2504754963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0812b670 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fecf80ae040 tx=0x7fecf801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed067fc640 1 -- 172.21.15.52:0/2504754963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf80b0050 con 0x7fed0806d0e0 2024-09-10T14:32:19.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed067fc640 1 -- 172.21.15.52:0/2504754963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf80b1040 con 0x7fed0806d0e0 2024-09-10T14:32:19.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0812a550 con 0x7fed0806d0e0 2024-09-10T14:32:19.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed067fc640 1 -- 172.21.15.52:0/2504754963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf80b5740 con 0x7fed0806d0e0 2024-09-10T14:32:19.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0812bd80 con 0x7fed0806d0e0 2024-09-10T14:32:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed067fc640 1 -- 172.21.15.52:0/2504754963 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fecf80be030 con 0x7fed0806d0e0 2024-09-10T14:32:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed08128cb0 con 0x7fed0806d0e0 2024-09-10T14:32:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed067fc640 1 --2- 172.21.15.52:0/2504754963 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fecf4035d60 0x7fecf4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed067fc640 1 -- 172.21.15.52:0/2504754963 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fecf80bc070 con 0x7fed0806d0e0 2024-09-10T14:32:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0d25d640 1 --2- 172.21.15.52:0/2504754963 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fecf4035d60 0x7fecf4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.116+0000 7fed0d25d640 1 --2- 172.21.15.52:0/2504754963 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fecf4035d60 0x7fecf4038220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0012f0 tx=0x7fecfc001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.120+0000 7fed067fc640 1 -- 172.21.15.52:0/2504754963 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecf80c5020 con 0x7fed0806d0e0 2024-09-10T14:32:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.284+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fed08072770 con 0x7fecf4035d60 2024-09-10T14:32:19.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.284+0000 7fed067fc640 1 -- 172.21.15.52:0/2504754963 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fed08072770 con 0x7fecf4035d60 2024-09-10T14:32:19.289 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T14:32:19.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fecf4035d60 msgr2=0x7fecf4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 --2- 172.21.15.52:0/2504754963 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fecf4035d60 0x7fecf4038220 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0012f0 tx=0x7fecfc001640 comp rx=0 tx=0).stop 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 msgr2=0x7fed0812b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 --2- 172.21.15.52:0/2504754963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0812b670 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fecf80ae040 tx=0x7fecf801abb0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 shutdown_connections 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 --2- 172.21.15.52:0/2504754963 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fecf4035d60 0x7fecf4038220 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 --2- 172.21.15.52:0/2504754963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0806d0e0 0x7fed0812b670 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 >> 172.21.15.52:0/2504754963 conn(0x7fed08099a50 msgr2=0x7fed0812ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 shutdown_connections 2024-09-10T14:32:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.288+0000 7fed0fcc2640 1 -- 172.21.15.52:0/2504754963 wait complete. 2024-09-10T14:32:19.307 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T14:32:19.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T14:32:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff735643640 1 Processor -- start 2024-09-10T14:32:19.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff735643640 1 -- start start 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff735643640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff73012e740 0x7ff730130b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff735643640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff730098840 con 0x7ff7301281c0 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff735643640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff73006f7b0 con 0x7ff73012e740 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff72effd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff7301281c0 0x7ff7301285a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45680/0 (socket says 172.21.15.52:45680) 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff72effd640 1 -- 172.21.15.52:0/1214610957 learned_addr learned my addr 172.21.15.52:0/1214610957 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff72e7fc640 1 --2- 172.21.15.52:0/1214610957 >> v2:172.21.15.52:3300/0 conn(0x7ff73012e740 0x7ff730130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff72dffb640 1 -- 172.21.15.52:0/1214610957 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922306102 0 0) 0x7ff730098840 con 0x7ff7301281c0 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff72dffb640 1 -- 172.21.15.52:0/1214610957 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff718003530 con 0x7ff7301281c0 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff72e7fc640 1 -- 172.21.15.52:0/1214610957 >> v1:172.21.15.52:6789/0 conn(0x7ff7301281c0 legacy=0x7ff7301285a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.428+0000 7ff72e7fc640 1 -- 172.21.15.52:0/1214610957 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff730127fa0 con 0x7ff73012e740 2024-09-10T14:32:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72e7fc640 1 --2- 172.21.15.52:0/1214610957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff73012e740 0x7ff730130b30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff724009740 tx=0x7ff72401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808f6d1d0e4db0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72dffb640 1 -- 172.21.15.52:0/1214610957 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240b0070 con 0x7ff73012e740 2024-09-10T14:32:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72dffb640 1 -- 172.21.15.52:0/1214610957 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7240ab530 con 0x7ff73012e740 2024-09-10T14:32:19.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72dffb640 1 -- 172.21.15.52:0/1214610957 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7240ab810 con 0x7ff73012e740 2024-09-10T14:32:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- 172.21.15.52:0/1214610957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff73012e740 msgr2=0x7ff730130b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 --2- 172.21.15.52:0/1214610957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff73012e740 0x7ff730130b30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff724009740 tx=0x7ff72401c310 comp rx=0 tx=0).stop 2024-09-10T14:32:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- 172.21.15.52:0/1214610957 shutdown_connections 2024-09-10T14:32:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 --2- 172.21.15.52:0/1214610957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff73012e740 0x7ff730130b30 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- 172.21.15.52:0/1214610957 >> 172.21.15.52:0/1214610957 conn(0x7ff7300998a0 msgr2=0x7ff730099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- 172.21.15.52:0/1214610957 shutdown_connections 2024-09-10T14:32:19.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- 172.21.15.52:0/1214610957 wait complete. 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 Processor -- start 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- start start 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7301281c0 0x7ff73012a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff730070960 con 0x7ff7301281c0 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7301281c0 0x7ff73012a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7301281c0 0x7ff73012a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39792/0 (socket says 172.21.15.52:39792) 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72effd640 1 -- 172.21.15.52:0/512790497 learned_addr learned my addr 172.21.15.52:0/512790497 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72effd640 1 -- 172.21.15.52:0/512790497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73012bce0 con 0x7ff7301281c0 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff72effd640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7301281c0 0x7ff73012a000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c3d0 tx=0x7ff72000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff720017070 con 0x7ff7301281c0 2024-09-10T14:32:19.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff720005ce0 con 0x7ff7301281c0 2024-09-10T14:32:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff730121b10 con 0x7ff7301281c0 2024-09-10T14:32:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7200070d0 con 0x7ff7301281c0 2024-09-10T14:32:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.432+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7301221a0 con 0x7ff7301281c0 2024-09-10T14:32:19.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff730131c40 con 0x7ff7301281c0 2024-09-10T14:32:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff72001a070 con 0x7ff7301281c0 2024-09-10T14:32:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff7177fe640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff71c035db0 0x7ff71c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ff7200485b0 con 0x7ff7301281c0 2024-09-10T14:32:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff7177fe640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff71c042220 0x7ff71c0446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff720016ec0 con 0x7ff71c042220 2024-09-10T14:32:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff72004f050 con 0x7ff7301281c0 2024-09-10T14:32:19.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff72e7fc640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff71c035db0 0x7ff71c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff72f7fe640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff71c042220 0x7ff71c0446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff72f7fe640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff71c042220 0x7ff71c0446c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff72e7fc640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff71c035db0 0x7ff71c038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff724009740 tx=0x7ff7240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.436+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 <== osd.2 v2:172.21.15.151:6816/2885613778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff720016ec0 con 0x7ff71c042220 2024-09-10T14:32:19.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 --> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff730074a40 con 0x7ff71c042220 2024-09-10T14:32:19.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff7177fe640 1 -- 172.21.15.52:0/512790497 <== osd.2 v2:172.21.15.151:6816/2885613778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff730074a40 con 0x7ff71c042220 2024-09-10T14:32:19.455 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T14:32:19.455 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T14:32:19.455 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T14:32:19.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff71c042220 msgr2=0x7ff71c0446c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff71c042220 0x7ff71c0446c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff71c035db0 msgr2=0x7ff71c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff71c035db0 0x7ff71c038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff724009740 tx=0x7ff7240a6000 comp rx=0 tx=0).stop 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7301281c0 msgr2=0x7ff73012a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7301281c0 0x7ff73012a000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c3d0 tx=0x7ff72000c890 comp rx=0 tx=0).stop 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 shutdown_connections 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6816/2885613778,v1:172.21.15.151:6817/2885613778] conn(0x7ff71c042220 0x7ff71c0446c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ff71c035db0 0x7ff71c038270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 --2- 172.21.15.52:0/512790497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7301281c0 0x7ff73012a000 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 >> 172.21.15.52:0/512790497 conn(0x7ff7300998a0 msgr2=0x7ff730071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 shutdown_connections 2024-09-10T14:32:19.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.452+0000 7ff735643640 1 -- 172.21.15.52:0/512790497 wait complete. 2024-09-10T14:32:19.471 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T14:32:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d80776640 1 Processor -- start 2024-09-10T14:32:19.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d80776640 1 -- start start 2024-09-10T14:32:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d80776640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d7812f390 0x7f8d78133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d80776640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d780984f0 con 0x7f8d7812e760 2024-09-10T14:32:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d80776640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8d78098dc0 con 0x7f8d7812f390 2024-09-10T14:32:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d7dd11640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d7812f390 0x7f8d78133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d7e512640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8d7812e760 0x7f8d7812ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45686/0 (socket says 172.21.15.52:45686) 2024-09-10T14:32:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d7dd11640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d7812f390 0x7f8d78133a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39806/0 (socket says 172.21.15.52:39806) 2024-09-10T14:32:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d7e512640 1 -- 172.21.15.52:0/3090527605 learned_addr learned my addr 172.21.15.52:0/3090527605 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d7dd11640 1 -- 172.21.15.52:0/3090527605 >> v1:172.21.15.52:6789/0 conn(0x7f8d7812e760 legacy=0x7f8d7812ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.584+0000 7f8d7dd11640 1 -- 172.21.15.52:0/3090527605 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d780981a0 con 0x7f8d7812f390 2024-09-10T14:32:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7dd11640 1 --2- 172.21.15.52:0/3090527605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812f390 0x7f8d78133a80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009740 tx=0x7f8d6801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79a54a08bee6802 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7d510640 1 -- 172.21.15.52:0/3090527605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d680b1070 con 0x7f8d7812f390 2024-09-10T14:32:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7d510640 1 -- 172.21.15.52:0/3090527605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d680ac570 con 0x7f8d7812f390 2024-09-10T14:32:19.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7d510640 1 -- 172.21.15.52:0/3090527605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d680ac870 con 0x7f8d7812f390 2024-09-10T14:32:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- 172.21.15.52:0/3090527605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812f390 msgr2=0x7f8d78133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 --2- 172.21.15.52:0/3090527605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812f390 0x7f8d78133a80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009740 tx=0x7f8d6801c400 comp rx=0 tx=0).stop 2024-09-10T14:32:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- 172.21.15.52:0/3090527605 shutdown_connections 2024-09-10T14:32:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 --2- 172.21.15.52:0/3090527605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812f390 0x7f8d78133a80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- 172.21.15.52:0/3090527605 >> 172.21.15.52:0/3090527605 conn(0x7f8d780a10a0 msgr2=0x7f8d780a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- 172.21.15.52:0/3090527605 shutdown_connections 2024-09-10T14:32:19.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- 172.21.15.52:0/3090527605 wait complete. 2024-09-10T14:32:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 Processor -- start 2024-09-10T14:32:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- start start 2024-09-10T14:32:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812e760 0x7f8d780963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78136b70 con 0x7f8d7812e760 2024-09-10T14:32:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7e512640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812e760 0x7f8d780963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7e512640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812e760 0x7f8d780963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39822/0 (socket says 172.21.15.52:39822) 2024-09-10T14:32:19.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7e512640 1 -- 172.21.15.52:0/3043007618 learned_addr learned my addr 172.21.15.52:0/3043007618 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:19.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7e512640 1 -- 172.21.15.52:0/3043007618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d78131730 con 0x7f8d7812e760 2024-09-10T14:32:19.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d7e512640 1 --2- 172.21.15.52:0/3043007618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812e760 0x7f8d780963d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400c480 tx=0x7f8d7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d6effd640 1 -- 172.21.15.52:0/3043007618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74017070 con 0x7f8d7812e760 2024-09-10T14:32:19.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d6effd640 1 -- 172.21.15.52:0/3043007618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74005c20 con 0x7f8d7812e760 2024-09-10T14:32:19.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d78128f50 con 0x7f8d7812e760 2024-09-10T14:32:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d6effd640 1 -- 172.21.15.52:0/3043007618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d74007070 con 0x7f8d7812e760 2024-09-10T14:32:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.588+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d78131da0 con 0x7f8d7812e760 2024-09-10T14:32:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.592+0000 7f8d6effd640 1 -- 172.21.15.52:0/3043007618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8d7401a070 con 0x7f8d7812e760 2024-09-10T14:32:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.592+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7812de00 con 0x7f8d7812e760 2024-09-10T14:32:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.592+0000 7f8d6effd640 1 --2- 172.21.15.52:0/3043007618 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d5c035e00 0x7f8d5c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.592+0000 7f8d6effd640 1 -- 172.21.15.52:0/3043007618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f8d74048490 con 0x7f8d7812e760 2024-09-10T14:32:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.592+0000 7f8d7dd11640 1 --2- 172.21.15.52:0/3043007618 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d5c035e00 0x7f8d5c0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.592+0000 7f8d7dd11640 1 --2- 172.21.15.52:0/3043007618 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d5c035e00 0x7f8d5c0382c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8d680ae000 tx=0x7f8d68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.596+0000 7f8d6effd640 1 -- 172.21.15.52:0/3043007618 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8d78131730 con 0x7f8d7812e760 2024-09-10T14:32:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.752+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f8d7812ec80 con 0x7f8d5c035e00 2024-09-10T14:32:19.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.752+0000 7f8d6effd640 1 -- 172.21.15.52:0/3043007618 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8d7812ec80 con 0x7f8d5c035e00 2024-09-10T14:32:19.758 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T14:32:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d5c035e00 msgr2=0x7f8d5c0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 --2- 172.21.15.52:0/3043007618 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d5c035e00 0x7f8d5c0382c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8d680ae000 tx=0x7f8d68008040 comp rx=0 tx=0).stop 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812e760 msgr2=0x7f8d780963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 --2- 172.21.15.52:0/3043007618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812e760 0x7f8d780963d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400c480 tx=0x7f8d7400c940 comp rx=0 tx=0).stop 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 shutdown_connections 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 --2- 172.21.15.52:0/3043007618 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f8d5c035e00 0x7f8d5c0382c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 --2- 172.21.15.52:0/3043007618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7812e760 0x7f8d780963d0 secure :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400c480 tx=0x7f8d7400c940 comp rx=0 tx=0).stop 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 >> 172.21.15.52:0/3043007618 conn(0x7f8d780a10a0 msgr2=0x7f8d780972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 shutdown_connections 2024-09-10T14:32:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.756+0000 7f8d80776640 1 -- 172.21.15.52:0/3043007618 wait complete. 2024-09-10T14:32:19.775 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T14:32:19.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T14:32:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6dfc785640 1 Processor -- start 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6dfc785640 1 -- start start 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6dfc785640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6df412be10 0x7f6df4130640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6dfc785640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df40704b0 con 0x7f6df412b320 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6dfc785640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6df4073470 con 0x7f6df412be10 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6df9d20640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6df412be10 0x7f6df4130640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6dfa521640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6df412b320 0x7f6df412b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45688/0 (socket says 172.21.15.52:45688) 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6dfa521640 1 -- 172.21.15.52:0/2540848761 learned_addr learned my addr 172.21.15.52:0/2540848761 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6df951f640 1 -- 172.21.15.52:0/2540848761 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589215669 0 0) 0x7f6df40704b0 con 0x7f6df412b320 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6df9d20640 1 -- 172.21.15.52:0/2540848761 >> v1:172.21.15.52:6789/0 conn(0x7f6df412b320 legacy=0x7f6df412b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6df9d20640 1 -- 172.21.15.52:0/2540848761 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df412c240 con 0x7f6df412be10 2024-09-10T14:32:19.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6df9d20640 1 --2- 172.21.15.52:0/2540848761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412be10 0x7f6df4130640 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009740 tx=0x7f6df001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b8b60fa0925f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6df951f640 1 -- 172.21.15.52:0/2540848761 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6df00b0070 con 0x7f6df412be10 2024-09-10T14:32:19.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6df951f640 1 -- 172.21.15.52:0/2540848761 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df00ab530 con 0x7f6df412be10 2024-09-10T14:32:19.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.900+0000 7f6df951f640 1 -- 172.21.15.52:0/2540848761 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6df00ab830 con 0x7f6df412be10 2024-09-10T14:32:19.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- 172.21.15.52:0/2540848761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412be10 msgr2=0x7f6df4130640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 --2- 172.21.15.52:0/2540848761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412be10 0x7f6df4130640 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009740 tx=0x7f6df001c400 comp rx=0 tx=0).stop 2024-09-10T14:32:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- 172.21.15.52:0/2540848761 shutdown_connections 2024-09-10T14:32:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 --2- 172.21.15.52:0/2540848761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412be10 0x7f6df4130640 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- 172.21.15.52:0/2540848761 >> 172.21.15.52:0/2540848761 conn(0x7f6df409ab20 msgr2=0x7f6df406d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- 172.21.15.52:0/2540848761 shutdown_connections 2024-09-10T14:32:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- 172.21.15.52:0/2540848761 wait complete. 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 Processor -- start 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- start start 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412b320 0x7f6df40970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41335b0 con 0x7f6df412b320 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfa521640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412b320 0x7f6df40970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfa521640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412b320 0x7f6df40970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39846/0 (socket says 172.21.15.52:39846) 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfa521640 1 -- 172.21.15.52:0/31285694 learned_addr learned my addr 172.21.15.52:0/31285694 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfa521640 1 -- 172.21.15.52:0/31285694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df412f1e0 con 0x7f6df412b320 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfa521640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412b320 0x7f6df40970a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c420 tx=0x7f6de400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de4018070 con 0x7f6df412b320 2024-09-10T14:32:19.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de40074d0 con 0x7f6df412b320 2024-09-10T14:32:19.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df412ee30 con 0x7f6df412b320 2024-09-10T14:32:19.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6de4004960 con 0x7f6df412b320 2024-09-10T14:32:19.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df4130150 con 0x7f6df412b320 2024-09-10T14:32:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6de401b070 con 0x7f6df412b320 2024-09-10T14:32:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6df40686b0 con 0x7f6df412b320 2024-09-10T14:32:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.904+0000 7f6deaffd640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6dd8035db0 0x7f6dd8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6de4048500 con 0x7f6df412b320 2024-09-10T14:32:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6deaffd640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f6dd8042220 0x7f6dd80446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:19.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6dd8044d90 con 0x7f6dd8042220 2024-09-10T14:32:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6de404f050 con 0x7f6df412b320 2024-09-10T14:32:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6df9d20640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6dd8035db0 0x7f6dd8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6dfad22640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f6dd8042220 0x7f6dd80446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6dfad22640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f6dd8042220 0x7f6dd80446c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6df9d20640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6dd8035db0 0x7f6dd8038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009740 tx=0x7f6df0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:19.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.908+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 <== osd.3 v2:172.21.15.151:6803/3136276598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6dd8044d90 con 0x7f6dd8042220 2024-09-10T14:32:19.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 --> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6df412b700 con 0x7f6dd8042220 2024-09-10T14:32:19.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6deaffd640 1 -- 172.21.15.52:0/31285694 <== osd.3 v2:172.21.15.151:6803/3136276598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6df412b700 con 0x7f6dd8042220 2024-09-10T14:32:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T14:32:19.927 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T14:32:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T14:32:19.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f6dd8042220 msgr2=0x7f6dd80446c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f6dd8042220 0x7f6dd80446c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6dd8035db0 msgr2=0x7f6dd8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6dd8035db0 0x7f6dd8038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009740 tx=0x7f6df0008040 comp rx=0 tx=0).stop 2024-09-10T14:32:19.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412b320 msgr2=0x7f6df40970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:19.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412b320 0x7f6df40970a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c420 tx=0x7f6de400c8e0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 shutdown_connections 2024-09-10T14:32:19.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6803/3136276598,v1:172.21.15.151:6805/3136276598] conn(0x7f6dd8042220 0x7f6dd80446c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6dd8035db0 0x7f6dd8038270 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 --2- 172.21.15.52:0/31285694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df412b320 0x7f6df40970a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:19.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 >> 172.21.15.52:0/31285694 conn(0x7f6df409ab20 msgr2=0x7f6df406bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:19.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 shutdown_connections 2024-09-10T14:32:19.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:19.924+0000 7f6dfc785640 1 -- 172.21.15.52:0/31285694 wait complete. 2024-09-10T14:32:19.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T14:32:20.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f625db13640 1 Processor -- start 2024-09-10T14:32:20.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f625db13640 1 -- start start 2024-09-10T14:32:20.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f625db13640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f625812d000 0x7f6258131a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:20.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f625db13640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62580927a0 con 0x7f625812c510 2024-09-10T14:32:20.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f625db13640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6258096e80 con 0x7f625812d000 2024-09-10T14:32:20.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f6256ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f625812d000 0x7f6258131a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:20.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f62577fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f625812c510 0x7f625812c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45702/0 (socket says 172.21.15.52:45702) 2024-09-10T14:32:20.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f62577fe640 1 -- 172.21.15.52:0/223928623 learned_addr learned my addr 172.21.15.52:0/223928623 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:20.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f62567fc640 1 -- 172.21.15.52:0/223928623 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833117718 0 0) 0x7f62580927a0 con 0x7f625812c510 2024-09-10T14:32:20.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f62567fc640 1 -- 172.21.15.52:0/223928623 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6240003530 con 0x7f625812c510 2024-09-10T14:32:20.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f6256ffd640 1 -- 172.21.15.52:0/223928623 >> v1:172.21.15.52:6789/0 conn(0x7f625812c510 legacy=0x7f625812c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:20.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.056+0000 7f6256ffd640 1 -- 172.21.15.52:0/223928623 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6258074ef0 con 0x7f625812d000 2024-09-10T14:32:20.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f6256ffd640 1 --2- 172.21.15.52:0/223928623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812d000 0x7f6258131a40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f624c009740 tx=0x7f624c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1d9265ce7a041e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:20.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f62567fc640 1 -- 172.21.15.52:0/223928623 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c0b0070 con 0x7f625812d000 2024-09-10T14:32:20.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f62567fc640 1 -- 172.21.15.52:0/223928623 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c0ab530 con 0x7f625812d000 2024-09-10T14:32:20.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f62567fc640 1 -- 172.21.15.52:0/223928623 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c0ab810 con 0x7f625812d000 2024-09-10T14:32:20.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 -- 172.21.15.52:0/223928623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812d000 msgr2=0x7f6258131a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:20.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 --2- 172.21.15.52:0/223928623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812d000 0x7f6258131a40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f624c009740 tx=0x7f624c01c370 comp rx=0 tx=0).stop 2024-09-10T14:32:20.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 -- 172.21.15.52:0/223928623 shutdown_connections 2024-09-10T14:32:20.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 --2- 172.21.15.52:0/223928623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812d000 0x7f6258131a40 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:20.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 -- 172.21.15.52:0/223928623 >> 172.21.15.52:0/223928623 conn(0x7f625809d4c0 msgr2=0x7f625809d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:20.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 -- 172.21.15.52:0/223928623 shutdown_connections 2024-09-10T14:32:20.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 -- 172.21.15.52:0/223928623 wait complete. 2024-09-10T14:32:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 Processor -- start 2024-09-10T14:32:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.060+0000 7f625db13640 1 -- start start 2024-09-10T14:32:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f625db13640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812c510 0x7f625808de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f625db13640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6258134b30 con 0x7f625812c510 2024-09-10T14:32:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f62577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812c510 0x7f625808de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f62577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812c510 0x7f625808de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39852/0 (socket says 172.21.15.52:39852) 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f62577fe640 1 -- 172.21.15.52:0/1186653343 learned_addr learned my addr 172.21.15.52:0/1186653343 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f62577fe640 1 -- 172.21.15.52:0/1186653343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625806d930 con 0x7f625812c510 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f62577fe640 1 --2- 172.21.15.52:0/1186653343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812c510 0x7f625808de60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f624800c3d0 tx=0x7f624800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f623ffff640 1 -- 172.21.15.52:0/1186653343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6248017070 con 0x7f625812c510 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f623ffff640 1 -- 172.21.15.52:0/1186653343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6248005ce0 con 0x7f625812c510 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6258090080 con 0x7f625812c510 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f623ffff640 1 -- 172.21.15.52:0/1186653343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62480070d0 con 0x7f625812c510 2024-09-10T14:32:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625808e3a0 con 0x7f625812c510 2024-09-10T14:32:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f623ffff640 1 -- 172.21.15.52:0/1186653343 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f624801a070 con 0x7f625812c510 2024-09-10T14:32:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6258093d50 con 0x7f625812c510 2024-09-10T14:32:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f623ffff640 1 --2- 172.21.15.52:0/1186653343 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6244035db0 0x7f6244038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f623ffff640 1 -- 172.21.15.52:0/1186653343 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f6248048670 con 0x7f625812c510 2024-09-10T14:32:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f6256ffd640 1 --2- 172.21.15.52:0/1186653343 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6244035db0 0x7f6244038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.064+0000 7f6256ffd640 1 --2- 172.21.15.52:0/1186653343 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6244035db0 0x7f6244038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f624c0ad000 tx=0x7f624c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:20.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.068+0000 7f623ffff640 1 -- 172.21.15.52:0/1186653343 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6258093d50 con 0x7f625812c510 2024-09-10T14:32:20.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.236+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f62580905d0 con 0x7f6244035db0 2024-09-10T14:32:20.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.236+0000 7f623ffff640 1 -- 172.21.15.52:0/1186653343 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f624c0b1040 con 0x7f6244035db0 2024-09-10T14:32:20.240 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T14:32:20.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6244035db0 msgr2=0x7f6244038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 --2- 172.21.15.52:0/1186653343 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6244035db0 0x7f6244038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f624c0ad000 tx=0x7f624c008040 comp rx=0 tx=0).stop 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812c510 msgr2=0x7f625808de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 --2- 172.21.15.52:0/1186653343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812c510 0x7f625808de60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f624800c3d0 tx=0x7f624800c890 comp rx=0 tx=0).stop 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 shutdown_connections 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 --2- 172.21.15.52:0/1186653343 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f6244035db0 0x7f6244038270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 --2- 172.21.15.52:0/1186653343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f625812c510 0x7f625808de60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 >> 172.21.15.52:0/1186653343 conn(0x7f625809d4c0 msgr2=0x7f625812da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 shutdown_connections 2024-09-10T14:32:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.240+0000 7f625db13640 1 -- 172.21.15.52:0/1186653343 wait complete. 2024-09-10T14:32:20.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:32:20.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.380+0000 7f145997d640 1 Processor -- start 2024-09-10T14:32:20.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.380+0000 7f145997d640 1 -- start start 2024-09-10T14:32:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.380+0000 7f145997d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f145412f390 0x7f1454133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.380+0000 7f145997d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14540984f0 con 0x7f145412e760 2024-09-10T14:32:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.380+0000 7f145997d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1454098dc0 con 0x7f145412f390 2024-09-10T14:32:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.380+0000 7f1452ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f145412e760 0x7f145412ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45716/0 (socket says 172.21.15.52:45716) 2024-09-10T14:32:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.380+0000 7f1452ffd640 1 -- 172.21.15.52:0/3332494943 learned_addr learned my addr 172.21.15.52:0/3332494943 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.380+0000 7f144bfff640 1 --2- 172.21.15.52:0/3332494943 >> v2:172.21.15.52:3300/0 conn(0x7f145412f390 0x7f1454133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f14527fc640 1 -- 172.21.15.52:0/3332494943 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985089013 0 0) 0x7f14540984f0 con 0x7f145412e760 2024-09-10T14:32:20.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f14527fc640 1 -- 172.21.15.52:0/3332494943 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1440003530 con 0x7f145412e760 2024-09-10T14:32:20.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f144bfff640 1 -- 172.21.15.52:0/3332494943 >> v1:172.21.15.52:6789/0 conn(0x7f145412e760 legacy=0x7f145412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:20.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f144bfff640 1 -- 172.21.15.52:0/3332494943 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14540981a0 con 0x7f145412f390 2024-09-10T14:32:20.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f144bfff640 1 --2- 172.21.15.52:0/3332494943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412f390 0x7f1454133a80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f143c009740 tx=0x7f143c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b062417144966b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:20.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f14527fc640 1 -- 172.21.15.52:0/3332494943 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f143c0b1070 con 0x7f145412f390 2024-09-10T14:32:20.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f14527fc640 1 -- 172.21.15.52:0/3332494943 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143c0ac570 con 0x7f145412f390 2024-09-10T14:32:20.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f14527fc640 1 -- 172.21.15.52:0/3332494943 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f143c0ac850 con 0x7f145412f390 2024-09-10T14:32:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f145997d640 1 -- 172.21.15.52:0/3332494943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412f390 msgr2=0x7f1454133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f145997d640 1 --2- 172.21.15.52:0/3332494943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412f390 0x7f1454133a80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f143c009740 tx=0x7f143c01c400 comp rx=0 tx=0).stop 2024-09-10T14:32:20.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f145997d640 1 -- 172.21.15.52:0/3332494943 shutdown_connections 2024-09-10T14:32:20.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f145997d640 1 --2- 172.21.15.52:0/3332494943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412f390 0x7f1454133a80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:20.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f145997d640 1 -- 172.21.15.52:0/3332494943 >> 172.21.15.52:0/3332494943 conn(0x7f14540a10a0 msgr2=0x7f14540a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:20.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f145997d640 1 -- 172.21.15.52:0/3332494943 shutdown_connections 2024-09-10T14:32:20.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.384+0000 7f145997d640 1 -- 172.21.15.52:0/3332494943 wait complete. 2024-09-10T14:32:20.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f145997d640 1 Processor -- start 2024-09-10T14:32:20.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f145997d640 1 -- start start 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f145997d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412e760 0x7f14540972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f145997d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1454136b70 con 0x7f145412e760 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1452ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412e760 0x7f14540972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1452ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412e760 0x7f14540972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39874/0 (socket says 172.21.15.52:39874) 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1452ffd640 1 -- 172.21.15.52:0/207044492 learned_addr learned my addr 172.21.15.52:0/207044492 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1452ffd640 1 -- 172.21.15.52:0/207044492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1454131150 con 0x7f145412e760 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1452ffd640 1 --2- 172.21.15.52:0/207044492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412e760 0x7f14540972f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f144400c3d0 tx=0x7f144400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1450ff9640 1 -- 172.21.15.52:0/207044492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1444017070 con 0x7f145412e760 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1450ff9640 1 -- 172.21.15.52:0/207044492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1444005ce0 con 0x7f145412e760 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1454132e30 con 0x7f145412e760 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1450ff9640 1 -- 172.21.15.52:0/207044492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14440070d0 con 0x7f145412e760 2024-09-10T14:32:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1454097830 con 0x7f145412e760 2024-09-10T14:32:20.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145412ec80 con 0x7f145412e760 2024-09-10T14:32:20.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1450ff9640 1 -- 172.21.15.52:0/207044492 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f144401a070 con 0x7f145412e760 2024-09-10T14:32:20.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1450ff9640 1 --2- 172.21.15.52:0/207044492 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1434035db0 0x7f1434038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:20.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f1450ff9640 1 -- 172.21.15.52:0/207044492 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f14440485a0 con 0x7f145412e760 2024-09-10T14:32:20.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f144bfff640 1 --2- 172.21.15.52:0/207044492 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1434035db0 0x7f1434038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:20.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.388+0000 7f144bfff640 1 --2- 172.21.15.52:0/207044492 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1434035db0 0x7f1434038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f143c0ae000 tx=0x7f143c0a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:20.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.392+0000 7f1450ff9640 1 -- 172.21.15.52:0/207044492 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1444019e10 con 0x7f145412e760 2024-09-10T14:32:20.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.548+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14541321e0 con 0x7f1434035db0 2024-09-10T14:32:20.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.592+0000 7f1450ff9640 1 -- 172.21.15.52:0/207044492 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666041 (secure 0 0 0) 0x7f143c0040c0 con 0x7f1434035db0 2024-09-10T14:32:20.605 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:32:20.611 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:32:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1434035db0 msgr2=0x7f1434038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 --2- 172.21.15.52:0/207044492 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1434035db0 0x7f1434038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f143c0ae000 tx=0x7f143c0a6070 comp rx=0 tx=0).stop 2024-09-10T14:32:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412e760 msgr2=0x7f14540972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 --2- 172.21.15.52:0/207044492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412e760 0x7f14540972f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f144400c3d0 tx=0x7f144400c890 comp rx=0 tx=0).stop 2024-09-10T14:32:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 shutdown_connections 2024-09-10T14:32:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 --2- 172.21.15.52:0/207044492 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1434035db0 0x7f1434038270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 --2- 172.21.15.52:0/207044492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145412e760 0x7f14540972f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 >> 172.21.15.52:0/207044492 conn(0x7f14540a10a0 msgr2=0x7f1454128080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 shutdown_connections 2024-09-10T14:32:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:20.604+0000 7f145997d640 1 -- 172.21.15.52:0/207044492 wait complete. 2024-09-10T14:32:20.622 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-10T14:32:18.797616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18036489,"num_objects":227,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4939,"num_read_kb":4514,"num_write":2124,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4512,"ondisk_log_size":4512,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165428,"kb_used_data":28208,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377321932,"statfs":{"total":386547056640,"available":386377658368,"internally_reserved":0,"allocated":28884992,"data_stored":27643423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8380416,"num_objects":-2,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":47,"num_read_kb":45,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006564"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786610+0000","last_change":"2024-09-10T14:28:28.910643+0000","last_active":"2024-09-10T14:29:08.786610+0000","last_peered":"2024-09-10T14:29:08.786610+0000","last_clean":"2024-09-10T14:29:08.786610+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:29:08.786610+0000","last_undegraded":"2024-09-10T14:29:08.786610+0000","last_fullsized":"2024-09-10T14:29:08.786610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:48.682064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743959+0000","last_change":"2024-09-10T14:28:30.866892+0000","last_active":"2024-09-10T14:29:15.743959+0000","last_peered":"2024-09-10T14:29:15.743959+0000","last_clean":"2024-09-10T14:29:15.743959+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:29:15.743959+0000","last_undegraded":"2024-09-10T14:29:15.743959+0000","last_fullsized":"2024-09-10T14:29:15.743959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.106885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.900665+0000","last_change":"2024-09-10T14:28:28.880130+0000","last_active":"2024-09-10T14:30:42.900665+0000","last_peered":"2024-09-10T14:30:42.900665+0000","last_clean":"2024-09-10T14:30:42.900665+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:30:42.900665+0000","last_undegraded":"2024-09-10T14:30:42.900665+0000","last_fullsized":"2024-09-10T14:30:42.900665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:27.360132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.874392+0000","last_change":"2024-09-10T14:28:30.882162+0000","last_active":"2024-09-10T14:31:43.874392+0000","last_peered":"2024-09-10T14:31:43.874392+0000","last_clean":"2024-09-10T14:31:43.874392+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:31:43.874392+0000","last_undegraded":"2024-09-10T14:31:43.874392+0000","last_fullsized":"2024-09-10T14:31:43.874392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:58.678590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779170+0000","last_change":"2024-09-10T14:28:28.879906+0000","last_active":"2024-09-10T14:29:08.779170+0000","last_peered":"2024-09-10T14:29:08.779170+0000","last_clean":"2024-09-10T14:29:08.779170+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:29:08.779170+0000","last_undegraded":"2024-09-10T14:29:08.779170+0000","last_fullsized":"2024-09-10T14:29:08.779170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:53.690949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072389+0000","last_change":"2024-09-10T14:28:30.882676+0000","last_active":"2024-09-10T14:31:44.072389+0000","last_peered":"2024-09-10T14:31:44.072389+0000","last_clean":"2024-09-10T14:31:44.072389+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:31:44.072389+0000","last_undegraded":"2024-09-10T14:31:44.072389+0000","last_fullsized":"2024-09-10T14:31:44.072389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:24.078737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.014030+0000","last_change":"2024-09-10T14:28:28.893233+0000","last_active":"2024-09-10T14:29:15.014030+0000","last_peered":"2024-09-10T14:29:15.014030+0000","last_clean":"2024-09-10T14:29:15.014030+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:29:15.014030+0000","last_undegraded":"2024-09-10T14:29:15.014030+0000","last_fullsized":"2024-09-10T14:29:15.014030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:24:11.076894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.045939+0000","last_change":"2024-09-10T14:28:30.881166+0000","last_active":"2024-09-10T14:30:39.045939+0000","last_peered":"2024-09-10T14:30:39.045939+0000","last_clean":"2024-09-10T14:30:39.045939+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:30:39.045939+0000","last_undegraded":"2024-09-10T14:30:39.045939+0000","last_fullsized":"2024-09-10T14:30:39.045939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:52.006581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770599+0000","last_change":"2024-09-10T14:28:28.883653+0000","last_active":"2024-09-10T14:29:08.770599+0000","last_peered":"2024-09-10T14:29:08.770599+0000","last_clean":"2024-09-10T14:29:08.770599+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:29:08.770599+0000","last_undegraded":"2024-09-10T14:29:08.770599+0000","last_fullsized":"2024-09-10T14:29:08.770599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:29.885799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.174109+0000","last_change":"2024-09-10T14:28:30.890087+0000","last_active":"2024-09-10T14:31:44.174109+0000","last_peered":"2024-09-10T14:31:44.174109+0000","last_clean":"2024-09-10T14:31:44.174109+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:31:44.174109+0000","last_undegraded":"2024-09-10T14:31:44.174109+0000","last_fullsized":"2024-09-10T14:31:44.174109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:24.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777518+0000","last_change":"2024-09-10T14:28:28.910148+0000","last_active":"2024-09-10T14:29:08.777518+0000","last_peered":"2024-09-10T14:29:08.777518+0000","last_clean":"2024-09-10T14:29:08.777518+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:29:08.777518+0000","last_undegraded":"2024-09-10T14:29:08.777518+0000","last_fullsized":"2024-09-10T14:29:08.777518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:47.128454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.736734+0000","last_change":"2024-09-10T14:28:30.875024+0000","last_active":"2024-09-10T14:31:43.736734+0000","last_peered":"2024-09-10T14:31:43.736734+0000","last_clean":"2024-09-10T14:31:43.736734+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:31:43.736734+0000","last_undegraded":"2024-09-10T14:31:43.736734+0000","last_fullsized":"2024-09-10T14:31:43.736734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:47.679026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770570+0000","last_change":"2024-09-10T14:28:28.890726+0000","last_active":"2024-09-10T14:29:08.770570+0000","last_peered":"2024-09-10T14:29:08.770570+0000","last_clean":"2024-09-10T14:29:08.770570+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:29:08.770570+0000","last_undegraded":"2024-09-10T14:29:08.770570+0000","last_fullsized":"2024-09-10T14:29:08.770570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:31.814715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'7","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.774452+0000","last_change":"2024-09-10T14:28:30.863498+0000","last_active":"2024-09-10T14:30:39.774452+0000","last_peered":"2024-09-10T14:30:39.774452+0000","last_clean":"2024-09-10T14:30:39.774452+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:30:39.774452+0000","last_undegraded":"2024-09-10T14:30:39.774452+0000","last_fullsized":"2024-09-10T14:30:39.774452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:34.818610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.089975+0000","last_change":"2024-09-10T14:28:28.876209+0000","last_active":"2024-09-10T14:29:09.089975+0000","last_peered":"2024-09-10T14:29:09.089975+0000","last_clean":"2024-09-10T14:29:09.089975+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:29:09.089975+0000","last_undegraded":"2024-09-10T14:29:09.089975+0000","last_fullsized":"2024-09-10T14:29:09.089975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:23.440776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.735816+0000","last_change":"2024-09-10T14:28:30.870535+0000","last_active":"2024-09-10T14:31:43.735816+0000","last_peered":"2024-09-10T14:31:43.735816+0000","last_clean":"2024-09-10T14:31:43.735816+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:31:43.735816+0000","last_undegraded":"2024-09-10T14:31:43.735816+0000","last_fullsized":"2024-09-10T14:31:43.735816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:16.469019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158427+0000","last_change":"2024-09-10T14:28:30.875126+0000","last_active":"2024-09-10T14:31:44.158427+0000","last_peered":"2024-09-10T14:31:44.158427+0000","last_clean":"2024-09-10T14:31:44.158427+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:31:44.158427+0000","last_undegraded":"2024-09-10T14:31:44.158427+0000","last_fullsized":"2024-09-10T14:31:44.158427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:31.392667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.790246+0000","last_change":"2024-09-10T14:28:28.902646+0000","last_active":"2024-09-10T14:29:08.790246+0000","last_peered":"2024-09-10T14:29:08.790246+0000","last_clean":"2024-09-10T14:29:08.790246+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:29:08.790246+0000","last_undegraded":"2024-09-10T14:29:08.790246+0000","last_fullsized":"2024-09-10T14:29:08.790246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:06.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071851+0000","last_change":"2024-09-10T14:28:30.871743+0000","last_active":"2024-09-10T14:31:44.071851+0000","last_peered":"2024-09-10T14:31:44.071851+0000","last_clean":"2024-09-10T14:31:44.071851+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:31:44.071851+0000","last_undegraded":"2024-09-10T14:31:44.071851+0000","last_fullsized":"2024-09-10T14:31:44.071851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:02.612612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788313+0000","last_change":"2024-09-10T14:28:28.913772+0000","last_active":"2024-09-10T14:29:08.788313+0000","last_peered":"2024-09-10T14:29:08.788313+0000","last_clean":"2024-09-10T14:29:08.788313+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:29:08.788313+0000","last_undegraded":"2024-09-10T14:29:08.788313+0000","last_fullsized":"2024-09-10T14:29:08.788313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:33.401745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.731033+0000","last_change":"2024-09-10T14:28:30.866947+0000","last_active":"2024-09-10T14:31:43.731033+0000","last_peered":"2024-09-10T14:31:43.731033+0000","last_clean":"2024-09-10T14:31:43.731033+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:31:43.731033+0000","last_undegraded":"2024-09-10T14:31:43.731033+0000","last_fullsized":"2024-09-10T14:31:43.731033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:33.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787811+0000","last_change":"2024-09-10T14:28:28.904198+0000","last_active":"2024-09-10T14:29:08.787811+0000","last_peered":"2024-09-10T14:29:08.787811+0000","last_clean":"2024-09-10T14:29:08.787811+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:29:08.787811+0000","last_undegraded":"2024-09-10T14:29:08.787811+0000","last_fullsized":"2024-09-10T14:29:08.787811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.028308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071682+0000","last_change":"2024-09-10T14:28:30.886686+0000","last_active":"2024-09-10T14:31:44.071682+0000","last_peered":"2024-09-10T14:31:44.071682+0000","last_clean":"2024-09-10T14:31:44.071682+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:44.071682+0000","last_undegraded":"2024-09-10T14:31:44.071682+0000","last_fullsized":"2024-09-10T14:31:44.071682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:43.469877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.020496+0000","last_change":"2024-09-10T14:28:28.888634+0000","last_active":"2024-09-10T14:29:15.020496+0000","last_peered":"2024-09-10T14:29:15.020496+0000","last_clean":"2024-09-10T14:29:15.020496+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:29:15.020496+0000","last_undegraded":"2024-09-10T14:29:15.020496+0000","last_fullsized":"2024-09-10T14:29:15.020496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:53.922561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158256+0000","last_change":"2024-09-10T14:28:30.870293+0000","last_active":"2024-09-10T14:31:44.158256+0000","last_peered":"2024-09-10T14:31:44.158256+0000","last_clean":"2024-09-10T14:31:44.158256+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:31:44.158256+0000","last_undegraded":"2024-09-10T14:31:44.158256+0000","last_fullsized":"2024-09-10T14:31:44.158256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:43.141173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.026158+0000","last_change":"2024-09-10T14:28:28.880689+0000","last_active":"2024-09-10T14:29:15.026158+0000","last_peered":"2024-09-10T14:29:15.026158+0000","last_clean":"2024-09-10T14:29:15.026158+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:29:15.026158+0000","last_undegraded":"2024-09-10T14:29:15.026158+0000","last_fullsized":"2024-09-10T14:29:15.026158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:06.449097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.046094+0000","last_change":"2024-09-10T14:28:30.889817+0000","last_active":"2024-09-10T14:30:39.046094+0000","last_peered":"2024-09-10T14:30:39.046094+0000","last_clean":"2024-09-10T14:30:39.046094+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:30:39.046094+0000","last_undegraded":"2024-09-10T14:30:39.046094+0000","last_fullsized":"2024-09-10T14:30:39.046094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:39.111758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770582+0000","last_change":"2024-09-10T14:28:28.891649+0000","last_active":"2024-09-10T14:29:08.770582+0000","last_peered":"2024-09-10T14:29:08.770582+0000","last_clean":"2024-09-10T14:29:08.770582+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:29:08.770582+0000","last_undegraded":"2024-09-10T14:29:08.770582+0000","last_fullsized":"2024-09-10T14:29:08.770582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:27.536920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.117237+0000","last_change":"2024-09-10T14:28:38.936524+0000","last_active":"2024-09-10T14:31:44.117237+0000","last_peered":"2024-09-10T14:31:44.117237+0000","last_clean":"2024-09-10T14:31:44.117237+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:31:44.117237+0000","last_undegraded":"2024-09-10T14:31:44.117237+0000","last_fullsized":"2024-09-10T14:31:44.117237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:46.216225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.756204+0000","last_change":"2024-09-10T14:29:07.798075+0000","last_active":"2024-09-10T14:29:09.756204+0000","last_peered":"2024-09-10T14:29:09.756204+0000","last_clean":"2024-09-10T14:29:09.756204+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:29:09.756204+0000","last_undegraded":"2024-09-10T14:29:09.756204+0000","last_fullsized":"2024-09-10T14:29:09.756204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:42.171906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770128+0000","last_change":"2024-09-10T14:28:28.894485+0000","last_active":"2024-09-10T14:29:08.770128+0000","last_peered":"2024-09-10T14:29:08.770128+0000","last_clean":"2024-09-10T14:29:08.770128+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:29:08.770128+0000","last_undegraded":"2024-09-10T14:29:08.770128+0000","last_fullsized":"2024-09-10T14:29:08.770128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:00.603357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776839+0000","last_change":"2024-09-10T14:28:32.888789+0000","last_active":"2024-09-10T14:29:08.776839+0000","last_peered":"2024-09-10T14:29:08.776839+0000","last_clean":"2024-09-10T14:29:08.776839+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:29:08.776839+0000","last_undegraded":"2024-09-10T14:29:08.776839+0000","last_fullsized":"2024-09-10T14:29:08.776839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:23.555023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'31","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.122649+0000","last_change":"2024-09-10T14:28:34.924424+0000","last_active":"2024-09-10T14:30:41.122649+0000","last_peered":"2024-09-10T14:30:41.122649+0000","last_clean":"2024-09-10T14:30:41.122649+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:30:41.122649+0000","last_undegraded":"2024-09-10T14:30:41.122649+0000","last_fullsized":"2024-09-10T14:30:41.122649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:02.869350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.790013+0000","last_change":"2024-09-10T14:28:36.938810+0000","last_active":"2024-09-10T14:29:08.790013+0000","last_peered":"2024-09-10T14:29:08.790013+0000","last_clean":"2024-09-10T14:29:08.790013+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:29:08.790013+0000","last_undegraded":"2024-09-10T14:29:08.790013+0000","last_fullsized":"2024-09-10T14:29:08.790013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:28.542198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.081040+0000","last_change":"2024-09-10T14:28:38.938155+0000","last_active":"2024-09-10T14:29:58.081040+0000","last_peered":"2024-09-10T14:29:58.081040+0000","last_clean":"2024-09-10T14:29:58.081040+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:29:58.081040+0000","last_undegraded":"2024-09-10T14:29:58.081040+0000","last_fullsized":"2024-09-10T14:29:58.081040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:16.961180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.731924+0000","last_change":"2024-09-10T14:28:30.876193+0000","last_active":"2024-09-10T14:31:43.731924+0000","last_peered":"2024-09-10T14:31:43.731924+0000","last_clean":"2024-09-10T14:31:43.731924+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:31:43.731924+0000","last_undegraded":"2024-09-10T14:31:43.731924+0000","last_fullsized":"2024-09-10T14:31:43.731924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.676792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776547+0000","last_change":"2024-09-10T14:28:28.895357+0000","last_active":"2024-09-10T14:30:49.776547+0000","last_peered":"2024-09-10T14:30:49.776547+0000","last_clean":"2024-09-10T14:30:49.776547+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:30:49.776547+0000","last_undegraded":"2024-09-10T14:30:49.776547+0000","last_fullsized":"2024-09-10T14:30:49.776547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:01.503117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099939+0000","last_change":"2024-09-10T14:28:32.878643+0000","last_active":"2024-09-10T14:29:09.099939+0000","last_peered":"2024-09-10T14:29:09.099939+0000","last_clean":"2024-09-10T14:29:09.099939+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:29:09.099939+0000","last_undegraded":"2024-09-10T14:29:09.099939+0000","last_fullsized":"2024-09-10T14:29:09.099939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:36:40.671350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788992+0000","last_change":"2024-09-10T14:28:34.889859+0000","last_active":"2024-09-10T14:29:08.788992+0000","last_peered":"2024-09-10T14:29:08.788992+0000","last_clean":"2024-09-10T14:29:08.788992+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:29:08.788992+0000","last_undegraded":"2024-09-10T14:29:08.788992+0000","last_fullsized":"2024-09-10T14:29:08.788992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:01.183310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788847+0000","last_change":"2024-09-10T14:28:36.934864+0000","last_active":"2024-09-10T14:29:08.788847+0000","last_peered":"2024-09-10T14:29:08.788847+0000","last_clean":"2024-09-10T14:29:08.788847+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:29:08.788847+0000","last_undegraded":"2024-09-10T14:29:08.788847+0000","last_fullsized":"2024-09-10T14:29:08.788847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.099079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095653+0000","last_change":"2024-09-10T14:28:38.928569+0000","last_active":"2024-09-10T14:29:09.095653+0000","last_peered":"2024-09-10T14:29:09.095653+0000","last_clean":"2024-09-10T14:29:09.095653+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:29:09.095653+0000","last_undegraded":"2024-09-10T14:29:09.095653+0000","last_fullsized":"2024-09-10T14:29:09.095653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:44.292475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787199+0000","last_change":"2024-09-10T14:28:30.879918+0000","last_active":"2024-09-10T14:30:58.787199+0000","last_peered":"2024-09-10T14:30:58.787199+0000","last_clean":"2024-09-10T14:30:58.787199+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:30:58.787199+0000","last_undegraded":"2024-09-10T14:30:58.787199+0000","last_fullsized":"2024-09-10T14:30:58.787199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:58.593808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784157+0000","last_change":"2024-09-10T14:28:28.890448+0000","last_active":"2024-09-10T14:30:48.784157+0000","last_peered":"2024-09-10T14:30:48.784157+0000","last_clean":"2024-09-10T14:30:48.784157+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:30:48.784157+0000","last_undegraded":"2024-09-10T14:30:48.784157+0000","last_fullsized":"2024-09-10T14:30:48.784157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:42.170026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.105820+0000","last_change":"2024-09-10T14:28:32.878770+0000","last_active":"2024-09-10T14:29:09.105820+0000","last_peered":"2024-09-10T14:29:09.105820+0000","last_clean":"2024-09-10T14:29:09.105820+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:29:09.105820+0000","last_undegraded":"2024-09-10T14:29:09.105820+0000","last_fullsized":"2024-09-10T14:29:09.105820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.818547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.780586+0000","last_change":"2024-09-10T14:28:34.899375+0000","last_active":"2024-09-10T14:29:08.780586+0000","last_peered":"2024-09-10T14:29:08.780586+0000","last_clean":"2024-09-10T14:29:08.780586+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:29:08.780586+0000","last_undegraded":"2024-09-10T14:29:08.780586+0000","last_fullsized":"2024-09-10T14:29:08.780586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:03:14.006039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120357+0000","last_change":"2024-09-10T14:28:36.944400+0000","last_active":"2024-09-10T14:31:43.120357+0000","last_peered":"2024-09-10T14:31:43.120357+0000","last_clean":"2024-09-10T14:31:43.120357+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:31:43.120357+0000","last_undegraded":"2024-09-10T14:31:43.120357+0000","last_fullsized":"2024-09-10T14:31:43.120357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:47.650335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.039826+0000","last_change":"2024-09-10T14:28:38.944662+0000","last_active":"2024-09-10T14:29:15.039826+0000","last_peered":"2024-09-10T14:29:15.039826+0000","last_clean":"2024-09-10T14:29:15.039826+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:29:15.039826+0000","last_undegraded":"2024-09-10T14:29:15.039826+0000","last_fullsized":"2024-09-10T14:29:15.039826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:11.695801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'5","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.888919+0000","last_change":"2024-09-10T14:28:30.884927+0000","last_active":"2024-09-10T14:31:43.888919+0000","last_peered":"2024-09-10T14:31:43.888919+0000","last_clean":"2024-09-10T14:31:43.888919+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:31:43.888919+0000","last_undegraded":"2024-09-10T14:31:43.888919+0000","last_fullsized":"2024-09-10T14:31:43.888919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:44.179281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.775615+0000","last_change":"2024-09-10T14:28:28.898609+0000","last_active":"2024-09-10T14:29:08.775615+0000","last_peered":"2024-09-10T14:29:08.775615+0000","last_clean":"2024-09-10T14:29:08.775615+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:29:08.775615+0000","last_undegraded":"2024-09-10T14:29:08.775615+0000","last_fullsized":"2024-09-10T14:29:08.775615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:14.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'4","reported_seq":228,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.577706+0000","last_change":"2024-09-10T14:28:32.888011+0000","last_active":"2024-09-10T14:30:42.577706+0000","last_peered":"2024-09-10T14:30:42.577706+0000","last_clean":"2024-09-10T14:30:42.577706+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:30:42.577706+0000","last_undegraded":"2024-09-10T14:30:42.577706+0000","last_fullsized":"2024-09-10T14:30:42.577706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:37.315922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.114910+0000","last_change":"2024-09-10T14:28:34.904591+0000","last_active":"2024-09-10T14:30:41.114910+0000","last_peered":"2024-09-10T14:30:41.114910+0000","last_clean":"2024-09-10T14:30:41.114910+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:30:41.114910+0000","last_undegraded":"2024-09-10T14:30:41.114910+0000","last_fullsized":"2024-09-10T14:30:41.114910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:15.929628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":407,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.222665+0000","last_change":"2024-09-10T14:28:36.902535+0000","last_active":"2024-09-10T14:32:15.222665+0000","last_peered":"2024-09-10T14:32:15.222665+0000","last_clean":"2024-09-10T14:32:15.222665+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:32:15.222665+0000","last_undegraded":"2024-09-10T14:32:15.222665+0000","last_fullsized":"2024-09-10T14:32:15.222665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:44.147166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.731663+0000","last_change":"2024-09-10T14:28:30.870811+0000","last_active":"2024-09-10T14:29:14.731663+0000","last_peered":"2024-09-10T14:29:14.731663+0000","last_clean":"2024-09-10T14:29:14.731663+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:29:14.731663+0000","last_undegraded":"2024-09-10T14:29:14.731663+0000","last_fullsized":"2024-09-10T14:29:14.731663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:38.431813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786131+0000","last_change":"2024-09-10T14:28:28.910600+0000","last_active":"2024-09-10T14:29:08.786131+0000","last_peered":"2024-09-10T14:29:08.786131+0000","last_clean":"2024-09-10T14:29:08.786131+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:29:08.786131+0000","last_undegraded":"2024-09-10T14:29:08.786131+0000","last_fullsized":"2024-09-10T14:29:08.786131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:28.271184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776997+0000","last_change":"2024-09-10T14:28:32.888462+0000","last_active":"2024-09-10T14:29:08.776997+0000","last_peered":"2024-09-10T14:29:08.776997+0000","last_clean":"2024-09-10T14:29:08.776997+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:29:08.776997+0000","last_undegraded":"2024-09-10T14:29:08.776997+0000","last_fullsized":"2024-09-10T14:29:08.776997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:33.818547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.128780+0000","last_change":"2024-09-10T14:28:34.891163+0000","last_active":"2024-09-10T14:30:41.128780+0000","last_peered":"2024-09-10T14:30:41.128780+0000","last_clean":"2024-09-10T14:30:41.128780+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:30:41.128780+0000","last_undegraded":"2024-09-10T14:30:41.128780+0000","last_fullsized":"2024-09-10T14:30:41.128780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:43.916591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095295+0000","last_change":"2024-09-10T14:28:36.914343+0000","last_active":"2024-09-10T14:29:09.095295+0000","last_peered":"2024-09-10T14:29:09.095295+0000","last_clean":"2024-09-10T14:29:09.095295+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:29:09.095295+0000","last_undegraded":"2024-09-10T14:29:09.095295+0000","last_fullsized":"2024-09-10T14:29:09.095295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:44.165530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.084003+0000","last_change":"2024-09-10T14:28:38.934568+0000","last_active":"2024-09-10T14:29:58.084003+0000","last_peered":"2024-09-10T14:29:58.084003+0000","last_clean":"2024-09-10T14:29:58.084003+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:29:58.084003+0000","last_undegraded":"2024-09-10T14:29:58.084003+0000","last_fullsized":"2024-09-10T14:29:58.084003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:16.561899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.781133+0000","last_change":"2024-09-10T14:28:30.867445+0000","last_active":"2024-09-10T14:30:43.781133+0000","last_peered":"2024-09-10T14:30:43.781133+0000","last_clean":"2024-09-10T14:30:43.781133+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:30:43.781133+0000","last_undegraded":"2024-09-10T14:30:43.781133+0000","last_fullsized":"2024-09-10T14:30:43.781133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:43.469877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786715+0000","last_change":"2024-09-10T14:28:28.895275+0000","last_active":"2024-09-10T14:29:08.786715+0000","last_peered":"2024-09-10T14:29:08.786715+0000","last_clean":"2024-09-10T14:29:08.786715+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:29:08.786715+0000","last_undegraded":"2024-09-10T14:29:08.786715+0000","last_fullsized":"2024-09-10T14:29:08.786715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.143838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096657+0000","last_change":"2024-09-10T14:28:32.877092+0000","last_active":"2024-09-10T14:29:09.096657+0000","last_peered":"2024-09-10T14:29:09.096657+0000","last_clean":"2024-09-10T14:29:09.096657+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:29:09.096657+0000","last_undegraded":"2024-09-10T14:29:09.096657+0000","last_fullsized":"2024-09-10T14:29:09.096657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:27.977679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'30","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.100623+0000","last_change":"2024-09-10T14:28:34.915801+0000","last_active":"2024-09-10T14:30:41.100623+0000","last_peered":"2024-09-10T14:30:41.100623+0000","last_clean":"2024-09-10T14:30:41.100623+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:30:41.100623+0000","last_undegraded":"2024-09-10T14:30:41.100623+0000","last_fullsized":"2024-09-10T14:30:41.100623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:45.906678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.090834+0000","last_change":"2024-09-10T14:28:36.924324+0000","last_active":"2024-09-10T14:29:09.090834+0000","last_peered":"2024-09-10T14:29:09.090834+0000","last_clean":"2024-09-10T14:29:09.090834+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:29:09.090834+0000","last_undegraded":"2024-09-10T14:29:09.090834+0000","last_fullsized":"2024-09-10T14:29:09.090834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:03.128287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'5","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:52.401551+0000","last_change":"2024-09-10T14:28:38.933258+0000","last_active":"2024-09-10T14:29:52.401551+0000","last_peered":"2024-09-10T14:29:52.401551+0000","last_clean":"2024-09-10T14:29:52.401551+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:29:52.401551+0000","last_undegraded":"2024-09-10T14:29:52.401551+0000","last_fullsized":"2024-09-10T14:29:52.401551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:44.292475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.156496+0000","last_change":"2024-09-10T14:29:07.803940+0000","last_active":"2024-09-10T14:31:44.156496+0000","last_peered":"2024-09-10T14:31:44.156496+0000","last_clean":"2024-09-10T14:31:44.156496+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:31:44.156496+0000","last_undegraded":"2024-09-10T14:31:44.156496+0000","last_fullsized":"2024-09-10T14:31:44.156496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:14.995711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778671+0000","last_change":"2024-09-10T14:28:28.889610+0000","last_active":"2024-09-10T14:29:08.778671+0000","last_peered":"2024-09-10T14:29:08.778671+0000","last_clean":"2024-09-10T14:29:08.778671+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:29:08.778671+0000","last_undegraded":"2024-09-10T14:29:08.778671+0000","last_fullsized":"2024-09-10T14:29:08.778671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:27.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099744+0000","last_change":"2024-09-10T14:28:32.877306+0000","last_active":"2024-09-10T14:29:09.099744+0000","last_peered":"2024-09-10T14:29:09.099744+0000","last_clean":"2024-09-10T14:29:09.099744+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:29:09.099744+0000","last_undegraded":"2024-09-10T14:29:09.099744+0000","last_fullsized":"2024-09-10T14:29:09.099744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:59.002429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.130848+0000","last_change":"2024-09-10T14:28:34.910458+0000","last_active":"2024-09-10T14:30:41.130848+0000","last_peered":"2024-09-10T14:30:41.130848+0000","last_clean":"2024-09-10T14:30:41.130848+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:30:41.130848+0000","last_undegraded":"2024-09-10T14:30:41.130848+0000","last_fullsized":"2024-09-10T14:30:41.130848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:11.614047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":360,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.225066+0000","last_change":"2024-09-10T14:28:36.924500+0000","last_active":"2024-09-10T14:32:15.225066+0000","last_peered":"2024-09-10T14:32:15.225066+0000","last_clean":"2024-09-10T14:32:15.225066+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:32:15.225066+0000","last_undegraded":"2024-09-10T14:32:15.225066+0000","last_fullsized":"2024-09-10T14:32:15.225066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:18.061873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.102731+0000","last_change":"2024-09-10T14:28:38.936021+0000","last_active":"2024-09-10T14:29:09.102731+0000","last_peered":"2024-09-10T14:29:09.102731+0000","last_clean":"2024-09-10T14:29:09.102731+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:29:09.102731+0000","last_undegraded":"2024-09-10T14:29:09.102731+0000","last_fullsized":"2024-09-10T14:29:09.102731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'11","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776609+0000","last_change":"2024-09-10T14:28:30.859489+0000","last_active":"2024-09-10T14:30:49.776609+0000","last_peered":"2024-09-10T14:30:49.776609+0000","last_clean":"2024-09-10T14:30:49.776609+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:30:49.776609+0000","last_undegraded":"2024-09-10T14:30:49.776609+0000","last_fullsized":"2024-09-10T14:30:49.776609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:12.219239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770620+0000","last_change":"2024-09-10T14:28:28.884739+0000","last_active":"2024-09-10T14:29:08.770620+0000","last_peered":"2024-09-10T14:29:08.770620+0000","last_clean":"2024-09-10T14:29:08.770620+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:29:08.770620+0000","last_undegraded":"2024-09-10T14:29:08.770620+0000","last_fullsized":"2024-09-10T14:29:08.770620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:09.370531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"26'1","reported_seq":222,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.175858+0000","last_change":"2024-09-10T14:28:32.883434+0000","last_active":"2024-09-10T14:32:15.175858+0000","last_peered":"2024-09-10T14:32:15.175858+0000","last_clean":"2024-09-10T14:32:15.175858+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:32:15.175858+0000","last_undegraded":"2024-09-10T14:32:15.175858+0000","last_fullsized":"2024-09-10T14:32:15.175858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:15.866979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'55","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.132850+0000","last_change":"2024-09-10T14:28:34.914638+0000","last_active":"2024-09-10T14:30:41.132850+0000","last_peered":"2024-09-10T14:30:41.132850+0000","last_clean":"2024-09-10T14:30:41.132850+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:30:41.132850+0000","last_undegraded":"2024-09-10T14:30:41.132850+0000","last_fullsized":"2024-09-10T14:30:41.132850+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:09.979440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.092054+0000","last_change":"2024-09-10T14:28:36.903930+0000","last_active":"2024-09-10T14:29:09.092054+0000","last_peered":"2024-09-10T14:29:09.092054+0000","last_clean":"2024-09-10T14:29:09.092054+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:29:09.092054+0000","last_undegraded":"2024-09-10T14:29:09.092054+0000","last_fullsized":"2024-09-10T14:29:09.092054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:07.331691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'20","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.381980+0000","last_change":"2024-09-10T14:28:38.919907+0000","last_active":"2024-09-10T14:31:44.381980+0000","last_peered":"2024-09-10T14:31:44.381980+0000","last_clean":"2024-09-10T14:31:44.381980+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:31:44.381980+0000","last_undegraded":"2024-09-10T14:31:44.381980+0000","last_fullsized":"2024-09-10T14:31:44.381980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:42:57.760263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.889287+0000","last_change":"2024-09-10T14:28:30.878590+0000","last_active":"2024-09-10T14:31:43.889287+0000","last_peered":"2024-09-10T14:31:43.889287+0000","last_clean":"2024-09-10T14:31:43.889287+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:31:43.889287+0000","last_undegraded":"2024-09-10T14:31:43.889287+0000","last_fullsized":"2024-09-10T14:31:43.889287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:29:43.722443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096578+0000","last_change":"2024-09-10T14:28:28.877127+0000","last_active":"2024-09-10T14:29:09.096578+0000","last_peered":"2024-09-10T14:29:09.096578+0000","last_clean":"2024-09-10T14:29:09.096578+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:29:09.096578+0000","last_undegraded":"2024-09-10T14:29:09.096578+0000","last_fullsized":"2024-09-10T14:29:09.096578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:00.704953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.785811+0000","last_change":"2024-09-10T14:28:32.878178+0000","last_active":"2024-09-10T14:29:08.785811+0000","last_peered":"2024-09-10T14:29:08.785811+0000","last_clean":"2024-09-10T14:29:08.785811+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:29:08.785811+0000","last_undegraded":"2024-09-10T14:29:08.785811+0000","last_fullsized":"2024-09-10T14:29:08.785811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:56.990523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.105783+0000","last_change":"2024-09-10T14:28:34.889384+0000","last_active":"2024-09-10T14:30:41.105783+0000","last_peered":"2024-09-10T14:30:41.105783+0000","last_clean":"2024-09-10T14:30:41.105783+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:30:41.105783+0000","last_undegraded":"2024-09-10T14:30:41.105783+0000","last_fullsized":"2024-09-10T14:30:41.105783+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:56.353841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779998+0000","last_change":"2024-09-10T14:28:36.946071+0000","last_active":"2024-09-10T14:29:08.779998+0000","last_peered":"2024-09-10T14:29:08.779998+0000","last_clean":"2024-09-10T14:29:08.779998+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:29:08.779998+0000","last_undegraded":"2024-09-10T14:29:08.779998+0000","last_fullsized":"2024-09-10T14:29:08.779998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:45.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:40.722091+0000","last_change":"2024-09-10T14:28:38.941887+0000","last_active":"2024-09-10T14:30:40.722091+0000","last_peered":"2024-09-10T14:30:40.722091+0000","last_clean":"2024-09-10T14:30:40.722091+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:30:40.722091+0000","last_undegraded":"2024-09-10T14:30:40.722091+0000","last_fullsized":"2024-09-10T14:30:40.722091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:09.738406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.376108+0000","last_change":"2024-09-10T14:28:30.890869+0000","last_active":"2024-09-10T14:29:58.376108+0000","last_peered":"2024-09-10T14:29:58.376108+0000","last_clean":"2024-09-10T14:29:58.376108+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:29:58.376108+0000","last_undegraded":"2024-09-10T14:29:58.376108+0000","last_fullsized":"2024-09-10T14:29:58.376108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:33.087704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.490899+0000","last_change":"2024-09-10T14:28:28.891910+0000","last_active":"2024-09-10T14:29:13.490899+0000","last_peered":"2024-09-10T14:29:13.490899+0000","last_clean":"2024-09-10T14:29:13.490899+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:29:13.490899+0000","last_undegraded":"2024-09-10T14:29:13.490899+0000","last_fullsized":"2024-09-10T14:29:13.490899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:44.681521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.099970+0000","last_change":"2024-09-10T14:28:32.877582+0000","last_active":"2024-09-10T14:29:09.099970+0000","last_peered":"2024-09-10T14:29:09.099970+0000","last_clean":"2024-09-10T14:29:09.099970+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:29:09.099970+0000","last_undegraded":"2024-09-10T14:29:09.099970+0000","last_fullsized":"2024-09-10T14:29:09.099970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:31.749719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.144934+0000","last_change":"2024-09-10T14:28:34.898334+0000","last_active":"2024-09-10T14:30:41.144934+0000","last_peered":"2024-09-10T14:30:41.144934+0000","last_clean":"2024-09-10T14:30:41.144934+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:30:41.144934+0000","last_undegraded":"2024-09-10T14:30:41.144934+0000","last_fullsized":"2024-09-10T14:30:41.144934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:56.399053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.408033+0000","last_change":"2024-09-10T14:28:36.937021+0000","last_active":"2024-09-10T14:31:44.408033+0000","last_peered":"2024-09-10T14:31:44.408033+0000","last_clean":"2024-09-10T14:31:44.408033+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:31:44.408033+0000","last_undegraded":"2024-09-10T14:31:44.408033+0000","last_fullsized":"2024-09-10T14:31:44.408033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:41.213212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776838+0000","last_change":"2024-09-10T14:28:38.936015+0000","last_active":"2024-09-10T14:30:47.776838+0000","last_peered":"2024-09-10T14:30:47.776838+0000","last_clean":"2024-09-10T14:30:47.776838+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:30:47.776838+0000","last_undegraded":"2024-09-10T14:30:47.776838+0000","last_fullsized":"2024-09-10T14:30:47.776838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:08.718072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.734924+0000","last_change":"2024-09-10T14:28:30.869152+0000","last_active":"2024-09-10T14:31:43.734924+0000","last_peered":"2024-09-10T14:31:43.734924+0000","last_clean":"2024-09-10T14:31:43.734924+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:31:43.734924+0000","last_undegraded":"2024-09-10T14:31:43.734924+0000","last_fullsized":"2024-09-10T14:31:43.734924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:29.230753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.213357+0000","last_change":"2024-09-10T14:28:28.890431+0000","last_active":"2024-09-10T14:31:44.213357+0000","last_peered":"2024-09-10T14:31:44.213357+0000","last_clean":"2024-09-10T14:31:44.213357+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:31:44.213357+0000","last_undegraded":"2024-09-10T14:31:44.213357+0000","last_fullsized":"2024-09-10T14:31:44.213357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:22.573383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.590739+0000","last_change":"2024-09-10T14:28:32.884446+0000","last_active":"2024-09-10T14:30:42.590739+0000","last_peered":"2024-09-10T14:30:42.590739+0000","last_clean":"2024-09-10T14:30:42.590739+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:30:42.590739+0000","last_undegraded":"2024-09-10T14:30:42.590739+0000","last_fullsized":"2024-09-10T14:30:42.590739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:15.273266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777108+0000","last_change":"2024-09-10T14:28:34.926311+0000","last_active":"2024-09-10T14:29:08.777108+0000","last_peered":"2024-09-10T14:29:08.777108+0000","last_clean":"2024-09-10T14:29:08.777108+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:29:08.777108+0000","last_undegraded":"2024-09-10T14:29:08.777108+0000","last_fullsized":"2024-09-10T14:29:08.777108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:40.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":462,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.335621+0000","last_change":"2024-09-10T14:28:36.922620+0000","last_active":"2024-09-10T14:31:44.335621+0000","last_peered":"2024-09-10T14:31:44.335621+0000","last_clean":"2024-09-10T14:31:44.335621+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:31:44.335621+0000","last_undegraded":"2024-09-10T14:31:44.335621+0000","last_fullsized":"2024-09-10T14:31:44.335621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:18.061873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.752153+0000","last_change":"2024-09-10T14:28:38.929142+0000","last_active":"2024-09-10T14:30:42.752153+0000","last_peered":"2024-09-10T14:30:42.752153+0000","last_clean":"2024-09-10T14:30:42.752153+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:30:42.752153+0000","last_undegraded":"2024-09-10T14:30:42.752153+0000","last_fullsized":"2024-09-10T14:30:42.752153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:15.327806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.324515+0000","last_change":"2024-09-10T14:28:30.889847+0000","last_active":"2024-09-10T14:31:44.324515+0000","last_peered":"2024-09-10T14:31:44.324515+0000","last_clean":"2024-09-10T14:31:44.324515+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:31:44.324515+0000","last_undegraded":"2024-09-10T14:31:44.324515+0000","last_fullsized":"2024-09-10T14:31:44.324515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:48.295547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768939+0000","last_change":"2024-09-10T14:28:28.894339+0000","last_active":"2024-09-10T14:29:08.768939+0000","last_peered":"2024-09-10T14:29:08.768939+0000","last_clean":"2024-09-10T14:29:08.768939+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:29:08.768939+0000","last_undegraded":"2024-09-10T14:29:08.768939+0000","last_fullsized":"2024-09-10T14:29:08.768939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:03.473546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779727+0000","last_change":"2024-09-10T14:28:32.891418+0000","last_active":"2024-09-10T14:29:08.779727+0000","last_peered":"2024-09-10T14:29:08.779727+0000","last_clean":"2024-09-10T14:29:08.779727+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:29:08.779727+0000","last_undegraded":"2024-09-10T14:29:08.779727+0000","last_fullsized":"2024-09-10T14:29:08.779727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:11.007860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'39","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783888+0000","last_change":"2024-09-10T14:28:34.889216+0000","last_active":"2024-09-10T14:30:53.783888+0000","last_peered":"2024-09-10T14:30:53.783888+0000","last_clean":"2024-09-10T14:30:53.783888+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:30:53.783888+0000","last_undegraded":"2024-09-10T14:30:53.783888+0000","last_fullsized":"2024-09-10T14:30:53.783888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:53.887819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778786+0000","last_change":"2024-09-10T14:28:36.938371+0000","last_active":"2024-09-10T14:29:08.778786+0000","last_peered":"2024-09-10T14:29:08.778786+0000","last_clean":"2024-09-10T14:29:08.778786+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:29:08.778786+0000","last_undegraded":"2024-09-10T14:29:08.778786+0000","last_fullsized":"2024-09-10T14:29:08.778786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:53.099481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.294156+0000","last_change":"2024-09-10T14:28:38.912768+0000","last_active":"2024-09-10T14:31:44.294156+0000","last_peered":"2024-09-10T14:31:44.294156+0000","last_clean":"2024-09-10T14:31:44.294156+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:31:44.294156+0000","last_undegraded":"2024-09-10T14:31:44.294156+0000","last_fullsized":"2024-09-10T14:31:44.294156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:20.861557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158954+0000","last_change":"2024-09-10T14:28:30.890682+0000","last_active":"2024-09-10T14:31:44.158954+0000","last_peered":"2024-09-10T14:31:44.158954+0000","last_clean":"2024-09-10T14:31:44.158954+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:31:44.158954+0000","last_undegraded":"2024-09-10T14:31:44.158954+0000","last_fullsized":"2024-09-10T14:31:44.158954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:17.279062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774963+0000","last_change":"2024-09-10T14:28:16.789816+0000","last_active":"2024-09-10T14:29:08.774963+0000","last_peered":"2024-09-10T14:29:08.774963+0000","last_clean":"2024-09-10T14:29:08.774963+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:29:08.774963+0000","last_undegraded":"2024-09-10T14:29:08.774963+0000","last_fullsized":"2024-09-10T14:29:08.774963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_clean_scrub_stamp":"2024-09-10T14:28:14.781430+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:16.536869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770870+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:29:08.770870+0000","last_peered":"2024-09-10T14:29:08.770870+0000","last_clean":"2024-09-10T14:29:08.770870+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:29:08.770870+0000","last_undegraded":"2024-09-10T14:29:08.770870+0000","last_fullsized":"2024-09-10T14:29:08.770870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:14.334391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.049324+0000","last_change":"2024-09-10T14:28:28.892198+0000","last_active":"2024-09-10T14:30:43.049324+0000","last_peered":"2024-09-10T14:30:43.049324+0000","last_clean":"2024-09-10T14:30:43.049324+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:30:43.049324+0000","last_undegraded":"2024-09-10T14:30:43.049324+0000","last_fullsized":"2024-09-10T14:30:43.049324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:02.556246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782315+0000","last_change":"2024-09-10T14:28:32.883286+0000","last_active":"2024-09-10T14:29:08.782315+0000","last_peered":"2024-09-10T14:29:08.782315+0000","last_clean":"2024-09-10T14:29:08.782315+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:29:08.782315+0000","last_undegraded":"2024-09-10T14:29:08.782315+0000","last_fullsized":"2024-09-10T14:29:08.782315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:49.691689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.140053+0000","last_change":"2024-09-10T14:28:34.925793+0000","last_active":"2024-09-10T14:30:41.140053+0000","last_peered":"2024-09-10T14:30:41.140053+0000","last_clean":"2024-09-10T14:30:41.140053+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:30:41.140053+0000","last_undegraded":"2024-09-10T14:30:41.140053+0000","last_fullsized":"2024-09-10T14:30:41.140053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:01.653420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095816+0000","last_change":"2024-09-10T14:28:36.925074+0000","last_active":"2024-09-10T14:29:09.095816+0000","last_peered":"2024-09-10T14:29:09.095816+0000","last_clean":"2024-09-10T14:29:09.095816+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:29:09.095816+0000","last_undegraded":"2024-09-10T14:29:09.095816+0000","last_fullsized":"2024-09-10T14:29:09.095816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:41.342463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.251835+0000","last_change":"2024-09-10T14:28:38.925950+0000","last_active":"2024-09-10T14:31:44.251835+0000","last_peered":"2024-09-10T14:31:44.251835+0000","last_clean":"2024-09-10T14:31:44.251835+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:31:44.251835+0000","last_undegraded":"2024-09-10T14:31:44.251835+0000","last_fullsized":"2024-09-10T14:31:44.251835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:06.497323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.378012+0000","last_change":"2024-09-10T14:28:30.878284+0000","last_active":"2024-09-10T14:29:58.378012+0000","last_peered":"2024-09-10T14:29:58.378012+0000","last_clean":"2024-09-10T14:29:58.378012+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:29:58.378012+0000","last_undegraded":"2024-09-10T14:29:58.378012+0000","last_fullsized":"2024-09-10T14:29:58.378012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:59.147562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768179+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:29:08.768179+0000","last_peered":"2024-09-10T14:29:08.768179+0000","last_clean":"2024-09-10T14:29:08.768179+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:29:08.768179+0000","last_undegraded":"2024-09-10T14:29:08.768179+0000","last_fullsized":"2024-09-10T14:29:08.768179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:11.168974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.048843+0000","last_change":"2024-09-10T14:28:28.873736+0000","last_active":"2024-09-10T14:31:44.048843+0000","last_peered":"2024-09-10T14:31:44.048843+0000","last_clean":"2024-09-10T14:31:44.048843+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:31:44.048843+0000","last_undegraded":"2024-09-10T14:31:44.048843+0000","last_fullsized":"2024-09-10T14:31:44.048843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:43.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782694+0000","last_change":"2024-09-10T14:28:32.888517+0000","last_active":"2024-09-10T14:29:08.782694+0000","last_peered":"2024-09-10T14:29:08.782694+0000","last_clean":"2024-09-10T14:29:08.782694+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:29:08.782694+0000","last_undegraded":"2024-09-10T14:29:08.782694+0000","last_fullsized":"2024-09-10T14:29:08.782694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:38.805133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'275","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.095600+0000","last_change":"2024-09-10T14:28:34.894665+0000","last_active":"2024-09-10T14:31:44.095600+0000","last_peered":"2024-09-10T14:31:44.095600+0000","last_clean":"2024-09-10T14:31:44.095600+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:31:44.095600+0000","last_undegraded":"2024-09-10T14:31:44.095600+0000","last_fullsized":"2024-09-10T14:31:44.095600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.418477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772230+0000","last_change":"2024-09-10T14:28:36.943974+0000","last_active":"2024-09-10T14:29:08.772230+0000","last_peered":"2024-09-10T14:29:08.772230+0000","last_clean":"2024-09-10T14:29:08.772230+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:29:08.772230+0000","last_undegraded":"2024-09-10T14:29:08.772230+0000","last_fullsized":"2024-09-10T14:29:08.772230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:48.045691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.777348+0000","last_change":"2024-09-10T14:28:38.943158+0000","last_active":"2024-09-10T14:31:43.777348+0000","last_peered":"2024-09-10T14:31:43.777348+0000","last_clean":"2024-09-10T14:31:43.777348+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:31:43.777348+0000","last_undegraded":"2024-09-10T14:31:43.777348+0000","last_fullsized":"2024-09-10T14:31:43.777348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:00.825733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.730417+0000","last_change":"2024-09-10T14:28:30.884260+0000","last_active":"2024-09-10T14:29:14.730417+0000","last_peered":"2024-09-10T14:29:14.730417+0000","last_clean":"2024-09-10T14:29:14.730417+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:29:14.730417+0000","last_undegraded":"2024-09-10T14:29:14.730417+0000","last_fullsized":"2024-09-10T14:29:14.730417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:55.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774556+0000","last_change":"2024-09-10T14:28:21.859213+0000","last_active":"2024-09-10T14:29:08.774556+0000","last_peered":"2024-09-10T14:29:08.774556+0000","last_clean":"2024-09-10T14:29:08.774556+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:29:08.774556+0000","last_undegraded":"2024-09-10T14:29:08.774556+0000","last_fullsized":"2024-09-10T14:29:08.774556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:40:49.580804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.058535+0000","last_change":"2024-09-10T14:28:28.874080+0000","last_active":"2024-09-10T14:31:44.058535+0000","last_peered":"2024-09-10T14:31:44.058535+0000","last_clean":"2024-09-10T14:31:44.058535+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:31:44.058535+0000","last_undegraded":"2024-09-10T14:31:44.058535+0000","last_fullsized":"2024-09-10T14:31:44.058535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:55.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786046+0000","last_change":"2024-09-10T14:28:32.871141+0000","last_active":"2024-09-10T14:29:08.786046+0000","last_peered":"2024-09-10T14:29:08.786046+0000","last_clean":"2024-09-10T14:29:08.786046+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:29:08.786046+0000","last_undegraded":"2024-09-10T14:29:08.786046+0000","last_fullsized":"2024-09-10T14:29:08.786046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:19.367394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'16","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120964+0000","last_change":"2024-09-10T14:28:34.884708+0000","last_active":"2024-09-10T14:31:43.120964+0000","last_peered":"2024-09-10T14:31:43.120964+0000","last_clean":"2024-09-10T14:31:43.120964+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:31:43.120964+0000","last_undegraded":"2024-09-10T14:31:43.120964+0000","last_fullsized":"2024-09-10T14:31:43.120964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:58.578905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093499+0000","last_change":"2024-09-10T14:28:36.924713+0000","last_active":"2024-09-10T14:29:09.093499+0000","last_peered":"2024-09-10T14:29:09.093499+0000","last_clean":"2024-09-10T14:29:09.093499+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:29:09.093499+0000","last_undegraded":"2024-09-10T14:29:09.093499+0000","last_fullsized":"2024-09-10T14:29:09.093499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:20.981089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768748+0000","last_change":"2024-09-10T14:28:38.943308+0000","last_active":"2024-09-10T14:29:08.768748+0000","last_peered":"2024-09-10T14:29:08.768748+0000","last_clean":"2024-09-10T14:29:08.768748+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:29:08.768748+0000","last_undegraded":"2024-09-10T14:29:08.768748+0000","last_fullsized":"2024-09-10T14:29:08.768748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:31.252411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227454+0000","last_change":"2024-09-10T14:28:30.863131+0000","last_active":"2024-09-10T14:31:44.227454+0000","last_peered":"2024-09-10T14:31:44.227454+0000","last_clean":"2024-09-10T14:31:44.227454+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:31:44.227454+0000","last_undegraded":"2024-09-10T14:31:44.227454+0000","last_fullsized":"2024-09-10T14:31:44.227454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:11.379786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769438+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:29:08.769438+0000","last_peered":"2024-09-10T14:29:08.769438+0000","last_clean":"2024-09-10T14:29:08.769438+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:29:08.769438+0000","last_undegraded":"2024-09-10T14:29:08.769438+0000","last_fullsized":"2024-09-10T14:29:08.769438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:08.712711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.779372+0000","last_change":"2024-09-10T14:28:28.892687+0000","last_active":"2024-09-10T14:29:08.779372+0000","last_peered":"2024-09-10T14:29:08.779372+0000","last_clean":"2024-09-10T14:29:08.779372+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:29:08.779372+0000","last_undegraded":"2024-09-10T14:29:08.779372+0000","last_fullsized":"2024-09-10T14:29:08.779372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:29.232546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.102198+0000","last_change":"2024-09-10T14:28:32.885999+0000","last_active":"2024-09-10T14:29:09.102198+0000","last_peered":"2024-09-10T14:29:09.102198+0000","last_clean":"2024-09-10T14:29:09.102198+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:29:09.102198+0000","last_undegraded":"2024-09-10T14:29:09.102198+0000","last_fullsized":"2024-09-10T14:29:09.102198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.742700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.142906+0000","last_change":"2024-09-10T14:28:34.924692+0000","last_active":"2024-09-10T14:31:43.142906+0000","last_peered":"2024-09-10T14:31:43.142906+0000","last_clean":"2024-09-10T14:31:43.142906+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:31:43.142906+0000","last_undegraded":"2024-09-10T14:31:43.142906+0000","last_fullsized":"2024-09-10T14:31:43.142906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:53.353299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782310+0000","last_change":"2024-09-10T14:28:36.943077+0000","last_active":"2024-09-10T14:29:08.782310+0000","last_peered":"2024-09-10T14:29:08.782310+0000","last_clean":"2024-09-10T14:29:08.782310+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:29:08.782310+0000","last_undegraded":"2024-09-10T14:29:08.782310+0000","last_fullsized":"2024-09-10T14:29:08.782310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:11.353120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.729145+0000","last_change":"2024-09-10T14:28:38.927597+0000","last_active":"2024-09-10T14:30:42.729145+0000","last_peered":"2024-09-10T14:30:42.729145+0000","last_clean":"2024-09-10T14:30:42.729145+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:30:42.729145+0000","last_undegraded":"2024-09-10T14:30:42.729145+0000","last_fullsized":"2024-09-10T14:30:42.729145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:59.259272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777851+0000","last_change":"2024-09-10T14:28:30.886735+0000","last_active":"2024-09-10T14:29:08.777851+0000","last_peered":"2024-09-10T14:29:08.777851+0000","last_clean":"2024-09-10T14:29:08.777851+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:29:08.777851+0000","last_undegraded":"2024-09-10T14:29:08.777851+0000","last_fullsized":"2024-09-10T14:29:08.777851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:55.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:34.773656+0000","last_change":"2024-09-10T14:28:28.911271+0000","last_active":"2024-09-10T14:30:34.773656+0000","last_peered":"2024-09-10T14:30:34.773656+0000","last_clean":"2024-09-10T14:30:34.773656+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:30:34.773656+0000","last_undegraded":"2024-09-10T14:30:34.773656+0000","last_fullsized":"2024-09-10T14:30:34.773656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:46.166561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.100259+0000","last_change":"2024-09-10T14:28:21.327700+0000","last_active":"2024-09-10T14:29:09.100259+0000","last_peered":"2024-09-10T14:29:09.100259+0000","last_clean":"2024-09-10T14:29:09.100259+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:29:09.100259+0000","last_undegraded":"2024-09-10T14:29:09.100259+0000","last_fullsized":"2024-09-10T14:29:09.100259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:52.160130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:14.782591+0000","last_change":"2024-09-10T14:29:07.784812+0000","last_active":"2024-09-10T14:31:14.782591+0000","last_peered":"2024-09-10T14:31:14.782591+0000","last_clean":"2024-09-10T14:31:14.782591+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:31:14.782591+0000","last_undegraded":"2024-09-10T14:31:14.782591+0000","last_fullsized":"2024-09-10T14:31:14.782591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:59.688011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'67","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.419392+0000","last_change":"2024-09-10T14:28:34.893626+0000","last_active":"2024-09-10T14:32:15.419392+0000","last_peered":"2024-09-10T14:32:15.419392+0000","last_clean":"2024-09-10T14:32:15.419392+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:32:15.419392+0000","last_undegraded":"2024-09-10T14:32:15.419392+0000","last_fullsized":"2024-09-10T14:32:15.419392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:28.104547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772307+0000","last_change":"2024-09-10T14:28:36.918342+0000","last_active":"2024-09-10T14:29:08.772307+0000","last_peered":"2024-09-10T14:29:08.772307+0000","last_clean":"2024-09-10T14:29:08.772307+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:29:08.772307+0000","last_undegraded":"2024-09-10T14:29:08.772307+0000","last_fullsized":"2024-09-10T14:29:08.772307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:03.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.974036+0000","last_change":"2024-09-10T14:28:38.924566+0000","last_active":"2024-09-10T14:30:42.974036+0000","last_peered":"2024-09-10T14:30:42.974036+0000","last_clean":"2024-09-10T14:30:42.974036+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:30:42.974036+0000","last_undegraded":"2024-09-10T14:30:42.974036+0000","last_fullsized":"2024-09-10T14:30:42.974036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:23.222217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227882+0000","last_change":"2024-09-10T14:28:30.889728+0000","last_active":"2024-09-10T14:31:44.227882+0000","last_peered":"2024-09-10T14:31:44.227882+0000","last_clean":"2024-09-10T14:31:44.227882+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:31:44.227882+0000","last_undegraded":"2024-09-10T14:31:44.227882+0000","last_fullsized":"2024-09-10T14:31:44.227882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:49.183418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093061+0000","last_change":"2024-09-10T14:28:28.907627+0000","last_active":"2024-09-10T14:29:09.093061+0000","last_peered":"2024-09-10T14:29:09.093061+0000","last_clean":"2024-09-10T14:29:09.093061+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:29:09.093061+0000","last_undegraded":"2024-09-10T14:29:09.093061+0000","last_fullsized":"2024-09-10T14:29:09.093061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:11.996924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777696+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:29:08.777696+0000","last_peered":"2024-09-10T14:29:08.777696+0000","last_clean":"2024-09-10T14:29:08.777696+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:29:08.777696+0000","last_undegraded":"2024-09-10T14:29:08.777696+0000","last_fullsized":"2024-09-10T14:29:08.777696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:21.647103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768826+0000","last_change":"2024-09-10T14:28:32.882261+0000","last_active":"2024-09-10T14:29:08.768826+0000","last_peered":"2024-09-10T14:29:08.768826+0000","last_clean":"2024-09-10T14:29:08.768826+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:29:08.768826+0000","last_undegraded":"2024-09-10T14:29:08.768826+0000","last_fullsized":"2024-09-10T14:29:08.768826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:59.101746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.075406+0000","last_change":"2024-09-10T14:28:34.901236+0000","last_active":"2024-09-10T14:29:58.075406+0000","last_peered":"2024-09-10T14:29:58.075406+0000","last_clean":"2024-09-10T14:29:58.075406+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:29:58.075406+0000","last_undegraded":"2024-09-10T14:29:58.075406+0000","last_fullsized":"2024-09-10T14:29:58.075406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:02.704400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":377,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.238990+0000","last_change":"2024-09-10T14:28:36.904472+0000","last_active":"2024-09-10T14:31:44.238990+0000","last_peered":"2024-09-10T14:31:44.238990+0000","last_clean":"2024-09-10T14:31:44.238990+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:31:44.238990+0000","last_undegraded":"2024-09-10T14:31:44.238990+0000","last_fullsized":"2024-09-10T14:31:44.238990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:07.331691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.268320+0000","last_change":"2024-09-10T14:28:38.937953+0000","last_active":"2024-09-10T14:31:43.268320+0000","last_peered":"2024-09-10T14:31:43.268320+0000","last_clean":"2024-09-10T14:31:43.268320+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:31:43.268320+0000","last_undegraded":"2024-09-10T14:31:43.268320+0000","last_fullsized":"2024-09-10T14:31:43.268320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:24.662394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743534+0000","last_change":"2024-09-10T14:28:30.888495+0000","last_active":"2024-09-10T14:29:15.743534+0000","last_peered":"2024-09-10T14:29:15.743534+0000","last_clean":"2024-09-10T14:29:15.743534+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:29:15.743534+0000","last_undegraded":"2024-09-10T14:29:15.743534+0000","last_fullsized":"2024-09-10T14:29:15.743534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:49.862009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.684814+0000","last_change":"2024-09-10T14:28:28.891219+0000","last_active":"2024-09-10T14:31:43.684814+0000","last_peered":"2024-09-10T14:31:43.684814+0000","last_clean":"2024-09-10T14:31:43.684814+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:31:43.684814+0000","last_undegraded":"2024-09-10T14:31:43.684814+0000","last_fullsized":"2024-09-10T14:31:43.684814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:24.892549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.103352+0000","last_change":"2024-09-10T14:28:21.327784+0000","last_active":"2024-09-10T14:29:09.103352+0000","last_peered":"2024-09-10T14:29:09.103352+0000","last_clean":"2024-09-10T14:29:09.103352+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:29:09.103352+0000","last_undegraded":"2024-09-10T14:29:09.103352+0000","last_fullsized":"2024-09-10T14:29:09.103352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:00.563029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769359+0000","last_change":"2024-09-10T14:28:32.881624+0000","last_active":"2024-09-10T14:29:08.769359+0000","last_peered":"2024-09-10T14:29:08.769359+0000","last_clean":"2024-09-10T14:29:08.769359+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:29:08.769359+0000","last_undegraded":"2024-09-10T14:29:08.769359+0000","last_fullsized":"2024-09-10T14:29:08.769359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:40.120625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.771369+0000","last_change":"2024-09-10T14:28:34.914868+0000","last_active":"2024-09-10T14:29:08.771369+0000","last_peered":"2024-09-10T14:29:08.771369+0000","last_clean":"2024-09-10T14:29:08.771369+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:29:08.771369+0000","last_undegraded":"2024-09-10T14:29:08.771369+0000","last_fullsized":"2024-09-10T14:29:08.771369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:28.103142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":395,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.220656+0000","last_change":"2024-09-10T14:28:36.902307+0000","last_active":"2024-09-10T14:32:15.220656+0000","last_peered":"2024-09-10T14:32:15.220656+0000","last_clean":"2024-09-10T14:32:15.220656+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:32:15.220656+0000","last_undegraded":"2024-09-10T14:32:15.220656+0000","last_fullsized":"2024-09-10T14:32:15.220656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:28.542198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781543+0000","last_change":"2024-09-10T14:28:38.934660+0000","last_active":"2024-09-10T14:29:08.781543+0000","last_peered":"2024-09-10T14:29:08.781543+0000","last_clean":"2024-09-10T14:29:08.781543+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:29:08.781543+0000","last_undegraded":"2024-09-10T14:29:08.781543+0000","last_fullsized":"2024-09-10T14:29:08.781543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:50:08.718072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227593+0000","last_change":"2024-09-10T14:28:30.872139+0000","last_active":"2024-09-10T14:31:44.227593+0000","last_peered":"2024-09-10T14:31:44.227593+0000","last_clean":"2024-09-10T14:31:44.227593+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:31:44.227593+0000","last_undegraded":"2024-09-10T14:31:44.227593+0000","last_fullsized":"2024-09-10T14:31:44.227593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:13.634815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.023364+0000","last_change":"2024-09-10T14:28:28.904513+0000","last_active":"2024-09-10T14:31:44.023364+0000","last_peered":"2024-09-10T14:31:44.023364+0000","last_clean":"2024-09-10T14:31:44.023364+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:31:44.023364+0000","last_undegraded":"2024-09-10T14:31:44.023364+0000","last_fullsized":"2024-09-10T14:31:44.023364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:05.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782794+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:29:08.782794+0000","last_peered":"2024-09-10T14:29:08.782794+0000","last_clean":"2024-09-10T14:29:08.782794+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:29:08.782794+0000","last_undegraded":"2024-09-10T14:29:08.782794+0000","last_fullsized":"2024-09-10T14:29:08.782794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:40:58.045195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.767895+0000","last_change":"2024-09-10T14:28:32.878971+0000","last_active":"2024-09-10T14:29:08.767895+0000","last_peered":"2024-09-10T14:29:08.767895+0000","last_clean":"2024-09-10T14:29:08.767895+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:29:08.767895+0000","last_undegraded":"2024-09-10T14:29:08.767895+0000","last_fullsized":"2024-09-10T14:29:08.767895+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:24.515657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'83","reported_seq":157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.111766+0000","last_change":"2024-09-10T14:28:34.903982+0000","last_active":"2024-09-10T14:30:41.111766+0000","last_peered":"2024-09-10T14:30:41.111766+0000","last_clean":"2024-09-10T14:30:41.111766+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:30:41.111766+0000","last_undegraded":"2024-09-10T14:30:41.111766+0000","last_fullsized":"2024-09-10T14:30:41.111766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:45.622257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.095336+0000","last_change":"2024-09-10T14:28:36.903264+0000","last_active":"2024-09-10T14:29:09.095336+0000","last_peered":"2024-09-10T14:29:09.095336+0000","last_clean":"2024-09-10T14:29:09.095336+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:29:09.095336+0000","last_undegraded":"2024-09-10T14:29:09.095336+0000","last_fullsized":"2024-09-10T14:29:09.095336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:26.562499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786817+0000","last_change":"2024-09-10T14:28:38.930196+0000","last_active":"2024-09-10T14:29:08.786817+0000","last_peered":"2024-09-10T14:29:08.786817+0000","last_clean":"2024-09-10T14:29:08.786817+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:29:08.786817+0000","last_undegraded":"2024-09-10T14:29:08.786817+0000","last_fullsized":"2024-09-10T14:29:08.786817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:55.481810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.069321+0000","last_change":"2024-09-10T14:28:38.944786+0000","last_active":"2024-09-10T14:29:58.069321+0000","last_peered":"2024-09-10T14:29:58.069321+0000","last_clean":"2024-09-10T14:29:58.069321+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:29:58.069321+0000","last_undegraded":"2024-09-10T14:29:58.069321+0000","last_fullsized":"2024-09-10T14:29:58.069321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:23.466063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071514+0000","last_change":"2024-09-10T14:28:30.877107+0000","last_active":"2024-09-10T14:31:44.071514+0000","last_peered":"2024-09-10T14:31:44.071514+0000","last_clean":"2024-09-10T14:31:44.071514+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:31:44.071514+0000","last_undegraded":"2024-09-10T14:31:44.071514+0000","last_fullsized":"2024-09-10T14:31:44.071514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:01.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.032703+0000","last_change":"2024-09-10T14:28:28.890437+0000","last_active":"2024-09-10T14:31:44.032703+0000","last_peered":"2024-09-10T14:31:44.032703+0000","last_clean":"2024-09-10T14:31:44.032703+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:31:44.032703+0000","last_undegraded":"2024-09-10T14:31:44.032703+0000","last_fullsized":"2024-09-10T14:31:44.032703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.203261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777010+0000","last_change":"2024-09-10T14:28:32.883682+0000","last_active":"2024-09-10T14:29:08.777010+0000","last_peered":"2024-09-10T14:29:08.777010+0000","last_clean":"2024-09-10T14:29:08.777010+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:29:08.777010+0000","last_undegraded":"2024-09-10T14:29:08.777010+0000","last_fullsized":"2024-09-10T14:29:08.777010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:49.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786759+0000","last_change":"2024-09-10T14:28:34.909586+0000","last_active":"2024-09-10T14:30:58.786759+0000","last_peered":"2024-09-10T14:30:58.786759+0000","last_clean":"2024-09-10T14:30:58.786759+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:30:58.786759+0000","last_undegraded":"2024-09-10T14:30:58.786759+0000","last_fullsized":"2024-09-10T14:30:58.786759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:41.169418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.772384+0000","last_change":"2024-09-10T14:28:36.937985+0000","last_active":"2024-09-10T14:29:08.772384+0000","last_peered":"2024-09-10T14:29:08.772384+0000","last_clean":"2024-09-10T14:29:08.772384+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:29:08.772384+0000","last_undegraded":"2024-09-10T14:29:08.772384+0000","last_fullsized":"2024-09-10T14:29:08.772384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:38.769274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:40.727074+0000","last_change":"2024-09-10T14:28:38.919940+0000","last_active":"2024-09-10T14:30:40.727074+0000","last_peered":"2024-09-10T14:30:40.727074+0000","last_clean":"2024-09-10T14:30:40.727074+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:30:40.727074+0000","last_undegraded":"2024-09-10T14:30:40.727074+0000","last_fullsized":"2024-09-10T14:30:40.727074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:50.182914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227269+0000","last_change":"2024-09-10T14:29:07.783673+0000","last_active":"2024-09-10T14:31:44.227269+0000","last_peered":"2024-09-10T14:31:44.227269+0000","last_clean":"2024-09-10T14:31:44.227269+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:31:44.227269+0000","last_undegraded":"2024-09-10T14:31:44.227269+0000","last_fullsized":"2024-09-10T14:31:44.227269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:50.089510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.784173+0000","last_change":"2024-09-10T14:28:28.897051+0000","last_active":"2024-09-10T14:29:08.784173+0000","last_peered":"2024-09-10T14:29:08.784173+0000","last_clean":"2024-09-10T14:29:08.784173+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:29:08.784173+0000","last_undegraded":"2024-09-10T14:29:08.784173+0000","last_fullsized":"2024-09-10T14:29:08.784173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:35.896977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769214+0000","last_change":"2024-09-10T14:28:32.889469+0000","last_active":"2024-09-10T14:29:08.769214+0000","last_peered":"2024-09-10T14:29:08.769214+0000","last_clean":"2024-09-10T14:29:08.769214+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:29:08.769214+0000","last_undegraded":"2024-09-10T14:29:08.769214+0000","last_fullsized":"2024-09-10T14:29:08.769214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:16.954547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'5","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.151756+0000","last_change":"2024-09-10T14:28:34.883314+0000","last_active":"2024-09-10T14:31:43.151756+0000","last_peered":"2024-09-10T14:31:43.151756+0000","last_clean":"2024-09-10T14:31:43.151756+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:31:43.151756+0000","last_undegraded":"2024-09-10T14:31:43.151756+0000","last_fullsized":"2024-09-10T14:31:43.151756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:55.702602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774240+0000","last_change":"2024-09-10T14:28:36.942744+0000","last_active":"2024-09-10T14:29:08.774240+0000","last_peered":"2024-09-10T14:29:08.774240+0000","last_clean":"2024-09-10T14:29:08.774240+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:29:08.774240+0000","last_undegraded":"2024-09-10T14:29:08.774240+0000","last_fullsized":"2024-09-10T14:29:08.774240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:27.947825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.100255+0000","last_change":"2024-09-10T14:28:38.936365+0000","last_active":"2024-09-10T14:29:09.100255+0000","last_peered":"2024-09-10T14:29:09.100255+0000","last_clean":"2024-09-10T14:29:09.100255+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:29:09.100255+0000","last_undegraded":"2024-09-10T14:29:09.100255+0000","last_fullsized":"2024-09-10T14:29:09.100255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:06.472831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.730616+0000","last_change":"2024-09-10T14:28:30.876200+0000","last_active":"2024-09-10T14:29:14.730616+0000","last_peered":"2024-09-10T14:29:14.730616+0000","last_clean":"2024-09-10T14:29:14.730616+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:29:14.730616+0000","last_undegraded":"2024-09-10T14:29:14.730616+0000","last_fullsized":"2024-09-10T14:29:14.730616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:29.106885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.232528+0000","last_change":"2024-09-10T14:28:28.895847+0000","last_active":"2024-09-10T14:29:14.232528+0000","last_peered":"2024-09-10T14:29:14.232528+0000","last_clean":"2024-09-10T14:29:14.232528+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:29:14.232528+0000","last_undegraded":"2024-09-10T14:29:14.232528+0000","last_fullsized":"2024-09-10T14:29:14.232528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:09.693064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774392+0000","last_change":"2024-09-10T14:28:32.872799+0000","last_active":"2024-09-10T14:29:08.774392+0000","last_peered":"2024-09-10T14:29:08.774392+0000","last_clean":"2024-09-10T14:29:08.774392+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:29:08.774392+0000","last_undegraded":"2024-09-10T14:29:08.774392+0000","last_fullsized":"2024-09-10T14:29:08.774392+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:03.562600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'43","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.298202+0000","last_change":"2024-09-10T14:28:34.883528+0000","last_active":"2024-09-10T14:32:15.298202+0000","last_peered":"2024-09-10T14:32:15.298202+0000","last_clean":"2024-09-10T14:32:15.298202+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:32:15.298202+0000","last_undegraded":"2024-09-10T14:32:15.298202+0000","last_fullsized":"2024-09-10T14:32:15.298202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:37.113514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776303+0000","last_change":"2024-09-10T14:28:36.903239+0000","last_active":"2024-09-10T14:29:08.776303+0000","last_peered":"2024-09-10T14:29:08.776303+0000","last_clean":"2024-09-10T14:29:08.776303+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:29:08.776303+0000","last_undegraded":"2024-09-10T14:29:08.776303+0000","last_fullsized":"2024-09-10T14:29:08.776303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:10.158060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769658+0000","last_change":"2024-09-10T14:28:38.937605+0000","last_active":"2024-09-10T14:29:08.769658+0000","last_peered":"2024-09-10T14:29:08.769658+0000","last_clean":"2024-09-10T14:29:08.769658+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:29:08.769658+0000","last_undegraded":"2024-09-10T14:29:08.769658+0000","last_fullsized":"2024-09-10T14:29:08.769658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:51.383935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.743397+0000","last_change":"2024-09-10T14:29:07.787878+0000","last_active":"2024-09-10T14:29:15.743397+0000","last_peered":"2024-09-10T14:29:15.743397+0000","last_clean":"2024-09-10T14:29:15.743397+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:29:15.743397+0000","last_undegraded":"2024-09-10T14:29:15.743397+0000","last_fullsized":"2024-09-10T14:29:15.743397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:39.937327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.827599+0000","last_change":"2024-09-10T14:28:28.902985+0000","last_active":"2024-09-10T14:30:42.827599+0000","last_peered":"2024-09-10T14:30:42.827599+0000","last_clean":"2024-09-10T14:30:42.827599+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:30:42.827599+0000","last_undegraded":"2024-09-10T14:30:42.827599+0000","last_fullsized":"2024-09-10T14:30:42.827599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:52.358354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769090+0000","last_change":"2024-09-10T14:28:32.882402+0000","last_active":"2024-09-10T14:29:08.769090+0000","last_peered":"2024-09-10T14:29:08.769090+0000","last_clean":"2024-09-10T14:29:08.769090+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:29:08.769090+0000","last_undegraded":"2024-09-10T14:29:08.769090+0000","last_fullsized":"2024-09-10T14:29:08.769090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:40.138989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'32","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.777771+0000","last_change":"2024-09-10T14:28:34.898884+0000","last_active":"2024-09-10T14:30:54.777771+0000","last_peered":"2024-09-10T14:30:54.777771+0000","last_clean":"2024-09-10T14:30:54.777771+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:30:54.777771+0000","last_undegraded":"2024-09-10T14:30:54.777771+0000","last_fullsized":"2024-09-10T14:30:54.777771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:00.691071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778374+0000","last_change":"2024-09-10T14:28:36.914261+0000","last_active":"2024-09-10T14:29:08.778374+0000","last_peered":"2024-09-10T14:29:08.778374+0000","last_clean":"2024-09-10T14:29:08.778374+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:29:08.778374+0000","last_undegraded":"2024-09-10T14:29:08.778374+0000","last_fullsized":"2024-09-10T14:29:08.778374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:53.185791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:14.731755+0000","last_change":"2024-09-10T14:28:30.877889+0000","last_active":"2024-09-10T14:29:14.731755+0000","last_peered":"2024-09-10T14:29:14.731755+0000","last_clean":"2024-09-10T14:29:14.731755+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:29:14.731755+0000","last_undegraded":"2024-09-10T14:29:14.731755+0000","last_fullsized":"2024-09-10T14:29:14.731755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:50.100814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768203+0000","last_change":"2024-09-10T14:28:28.893360+0000","last_active":"2024-09-10T14:29:08.768203+0000","last_peered":"2024-09-10T14:29:08.768203+0000","last_clean":"2024-09-10T14:29:08.768203+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:29:08.768203+0000","last_undegraded":"2024-09-10T14:29:08.768203+0000","last_fullsized":"2024-09-10T14:29:08.768203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:07.284771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.756273+0000","last_change":"2024-09-10T14:29:08.790434+0000","last_active":"2024-09-10T14:29:09.756273+0000","last_peered":"2024-09-10T14:29:09.756273+0000","last_clean":"2024-09-10T14:29:09.756273+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:29:09.756273+0000","last_undegraded":"2024-09-10T14:29:09.756273+0000","last_fullsized":"2024-09-10T14:29:09.756273+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:43:57.151248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'60","reported_seq":126,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.492141+0000","last_change":"2024-09-10T14:28:34.883522+0000","last_active":"2024-09-10T14:32:15.492141+0000","last_peered":"2024-09-10T14:32:15.492141+0000","last_clean":"2024-09-10T14:32:15.492141+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:32:15.492141+0000","last_undegraded":"2024-09-10T14:32:15.492141+0000","last_fullsized":"2024-09-10T14:32:15.492141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:16.061284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778501+0000","last_change":"2024-09-10T14:28:36.910017+0000","last_active":"2024-09-10T14:29:08.778501+0000","last_peered":"2024-09-10T14:29:08.778501+0000","last_clean":"2024-09-10T14:29:08.778501+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:29:08.778501+0000","last_undegraded":"2024-09-10T14:29:08.778501+0000","last_fullsized":"2024-09-10T14:29:08.778501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:51.066667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.964268+0000","last_change":"2024-09-10T14:28:38.928679+0000","last_active":"2024-09-10T14:30:42.964268+0000","last_peered":"2024-09-10T14:30:42.964268+0000","last_clean":"2024-09-10T14:30:42.964268+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:30:42.964268+0000","last_undegraded":"2024-09-10T14:30:42.964268+0000","last_fullsized":"2024-09-10T14:30:42.964268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:20.861557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.873676+0000","last_change":"2024-09-10T14:28:30.881385+0000","last_active":"2024-09-10T14:31:43.873676+0000","last_peered":"2024-09-10T14:31:43.873676+0000","last_clean":"2024-09-10T14:31:43.873676+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:31:43.873676+0000","last_undegraded":"2024-09-10T14:31:43.873676+0000","last_fullsized":"2024-09-10T14:31:43.873676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.775827+0000","last_change":"2024-09-10T14:28:28.906793+0000","last_active":"2024-09-10T14:29:08.775827+0000","last_peered":"2024-09-10T14:29:08.775827+0000","last_clean":"2024-09-10T14:29:08.775827+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:29:08.775827+0000","last_undegraded":"2024-09-10T14:29:08.775827+0000","last_fullsized":"2024-09-10T14:29:08.775827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:45.691675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.786646+0000","last_change":"2024-09-10T14:28:32.880162+0000","last_active":"2024-09-10T14:29:08.786646+0000","last_peered":"2024-09-10T14:29:08.786646+0000","last_clean":"2024-09-10T14:29:08.786646+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:29:08.786646+0000","last_undegraded":"2024-09-10T14:29:08.786646+0000","last_fullsized":"2024-09-10T14:29:08.786646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:19.866288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.110766+0000","last_change":"2024-09-10T14:28:34.922844+0000","last_active":"2024-09-10T14:30:41.110766+0000","last_peered":"2024-09-10T14:30:41.110766+0000","last_clean":"2024-09-10T14:30:41.110766+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:30:41.110766+0000","last_undegraded":"2024-09-10T14:30:41.110766+0000","last_fullsized":"2024-09-10T14:30:41.110766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:55.366020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782945+0000","last_change":"2024-09-10T14:28:36.940467+0000","last_active":"2024-09-10T14:29:08.782945+0000","last_peered":"2024-09-10T14:29:08.782945+0000","last_clean":"2024-09-10T14:29:08.782945+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:29:08.782945+0000","last_undegraded":"2024-09-10T14:29:08.782945+0000","last_fullsized":"2024-09-10T14:29:08.782945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:26.562499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.113319+0000","last_change":"2024-09-10T14:28:38.943738+0000","last_active":"2024-09-10T14:30:43.113319+0000","last_peered":"2024-09-10T14:30:43.113319+0000","last_clean":"2024-09-10T14:30:43.113319+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:30:43.113319+0000","last_undegraded":"2024-09-10T14:30:43.113319+0000","last_fullsized":"2024-09-10T14:30:43.113319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:23.582530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.176038+0000","last_change":"2024-09-10T14:28:30.890718+0000","last_active":"2024-09-10T14:31:44.176038+0000","last_peered":"2024-09-10T14:31:44.176038+0000","last_clean":"2024-09-10T14:31:44.176038+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:31:44.176038+0000","last_undegraded":"2024-09-10T14:31:44.176038+0000","last_fullsized":"2024-09-10T14:31:44.176038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:12.035474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777261+0000","last_change":"2024-09-10T14:28:28.904304+0000","last_active":"2024-09-10T14:29:08.777261+0000","last_peered":"2024-09-10T14:29:08.777261+0000","last_clean":"2024-09-10T14:29:08.777261+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:29:08.777261+0000","last_undegraded":"2024-09-10T14:29:08.777261+0000","last_fullsized":"2024-09-10T14:29:08.777261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:05.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.784823+0000","last_change":"2024-09-10T14:28:32.881286+0000","last_active":"2024-09-10T14:29:08.784823+0000","last_peered":"2024-09-10T14:29:08.784823+0000","last_clean":"2024-09-10T14:29:08.784823+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:29:08.784823+0000","last_undegraded":"2024-09-10T14:29:08.784823+0000","last_fullsized":"2024-09-10T14:29:08.784823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:22.999469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'35","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.389356+0000","last_change":"2024-09-10T14:28:34.894052+0000","last_active":"2024-09-10T14:32:15.389356+0000","last_peered":"2024-09-10T14:32:15.389356+0000","last_clean":"2024-09-10T14:32:15.389356+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:32:15.389356+0000","last_undegraded":"2024-09-10T14:32:15.389356+0000","last_fullsized":"2024-09-10T14:32:15.389356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:42.457623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096104+0000","last_change":"2024-09-10T14:28:36.914374+0000","last_active":"2024-09-10T14:29:09.096104+0000","last_peered":"2024-09-10T14:29:09.096104+0000","last_clean":"2024-09-10T14:29:09.096104+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:29:09.096104+0000","last_undegraded":"2024-09-10T14:29:09.096104+0000","last_fullsized":"2024-09-10T14:29:09.096104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:27.581565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.878132+0000","last_change":"2024-09-10T14:28:38.940779+0000","last_active":"2024-09-10T14:31:43.878132+0000","last_peered":"2024-09-10T14:31:43.878132+0000","last_clean":"2024-09-10T14:31:43.878132+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:31:43.878132+0000","last_undegraded":"2024-09-10T14:31:43.878132+0000","last_fullsized":"2024-09-10T14:31:43.878132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:01.962705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072247+0000","last_change":"2024-09-10T14:28:30.863566+0000","last_active":"2024-09-10T14:31:44.072247+0000","last_peered":"2024-09-10T14:31:44.072247+0000","last_clean":"2024-09-10T14:31:44.072247+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:31:44.072247+0000","last_undegraded":"2024-09-10T14:31:44.072247+0000","last_fullsized":"2024-09-10T14:31:44.072247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:33.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:15.004264+0000","last_change":"2024-09-10T14:28:28.890479+0000","last_active":"2024-09-10T14:29:15.004264+0000","last_peered":"2024-09-10T14:29:15.004264+0000","last_clean":"2024-09-10T14:29:15.004264+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:29:15.004264+0000","last_undegraded":"2024-09-10T14:29:15.004264+0000","last_fullsized":"2024-09-10T14:29:15.004264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:41.460622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.793988+0000","last_change":"2024-09-10T14:29:08.793243+0000","last_active":"2024-09-10T14:29:08.793988+0000","last_peered":"2024-09-10T14:29:08.793988+0000","last_clean":"2024-09-10T14:29:08.793988+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:29:08.793988+0000","last_undegraded":"2024-09-10T14:29:08.793988+0000","last_fullsized":"2024-09-10T14:29:08.793988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:43.893530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781141+0000","last_change":"2024-09-10T14:28:34.927446+0000","last_active":"2024-09-10T14:29:08.781141+0000","last_peered":"2024-09-10T14:29:08.781141+0000","last_clean":"2024-09-10T14:29:08.781141+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:29:08.781141+0000","last_undegraded":"2024-09-10T14:29:08.781141+0000","last_fullsized":"2024-09-10T14:29:08.781141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:11.151127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":409,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.120415+0000","last_change":"2024-09-10T14:28:36.941280+0000","last_active":"2024-09-10T14:31:43.120415+0000","last_peered":"2024-09-10T14:31:43.120415+0000","last_clean":"2024-09-10T14:31:43.120415+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:31:43.120415+0000","last_undegraded":"2024-09-10T14:31:43.120415+0000","last_fullsized":"2024-09-10T14:31:43.120415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:56.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.767087+0000","last_change":"2024-09-10T14:28:38.938263+0000","last_active":"2024-09-10T14:29:08.767087+0000","last_peered":"2024-09-10T14:29:08.767087+0000","last_clean":"2024-09-10T14:29:08.767087+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:29:08.767087+0000","last_undegraded":"2024-09-10T14:29:08.767087+0000","last_fullsized":"2024-09-10T14:29:08.767087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:24.663593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227129+0000","last_change":"2024-09-10T14:28:30.861357+0000","last_active":"2024-09-10T14:31:44.227129+0000","last_peered":"2024-09-10T14:31:44.227129+0000","last_clean":"2024-09-10T14:31:44.227129+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:31:44.227129+0000","last_undegraded":"2024-09-10T14:31:44.227129+0000","last_fullsized":"2024-09-10T14:31:44.227129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:51.916826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.782831+0000","last_change":"2024-09-10T14:28:28.885941+0000","last_active":"2024-09-10T14:29:08.782831+0000","last_peered":"2024-09-10T14:29:08.782831+0000","last_clean":"2024-09-10T14:29:08.782831+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:29:08.782831+0000","last_undegraded":"2024-09-10T14:29:08.782831+0000","last_fullsized":"2024-09-10T14:29:08.782831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:23.440776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.776786+0000","last_change":"2024-09-10T14:28:32.883472+0000","last_active":"2024-09-10T14:29:08.776786+0000","last_peered":"2024-09-10T14:29:08.776786+0000","last_clean":"2024-09-10T14:29:08.776786+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:29:08.776786+0000","last_undegraded":"2024-09-10T14:29:08.776786+0000","last_fullsized":"2024-09-10T14:29:08.776786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:16.905282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'38","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.097227+0000","last_change":"2024-09-10T14:28:34.894279+0000","last_active":"2024-09-10T14:30:41.097227+0000","last_peered":"2024-09-10T14:30:41.097227+0000","last_clean":"2024-09-10T14:30:41.097227+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:30:41.097227+0000","last_undegraded":"2024-09-10T14:30:41.097227+0000","last_fullsized":"2024-09-10T14:30:41.097227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:42.457623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.092515+0000","last_change":"2024-09-10T14:28:36.924051+0000","last_active":"2024-09-10T14:29:09.092515+0000","last_peered":"2024-09-10T14:29:09.092515+0000","last_clean":"2024-09-10T14:29:09.092515+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:29:09.092515+0000","last_undegraded":"2024-09-10T14:29:09.092515+0000","last_fullsized":"2024-09-10T14:29:09.092515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:10.158060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.180558+0000","last_change":"2024-09-10T14:28:38.931948+0000","last_active":"2024-09-10T14:31:44.180558+0000","last_peered":"2024-09-10T14:31:44.180558+0000","last_clean":"2024-09-10T14:31:44.180558+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:31:44.180558+0000","last_undegraded":"2024-09-10T14:31:44.180558+0000","last_fullsized":"2024-09-10T14:31:44.180558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.156721+0000","last_change":"2024-09-10T14:28:30.857116+0000","last_active":"2024-09-10T14:31:44.156721+0000","last_peered":"2024-09-10T14:31:44.156721+0000","last_clean":"2024-09-10T14:31:44.156721+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:31:44.156721+0000","last_undegraded":"2024-09-10T14:31:44.156721+0000","last_fullsized":"2024-09-10T14:31:44.156721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:21.150726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'6","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787090+0000","last_change":"2024-09-10T14:28:28.889060+0000","last_active":"2024-09-10T14:30:58.787090+0000","last_peered":"2024-09-10T14:30:58.787090+0000","last_clean":"2024-09-10T14:30:58.787090+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:30:58.787090+0000","last_undegraded":"2024-09-10T14:30:58.787090+0000","last_fullsized":"2024-09-10T14:30:58.787090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:04.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":15,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781204+0000","last_change":"2024-09-10T14:28:32.886513+0000","last_active":"2024-09-10T14:29:08.781204+0000","last_peered":"2024-09-10T14:29:08.781204+0000","last_clean":"2024-09-10T14:29:08.781204+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:29:08.781204+0000","last_undegraded":"2024-09-10T14:29:08.781204+0000","last_fullsized":"2024-09-10T14:29:08.781204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:36.827270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'33","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.443083+0000","last_change":"2024-09-10T14:28:34.895458+0000","last_active":"2024-09-10T14:32:15.443083+0000","last_peered":"2024-09-10T14:32:15.443083+0000","last_clean":"2024-09-10T14:32:15.443083+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:32:15.443083+0000","last_undegraded":"2024-09-10T14:32:15.443083+0000","last_fullsized":"2024-09-10T14:32:15.443083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:21.304872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768221+0000","last_change":"2024-09-10T14:28:36.939560+0000","last_active":"2024-09-10T14:29:08.768221+0000","last_peered":"2024-09-10T14:29:08.768221+0000","last_clean":"2024-09-10T14:29:08.768221+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:29:08.768221+0000","last_undegraded":"2024-09-10T14:29:08.768221+0000","last_fullsized":"2024-09-10T14:29:08.768221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:17.208670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781377+0000","last_change":"2024-09-10T14:28:38.950672+0000","last_active":"2024-09-10T14:29:08.781377+0000","last_peered":"2024-09-10T14:29:08.781377+0000","last_clean":"2024-09-10T14:29:08.781377+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:29:08.781377+0000","last_undegraded":"2024-09-10T14:29:08.781377+0000","last_fullsized":"2024-09-10T14:29:08.781377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:51.478025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072298+0000","last_change":"2024-09-10T14:28:30.877715+0000","last_active":"2024-09-10T14:31:44.072298+0000","last_peered":"2024-09-10T14:31:44.072298+0000","last_clean":"2024-09-10T14:31:44.072298+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:31:44.072298+0000","last_undegraded":"2024-09-10T14:31:44.072298+0000","last_fullsized":"2024-09-10T14:31:44.072298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:47.874293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.093159+0000","last_change":"2024-09-10T14:28:28.876685+0000","last_active":"2024-09-10T14:29:09.093159+0000","last_peered":"2024-09-10T14:29:09.093159+0000","last_clean":"2024-09-10T14:29:09.093159+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:29:09.093159+0000","last_undegraded":"2024-09-10T14:29:09.093159+0000","last_fullsized":"2024-09-10T14:29:09.093159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:52.417731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.774563+0000","last_change":"2024-09-10T14:28:32.884054+0000","last_active":"2024-09-10T14:29:08.774563+0000","last_peered":"2024-09-10T14:29:08.774563+0000","last_clean":"2024-09-10T14:29:08.774563+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:29:08.774563+0000","last_undegraded":"2024-09-10T14:29:08.774563+0000","last_fullsized":"2024-09-10T14:29:08.774563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:39.742700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.131887+0000","last_change":"2024-09-10T14:28:34.914074+0000","last_active":"2024-09-10T14:30:41.131887+0000","last_peered":"2024-09-10T14:30:41.131887+0000","last_clean":"2024-09-10T14:30:41.131887+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:30:41.131887+0000","last_undegraded":"2024-09-10T14:30:41.131887+0000","last_fullsized":"2024-09-10T14:30:41.131887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:12.635701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.769265+0000","last_change":"2024-09-10T14:28:36.945615+0000","last_active":"2024-09-10T14:29:08.769265+0000","last_peered":"2024-09-10T14:29:08.769265+0000","last_clean":"2024-09-10T14:29:08.769265+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:29:08.769265+0000","last_undegraded":"2024-09-10T14:29:08.769265+0000","last_fullsized":"2024-09-10T14:29:08.769265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:28.372594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.329350+0000","last_change":"2024-09-10T14:28:38.949225+0000","last_active":"2024-09-10T14:31:44.329350+0000","last_peered":"2024-09-10T14:31:44.329350+0000","last_clean":"2024-09-10T14:31:44.329350+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:31:44.329350+0000","last_undegraded":"2024-09-10T14:31:44.329350+0000","last_fullsized":"2024-09-10T14:31:44.329350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:30.977933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227695+0000","last_change":"2024-09-10T14:28:30.857745+0000","last_active":"2024-09-10T14:31:44.227695+0000","last_peered":"2024-09-10T14:31:44.227695+0000","last_clean":"2024-09-10T14:31:44.227695+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:31:44.227695+0000","last_undegraded":"2024-09-10T14:31:44.227695+0000","last_fullsized":"2024-09-10T14:31:44.227695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:20.516570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.049736+0000","last_change":"2024-09-10T14:28:28.904511+0000","last_active":"2024-09-10T14:31:44.049736+0000","last_peered":"2024-09-10T14:31:44.049736+0000","last_clean":"2024-09-10T14:31:44.049736+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:31:44.049736+0000","last_undegraded":"2024-09-10T14:31:44.049736+0000","last_fullsized":"2024-09-10T14:31:44.049736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:55.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.533136+0000","last_change":"2024-09-10T14:28:32.889332+0000","last_active":"2024-09-10T14:30:39.533136+0000","last_peered":"2024-09-10T14:30:39.533136+0000","last_clean":"2024-09-10T14:30:39.533136+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:30:39.533136+0000","last_undegraded":"2024-09-10T14:30:39.533136+0000","last_fullsized":"2024-09-10T14:30:39.533136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:50.606255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'33","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.153147+0000","last_change":"2024-09-10T14:28:34.914339+0000","last_active":"2024-09-10T14:31:43.153147+0000","last_peered":"2024-09-10T14:31:43.153147+0000","last_clean":"2024-09-10T14:31:43.153147+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:31:43.153147+0000","last_undegraded":"2024-09-10T14:31:43.153147+0000","last_fullsized":"2024-09-10T14:31:43.153147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:00.676530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.098628+0000","last_change":"2024-09-10T14:28:36.924970+0000","last_active":"2024-09-10T14:29:09.098628+0000","last_peered":"2024-09-10T14:29:09.098628+0000","last_clean":"2024-09-10T14:29:09.098628+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:29:09.098628+0000","last_undegraded":"2024-09-10T14:29:09.098628+0000","last_fullsized":"2024-09-10T14:29:09.098628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.099079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:41.152719+0000","last_change":"2024-09-10T14:28:38.949254+0000","last_active":"2024-09-10T14:30:41.152719+0000","last_peered":"2024-09-10T14:30:41.152719+0000","last_clean":"2024-09-10T14:30:41.152719+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:30:41.152719+0000","last_undegraded":"2024-09-10T14:30:41.152719+0000","last_fullsized":"2024-09-10T14:30:41.152719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:37.882075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071743+0000","last_change":"2024-09-10T14:28:30.890252+0000","last_active":"2024-09-10T14:31:44.071743+0000","last_peered":"2024-09-10T14:31:44.071743+0000","last_clean":"2024-09-10T14:31:44.071743+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:31:44.071743+0000","last_undegraded":"2024-09-10T14:31:44.071743+0000","last_fullsized":"2024-09-10T14:31:44.071743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:36.092002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.023557+0000","last_change":"2024-09-10T14:28:28.876974+0000","last_active":"2024-09-10T14:30:39.023557+0000","last_peered":"2024-09-10T14:30:39.023557+0000","last_clean":"2024-09-10T14:30:39.023557+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:30:39.023557+0000","last_undegraded":"2024-09-10T14:30:39.023557+0000","last_fullsized":"2024-09-10T14:30:39.023557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:56.895016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.105167+0000","last_change":"2024-09-10T14:28:30.861035+0000","last_active":"2024-09-10T14:29:09.105167+0000","last_peered":"2024-09-10T14:29:09.105167+0000","last_clean":"2024-09-10T14:29:09.105167+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:29:09.105167+0000","last_undegraded":"2024-09-10T14:29:09.105167+0000","last_fullsized":"2024-09-10T14:29:09.105167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:11.237117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.995691+0000","last_change":"2024-09-10T14:28:28.880673+0000","last_active":"2024-09-10T14:30:42.995691+0000","last_peered":"2024-09-10T14:30:42.995691+0000","last_clean":"2024-09-10T14:30:42.995691+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:30:42.995691+0000","last_undegraded":"2024-09-10T14:30:42.995691+0000","last_fullsized":"2024-09-10T14:30:42.995691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:05.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'9","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.242990+0000","last_change":"2024-09-10T14:28:30.876383+0000","last_active":"2024-09-10T14:31:44.242990+0000","last_peered":"2024-09-10T14:31:44.242990+0000","last_clean":"2024-09-10T14:31:44.242990+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:31:44.242990+0000","last_undegraded":"2024-09-10T14:31:44.242990+0000","last_fullsized":"2024-09-10T14:31:44.242990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:27.003138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.358756+0000","last_change":"2024-09-10T14:28:28.892938+0000","last_active":"2024-09-10T14:29:58.358756+0000","last_peered":"2024-09-10T14:29:58.358756+0000","last_clean":"2024-09-10T14:29:58.358756+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:29:58.358756+0000","last_undegraded":"2024-09-10T14:29:58.358756+0000","last_fullsized":"2024-09-10T14:29:58.358756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:31.835408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:58.073511+0000","last_change":"2024-09-10T14:28:30.863758+0000","last_active":"2024-09-10T14:29:58.073511+0000","last_peered":"2024-09-10T14:29:58.073511+0000","last_clean":"2024-09-10T14:29:58.073511+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:29:58.073511+0000","last_undegraded":"2024-09-10T14:29:58.073511+0000","last_fullsized":"2024-09-10T14:29:58.073511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:55.212516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.494361+0000","last_change":"2024-09-10T14:28:28.880499+0000","last_active":"2024-09-10T14:29:13.494361+0000","last_peered":"2024-09-10T14:29:13.494361+0000","last_clean":"2024-09-10T14:29:13.494361+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:29:13.494361+0000","last_undegraded":"2024-09-10T14:29:13.494361+0000","last_fullsized":"2024-09-10T14:29:13.494361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:45.094407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.739142+0000","last_change":"2024-09-10T14:28:30.886667+0000","last_active":"2024-09-10T14:31:43.739142+0000","last_peered":"2024-09-10T14:31:43.739142+0000","last_clean":"2024-09-10T14:31:43.739142+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:43.739142+0000","last_undegraded":"2024-09-10T14:31:43.739142+0000","last_fullsized":"2024-09-10T14:31:43.739142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:02.612612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.491902+0000","last_change":"2024-09-10T14:28:28.908422+0000","last_active":"2024-09-10T14:29:13.491902+0000","last_peered":"2024-09-10T14:29:13.491902+0000","last_clean":"2024-09-10T14:29:13.491902+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:29:13.491902+0000","last_undegraded":"2024-09-10T14:29:13.491902+0000","last_fullsized":"2024-09-10T14:29:13.491902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:18.554945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.783600+0000","last_change":"2024-09-10T14:28:30.886359+0000","last_active":"2024-09-10T14:29:08.783600+0000","last_peered":"2024-09-10T14:29:08.783600+0000","last_clean":"2024-09-10T14:29:08.783600+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:29:08.783600+0000","last_undegraded":"2024-09-10T14:29:08.783600+0000","last_fullsized":"2024-09-10T14:29:08.783600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:11.237117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787165+0000","last_change":"2024-09-10T14:28:28.899480+0000","last_active":"2024-09-10T14:29:08.787165+0000","last_peered":"2024-09-10T14:29:08.787165+0000","last_clean":"2024-09-10T14:29:08.787165+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:29:08.787165+0000","last_undegraded":"2024-09-10T14:29:08.787165+0000","last_fullsized":"2024-09-10T14:29:08.787165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:43.338988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.175804+0000","last_change":"2024-09-10T14:28:30.881839+0000","last_active":"2024-09-10T14:31:44.175804+0000","last_peered":"2024-09-10T14:31:44.175804+0000","last_clean":"2024-09-10T14:31:44.175804+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:31:44.175804+0000","last_undegraded":"2024-09-10T14:31:44.175804+0000","last_fullsized":"2024-09-10T14:31:44.175804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:06.988787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.787432+0000","last_change":"2024-09-10T14:28:28.913505+0000","last_active":"2024-09-10T14:29:08.787432+0000","last_peered":"2024-09-10T14:29:08.787432+0000","last_clean":"2024-09-10T14:29:08.787432+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:29:08.787432+0000","last_undegraded":"2024-09-10T14:29:08.787432+0000","last_fullsized":"2024-09-10T14:29:08.787432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:11.822278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071529+0000","last_change":"2024-09-10T14:28:30.887181+0000","last_active":"2024-09-10T14:31:44.071529+0000","last_peered":"2024-09-10T14:31:44.071529+0000","last_clean":"2024-09-10T14:31:44.071529+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:31:44.071529+0000","last_undegraded":"2024-09-10T14:31:44.071529+0000","last_fullsized":"2024-09-10T14:31:44.071529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:11.379786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:09.096944+0000","last_change":"2024-09-10T14:28:28.878802+0000","last_active":"2024-09-10T14:29:09.096944+0000","last_peered":"2024-09-10T14:29:09.096944+0000","last_clean":"2024-09-10T14:29:09.096944+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:29:09.096944+0000","last_undegraded":"2024-09-10T14:29:09.096944+0000","last_fullsized":"2024-09-10T14:29:09.096944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:26.929099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.875049+0000","last_change":"2024-09-10T14:28:30.873038+0000","last_active":"2024-09-10T14:31:43.875049+0000","last_peered":"2024-09-10T14:31:43.875049+0000","last_clean":"2024-09-10T14:31:43.875049+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:31:43.875049+0000","last_undegraded":"2024-09-10T14:31:43.875049+0000","last_fullsized":"2024-09-10T14:31:43.875049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:24.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.768501+0000","last_change":"2024-09-10T14:28:28.893263+0000","last_active":"2024-09-10T14:29:08.768501+0000","last_peered":"2024-09-10T14:29:08.768501+0000","last_clean":"2024-09-10T14:29:08.768501+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:29:08.768501+0000","last_undegraded":"2024-09-10T14:29:08.768501+0000","last_fullsized":"2024-09-10T14:29:08.768501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:14.670209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.072636+0000","last_change":"2024-09-10T14:28:30.885304+0000","last_active":"2024-09-10T14:31:44.072636+0000","last_peered":"2024-09-10T14:31:44.072636+0000","last_clean":"2024-09-10T14:31:44.072636+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:31:44.072636+0000","last_undegraded":"2024-09-10T14:31:44.072636+0000","last_fullsized":"2024-09-10T14:31:44.072636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:52.328031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:13.489629+0000","last_change":"2024-09-10T14:28:28.879959+0000","last_active":"2024-09-10T14:29:13.489629+0000","last_peered":"2024-09-10T14:29:13.489629+0000","last_clean":"2024-09-10T14:29:13.489629+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:29:13.489629+0000","last_undegraded":"2024-09-10T14:29:13.489629+0000","last_fullsized":"2024-09-10T14:29:13.489629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:59.028308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.071788+0000","last_change":"2024-09-10T14:28:30.875900+0000","last_active":"2024-09-10T14:31:44.071788+0000","last_peered":"2024-09-10T14:31:44.071788+0000","last_clean":"2024-09-10T14:31:44.071788+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:31:44.071788+0000","last_undegraded":"2024-09-10T14:31:44.071788+0000","last_fullsized":"2024-09-10T14:31:44.071788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:33.823970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.777667+0000","last_change":"2024-09-10T14:28:28.888402+0000","last_active":"2024-09-10T14:29:08.777667+0000","last_peered":"2024-09-10T14:29:08.777667+0000","last_clean":"2024-09-10T14:29:08.777667+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:29:08.777667+0000","last_undegraded":"2024-09-10T14:29:08.777667+0000","last_fullsized":"2024-09-10T14:29:08.777667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:04.011779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.732962+0000","last_change":"2024-09-10T14:28:30.883269+0000","last_active":"2024-09-10T14:31:43.732962+0000","last_peered":"2024-09-10T14:31:43.732962+0000","last_clean":"2024-09-10T14:31:43.732962+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:31:43.732962+0000","last_undegraded":"2024-09-10T14:31:43.732962+0000","last_fullsized":"2024-09-10T14:31:43.732962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.305094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.781430+0000","last_change":"2024-09-10T14:28:28.906234+0000","last_active":"2024-09-10T14:29:08.781430+0000","last_peered":"2024-09-10T14:29:08.781430+0000","last_clean":"2024-09-10T14:29:08.781430+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:29:08.781430+0000","last_undegraded":"2024-09-10T14:29:08.781430+0000","last_fullsized":"2024-09-10T14:29:08.781430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:39.391774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227328+0000","last_change":"2024-09-10T14:28:30.886081+0000","last_active":"2024-09-10T14:31:44.227328+0000","last_peered":"2024-09-10T14:31:44.227328+0000","last_clean":"2024-09-10T14:31:44.227328+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:31:44.227328+0000","last_undegraded":"2024-09-10T14:31:44.227328+0000","last_fullsized":"2024-09-10T14:31:44.227328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.771512+0000","last_change":"2024-09-10T14:28:28.890888+0000","last_active":"2024-09-10T14:29:08.771512+0000","last_peered":"2024-09-10T14:29:08.771512+0000","last_clean":"2024-09-10T14:29:08.771512+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:29:08.771512+0000","last_undegraded":"2024-09-10T14:29:08.771512+0000","last_fullsized":"2024-09-10T14:29:08.771512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:40.510621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.158665+0000","last_change":"2024-09-10T14:28:30.866941+0000","last_active":"2024-09-10T14:31:44.158665+0000","last_peered":"2024-09-10T14:31:44.158665+0000","last_clean":"2024-09-10T14:31:44.158665+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:31:44.158665+0000","last_undegraded":"2024-09-10T14:31:44.158665+0000","last_fullsized":"2024-09-10T14:31:44.158665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:44.179281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.778431+0000","last_change":"2024-09-10T14:28:28.880438+0000","last_active":"2024-09-10T14:29:08.778431+0000","last_peered":"2024-09-10T14:29:08.778431+0000","last_clean":"2024-09-10T14:29:08.778431+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:29:08.778431+0000","last_undegraded":"2024-09-10T14:29:08.778431+0000","last_fullsized":"2024-09-10T14:29:08.778431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:26.888320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'13","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784209+0000","last_change":"2024-09-10T14:28:30.887810+0000","last_active":"2024-09-10T14:30:48.784209+0000","last_peered":"2024-09-10T14:30:48.784209+0000","last_clean":"2024-09-10T14:30:48.784209+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:30:48.784209+0000","last_undegraded":"2024-09-10T14:30:48.784209+0000","last_fullsized":"2024-09-10T14:30:48.784209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:57.157500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.788071+0000","last_change":"2024-09-10T14:28:28.914161+0000","last_active":"2024-09-10T14:29:08.788071+0000","last_peered":"2024-09-10T14:29:08.788071+0000","last_clean":"2024-09-10T14:29:08.788071+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:29:08.788071+0000","last_undegraded":"2024-09-10T14:29:08.788071+0000","last_fullsized":"2024-09-10T14:29:08.788071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:36:57.354096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244157+0000","last_change":"2024-09-10T14:28:30.862241+0000","last_active":"2024-09-10T14:31:44.244157+0000","last_peered":"2024-09-10T14:31:44.244157+0000","last_clean":"2024-09-10T14:31:44.244157+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:31:44.244157+0000","last_undegraded":"2024-09-10T14:31:44.244157+0000","last_fullsized":"2024-09-10T14:31:44.244157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:13:33.823970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.646886+0000","last_change":"2024-09-10T14:28:28.879289+0000","last_active":"2024-09-10T14:31:43.646886+0000","last_peered":"2024-09-10T14:31:43.646886+0000","last_clean":"2024-09-10T14:31:43.646886+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:31:43.646886+0000","last_undegraded":"2024-09-10T14:31:43.646886+0000","last_fullsized":"2024-09-10T14:31:43.646886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:09.227862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.770986+0000","last_change":"2024-09-10T14:28:28.892314+0000","last_active":"2024-09-10T14:29:08.770986+0000","last_peered":"2024-09-10T14:29:08.770986+0000","last_clean":"2024-09-10T14:29:08.770986+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:29:08.770986+0000","last_undegraded":"2024-09-10T14:29:08.770986+0000","last_fullsized":"2024-09-10T14:29:08.770986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:13.058159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.227341+0000","last_change":"2024-09-10T14:28:30.891092+0000","last_active":"2024-09-10T14:31:44.227341+0000","last_peered":"2024-09-10T14:31:44.227341+0000","last_clean":"2024-09-10T14:31:44.227341+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:31:44.227341+0000","last_undegraded":"2024-09-10T14:31:44.227341+0000","last_fullsized":"2024-09-10T14:31:44.227341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:24.582638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.595880+0000","last_change":"2024-09-10T14:28:28.881653+0000","last_active":"2024-09-10T14:31:43.595880+0000","last_peered":"2024-09-10T14:31:43.595880+0000","last_clean":"2024-09-10T14:31:43.595880+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:31:43.595880+0000","last_undegraded":"2024-09-10T14:31:43.595880+0000","last_fullsized":"2024-09-10T14:31:43.595880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:53.922561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:29:08.791605+0000","last_change":"2024-09-10T14:28:30.887038+0000","last_active":"2024-09-10T14:29:08.791605+0000","last_peered":"2024-09-10T14:29:08.791605+0000","last_clean":"2024-09-10T14:29:08.791605+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:29:08.791605+0000","last_undegraded":"2024-09-10T14:29:08.791605+0000","last_fullsized":"2024-09-10T14:29:08.791605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:55.417111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":17429376,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":87,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25817088,"data_stored":25817088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640309,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48920,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322920,"statfs":{"total":96636764160,"available":96586670080,"internally_reserved":0,"allocated":9641984,"data_stored":9357446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673013,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":8900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":9113600,"data_stored":8768463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673013,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44776,"kb_used_data":9432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327064,"statfs":{"total":96636764160,"available":96590913536,"internally_reserved":0,"allocated":9658368,"data_stored":9355915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":161599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:32:20.632 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.632 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.632 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.632 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.633 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.634 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.635 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.636 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.637 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.637 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.637 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.637 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.637 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.637 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.637 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.638 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.638 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.638 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.638 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.638 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.638 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.638 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.638 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.639 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.640 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.641 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.641 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.641 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.641 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.641 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.641 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.641 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.641 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.642 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.642 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.642 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.642 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.642 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.642 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.642 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.642 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.643 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T14:28:14.781430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.644 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.645 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.646 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.647 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.648 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.649 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.649 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.649 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.649 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.649 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.649 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.650 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.651 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.652 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.652 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.652 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.652 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.652 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.652 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.652 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.652 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.653 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.654 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.655 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.655 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.655 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.655 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.655 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.655 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.655 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.655 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.656 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.657 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.657 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.657 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.657 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.657 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.658 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.658 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.658 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.658 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.658 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.658 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.658 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.658 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.659 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.659 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.659 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.659 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.659 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.659 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.659 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.659 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.660 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.661 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.661 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.661 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.661 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.661 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.661 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.661 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.661 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.662 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.662 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.662 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.662 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.662 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.662 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.662 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.662 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.663 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.663 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.663 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.663 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.663 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.663 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:20.663 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T14:32:40.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:32:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.796+0000 7f5b2aa87640 1 Processor -- start 2024-09-10T14:32:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b2aa87640 1 -- start start 2024-09-10T14:32:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b2aa87640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b2412f390 0x7f5b24133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b2aa87640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b240984f0 con 0x7f5b2412e760 2024-09-10T14:32:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b2aa87640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5b24098dc0 con 0x7f5b2412f390 2024-09-10T14:32:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b23fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5b2412f390 0x7f5b24133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b28823640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5b2412e760 0x7f5b2412ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54646/0 (socket says 172.21.15.52:54646) 2024-09-10T14:32:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b28823640 1 -- 172.21.15.52:0/3666428925 learned_addr learned my addr 172.21.15.52:0/3666428925 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:32:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b23fff640 1 -- 172.21.15.52:0/3666428925 >> v1:172.21.15.52:6789/0 conn(0x7f5b2412e760 legacy=0x7f5b2412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:40.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b23fff640 1 -- 172.21.15.52:0/3666428925 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b240981a0 con 0x7f5b2412f390 2024-09-10T14:32:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b23fff640 1 --2- 172.21.15.52:0/3666428925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412f390 0x7f5b24133a80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009740 tx=0x7f5b1801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a3d1135f57c303 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b237fe640 1 -- 172.21.15.52:0/3666428925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b180b1070 con 0x7f5b2412f390 2024-09-10T14:32:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b237fe640 1 -- 172.21.15.52:0/3666428925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b180ac570 con 0x7f5b2412f390 2024-09-10T14:32:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.800+0000 7f5b237fe640 1 -- 172.21.15.52:0/3666428925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b180ac870 con 0x7f5b2412f390 2024-09-10T14:32:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- 172.21.15.52:0/3666428925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412f390 msgr2=0x7f5b24133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 --2- 172.21.15.52:0/3666428925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412f390 0x7f5b24133a80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009740 tx=0x7f5b1801c400 comp rx=0 tx=0).stop 2024-09-10T14:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- 172.21.15.52:0/3666428925 shutdown_connections 2024-09-10T14:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 --2- 172.21.15.52:0/3666428925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412f390 0x7f5b24133a80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- 172.21.15.52:0/3666428925 >> 172.21.15.52:0/3666428925 conn(0x7f5b240a10a0 msgr2=0x7f5b240a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- 172.21.15.52:0/3666428925 shutdown_connections 2024-09-10T14:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- 172.21.15.52:0/3666428925 wait complete. 2024-09-10T14:32:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 Processor -- start 2024-09-10T14:32:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- start start 2024-09-10T14:32:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412e760 0x7f5b240963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5b24136b70 con 0x7f5b2412e760 2024-09-10T14:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b28823640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412e760 0x7f5b240963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b28823640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412e760 0x7f5b240963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41416/0 (socket says 172.21.15.52:41416) 2024-09-10T14:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b28823640 1 -- 172.21.15.52:0/1912499675 learned_addr learned my addr 172.21.15.52:0/1912499675 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b28823640 1 -- 172.21.15.52:0/1912499675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b24131730 con 0x7f5b2412e760 2024-09-10T14:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b28823640 1 --2- 172.21.15.52:0/1912499675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412e760 0x7f5b240963d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c480 tx=0x7f5b1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b217fa640 1 -- 172.21.15.52:0/1912499675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b14017070 con 0x7f5b2412e760 2024-09-10T14:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b217fa640 1 -- 172.21.15.52:0/1912499675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b14005c20 con 0x7f5b2412e760 2024-09-10T14:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b24128f50 con 0x7f5b2412e760 2024-09-10T14:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b217fa640 1 -- 172.21.15.52:0/1912499675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b14007070 con 0x7f5b2412e760 2024-09-10T14:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b24131da0 con 0x7f5b2412e760 2024-09-10T14:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2412de00 con 0x7f5b2412e760 2024-09-10T14:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.804+0000 7f5b217fa640 1 -- 172.21.15.52:0/1912499675 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b1401a070 con 0x7f5b2412e760 2024-09-10T14:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.808+0000 7f5b217fa640 1 --2- 172.21.15.52:0/1912499675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5b10035db0 0x7f5b10038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.808+0000 7f5b217fa640 1 -- 172.21.15.52:0/1912499675 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f5b14048410 con 0x7f5b2412e760 2024-09-10T14:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.808+0000 7f5b23fff640 1 --2- 172.21.15.52:0/1912499675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5b10035db0 0x7f5b10038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.808+0000 7f5b23fff640 1 --2- 172.21.15.52:0/1912499675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5b10035db0 0x7f5b10038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5b180ae000 tx=0x7f5b18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:32:40.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.812+0000 7f5b217fa640 1 -- 172.21.15.52:0/1912499675 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5b24131730 con 0x7f5b2412e760 2024-09-10T14:32:40.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:40.972+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b2412ec80 con 0x7f5b10035db0 2024-09-10T14:32:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.024+0000 7f5b217fa640 1 -- 172.21.15.52:0/1912499675 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+659178 (secure 0 0 0) 0x7f5b2412ec80 con 0x7f5b10035db0 2024-09-10T14:32:41.033 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:32:41.043 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:32:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5b10035db0 msgr2=0x7f5b10038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 --2- 172.21.15.52:0/1912499675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5b10035db0 0x7f5b10038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5b180ae000 tx=0x7f5b18008040 comp rx=0 tx=0).stop 2024-09-10T14:32:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412e760 msgr2=0x7f5b240963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:32:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 --2- 172.21.15.52:0/1912499675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412e760 0x7f5b240963d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c480 tx=0x7f5b1400c940 comp rx=0 tx=0).stop 2024-09-10T14:32:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 shutdown_connections 2024-09-10T14:32:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 --2- 172.21.15.52:0/1912499675 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f5b10035db0 0x7f5b10038270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 --2- 172.21.15.52:0/1912499675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b2412e760 0x7f5b240963d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:32:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 >> 172.21.15.52:0/1912499675 conn(0x7f5b240a10a0 msgr2=0x7f5b240972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:32:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 shutdown_connections 2024-09-10T14:32:41.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:32:41.028+0000 7f5b2aa87640 1 -- 172.21.15.52:0/1912499675 wait complete. 2024-09-10T14:32:41.051 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-10T14:32:40.809899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4731,"ondisk_log_size":4731,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148528,"kb_used_data":2992,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338832,"statfs":{"total":386547056640,"available":386394963968,"internally_reserved":0,"allocated":3063808,"data_stored":1824624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006909"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758654+0000","last_change":"2024-09-10T14:28:28.910643+0000","last_active":"2024-09-10T14:32:19.758654+0000","last_peered":"2024-09-10T14:32:19.758654+0000","last_clean":"2024-09-10T14:32:19.758654+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:32:19.758654+0000","last_undegraded":"2024-09-10T14:32:19.758654+0000","last_fullsized":"2024-09-10T14:32:19.758654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.786205+0000","last_change":"2024-09-10T14:28:30.866892+0000","last_active":"2024-09-10T14:31:03.786205+0000","last_peered":"2024-09-10T14:31:03.786205+0000","last_clean":"2024-09-10T14:31:03.786205+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:31:03.786205+0000","last_undegraded":"2024-09-10T14:31:03.786205+0000","last_fullsized":"2024-09-10T14:31:03.786205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.908826+0000","last_change":"2024-09-10T14:28:28.880130+0000","last_active":"2024-09-10T14:30:42.908826+0000","last_peered":"2024-09-10T14:30:42.908826+0000","last_clean":"2024-09-10T14:30:42.908826+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:30:42.908826+0000","last_undegraded":"2024-09-10T14:30:42.908826+0000","last_fullsized":"2024-09-10T14:30:42.908826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.889129+0000","last_change":"2024-09-10T14:28:30.882162+0000","last_active":"2024-09-10T14:31:43.889129+0000","last_peered":"2024-09-10T14:31:43.889129+0000","last_clean":"2024-09-10T14:31:43.889129+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:31:43.889129+0000","last_undegraded":"2024-09-10T14:31:43.889129+0000","last_fullsized":"2024-09-10T14:31:43.889129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241571+0000","last_change":"2024-09-10T14:28:28.879906+0000","last_active":"2024-09-10T14:32:20.241571+0000","last_peered":"2024-09-10T14:32:20.241571+0000","last_clean":"2024-09-10T14:32:20.241571+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:32:20.241571+0000","last_undegraded":"2024-09-10T14:32:20.241571+0000","last_fullsized":"2024-09-10T14:32:20.241571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.090802+0000","last_change":"2024-09-10T14:28:30.882676+0000","last_active":"2024-09-10T14:31:44.090802+0000","last_peered":"2024-09-10T14:31:44.090802+0000","last_clean":"2024-09-10T14:31:44.090802+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:31:44.090802+0000","last_undegraded":"2024-09-10T14:31:44.090802+0000","last_fullsized":"2024-09-10T14:31:44.090802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758630+0000","last_change":"2024-09-10T14:28:28.893233+0000","last_active":"2024-09-10T14:32:19.758630+0000","last_peered":"2024-09-10T14:32:19.758630+0000","last_clean":"2024-09-10T14:32:19.758630+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:32:19.758630+0000","last_undegraded":"2024-09-10T14:32:19.758630+0000","last_fullsized":"2024-09-10T14:32:19.758630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.788268+0000","last_change":"2024-09-10T14:28:30.881166+0000","last_active":"2024-09-10T14:31:03.788268+0000","last_peered":"2024-09-10T14:31:03.788268+0000","last_clean":"2024-09-10T14:31:03.788268+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:31:03.788268+0000","last_undegraded":"2024-09-10T14:31:03.788268+0000","last_fullsized":"2024-09-10T14:31:03.788268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786983+0000","last_change":"2024-09-10T14:28:28.883653+0000","last_active":"2024-09-10T14:30:58.786983+0000","last_peered":"2024-09-10T14:30:58.786983+0000","last_clean":"2024-09-10T14:30:58.786983+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:30:58.786983+0000","last_undegraded":"2024-09-10T14:30:58.786983+0000","last_fullsized":"2024-09-10T14:30:58.786983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'5","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.290998+0000","last_change":"2024-09-10T14:28:30.890087+0000","last_active":"2024-09-10T14:32:19.290998+0000","last_peered":"2024-09-10T14:32:19.290998+0000","last_clean":"2024-09-10T14:32:19.290998+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:32:19.290998+0000","last_undegraded":"2024-09-10T14:32:19.290998+0000","last_fullsized":"2024-09-10T14:32:19.290998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:59.779105+0000","last_change":"2024-09-10T14:28:28.910148+0000","last_active":"2024-09-10T14:30:59.779105+0000","last_peered":"2024-09-10T14:30:59.779105+0000","last_clean":"2024-09-10T14:30:59.779105+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:30:59.779105+0000","last_undegraded":"2024-09-10T14:30:59.779105+0000","last_fullsized":"2024-09-10T14:30:59.779105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.756849+0000","last_change":"2024-09-10T14:28:30.875024+0000","last_active":"2024-09-10T14:31:43.756849+0000","last_peered":"2024-09-10T14:31:43.756849+0000","last_clean":"2024-09-10T14:31:43.756849+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:31:43.756849+0000","last_undegraded":"2024-09-10T14:31:43.756849+0000","last_fullsized":"2024-09-10T14:31:43.756849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786825+0000","last_change":"2024-09-10T14:28:28.890726+0000","last_active":"2024-09-10T14:30:58.786825+0000","last_peered":"2024-09-10T14:30:58.786825+0000","last_clean":"2024-09-10T14:30:58.786825+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:30:58.786825+0000","last_undegraded":"2024-09-10T14:30:58.786825+0000","last_fullsized":"2024-09-10T14:30:58.786825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'7","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.325487+0000","last_change":"2024-09-10T14:28:30.863498+0000","last_active":"2024-09-10T14:31:44.325487+0000","last_peered":"2024-09-10T14:31:44.325487+0000","last_clean":"2024-09-10T14:31:44.325487+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:31:44.325487+0000","last_undegraded":"2024-09-10T14:31:44.325487+0000","last_fullsized":"2024-09-10T14:31:44.325487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:02.780314+0000","last_change":"2024-09-10T14:28:28.876209+0000","last_active":"2024-09-10T14:31:02.780314+0000","last_peered":"2024-09-10T14:31:02.780314+0000","last_clean":"2024-09-10T14:31:02.780314+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:31:02.780314+0000","last_undegraded":"2024-09-10T14:31:02.780314+0000","last_fullsized":"2024-09-10T14:31:02.780314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.755072+0000","last_change":"2024-09-10T14:28:30.870535+0000","last_active":"2024-09-10T14:31:43.755072+0000","last_peered":"2024-09-10T14:31:43.755072+0000","last_clean":"2024-09-10T14:31:43.755072+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:31:43.755072+0000","last_undegraded":"2024-09-10T14:31:43.755072+0000","last_fullsized":"2024-09-10T14:31:43.755072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.175732+0000","last_change":"2024-09-10T14:28:30.875126+0000","last_active":"2024-09-10T14:31:44.175732+0000","last_peered":"2024-09-10T14:31:44.175732+0000","last_clean":"2024-09-10T14:31:44.175732+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:31:44.175732+0000","last_undegraded":"2024-09-10T14:31:44.175732+0000","last_fullsized":"2024-09-10T14:31:44.175732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783982+0000","last_change":"2024-09-10T14:28:28.902646+0000","last_active":"2024-09-10T14:30:53.783982+0000","last_peered":"2024-09-10T14:30:53.783982+0000","last_clean":"2024-09-10T14:30:53.783982+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:30:53.783982+0000","last_undegraded":"2024-09-10T14:30:53.783982+0000","last_fullsized":"2024-09-10T14:30:53.783982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.090259+0000","last_change":"2024-09-10T14:28:30.871743+0000","last_active":"2024-09-10T14:31:44.090259+0000","last_peered":"2024-09-10T14:31:44.090259+0000","last_clean":"2024-09-10T14:31:44.090259+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:31:44.090259+0000","last_undegraded":"2024-09-10T14:31:44.090259+0000","last_fullsized":"2024-09-10T14:31:44.090259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.778108+0000","last_change":"2024-09-10T14:28:28.913772+0000","last_active":"2024-09-10T14:30:54.778108+0000","last_peered":"2024-09-10T14:30:54.778108+0000","last_clean":"2024-09-10T14:30:54.778108+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:30:54.778108+0000","last_undegraded":"2024-09-10T14:30:54.778108+0000","last_fullsized":"2024-09-10T14:30:54.778108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.756052+0000","last_change":"2024-09-10T14:28:30.866947+0000","last_active":"2024-09-10T14:31:43.756052+0000","last_peered":"2024-09-10T14:31:43.756052+0000","last_clean":"2024-09-10T14:31:43.756052+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:31:43.756052+0000","last_undegraded":"2024-09-10T14:31:43.756052+0000","last_fullsized":"2024-09-10T14:31:43.756052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783859+0000","last_change":"2024-09-10T14:28:28.904198+0000","last_active":"2024-09-10T14:30:53.783859+0000","last_peered":"2024-09-10T14:30:53.783859+0000","last_clean":"2024-09-10T14:30:53.783859+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:30:53.783859+0000","last_undegraded":"2024-09-10T14:30:53.783859+0000","last_fullsized":"2024-09-10T14:30:53.783859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.091562+0000","last_change":"2024-09-10T14:28:30.886686+0000","last_active":"2024-09-10T14:31:44.091562+0000","last_peered":"2024-09-10T14:31:44.091562+0000","last_clean":"2024-09-10T14:31:44.091562+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:44.091562+0000","last_undegraded":"2024-09-10T14:31:44.091562+0000","last_fullsized":"2024-09-10T14:31:44.091562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783788+0000","last_change":"2024-09-10T14:28:28.888634+0000","last_active":"2024-09-10T14:30:53.783788+0000","last_peered":"2024-09-10T14:30:53.783788+0000","last_clean":"2024-09-10T14:30:53.783788+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:30:53.783788+0000","last_undegraded":"2024-09-10T14:30:53.783788+0000","last_fullsized":"2024-09-10T14:30:53.783788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.177871+0000","last_change":"2024-09-10T14:28:30.870293+0000","last_active":"2024-09-10T14:31:44.177871+0000","last_peered":"2024-09-10T14:31:44.177871+0000","last_clean":"2024-09-10T14:31:44.177871+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:31:44.177871+0000","last_undegraded":"2024-09-10T14:31:44.177871+0000","last_fullsized":"2024-09-10T14:31:44.177871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:57.779176+0000","last_change":"2024-09-10T14:28:28.880689+0000","last_active":"2024-09-10T14:30:57.779176+0000","last_peered":"2024-09-10T14:30:57.779176+0000","last_clean":"2024-09-10T14:30:57.779176+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:30:57.779176+0000","last_undegraded":"2024-09-10T14:30:57.779176+0000","last_fullsized":"2024-09-10T14:30:57.779176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.785161+0000","last_change":"2024-09-10T14:28:30.889817+0000","last_active":"2024-09-10T14:30:58.785161+0000","last_peered":"2024-09-10T14:30:58.785161+0000","last_clean":"2024-09-10T14:30:58.785161+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:30:58.785161+0000","last_undegraded":"2024-09-10T14:30:58.785161+0000","last_fullsized":"2024-09-10T14:30:58.785161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784264+0000","last_change":"2024-09-10T14:28:28.891649+0000","last_active":"2024-09-10T14:30:48.784264+0000","last_peered":"2024-09-10T14:30:48.784264+0000","last_clean":"2024-09-10T14:30:48.784264+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:30:48.784264+0000","last_undegraded":"2024-09-10T14:30:48.784264+0000","last_fullsized":"2024-09-10T14:30:48.784264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.267414+0000","last_change":"2024-09-10T14:28:38.936524+0000","last_active":"2024-09-10T14:31:44.267414+0000","last_peered":"2024-09-10T14:31:44.267414+0000","last_clean":"2024-09-10T14:31:44.267414+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:31:44.267414+0000","last_undegraded":"2024-09-10T14:31:44.267414+0000","last_fullsized":"2024-09-10T14:31:44.267414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:29.785850+0000","last_change":"2024-09-10T14:29:07.798075+0000","last_active":"2024-09-10T14:31:29.785850+0000","last_peered":"2024-09-10T14:31:29.785850+0000","last_clean":"2024-09-10T14:31:29.785850+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:31:29.785850+0000","last_undegraded":"2024-09-10T14:31:29.785850+0000","last_fullsized":"2024-09-10T14:31:29.785850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784316+0000","last_change":"2024-09-10T14:28:28.894485+0000","last_active":"2024-09-10T14:30:48.784316+0000","last_peered":"2024-09-10T14:30:48.784316+0000","last_clean":"2024-09-10T14:30:48.784316+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:30:48.784316+0000","last_undegraded":"2024-09-10T14:30:48.784316+0000","last_fullsized":"2024-09-10T14:30:48.784316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.424000+0000","last_change":"2024-09-10T14:32:21.424117+0000","last_active":"2024-09-10T14:32:21.424000+0000","last_peered":"2024-09-10T14:32:21.424000+0000","last_clean":"2024-09-10T14:32:21.424000+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:32:21.424000+0000","last_undegraded":"2024-09-10T14:32:21.424000+0000","last_fullsized":"2024-09-10T14:32:21.424000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.423759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:32.872552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'34","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.332885+0000","last_change":"2024-09-10T14:28:34.924424+0000","last_active":"2024-09-10T14:32:15.332885+0000","last_peered":"2024-09-10T14:32:15.332885+0000","last_clean":"2024-09-10T14:32:15.332885+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:32:15.332885+0000","last_undegraded":"2024-09-10T14:32:15.332885+0000","last_fullsized":"2024-09-10T14:32:15.332885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.955541+0000","last_change":"2024-09-10T14:32:34.955641+0000","last_active":"2024-09-10T14:32:34.955541+0000","last_peered":"2024-09-10T14:32:34.955541+0000","last_clean":"2024-09-10T14:32:34.955541+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:32:34.955541+0000","last_undegraded":"2024-09-10T14:32:34.955541+0000","last_fullsized":"2024-09-10T14:32:34.955541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.955261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:29:53.485810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.786268+0000","last_change":"2024-09-10T14:28:38.938155+0000","last_active":"2024-09-10T14:31:03.786268+0000","last_peered":"2024-09-10T14:31:03.786268+0000","last_clean":"2024-09-10T14:31:03.786268+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:31:03.786268+0000","last_undegraded":"2024-09-10T14:31:03.786268+0000","last_fullsized":"2024-09-10T14:31:03.786268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.754518+0000","last_change":"2024-09-10T14:28:30.876193+0000","last_active":"2024-09-10T14:31:43.754518+0000","last_peered":"2024-09-10T14:31:43.754518+0000","last_clean":"2024-09-10T14:31:43.754518+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:31:43.754518+0000","last_undegraded":"2024-09-10T14:31:43.754518+0000","last_fullsized":"2024-09-10T14:31:43.754518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.507638+0000","last_change":"2024-09-10T14:28:28.895357+0000","last_active":"2024-09-10T14:32:15.507638+0000","last_peered":"2024-09-10T14:32:15.507638+0000","last_clean":"2024-09-10T14:32:15.507638+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:32:15.507638+0000","last_undegraded":"2024-09-10T14:32:15.507638+0000","last_fullsized":"2024-09-10T14:32:15.507638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:52.778094+0000","last_change":"2024-09-10T14:28:32.878643+0000","last_active":"2024-09-10T14:30:52.778094+0000","last_peered":"2024-09-10T14:30:52.778094+0000","last_clean":"2024-09-10T14:30:52.778094+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:30:52.778094+0000","last_undegraded":"2024-09-10T14:30:52.778094+0000","last_fullsized":"2024-09-10T14:30:52.778094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.994838+0000","last_change":"2024-09-10T14:32:24.994910+0000","last_active":"2024-09-10T14:32:24.994838+0000","last_peered":"2024-09-10T14:32:24.994838+0000","last_clean":"2024-09-10T14:32:24.994838+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:32:24.994838+0000","last_undegraded":"2024-09-10T14:32:24.994838+0000","last_fullsized":"2024-09-10T14:32:24.994838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.994665+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:23.745673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.984911+0000","last_change":"2024-09-10T14:32:30.985015+0000","last_active":"2024-09-10T14:32:30.984911+0000","last_peered":"2024-09-10T14:32:30.984911+0000","last_clean":"2024-09-10T14:32:30.984911+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:32:30.984911+0000","last_undegraded":"2024-09-10T14:32:30.984911+0000","last_fullsized":"2024-09-10T14:32:30.984911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.984682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:15.495746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:12.782442+0000","last_change":"2024-09-10T14:28:38.928569+0000","last_active":"2024-09-10T14:31:12.782442+0000","last_peered":"2024-09-10T14:31:12.782442+0000","last_clean":"2024-09-10T14:31:12.782442+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:31:12.782442+0000","last_undegraded":"2024-09-10T14:31:12.782442+0000","last_fullsized":"2024-09-10T14:31:12.782442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'1","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.323903+0000","last_change":"2024-09-10T14:28:30.879918+0000","last_active":"2024-09-10T14:31:44.323903+0000","last_peered":"2024-09-10T14:31:44.323903+0000","last_clean":"2024-09-10T14:31:44.323903+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:31:44.323903+0000","last_undegraded":"2024-09-10T14:31:44.323903+0000","last_fullsized":"2024-09-10T14:31:44.323903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.511521+0000","last_change":"2024-09-10T14:28:28.890448+0000","last_active":"2024-09-10T14:32:15.511521+0000","last_peered":"2024-09-10T14:32:15.511521+0000","last_clean":"2024-09-10T14:32:15.511521+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:32:15.511521+0000","last_undegraded":"2024-09-10T14:32:15.511521+0000","last_fullsized":"2024-09-10T14:32:15.511521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.218936+0000","last_change":"2024-09-10T14:32:37.218999+0000","last_active":"2024-09-10T14:32:37.218936+0000","last_peered":"2024-09-10T14:32:37.218936+0000","last_clean":"2024-09-10T14:32:37.218936+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:32:37.218936+0000","last_undegraded":"2024-09-10T14:32:37.218936+0000","last_fullsized":"2024-09-10T14:32:37.218936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.218734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:20.123545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.492091+0000","last_change":"2024-09-10T14:32:28.492161+0000","last_active":"2024-09-10T14:32:28.492091+0000","last_peered":"2024-09-10T14:32:28.492091+0000","last_clean":"2024-09-10T14:32:28.492091+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:32:28.492091+0000","last_undegraded":"2024-09-10T14:32:28.492091+0000","last_fullsized":"2024-09-10T14:32:28.492091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.491906+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:07.716285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":397,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.542515+0000","last_change":"2024-09-10T14:28:36.944400+0000","last_active":"2024-09-10T14:32:15.542515+0000","last_peered":"2024-09-10T14:32:15.542515+0000","last_clean":"2024-09-10T14:32:15.542515+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:32:15.542515+0000","last_undegraded":"2024-09-10T14:32:15.542515+0000","last_fullsized":"2024-09-10T14:32:15.542515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:09.781390+0000","last_change":"2024-09-10T14:28:38.944662+0000","last_active":"2024-09-10T14:31:09.781390+0000","last_peered":"2024-09-10T14:31:09.781390+0000","last_clean":"2024-09-10T14:31:09.781390+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:31:09.781390+0000","last_undegraded":"2024-09-10T14:31:09.781390+0000","last_fullsized":"2024-09-10T14:31:09.781390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'5","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.325548+0000","last_change":"2024-09-10T14:28:30.884927+0000","last_active":"2024-09-10T14:31:44.325548+0000","last_peered":"2024-09-10T14:31:44.325548+0000","last_clean":"2024-09-10T14:31:44.325548+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:31:44.325548+0000","last_undegraded":"2024-09-10T14:31:44.325548+0000","last_fullsized":"2024-09-10T14:31:44.325548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.782295+0000","last_change":"2024-09-10T14:28:28.898609+0000","last_active":"2024-09-10T14:30:48.782295+0000","last_peered":"2024-09-10T14:30:48.782295+0000","last_clean":"2024-09-10T14:30:48.782295+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:30:48.782295+0000","last_undegraded":"2024-09-10T14:30:48.782295+0000","last_fullsized":"2024-09-10T14:30:48.782295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'5","reported_seq":240,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.464976+0000","last_change":"2024-09-10T14:32:24.465044+0000","last_active":"2024-09-10T14:32:24.464976+0000","last_peered":"2024-09-10T14:32:24.464976+0000","last_clean":"2024-09-10T14:32:24.464976+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:32:24.464976+0000","last_undegraded":"2024-09-10T14:32:24.464976+0000","last_fullsized":"2024-09-10T14:32:24.464976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.464758+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:15.815013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.479093+0000","last_change":"2024-09-10T14:32:29.479227+0000","last_active":"2024-09-10T14:32:29.479093+0000","last_peered":"2024-09-10T14:32:29.479093+0000","last_clean":"2024-09-10T14:32:29.479093+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:32:29.479093+0000","last_undegraded":"2024-09-10T14:32:29.479093+0000","last_fullsized":"2024-09-10T14:32:29.479093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.478794+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:53.505918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.041869+0000","last_change":"2024-09-10T14:32:24.041931+0000","last_active":"2024-09-10T14:32:24.041869+0000","last_peered":"2024-09-10T14:32:24.041869+0000","last_clean":"2024-09-10T14:32:24.041869+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:32:24.041869+0000","last_undegraded":"2024-09-10T14:32:24.041869+0000","last_fullsized":"2024-09-10T14:32:24.041869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.041685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:10.399631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.782678+0000","last_change":"2024-09-10T14:28:30.870811+0000","last_active":"2024-09-10T14:30:43.782678+0000","last_peered":"2024-09-10T14:30:43.782678+0000","last_clean":"2024-09-10T14:30:43.782678+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:30:43.782678+0000","last_undegraded":"2024-09-10T14:30:43.782678+0000","last_fullsized":"2024-09-10T14:30:43.782678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:44.775552+0000","last_change":"2024-09-10T14:28:28.910600+0000","last_active":"2024-09-10T14:30:44.775552+0000","last_peered":"2024-09-10T14:30:44.775552+0000","last_clean":"2024-09-10T14:30:44.775552+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:30:44.775552+0000","last_undegraded":"2024-09-10T14:30:44.775552+0000","last_fullsized":"2024-09-10T14:30:44.775552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.014432+0000","last_change":"2024-09-10T14:32:30.014533+0000","last_active":"2024-09-10T14:32:30.014432+0000","last_peered":"2024-09-10T14:32:30.014432+0000","last_clean":"2024-09-10T14:32:30.014432+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:32:30.014432+0000","last_undegraded":"2024-09-10T14:32:30.014432+0000","last_fullsized":"2024-09-10T14:32:30.014432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.014216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:20.605790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":113,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.517892+0000","last_change":"2024-09-10T14:32:34.517939+0000","last_active":"2024-09-10T14:32:34.517892+0000","last_peered":"2024-09-10T14:32:34.517892+0000","last_clean":"2024-09-10T14:32:34.517892+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:32:34.517892+0000","last_undegraded":"2024-09-10T14:32:34.517892+0000","last_fullsized":"2024-09-10T14:32:34.517892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.517813+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:15.055588+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.040409+0000","last_change":"2024-09-10T14:32:19.040437+0000","last_active":"2024-09-10T14:32:19.040409+0000","last_peered":"2024-09-10T14:32:19.040409+0000","last_clean":"2024-09-10T14:32:19.040409+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:32:19.040409+0000","last_undegraded":"2024-09-10T14:32:19.040409+0000","last_fullsized":"2024-09-10T14:32:19.040409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.040292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:34.054916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.402177+0000","last_change":"2024-09-10T14:32:39.402239+0000","last_active":"2024-09-10T14:32:39.402177+0000","last_peered":"2024-09-10T14:32:39.402177+0000","last_clean":"2024-09-10T14:32:39.402177+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:32:39.402177+0000","last_undegraded":"2024-09-10T14:32:39.402177+0000","last_fullsized":"2024-09-10T14:32:39.402177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.401987+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:54.650326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'1","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.323905+0000","last_change":"2024-09-10T14:28:30.867445+0000","last_active":"2024-09-10T14:31:44.323905+0000","last_peered":"2024-09-10T14:31:44.323905+0000","last_clean":"2024-09-10T14:31:44.323905+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:31:44.323905+0000","last_undegraded":"2024-09-10T14:31:44.323905+0000","last_fullsized":"2024-09-10T14:31:44.323905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:44.775490+0000","last_change":"2024-09-10T14:28:28.895275+0000","last_active":"2024-09-10T14:30:44.775490+0000","last_peered":"2024-09-10T14:30:44.775490+0000","last_clean":"2024-09-10T14:30:44.775490+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:30:44.775490+0000","last_undegraded":"2024-09-10T14:30:44.775490+0000","last_fullsized":"2024-09-10T14:30:44.775490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.775345+0000","last_change":"2024-09-10T14:28:32.877092+0000","last_active":"2024-09-10T14:30:42.775345+0000","last_peered":"2024-09-10T14:30:42.775345+0000","last_clean":"2024-09-10T14:30:42.775345+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:30:42.775345+0000","last_undegraded":"2024-09-10T14:30:42.775345+0000","last_fullsized":"2024-09-10T14:30:42.775345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'33","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.452567+0000","last_change":"2024-09-10T14:28:34.915801+0000","last_active":"2024-09-10T14:32:15.452567+0000","last_peered":"2024-09-10T14:32:15.452567+0000","last_clean":"2024-09-10T14:32:15.452567+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:32:15.452567+0000","last_undegraded":"2024-09-10T14:32:15.452567+0000","last_fullsized":"2024-09-10T14:32:15.452567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.039096+0000","last_change":"2024-09-10T14:32:27.039240+0000","last_active":"2024-09-10T14:32:27.039096+0000","last_peered":"2024-09-10T14:32:27.039096+0000","last_clean":"2024-09-10T14:32:27.039096+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:32:27.039096+0000","last_undegraded":"2024-09-10T14:32:27.039096+0000","last_fullsized":"2024-09-10T14:32:27.039096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.038840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:05.450794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'5","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.781338+0000","last_change":"2024-09-10T14:28:38.933258+0000","last_active":"2024-09-10T14:30:43.781338+0000","last_peered":"2024-09-10T14:30:43.781338+0000","last_clean":"2024-09-10T14:30:43.781338+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:30:43.781338+0000","last_undegraded":"2024-09-10T14:30:43.781338+0000","last_fullsized":"2024-09-10T14:30:43.781338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.174109+0000","last_change":"2024-09-10T14:29:07.803940+0000","last_active":"2024-09-10T14:31:44.174109+0000","last_peered":"2024-09-10T14:31:44.174109+0000","last_clean":"2024-09-10T14:31:44.174109+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:31:44.174109+0000","last_undegraded":"2024-09-10T14:31:44.174109+0000","last_fullsized":"2024-09-10T14:31:44.174109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.783146+0000","last_change":"2024-09-10T14:28:28.889610+0000","last_active":"2024-09-10T14:30:43.783146+0000","last_peered":"2024-09-10T14:30:43.783146+0000","last_clean":"2024-09-10T14:30:43.783146+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:30:43.783146+0000","last_undegraded":"2024-09-10T14:30:43.783146+0000","last_fullsized":"2024-09-10T14:30:43.783146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776959+0000","last_change":"2024-09-10T14:28:32.877306+0000","last_active":"2024-09-10T14:30:47.776959+0000","last_peered":"2024-09-10T14:30:47.776959+0000","last_clean":"2024-09-10T14:30:47.776959+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:30:47.776959+0000","last_undegraded":"2024-09-10T14:30:47.776959+0000","last_fullsized":"2024-09-10T14:30:47.776959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'47","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.415087+0000","last_change":"2024-09-10T14:32:27.415162+0000","last_active":"2024-09-10T14:32:27.415087+0000","last_peered":"2024-09-10T14:32:27.415087+0000","last_clean":"2024-09-10T14:32:27.415087+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:32:27.415087+0000","last_undegraded":"2024-09-10T14:32:27.415087+0000","last_fullsized":"2024-09-10T14:32:27.415087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.414901+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:51.152227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":369,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.166310+0000","last_change":"2024-09-10T14:32:31.166376+0000","last_active":"2024-09-10T14:32:31.166310+0000","last_peered":"2024-09-10T14:32:31.166310+0000","last_clean":"2024-09-10T14:32:31.166310+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:32:31.166310+0000","last_undegraded":"2024-09-10T14:32:31.166310+0000","last_fullsized":"2024-09-10T14:32:31.166310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.166120+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:33.186827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:52.778155+0000","last_change":"2024-09-10T14:28:38.936021+0000","last_active":"2024-09-10T14:30:52.778155+0000","last_peered":"2024-09-10T14:30:52.778155+0000","last_clean":"2024-09-10T14:30:52.778155+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:30:52.778155+0000","last_undegraded":"2024-09-10T14:30:52.778155+0000","last_fullsized":"2024-09-10T14:30:52.778155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'11","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.323308+0000","last_change":"2024-09-10T14:28:30.859489+0000","last_active":"2024-09-10T14:31:44.323308+0000","last_peered":"2024-09-10T14:31:44.323308+0000","last_clean":"2024-09-10T14:31:44.323308+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:31:44.323308+0000","last_undegraded":"2024-09-10T14:31:44.323308+0000","last_fullsized":"2024-09-10T14:31:44.323308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.782947+0000","last_change":"2024-09-10T14:28:28.884739+0000","last_active":"2024-09-10T14:30:43.782947+0000","last_peered":"2024-09-10T14:30:43.782947+0000","last_clean":"2024-09-10T14:30:43.782947+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:30:43.782947+0000","last_undegraded":"2024-09-10T14:30:43.782947+0000","last_fullsized":"2024-09-10T14:30:43.782947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"36'2","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.252059+0000","last_change":"2024-09-10T14:32:36.252127+0000","last_active":"2024-09-10T14:32:36.252059+0000","last_peered":"2024-09-10T14:32:36.252059+0000","last_clean":"2024-09-10T14:32:36.252059+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:32:36.252059+0000","last_undegraded":"2024-09-10T14:32:36.252059+0000","last_fullsized":"2024-09-10T14:32:36.252059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.251846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:51:42.564689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'64","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.463727+0000","last_change":"2024-09-10T14:32:33.463817+0000","last_active":"2024-09-10T14:32:33.463727+0000","last_peered":"2024-09-10T14:32:33.463727+0000","last_clean":"2024-09-10T14:32:33.463727+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:32:33.463727+0000","last_undegraded":"2024-09-10T14:32:33.463727+0000","last_fullsized":"2024-09-10T14:32:33.463727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'64","last_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_deep_scrub":"36'64","last_deep_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.463523+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:28.060036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.053757+0000","last_change":"2024-09-10T14:32:21.053813+0000","last_active":"2024-09-10T14:32:21.053757+0000","last_peered":"2024-09-10T14:32:21.053757+0000","last_clean":"2024-09-10T14:32:21.053757+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:32:21.053757+0000","last_undegraded":"2024-09-10T14:32:21.053757+0000","last_fullsized":"2024-09-10T14:32:21.053757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.053565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:23.410520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'20","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.392208+0000","last_change":"2024-09-10T14:28:38.919907+0000","last_active":"2024-09-10T14:31:44.392208+0000","last_peered":"2024-09-10T14:31:44.392208+0000","last_clean":"2024-09-10T14:31:44.392208+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:31:44.392208+0000","last_undegraded":"2024-09-10T14:31:44.392208+0000","last_fullsized":"2024-09-10T14:31:44.392208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.325782+0000","last_change":"2024-09-10T14:28:30.878590+0000","last_active":"2024-09-10T14:31:44.325782+0000","last_peered":"2024-09-10T14:31:44.325782+0000","last_clean":"2024-09-10T14:31:44.325782+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:31:44.325782+0000","last_undegraded":"2024-09-10T14:31:44.325782+0000","last_fullsized":"2024-09-10T14:31:44.325782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776975+0000","last_change":"2024-09-10T14:28:28.877127+0000","last_active":"2024-09-10T14:30:47.776975+0000","last_peered":"2024-09-10T14:30:47.776975+0000","last_clean":"2024-09-10T14:30:47.776975+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:30:47.776975+0000","last_undegraded":"2024-09-10T14:30:47.776975+0000","last_fullsized":"2024-09-10T14:30:47.776975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776691+0000","last_change":"2024-09-10T14:28:32.878178+0000","last_active":"2024-09-10T14:30:49.776691+0000","last_peered":"2024-09-10T14:30:49.776691+0000","last_clean":"2024-09-10T14:30:49.776691+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:30:49.776691+0000","last_undegraded":"2024-09-10T14:30:49.776691+0000","last_fullsized":"2024-09-10T14:30:49.776691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.040219+0000","last_change":"2024-09-10T14:32:26.040293+0000","last_active":"2024-09-10T14:32:26.040219+0000","last_peered":"2024-09-10T14:32:26.040219+0000","last_clean":"2024-09-10T14:32:26.040219+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:32:26.040219+0000","last_undegraded":"2024-09-10T14:32:26.040219+0000","last_fullsized":"2024-09-10T14:32:26.040219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.040008+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:55.634620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.785831+0000","last_change":"2024-09-10T14:28:36.946071+0000","last_active":"2024-09-10T14:30:53.785831+0000","last_peered":"2024-09-10T14:30:53.785831+0000","last_clean":"2024-09-10T14:30:53.785831+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:30:53.785831+0000","last_undegraded":"2024-09-10T14:30:53.785831+0000","last_fullsized":"2024-09-10T14:30:53.785831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243371+0000","last_change":"2024-09-10T14:28:38.941887+0000","last_active":"2024-09-10T14:32:20.243371+0000","last_peered":"2024-09-10T14:32:20.243371+0000","last_clean":"2024-09-10T14:32:20.243371+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:32:20.243371+0000","last_undegraded":"2024-09-10T14:32:20.243371+0000","last_fullsized":"2024-09-10T14:32:20.243371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.478515+0000","last_change":"2024-09-10T14:32:32.478577+0000","last_active":"2024-09-10T14:32:32.478515+0000","last_peered":"2024-09-10T14:32:32.478515+0000","last_clean":"2024-09-10T14:32:32.478515+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:32:32.478515+0000","last_undegraded":"2024-09-10T14:32:32.478515+0000","last_fullsized":"2024-09-10T14:32:32.478515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.478327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:57.945668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:38.781631+0000","last_change":"2024-09-10T14:28:28.891910+0000","last_active":"2024-09-10T14:30:38.781631+0000","last_peered":"2024-09-10T14:30:38.781631+0000","last_clean":"2024-09-10T14:30:38.781631+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:30:38.781631+0000","last_undegraded":"2024-09-10T14:30:38.781631+0000","last_fullsized":"2024-09-10T14:30:38.781631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.777015+0000","last_change":"2024-09-10T14:28:32.877582+0000","last_active":"2024-09-10T14:30:47.777015+0000","last_peered":"2024-09-10T14:30:47.777015+0000","last_clean":"2024-09-10T14:30:47.777015+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:30:47.777015+0000","last_undegraded":"2024-09-10T14:30:47.777015+0000","last_fullsized":"2024-09-10T14:30:47.777015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.499266+0000","last_change":"2024-09-10T14:32:33.499425+0000","last_active":"2024-09-10T14:32:33.499266+0000","last_peered":"2024-09-10T14:32:33.499266+0000","last_clean":"2024-09-10T14:32:33.499266+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:32:33.499266+0000","last_undegraded":"2024-09-10T14:32:33.499266+0000","last_fullsized":"2024-09-10T14:32:33.499266+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.499022+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":445,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.396495+0000","last_change":"2024-09-10T14:32:22.396571+0000","last_active":"2024-09-10T14:32:22.396495+0000","last_peered":"2024-09-10T14:32:22.396495+0000","last_clean":"2024-09-10T14:32:22.396495+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:32:22.396495+0000","last_undegraded":"2024-09-10T14:32:22.396495+0000","last_fullsized":"2024-09-10T14:32:22.396495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.396275+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:50.169559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.339088+0000","last_change":"2024-09-10T14:28:38.936015+0000","last_active":"2024-09-10T14:31:44.339088+0000","last_peered":"2024-09-10T14:31:44.339088+0000","last_clean":"2024-09-10T14:31:44.339088+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:31:44.339088+0000","last_undegraded":"2024-09-10T14:31:44.339088+0000","last_fullsized":"2024-09-10T14:31:44.339088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.755598+0000","last_change":"2024-09-10T14:28:30.869152+0000","last_active":"2024-09-10T14:31:43.755598+0000","last_peered":"2024-09-10T14:31:43.755598+0000","last_clean":"2024-09-10T14:31:43.755598+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:31:43.755598+0000","last_undegraded":"2024-09-10T14:31:43.755598+0000","last_fullsized":"2024-09-10T14:31:43.755598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.220281+0000","last_change":"2024-09-10T14:28:28.890431+0000","last_active":"2024-09-10T14:31:44.220281+0000","last_peered":"2024-09-10T14:31:44.220281+0000","last_clean":"2024-09-10T14:31:44.220281+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:31:44.220281+0000","last_undegraded":"2024-09-10T14:31:44.220281+0000","last_fullsized":"2024-09-10T14:31:44.220281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.957431+0000","last_change":"2024-09-10T14:32:31.957497+0000","last_active":"2024-09-10T14:32:31.957431+0000","last_peered":"2024-09-10T14:32:31.957431+0000","last_clean":"2024-09-10T14:32:31.957431+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:32:31.957431+0000","last_undegraded":"2024-09-10T14:32:31.957431+0000","last_fullsized":"2024-09-10T14:32:31.957431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.957244+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:59.661372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.785687+0000","last_change":"2024-09-10T14:28:34.926311+0000","last_active":"2024-09-10T14:30:53.785687+0000","last_peered":"2024-09-10T14:30:53.785687+0000","last_clean":"2024-09-10T14:30:53.785687+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:30:53.785687+0000","last_undegraded":"2024-09-10T14:30:53.785687+0000","last_fullsized":"2024-09-10T14:30:53.785687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":474,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.046172+0000","last_change":"2024-09-10T14:32:27.046231+0000","last_active":"2024-09-10T14:32:27.046172+0000","last_peered":"2024-09-10T14:32:27.046172+0000","last_clean":"2024-09-10T14:32:27.046172+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:32:27.046172+0000","last_undegraded":"2024-09-10T14:32:27.046172+0000","last_fullsized":"2024-09-10T14:32:27.046172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.045975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:13.403921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.470010+0000","last_change":"2024-09-10T14:32:31.470074+0000","last_active":"2024-09-10T14:32:31.470010+0000","last_peered":"2024-09-10T14:32:31.470010+0000","last_clean":"2024-09-10T14:32:31.470010+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:32:31.470010+0000","last_undegraded":"2024-09-10T14:32:31.470010+0000","last_fullsized":"2024-09-10T14:32:31.470010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.469828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:50.291732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'6","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.325605+0000","last_change":"2024-09-10T14:28:30.889847+0000","last_active":"2024-09-10T14:31:44.325605+0000","last_peered":"2024-09-10T14:31:44.325605+0000","last_clean":"2024-09-10T14:31:44.325605+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:31:44.325605+0000","last_undegraded":"2024-09-10T14:31:44.325605+0000","last_fullsized":"2024-09-10T14:31:44.325605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:38.781536+0000","last_change":"2024-09-10T14:28:28.894339+0000","last_active":"2024-09-10T14:30:38.781536+0000","last_peered":"2024-09-10T14:30:38.781536+0000","last_clean":"2024-09-10T14:30:38.781536+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:30:38.781536+0000","last_undegraded":"2024-09-10T14:30:38.781536+0000","last_fullsized":"2024-09-10T14:30:38.781536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.468611+0000","last_change":"2024-09-10T14:32:23.468662+0000","last_active":"2024-09-10T14:32:23.468611+0000","last_peered":"2024-09-10T14:32:23.468611+0000","last_clean":"2024-09-10T14:32:23.468611+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:32:23.468611+0000","last_undegraded":"2024-09-10T14:32:23.468611+0000","last_fullsized":"2024-09-10T14:32:23.468611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.468416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:16.409761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.022982+0000","last_change":"2024-09-10T14:32:28.023066+0000","last_active":"2024-09-10T14:32:28.022982+0000","last_peered":"2024-09-10T14:32:28.022982+0000","last_clean":"2024-09-10T14:32:28.022982+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:32:28.022982+0000","last_undegraded":"2024-09-10T14:32:28.022982+0000","last_fullsized":"2024-09-10T14:32:28.022982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.022782+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:04.020612+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.346377+0000","last_change":"2024-09-10T14:32:21.346431+0000","last_active":"2024-09-10T14:32:21.346377+0000","last_peered":"2024-09-10T14:32:21.346377+0000","last_clean":"2024-09-10T14:32:21.346377+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:32:21.346377+0000","last_undegraded":"2024-09-10T14:32:21.346377+0000","last_fullsized":"2024-09-10T14:32:21.346377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.346185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:37.786157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'14","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.386723+0000","last_change":"2024-09-10T14:28:38.912768+0000","last_active":"2024-09-10T14:31:44.386723+0000","last_peered":"2024-09-10T14:31:44.386723+0000","last_clean":"2024-09-10T14:31:44.386723+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:31:44.386723+0000","last_undegraded":"2024-09-10T14:31:44.386723+0000","last_fullsized":"2024-09-10T14:31:44.386723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.450681+0000","last_change":"2024-09-10T14:32:36.450748+0000","last_active":"2024-09-10T14:32:36.450681+0000","last_peered":"2024-09-10T14:32:36.450681+0000","last_clean":"2024-09-10T14:32:36.450681+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:32:36.450681+0000","last_undegraded":"2024-09-10T14:32:36.450681+0000","last_fullsized":"2024-09-10T14:32:36.450681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.450484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:32.265283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":209,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.802861+0000","last_change":"2024-09-10T14:28:16.789816+0000","last_active":"2024-09-10T14:32:18.802861+0000","last_peered":"2024-09-10T14:32:18.802861+0000","last_clean":"2024-09-10T14:32:18.802861+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:32:18.802861+0000","last_undegraded":"2024-09-10T14:32:18.802861+0000","last_fullsized":"2024-09-10T14:32:18.802861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_clean_scrub_stamp":"2024-09-10T14:28:14.781430+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240704+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:32:20.240704+0000","last_peered":"2024-09-10T14:32:20.240704+0000","last_clean":"2024-09-10T14:32:20.240704+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:32:20.240704+0000","last_undegraded":"2024-09-10T14:32:20.240704+0000","last_fullsized":"2024-09-10T14:32:20.240704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240727+0000","last_change":"2024-09-10T14:28:28.892198+0000","last_active":"2024-09-10T14:32:20.240727+0000","last_peered":"2024-09-10T14:32:20.240727+0000","last_clean":"2024-09-10T14:32:20.240727+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:32:20.240727+0000","last_undegraded":"2024-09-10T14:32:20.240727+0000","last_fullsized":"2024-09-10T14:32:20.240727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.952643+0000","last_change":"2024-09-10T14:32:36.952793+0000","last_active":"2024-09-10T14:32:36.952643+0000","last_peered":"2024-09-10T14:32:36.952643+0000","last_clean":"2024-09-10T14:32:36.952643+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:32:36.952643+0000","last_undegraded":"2024-09-10T14:32:36.952643+0000","last_fullsized":"2024-09-10T14:32:36.952643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.952410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:45.541704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'85","reported_seq":169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.412659+0000","last_change":"2024-09-10T14:28:34.925793+0000","last_active":"2024-09-10T14:32:15.412659+0000","last_peered":"2024-09-10T14:32:15.412659+0000","last_clean":"2024-09-10T14:32:15.412659+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:32:15.412659+0000","last_undegraded":"2024-09-10T14:32:15.412659+0000","last_fullsized":"2024-09-10T14:32:15.412659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.777093+0000","last_change":"2024-09-10T14:28:36.925074+0000","last_active":"2024-09-10T14:30:47.777093+0000","last_peered":"2024-09-10T14:30:47.777093+0000","last_clean":"2024-09-10T14:30:47.777093+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:30:47.777093+0000","last_undegraded":"2024-09-10T14:30:47.777093+0000","last_fullsized":"2024-09-10T14:30:47.777093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":174,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.463624+0000","last_change":"2024-09-10T14:32:27.463686+0000","last_active":"2024-09-10T14:32:27.463624+0000","last_peered":"2024-09-10T14:32:27.463624+0000","last_clean":"2024-09-10T14:32:27.463624+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:32:27.463624+0000","last_undegraded":"2024-09-10T14:32:27.463624+0000","last_fullsized":"2024-09-10T14:32:27.463624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.463440+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:01.315498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.783211+0000","last_change":"2024-09-10T14:28:30.878284+0000","last_active":"2024-09-10T14:30:43.783211+0000","last_peered":"2024-09-10T14:30:43.783211+0000","last_clean":"2024-09-10T14:30:43.783211+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:30:43.783211+0000","last_undegraded":"2024-09-10T14:30:43.783211+0000","last_fullsized":"2024-09-10T14:30:43.783211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.805659+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:32:18.805659+0000","last_peered":"2024-09-10T14:32:18.805659+0000","last_clean":"2024-09-10T14:32:18.805659+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:32:18.805659+0000","last_undegraded":"2024-09-10T14:32:18.805659+0000","last_fullsized":"2024-09-10T14:32:18.805659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.510155+0000","last_change":"2024-09-10T14:28:28.873736+0000","last_active":"2024-09-10T14:32:15.510155+0000","last_peered":"2024-09-10T14:32:15.510155+0000","last_clean":"2024-09-10T14:32:15.510155+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:32:15.510155+0000","last_undegraded":"2024-09-10T14:32:15.510155+0000","last_fullsized":"2024-09-10T14:32:15.510155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.452994+0000","last_change":"2024-09-10T14:32:22.453049+0000","last_active":"2024-09-10T14:32:22.452994+0000","last_peered":"2024-09-10T14:32:22.452994+0000","last_clean":"2024-09-10T14:32:22.452994+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:32:22.452994+0000","last_undegraded":"2024-09-10T14:32:22.452994+0000","last_fullsized":"2024-09-10T14:32:22.452994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.452808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:07.398717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'292","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.028702+0000","last_change":"2024-09-10T14:32:22.028865+0000","last_active":"2024-09-10T14:32:22.028702+0000","last_peered":"2024-09-10T14:32:22.028702+0000","last_clean":"2024-09-10T14:32:22.028702+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:32:22.028702+0000","last_undegraded":"2024-09-10T14:32:22.028702+0000","last_fullsized":"2024-09-10T14:32:22.028702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'292","last_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_deep_scrub":"36'292","last_deep_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.028508+0000","objects_scrubbed":10,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:37.043133+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.783020+0000","last_change":"2024-09-10T14:28:36.943974+0000","last_active":"2024-09-10T14:30:43.783020+0000","last_peered":"2024-09-10T14:30:43.783020+0000","last_clean":"2024-09-10T14:30:43.783020+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:30:43.783020+0000","last_undegraded":"2024-09-10T14:30:43.783020+0000","last_fullsized":"2024-09-10T14:30:43.783020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.082650+0000","last_change":"2024-09-10T14:28:38.943158+0000","last_active":"2024-09-10T14:31:44.082650+0000","last_peered":"2024-09-10T14:31:44.082650+0000","last_clean":"2024-09-10T14:31:44.082650+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:31:44.082650+0000","last_undegraded":"2024-09-10T14:31:44.082650+0000","last_fullsized":"2024-09-10T14:31:44.082650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.775843+0000","last_change":"2024-09-10T14:28:30.884260+0000","last_active":"2024-09-10T14:30:42.775843+0000","last_peered":"2024-09-10T14:30:42.775843+0000","last_clean":"2024-09-10T14:30:42.775843+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:30:42.775843+0000","last_undegraded":"2024-09-10T14:30:42.775843+0000","last_fullsized":"2024-09-10T14:30:42.775843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758240+0000","last_change":"2024-09-10T14:28:21.859213+0000","last_active":"2024-09-10T14:32:19.758240+0000","last_peered":"2024-09-10T14:32:19.758240+0000","last_clean":"2024-09-10T14:32:19.758240+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:32:19.758240+0000","last_undegraded":"2024-09-10T14:32:19.758240+0000","last_fullsized":"2024-09-10T14:32:19.758240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806569+0000","last_change":"2024-09-10T14:28:28.874080+0000","last_active":"2024-09-10T14:32:18.806569+0000","last_peered":"2024-09-10T14:32:18.806569+0000","last_clean":"2024-09-10T14:32:18.806569+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:32:18.806569+0000","last_undegraded":"2024-09-10T14:32:18.806569+0000","last_fullsized":"2024-09-10T14:32:18.806569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:44.775466+0000","last_change":"2024-09-10T14:28:32.871141+0000","last_active":"2024-09-10T14:30:44.775466+0000","last_peered":"2024-09-10T14:30:44.775466+0000","last_clean":"2024-09-10T14:30:44.775466+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:30:44.775466+0000","last_undegraded":"2024-09-10T14:30:44.775466+0000","last_fullsized":"2024-09-10T14:30:44.775466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'24","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.504219+0000","last_change":"2024-09-10T14:32:36.504309+0000","last_active":"2024-09-10T14:32:36.504219+0000","last_peered":"2024-09-10T14:32:36.504219+0000","last_clean":"2024-09-10T14:32:36.504219+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:32:36.504219+0000","last_undegraded":"2024-09-10T14:32:36.504219+0000","last_fullsized":"2024-09-10T14:32:36.504219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.504009+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:54.102292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.223775+0000","last_change":"2024-09-10T14:32:35.223829+0000","last_active":"2024-09-10T14:32:35.223775+0000","last_peered":"2024-09-10T14:32:35.223775+0000","last_clean":"2024-09-10T14:32:35.223775+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:32:35.223775+0000","last_undegraded":"2024-09-10T14:32:35.223775+0000","last_fullsized":"2024-09-10T14:32:35.223775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.223582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:41.920597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.785584+0000","last_change":"2024-09-10T14:28:38.943308+0000","last_active":"2024-09-10T14:30:53.785584+0000","last_peered":"2024-09-10T14:30:53.785584+0000","last_clean":"2024-09-10T14:30:53.785584+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:30:53.785584+0000","last_undegraded":"2024-09-10T14:30:53.785584+0000","last_fullsized":"2024-09-10T14:30:53.785584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.245516+0000","last_change":"2024-09-10T14:28:30.863131+0000","last_active":"2024-09-10T14:31:44.245516+0000","last_peered":"2024-09-10T14:31:44.245516+0000","last_clean":"2024-09-10T14:31:44.245516+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:31:44.245516+0000","last_undegraded":"2024-09-10T14:31:44.245516+0000","last_fullsized":"2024-09-10T14:31:44.245516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240672+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:32:20.240672+0000","last_peered":"2024-09-10T14:32:20.240672+0000","last_clean":"2024-09-10T14:32:20.240672+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:32:20.240672+0000","last_undegraded":"2024-09-10T14:32:20.240672+0000","last_fullsized":"2024-09-10T14:32:20.240672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758284+0000","last_change":"2024-09-10T14:28:28.892687+0000","last_active":"2024-09-10T14:32:19.758284+0000","last_peered":"2024-09-10T14:32:19.758284+0000","last_clean":"2024-09-10T14:32:19.758284+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:32:19.758284+0000","last_undegraded":"2024-09-10T14:32:19.758284+0000","last_fullsized":"2024-09-10T14:32:19.758284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.202450+0000","last_change":"2024-09-10T14:32:34.202503+0000","last_active":"2024-09-10T14:32:34.202450+0000","last_peered":"2024-09-10T14:32:34.202450+0000","last_clean":"2024-09-10T14:32:34.202450+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:32:34.202450+0000","last_undegraded":"2024-09-10T14:32:34.202450+0000","last_fullsized":"2024-09-10T14:32:34.202450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.202259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:34.865922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'13","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.172075+0000","last_change":"2024-09-10T14:28:34.924692+0000","last_active":"2024-09-10T14:31:43.172075+0000","last_peered":"2024-09-10T14:31:43.172075+0000","last_clean":"2024-09-10T14:31:43.172075+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:31:43.172075+0000","last_undegraded":"2024-09-10T14:31:43.172075+0000","last_fullsized":"2024-09-10T14:31:43.172075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784551+0000","last_change":"2024-09-10T14:28:36.943077+0000","last_active":"2024-09-10T14:30:48.784551+0000","last_peered":"2024-09-10T14:30:48.784551+0000","last_clean":"2024-09-10T14:30:48.784551+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:30:48.784551+0000","last_undegraded":"2024-09-10T14:30:48.784551+0000","last_fullsized":"2024-09-10T14:30:48.784551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.782217+0000","last_change":"2024-09-10T14:28:38.927597+0000","last_active":"2024-09-10T14:30:48.782217+0000","last_peered":"2024-09-10T14:30:48.782217+0000","last_clean":"2024-09-10T14:30:48.782217+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:30:48.782217+0000","last_undegraded":"2024-09-10T14:30:48.782217+0000","last_fullsized":"2024-09-10T14:30:48.782217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:38.780062+0000","last_change":"2024-09-10T14:28:30.886735+0000","last_active":"2024-09-10T14:30:38.780062+0000","last_peered":"2024-09-10T14:30:38.780062+0000","last_clean":"2024-09-10T14:30:38.780062+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:30:38.780062+0000","last_undegraded":"2024-09-10T14:30:38.780062+0000","last_fullsized":"2024-09-10T14:30:38.780062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758374+0000","last_change":"2024-09-10T14:28:28.911271+0000","last_active":"2024-09-10T14:32:19.758374+0000","last_peered":"2024-09-10T14:32:19.758374+0000","last_clean":"2024-09-10T14:32:19.758374+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:32:19.758374+0000","last_undegraded":"2024-09-10T14:32:19.758374+0000","last_fullsized":"2024-09-10T14:32:19.758374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806442+0000","last_change":"2024-09-10T14:28:21.327700+0000","last_active":"2024-09-10T14:32:18.806442+0000","last_peered":"2024-09-10T14:32:18.806442+0000","last_clean":"2024-09-10T14:32:18.806442+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:32:18.806442+0000","last_undegraded":"2024-09-10T14:32:18.806442+0000","last_fullsized":"2024-09-10T14:32:18.806442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.204746+0000","last_change":"2024-09-10T14:29:07.784812+0000","last_active":"2024-09-10T14:32:15.204746+0000","last_peered":"2024-09-10T14:32:15.204746+0000","last_clean":"2024-09-10T14:32:15.204746+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:32:15.204746+0000","last_undegraded":"2024-09-10T14:32:15.204746+0000","last_fullsized":"2024-09-10T14:32:15.204746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'74","reported_seq":153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.093004+0000","last_change":"2024-09-10T14:32:29.093004+0000","last_active":"2024-09-10T14:32:29.093004+0000","last_peered":"2024-09-10T14:32:29.093004+0000","last_clean":"2024-09-10T14:32:29.093004+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:32:29.093004+0000","last_undegraded":"2024-09-10T14:32:29.093004+0000","last_fullsized":"2024-09-10T14:32:29.093004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.092705+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:13.603769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.438571+0000","last_change":"2024-09-10T14:32:24.438626+0000","last_active":"2024-09-10T14:32:24.438571+0000","last_peered":"2024-09-10T14:32:24.438571+0000","last_clean":"2024-09-10T14:32:24.438571+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:32:24.438571+0000","last_undegraded":"2024-09-10T14:32:24.438571+0000","last_fullsized":"2024-09-10T14:32:24.438571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.438373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:44.201354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:57.779310+0000","last_change":"2024-09-10T14:28:38.924566+0000","last_active":"2024-09-10T14:30:57.779310+0000","last_peered":"2024-09-10T14:30:57.779310+0000","last_clean":"2024-09-10T14:30:57.779310+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:30:57.779310+0000","last_undegraded":"2024-09-10T14:30:57.779310+0000","last_fullsized":"2024-09-10T14:30:57.779310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244808+0000","last_change":"2024-09-10T14:28:30.889728+0000","last_active":"2024-09-10T14:31:44.244808+0000","last_peered":"2024-09-10T14:31:44.244808+0000","last_clean":"2024-09-10T14:31:44.244808+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:31:44.244808+0000","last_undegraded":"2024-09-10T14:31:44.244808+0000","last_fullsized":"2024-09-10T14:31:44.244808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:37.774399+0000","last_change":"2024-09-10T14:28:28.907627+0000","last_active":"2024-09-10T14:30:37.774399+0000","last_peered":"2024-09-10T14:30:37.774399+0000","last_clean":"2024-09-10T14:30:37.774399+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:30:37.774399+0000","last_undegraded":"2024-09-10T14:30:37.774399+0000","last_fullsized":"2024-09-10T14:30:37.774399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240674+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:32:20.240674+0000","last_peered":"2024-09-10T14:32:20.240674+0000","last_clean":"2024-09-10T14:32:20.240674+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:32:20.240674+0000","last_undegraded":"2024-09-10T14:32:20.240674+0000","last_fullsized":"2024-09-10T14:32:20.240674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.399127+0000","last_change":"2024-09-10T14:32:28.399267+0000","last_active":"2024-09-10T14:32:28.399127+0000","last_peered":"2024-09-10T14:32:28.399127+0000","last_clean":"2024-09-10T14:32:28.399127+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:32:28.399127+0000","last_undegraded":"2024-09-10T14:32:28.399127+0000","last_fullsized":"2024-09-10T14:32:28.399127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.398875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:59.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'22","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.978260+0000","last_change":"2024-09-10T14:32:20.978344+0000","last_active":"2024-09-10T14:32:20.978260+0000","last_peered":"2024-09-10T14:32:20.978260+0000","last_clean":"2024-09-10T14:32:20.978260+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:32:20.978260+0000","last_undegraded":"2024-09-10T14:32:20.978260+0000","last_fullsized":"2024-09-10T14:32:20.978260+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.978065+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:42.621330+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":390,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.978149+0000","last_change":"2024-09-10T14:32:22.978149+0000","last_active":"2024-09-10T14:32:22.978149+0000","last_peered":"2024-09-10T14:32:22.978149+0000","last_clean":"2024-09-10T14:32:22.978149+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:32:22.978149+0000","last_undegraded":"2024-09-10T14:32:22.978149+0000","last_fullsized":"2024-09-10T14:32:22.978149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.977905+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:38.553496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.747952+0000","last_change":"2024-09-10T14:28:38.937953+0000","last_active":"2024-09-10T14:31:43.747952+0000","last_peered":"2024-09-10T14:31:43.747952+0000","last_clean":"2024-09-10T14:31:43.747952+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:31:43.747952+0000","last_undegraded":"2024-09-10T14:31:43.747952+0000","last_fullsized":"2024-09-10T14:31:43.747952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.418284+0000","last_change":"2024-09-10T14:32:37.418352+0000","last_active":"2024-09-10T14:32:37.418284+0000","last_peered":"2024-09-10T14:32:37.418284+0000","last_clean":"2024-09-10T14:32:37.418284+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:32:37.418284+0000","last_undegraded":"2024-09-10T14:32:37.418284+0000","last_fullsized":"2024-09-10T14:32:37.418284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.418081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:08.888989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.691848+0000","last_change":"2024-09-10T14:28:28.891219+0000","last_active":"2024-09-10T14:31:43.691848+0000","last_peered":"2024-09-10T14:31:43.691848+0000","last_clean":"2024-09-10T14:31:43.691848+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:31:43.691848+0000","last_undegraded":"2024-09-10T14:31:43.691848+0000","last_fullsized":"2024-09-10T14:31:43.691848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:32.773241+0000","last_change":"2024-09-10T14:28:21.327784+0000","last_active":"2024-09-10T14:30:32.773241+0000","last_peered":"2024-09-10T14:30:32.773241+0000","last_clean":"2024-09-10T14:30:32.773241+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:30:32.773241+0000","last_undegraded":"2024-09-10T14:30:32.773241+0000","last_fullsized":"2024-09-10T14:30:32.773241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.448876+0000","last_change":"2024-09-10T14:32:29.448927+0000","last_active":"2024-09-10T14:32:29.448876+0000","last_peered":"2024-09-10T14:32:29.448876+0000","last_clean":"2024-09-10T14:32:29.448876+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:32:29.448876+0000","last_undegraded":"2024-09-10T14:32:29.448876+0000","last_fullsized":"2024-09-10T14:32:29.448876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.448685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:13.499393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'15","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.429418+0000","last_change":"2024-09-10T14:32:35.429507+0000","last_active":"2024-09-10T14:32:35.429418+0000","last_peered":"2024-09-10T14:32:35.429418+0000","last_clean":"2024-09-10T14:32:35.429418+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:32:35.429418+0000","last_undegraded":"2024-09-10T14:32:35.429418+0000","last_fullsized":"2024-09-10T14:32:35.429418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.429210+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:32.213391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.060621+0000","last_change":"2024-09-10T14:32:25.060686+0000","last_active":"2024-09-10T14:32:25.060621+0000","last_peered":"2024-09-10T14:32:25.060621+0000","last_clean":"2024-09-10T14:32:25.060621+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:32:25.060621+0000","last_undegraded":"2024-09-10T14:32:25.060621+0000","last_fullsized":"2024-09-10T14:32:25.060621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.060434+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:01.652381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783765+0000","last_change":"2024-09-10T14:28:38.934660+0000","last_active":"2024-09-10T14:30:53.783765+0000","last_peered":"2024-09-10T14:30:53.783765+0000","last_clean":"2024-09-10T14:30:53.783765+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:30:53.783765+0000","last_undegraded":"2024-09-10T14:30:53.783765+0000","last_fullsized":"2024-09-10T14:30:53.783765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244908+0000","last_change":"2024-09-10T14:28:30.872139+0000","last_active":"2024-09-10T14:31:44.244908+0000","last_peered":"2024-09-10T14:31:44.244908+0000","last_clean":"2024-09-10T14:31:44.244908+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:31:44.244908+0000","last_undegraded":"2024-09-10T14:31:44.244908+0000","last_fullsized":"2024-09-10T14:31:44.244908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.509611+0000","last_change":"2024-09-10T14:28:28.904513+0000","last_active":"2024-09-10T14:32:15.509611+0000","last_peered":"2024-09-10T14:32:15.509611+0000","last_clean":"2024-09-10T14:32:15.509611+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:32:15.509611+0000","last_undegraded":"2024-09-10T14:32:15.509611+0000","last_fullsized":"2024-09-10T14:32:15.509611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240704+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:32:20.240704+0000","last_peered":"2024-09-10T14:32:20.240704+0000","last_clean":"2024-09-10T14:32:20.240704+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:32:20.240704+0000","last_undegraded":"2024-09-10T14:32:20.240704+0000","last_fullsized":"2024-09-10T14:32:20.240704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.463375+0000","last_change":"2024-09-10T14:32:30.463375+0000","last_active":"2024-09-10T14:32:30.463375+0000","last_peered":"2024-09-10T14:32:30.463375+0000","last_clean":"2024-09-10T14:32:30.463375+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:32:30.463375+0000","last_undegraded":"2024-09-10T14:32:30.463375+0000","last_fullsized":"2024-09-10T14:32:30.463375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.463102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:57.418601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.518995+0000","last_change":"2024-09-10T14:32:30.519074+0000","last_active":"2024-09-10T14:32:30.518995+0000","last_peered":"2024-09-10T14:32:30.518995+0000","last_clean":"2024-09-10T14:32:30.518995+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:32:30.518995+0000","last_undegraded":"2024-09-10T14:32:30.518995+0000","last_fullsized":"2024-09-10T14:32:30.518995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'97","last_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_deep_scrub":"36'97","last_deep_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.518776+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:01.405166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.030324+0000","last_change":"2024-09-10T14:32:22.030434+0000","last_active":"2024-09-10T14:32:22.030324+0000","last_peered":"2024-09-10T14:32:22.030324+0000","last_clean":"2024-09-10T14:32:22.030324+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:32:22.030324+0000","last_undegraded":"2024-09-10T14:32:22.030324+0000","last_fullsized":"2024-09-10T14:32:22.030324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.030103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:44.176468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.500554+0000","last_change":"2024-09-10T14:32:35.500613+0000","last_active":"2024-09-10T14:32:35.500554+0000","last_peered":"2024-09-10T14:32:35.500554+0000","last_clean":"2024-09-10T14:32:35.500554+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:32:35.500554+0000","last_undegraded":"2024-09-10T14:32:35.500554+0000","last_fullsized":"2024-09-10T14:32:35.500554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:58.771563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:44.775530+0000","last_change":"2024-09-10T14:28:38.944786+0000","last_active":"2024-09-10T14:30:44.775530+0000","last_peered":"2024-09-10T14:30:44.775530+0000","last_clean":"2024-09-10T14:30:44.775530+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:30:44.775530+0000","last_undegraded":"2024-09-10T14:30:44.775530+0000","last_fullsized":"2024-09-10T14:30:44.775530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.091585+0000","last_change":"2024-09-10T14:28:30.877107+0000","last_active":"2024-09-10T14:31:44.091585+0000","last_peered":"2024-09-10T14:31:44.091585+0000","last_clean":"2024-09-10T14:31:44.091585+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:31:44.091585+0000","last_undegraded":"2024-09-10T14:31:44.091585+0000","last_fullsized":"2024-09-10T14:31:44.091585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.039741+0000","last_change":"2024-09-10T14:28:28.890437+0000","last_active":"2024-09-10T14:31:44.039741+0000","last_peered":"2024-09-10T14:31:44.039741+0000","last_clean":"2024-09-10T14:31:44.039741+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:31:44.039741+0000","last_undegraded":"2024-09-10T14:31:44.039741+0000","last_fullsized":"2024-09-10T14:31:44.039741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.968378+0000","last_change":"2024-09-10T14:32:33.968430+0000","last_active":"2024-09-10T14:32:33.968378+0000","last_peered":"2024-09-10T14:32:33.968378+0000","last_clean":"2024-09-10T14:32:33.968378+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:32:33.968378+0000","last_undegraded":"2024-09-10T14:32:33.968378+0000","last_fullsized":"2024-09-10T14:32:33.968378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.968186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.923144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.456123+0000","last_change":"2024-09-10T14:32:25.456201+0000","last_active":"2024-09-10T14:32:25.456123+0000","last_peered":"2024-09-10T14:32:25.456123+0000","last_clean":"2024-09-10T14:32:25.456123+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:32:25.456123+0000","last_undegraded":"2024-09-10T14:32:25.456123+0000","last_fullsized":"2024-09-10T14:32:25.456123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.455949+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:59.272502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786729+0000","last_change":"2024-09-10T14:28:36.937985+0000","last_active":"2024-09-10T14:30:58.786729+0000","last_peered":"2024-09-10T14:30:58.786729+0000","last_clean":"2024-09-10T14:30:58.786729+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:30:58.786729+0000","last_undegraded":"2024-09-10T14:30:58.786729+0000","last_fullsized":"2024-09-10T14:30:58.786729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.775624+0000","last_change":"2024-09-10T14:28:38.919940+0000","last_active":"2024-09-10T14:30:42.775624+0000","last_peered":"2024-09-10T14:30:42.775624+0000","last_clean":"2024-09-10T14:30:42.775624+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:30:42.775624+0000","last_undegraded":"2024-09-10T14:30:42.775624+0000","last_fullsized":"2024-09-10T14:30:42.775624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244941+0000","last_change":"2024-09-10T14:29:07.783673+0000","last_active":"2024-09-10T14:31:44.244941+0000","last_peered":"2024-09-10T14:31:44.244941+0000","last_clean":"2024-09-10T14:31:44.244941+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:31:44.244941+0000","last_undegraded":"2024-09-10T14:31:44.244941+0000","last_fullsized":"2024-09-10T14:31:44.244941+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.777937+0000","last_change":"2024-09-10T14:28:28.897051+0000","last_active":"2024-09-10T14:30:54.777937+0000","last_peered":"2024-09-10T14:30:54.777937+0000","last_clean":"2024-09-10T14:30:54.777937+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:30:54.777937+0000","last_undegraded":"2024-09-10T14:30:54.777937+0000","last_fullsized":"2024-09-10T14:30:54.777937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.411315+0000","last_change":"2024-09-10T14:32:20.411370+0000","last_active":"2024-09-10T14:32:20.411315+0000","last_peered":"2024-09-10T14:32:20.411315+0000","last_clean":"2024-09-10T14:32:20.411315+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:32:20.411315+0000","last_undegraded":"2024-09-10T14:32:20.411315+0000","last_fullsized":"2024-09-10T14:32:20.411315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.411095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:12.327829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.216223+0000","last_change":"2024-09-10T14:32:33.216290+0000","last_active":"2024-09-10T14:32:33.216223+0000","last_peered":"2024-09-10T14:32:33.216223+0000","last_clean":"2024-09-10T14:32:33.216223+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:32:33.216223+0000","last_undegraded":"2024-09-10T14:32:33.216223+0000","last_fullsized":"2024-09-10T14:32:33.216223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.216034+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:39:05.267034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.415549+0000","last_change":"2024-09-10T14:32:23.415600+0000","last_active":"2024-09-10T14:32:23.415549+0000","last_peered":"2024-09-10T14:32:23.415549+0000","last_clean":"2024-09-10T14:32:23.415549+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:32:23.415549+0000","last_undegraded":"2024-09-10T14:32:23.415549+0000","last_fullsized":"2024-09-10T14:32:23.415549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.415359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:40.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:12.782563+0000","last_change":"2024-09-10T14:28:38.936365+0000","last_active":"2024-09-10T14:31:12.782563+0000","last_peered":"2024-09-10T14:31:12.782563+0000","last_clean":"2024-09-10T14:31:12.782563+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:31:12.782563+0000","last_undegraded":"2024-09-10T14:31:12.782563+0000","last_fullsized":"2024-09-10T14:31:12.782563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:52.778001+0000","last_change":"2024-09-10T14:28:30.876200+0000","last_active":"2024-09-10T14:30:52.778001+0000","last_peered":"2024-09-10T14:30:52.778001+0000","last_clean":"2024-09-10T14:30:52.778001+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:30:52.778001+0000","last_undegraded":"2024-09-10T14:30:52.778001+0000","last_fullsized":"2024-09-10T14:30:52.778001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.778074+0000","last_change":"2024-09-10T14:28:28.895847+0000","last_active":"2024-09-10T14:30:54.778074+0000","last_peered":"2024-09-10T14:30:54.778074+0000","last_clean":"2024-09-10T14:30:54.778074+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:30:54.778074+0000","last_undegraded":"2024-09-10T14:30:54.778074+0000","last_fullsized":"2024-09-10T14:30:54.778074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.777706+0000","last_change":"2024-09-10T14:28:32.872799+0000","last_active":"2024-09-10T14:30:54.777706+0000","last_peered":"2024-09-10T14:30:54.777706+0000","last_clean":"2024-09-10T14:30:54.777706+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:30:54.777706+0000","last_undegraded":"2024-09-10T14:30:54.777706+0000","last_fullsized":"2024-09-10T14:30:54.777706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.137444+0000","last_change":"2024-09-10T14:32:30.137615+0000","last_active":"2024-09-10T14:32:30.137444+0000","last_peered":"2024-09-10T14:32:30.137444+0000","last_clean":"2024-09-10T14:32:30.137444+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:32:30.137444+0000","last_undegraded":"2024-09-10T14:32:30.137444+0000","last_fullsized":"2024-09-10T14:32:30.137444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.137220+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:57.841349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.938865+0000","last_change":"2024-09-10T14:32:19.938967+0000","last_active":"2024-09-10T14:32:19.938865+0000","last_peered":"2024-09-10T14:32:19.938865+0000","last_clean":"2024-09-10T14:32:19.938865+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:32:19.938865+0000","last_undegraded":"2024-09-10T14:32:19.938865+0000","last_fullsized":"2024-09-10T14:32:19.938865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.938638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:13.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:08.789525+0000","last_change":"2024-09-10T14:28:38.937605+0000","last_active":"2024-09-10T14:31:08.789525+0000","last_peered":"2024-09-10T14:31:08.789525+0000","last_clean":"2024-09-10T14:31:08.789525+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:31:08.789525+0000","last_undegraded":"2024-09-10T14:31:08.789525+0000","last_fullsized":"2024-09-10T14:31:08.789525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:29.785703+0000","last_change":"2024-09-10T14:29:07.787878+0000","last_active":"2024-09-10T14:31:29.785703+0000","last_peered":"2024-09-10T14:31:29.785703+0000","last_clean":"2024-09-10T14:31:29.785703+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:31:29.785703+0000","last_undegraded":"2024-09-10T14:31:29.785703+0000","last_fullsized":"2024-09-10T14:31:29.785703+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783952+0000","last_change":"2024-09-10T14:28:28.902985+0000","last_active":"2024-09-10T14:30:53.783952+0000","last_peered":"2024-09-10T14:30:53.783952+0000","last_clean":"2024-09-10T14:30:53.783952+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:30:53.783952+0000","last_undegraded":"2024-09-10T14:30:53.783952+0000","last_fullsized":"2024-09-10T14:30:53.783952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.446212+0000","last_change":"2024-09-10T14:32:26.446266+0000","last_active":"2024-09-10T14:32:26.446212+0000","last_peered":"2024-09-10T14:32:26.446212+0000","last_clean":"2024-09-10T14:32:26.446212+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:32:26.446212+0000","last_undegraded":"2024-09-10T14:32:26.446212+0000","last_fullsized":"2024-09-10T14:32:26.446212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.446026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:41.594078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'39","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.497682+0000","last_change":"2024-09-10T14:32:32.497756+0000","last_active":"2024-09-10T14:32:32.497682+0000","last_peered":"2024-09-10T14:32:32.497682+0000","last_clean":"2024-09-10T14:32:32.497682+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:32:32.497682+0000","last_undegraded":"2024-09-10T14:32:32.497682+0000","last_fullsized":"2024-09-10T14:32:32.497682+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.497494+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:32.552961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.396694+0000","last_change":"2024-09-10T14:32:25.396828+0000","last_active":"2024-09-10T14:32:25.396694+0000","last_peered":"2024-09-10T14:32:25.396694+0000","last_clean":"2024-09-10T14:32:25.396694+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:32:25.396694+0000","last_undegraded":"2024-09-10T14:32:25.396694+0000","last_fullsized":"2024-09-10T14:32:25.396694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.396450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:54.696304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:38.781750+0000","last_change":"2024-09-10T14:28:30.877889+0000","last_active":"2024-09-10T14:30:38.781750+0000","last_peered":"2024-09-10T14:30:38.781750+0000","last_clean":"2024-09-10T14:30:38.781750+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:30:38.781750+0000","last_undegraded":"2024-09-10T14:30:38.781750+0000","last_fullsized":"2024-09-10T14:30:38.781750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.785401+0000","last_change":"2024-09-10T14:28:28.893360+0000","last_active":"2024-09-10T14:30:53.785401+0000","last_peered":"2024-09-10T14:30:53.785401+0000","last_clean":"2024-09-10T14:30:53.785401+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:30:53.785401+0000","last_undegraded":"2024-09-10T14:30:53.785401+0000","last_fullsized":"2024-09-10T14:30:53.785401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:09.781526+0000","last_change":"2024-09-10T14:29:08.790434+0000","last_active":"2024-09-10T14:31:09.781526+0000","last_peered":"2024-09-10T14:31:09.781526+0000","last_clean":"2024-09-10T14:31:09.781526+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:31:09.781526+0000","last_undegraded":"2024-09-10T14:31:09.781526+0000","last_fullsized":"2024-09-10T14:31:09.781526+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.180889+0000","last_change":"2024-09-10T14:32:32.180966+0000","last_active":"2024-09-10T14:32:32.180889+0000","last_peered":"2024-09-10T14:32:32.180889+0000","last_clean":"2024-09-10T14:32:32.180889+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:32:32.180889+0000","last_undegraded":"2024-09-10T14:32:32.180889+0000","last_fullsized":"2024-09-10T14:32:32.180889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.180675+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:49.216006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.442239+0000","last_change":"2024-09-10T14:32:26.442290+0000","last_active":"2024-09-10T14:32:26.442239+0000","last_peered":"2024-09-10T14:32:26.442239+0000","last_clean":"2024-09-10T14:32:26.442239+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:32:26.442239+0000","last_undegraded":"2024-09-10T14:32:26.442239+0000","last_fullsized":"2024-09-10T14:32:26.442239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.442018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:13.048162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:02.780381+0000","last_change":"2024-09-10T14:28:38.928679+0000","last_active":"2024-09-10T14:31:02.780381+0000","last_peered":"2024-09-10T14:31:02.780381+0000","last_clean":"2024-09-10T14:31:02.780381+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:31:02.780381+0000","last_undegraded":"2024-09-10T14:31:02.780381+0000","last_fullsized":"2024-09-10T14:31:02.780381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.807144+0000","last_change":"2024-09-10T14:28:30.881385+0000","last_active":"2024-09-10T14:32:18.807144+0000","last_peered":"2024-09-10T14:32:18.807144+0000","last_clean":"2024-09-10T14:32:18.807144+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:32:18.807144+0000","last_undegraded":"2024-09-10T14:32:18.807144+0000","last_fullsized":"2024-09-10T14:32:18.807144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783596+0000","last_change":"2024-09-10T14:28:28.906793+0000","last_active":"2024-09-10T14:30:53.783596+0000","last_peered":"2024-09-10T14:30:53.783596+0000","last_clean":"2024-09-10T14:30:53.783596+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:30:53.783596+0000","last_undegraded":"2024-09-10T14:30:53.783596+0000","last_fullsized":"2024-09-10T14:30:53.783596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.774467+0000","last_change":"2024-09-10T14:28:32.880162+0000","last_active":"2024-09-10T14:30:39.774467+0000","last_peered":"2024-09-10T14:30:39.774467+0000","last_clean":"2024-09-10T14:30:39.774467+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:30:39.774467+0000","last_undegraded":"2024-09-10T14:30:39.774467+0000","last_fullsized":"2024-09-10T14:30:39.774467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.529521+0000","last_change":"2024-09-10T14:28:34.922844+0000","last_active":"2024-09-10T14:32:15.529521+0000","last_peered":"2024-09-10T14:32:15.529521+0000","last_clean":"2024-09-10T14:32:15.529521+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:32:15.529521+0000","last_undegraded":"2024-09-10T14:32:15.529521+0000","last_fullsized":"2024-09-10T14:32:15.529521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:08.787685+0000","last_change":"2024-09-10T14:28:36.940467+0000","last_active":"2024-09-10T14:31:08.787685+0000","last_peered":"2024-09-10T14:31:08.787685+0000","last_clean":"2024-09-10T14:31:08.787685+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:31:08.787685+0000","last_undegraded":"2024-09-10T14:31:08.787685+0000","last_fullsized":"2024-09-10T14:31:08.787685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786881+0000","last_change":"2024-09-10T14:28:38.943738+0000","last_active":"2024-09-10T14:30:58.786881+0000","last_peered":"2024-09-10T14:30:58.786881+0000","last_clean":"2024-09-10T14:30:58.786881+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:30:58.786881+0000","last_undegraded":"2024-09-10T14:30:58.786881+0000","last_fullsized":"2024-09-10T14:30:58.786881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.463872+0000","last_change":"2024-09-10T14:32:34.464002+0000","last_active":"2024-09-10T14:32:34.463872+0000","last_peered":"2024-09-10T14:32:34.463872+0000","last_clean":"2024-09-10T14:32:34.463872+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:32:34.463872+0000","last_undegraded":"2024-09-10T14:32:34.463872+0000","last_fullsized":"2024-09-10T14:32:34.463872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.463639+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:46.301912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.784980+0000","last_change":"2024-09-10T14:28:28.904304+0000","last_active":"2024-09-10T14:30:58.784980+0000","last_peered":"2024-09-10T14:30:58.784980+0000","last_clean":"2024-09-10T14:30:58.784980+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:30:58.784980+0000","last_undegraded":"2024-09-10T14:30:58.784980+0000","last_fullsized":"2024-09-10T14:30:58.784980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.435870+0000","last_change":"2024-09-10T14:32:38.435925+0000","last_active":"2024-09-10T14:32:38.435870+0000","last_peered":"2024-09-10T14:32:38.435870+0000","last_clean":"2024-09-10T14:32:38.435870+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:32:38.435870+0000","last_undegraded":"2024-09-10T14:32:38.435870+0000","last_fullsized":"2024-09-10T14:32:38.435870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.435674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:15.679874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.074522+0000","last_change":"2024-09-10T14:32:28.074597+0000","last_active":"2024-09-10T14:32:28.074522+0000","last_peered":"2024-09-10T14:32:28.074522+0000","last_clean":"2024-09-10T14:32:28.074522+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:32:28.074522+0000","last_undegraded":"2024-09-10T14:32:28.074522+0000","last_fullsized":"2024-09-10T14:32:28.074522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.074323+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:22.414417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.062808+0000","last_change":"2024-09-10T14:32:20.062808+0000","last_active":"2024-09-10T14:32:20.062808+0000","last_peered":"2024-09-10T14:32:20.062808+0000","last_clean":"2024-09-10T14:32:20.062808+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:32:20.062808+0000","last_undegraded":"2024-09-10T14:32:20.062808+0000","last_fullsized":"2024-09-10T14:32:20.062808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.062623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:35.638214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.893383+0000","last_change":"2024-09-10T14:28:38.940779+0000","last_active":"2024-09-10T14:31:43.893383+0000","last_peered":"2024-09-10T14:31:43.893383+0000","last_clean":"2024-09-10T14:31:43.893383+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:31:43.893383+0000","last_undegraded":"2024-09-10T14:31:43.893383+0000","last_fullsized":"2024-09-10T14:31:43.893383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.090541+0000","last_change":"2024-09-10T14:28:30.863566+0000","last_active":"2024-09-10T14:31:44.090541+0000","last_peered":"2024-09-10T14:31:44.090541+0000","last_clean":"2024-09-10T14:31:44.090541+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:31:44.090541+0000","last_undegraded":"2024-09-10T14:31:44.090541+0000","last_fullsized":"2024-09-10T14:31:44.090541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786958+0000","last_change":"2024-09-10T14:28:28.890479+0000","last_active":"2024-09-10T14:30:58.786958+0000","last_peered":"2024-09-10T14:30:58.786958+0000","last_clean":"2024-09-10T14:30:58.786958+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:30:58.786958+0000","last_undegraded":"2024-09-10T14:30:58.786958+0000","last_fullsized":"2024-09-10T14:30:58.786958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.786425+0000","last_change":"2024-09-10T14:29:08.793243+0000","last_active":"2024-09-10T14:31:03.786425+0000","last_peered":"2024-09-10T14:31:03.786425+0000","last_clean":"2024-09-10T14:31:03.786425+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:31:03.786425+0000","last_undegraded":"2024-09-10T14:31:03.786425+0000","last_fullsized":"2024-09-10T14:31:03.786425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.242999+0000","last_change":"2024-09-10T14:28:34.927446+0000","last_active":"2024-09-10T14:32:20.242999+0000","last_peered":"2024-09-10T14:32:20.242999+0000","last_clean":"2024-09-10T14:32:20.242999+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:32:20.242999+0000","last_undegraded":"2024-09-10T14:32:20.242999+0000","last_fullsized":"2024-09-10T14:32:20.242999+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.385690+0000","last_change":"2024-09-10T14:32:20.385755+0000","last_active":"2024-09-10T14:32:20.385690+0000","last_peered":"2024-09-10T14:32:20.385690+0000","last_clean":"2024-09-10T14:32:20.385690+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:32:20.385690+0000","last_undegraded":"2024-09-10T14:32:20.385690+0000","last_fullsized":"2024-09-10T14:32:20.385690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.385473+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:25.661393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786652+0000","last_change":"2024-09-10T14:28:38.938263+0000","last_active":"2024-09-10T14:30:58.786652+0000","last_peered":"2024-09-10T14:30:58.786652+0000","last_clean":"2024-09-10T14:30:58.786652+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:30:58.786652+0000","last_undegraded":"2024-09-10T14:30:58.786652+0000","last_fullsized":"2024-09-10T14:30:58.786652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.243812+0000","last_change":"2024-09-10T14:28:30.861357+0000","last_active":"2024-09-10T14:31:44.243812+0000","last_peered":"2024-09-10T14:31:44.243812+0000","last_clean":"2024-09-10T14:31:44.243812+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:31:44.243812+0000","last_undegraded":"2024-09-10T14:31:44.243812+0000","last_fullsized":"2024-09-10T14:31:44.243812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.785073+0000","last_change":"2024-09-10T14:28:28.885941+0000","last_active":"2024-09-10T14:30:58.785073+0000","last_peered":"2024-09-10T14:30:58.785073+0000","last_clean":"2024-09-10T14:30:58.785073+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:30:58.785073+0000","last_undegraded":"2024-09-10T14:30:58.785073+0000","last_fullsized":"2024-09-10T14:30:58.785073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.954255+0000","last_change":"2024-09-10T14:32:35.954305+0000","last_active":"2024-09-10T14:32:35.954255+0000","last_peered":"2024-09-10T14:32:35.954255+0000","last_clean":"2024-09-10T14:32:35.954255+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:32:35.954255+0000","last_undegraded":"2024-09-10T14:32:35.954255+0000","last_fullsized":"2024-09-10T14:32:35.954255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.954067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:56.841551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'47","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.005299+0000","last_change":"2024-09-10T14:32:24.005471+0000","last_active":"2024-09-10T14:32:24.005299+0000","last_peered":"2024-09-10T14:32:24.005299+0000","last_clean":"2024-09-10T14:32:24.005299+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:32:24.005299+0000","last_undegraded":"2024-09-10T14:32:24.005299+0000","last_fullsized":"2024-09-10T14:32:24.005299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.005077+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:26.362032+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.075023+0000","last_change":"2024-09-10T14:32:23.075075+0000","last_active":"2024-09-10T14:32:23.075023+0000","last_peered":"2024-09-10T14:32:23.075023+0000","last_clean":"2024-09-10T14:32:23.075023+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:32:23.075023+0000","last_undegraded":"2024-09-10T14:32:23.075023+0000","last_fullsized":"2024-09-10T14:32:23.075023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.074819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:52.669431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.237589+0000","last_change":"2024-09-10T14:28:38.931948+0000","last_active":"2024-09-10T14:31:44.237589+0000","last_peered":"2024-09-10T14:31:44.237589+0000","last_clean":"2024-09-10T14:31:44.237589+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:31:44.237589+0000","last_undegraded":"2024-09-10T14:31:44.237589+0000","last_fullsized":"2024-09-10T14:31:44.237589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.175969+0000","last_change":"2024-09-10T14:28:30.857116+0000","last_active":"2024-09-10T14:31:44.175969+0000","last_peered":"2024-09-10T14:31:44.175969+0000","last_clean":"2024-09-10T14:31:44.175969+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:31:44.175969+0000","last_undegraded":"2024-09-10T14:31:44.175969+0000","last_fullsized":"2024-09-10T14:31:44.175969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'7","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.509888+0000","last_change":"2024-09-10T14:28:28.889060+0000","last_active":"2024-09-10T14:32:15.509888+0000","last_peered":"2024-09-10T14:32:15.509888+0000","last_clean":"2024-09-10T14:32:15.509888+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:32:15.509888+0000","last_undegraded":"2024-09-10T14:32:15.509888+0000","last_fullsized":"2024-09-10T14:32:15.509888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.460009+0000","last_change":"2024-09-10T14:32:37.460071+0000","last_active":"2024-09-10T14:32:37.460009+0000","last_peered":"2024-09-10T14:32:37.460009+0000","last_clean":"2024-09-10T14:32:37.460009+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:32:37.460009+0000","last_undegraded":"2024-09-10T14:32:37.460009+0000","last_fullsized":"2024-09-10T14:32:37.460009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.459813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:14.821058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.028479+0000","last_change":"2024-09-10T14:32:26.028627+0000","last_active":"2024-09-10T14:32:26.028479+0000","last_peered":"2024-09-10T14:32:26.028479+0000","last_clean":"2024-09-10T14:32:26.028479+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:32:26.028479+0000","last_undegraded":"2024-09-10T14:32:26.028479+0000","last_fullsized":"2024-09-10T14:32:26.028479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.028252+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:17.812152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.788085+0000","last_change":"2024-09-10T14:28:36.939560+0000","last_active":"2024-09-10T14:31:03.788085+0000","last_peered":"2024-09-10T14:31:03.788085+0000","last_clean":"2024-09-10T14:31:03.788085+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:31:03.788085+0000","last_undegraded":"2024-09-10T14:31:03.788085+0000","last_fullsized":"2024-09-10T14:31:03.788085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.788457+0000","last_change":"2024-09-10T14:28:38.950672+0000","last_active":"2024-09-10T14:31:03.788457+0000","last_peered":"2024-09-10T14:31:03.788457+0000","last_clean":"2024-09-10T14:31:03.788457+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:31:03.788457+0000","last_undegraded":"2024-09-10T14:31:03.788457+0000","last_fullsized":"2024-09-10T14:31:03.788457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.090659+0000","last_change":"2024-09-10T14:28:30.877715+0000","last_active":"2024-09-10T14:31:44.090659+0000","last_peered":"2024-09-10T14:31:44.090659+0000","last_clean":"2024-09-10T14:31:44.090659+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:31:44.090659+0000","last_undegraded":"2024-09-10T14:31:44.090659+0000","last_fullsized":"2024-09-10T14:31:44.090659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806646+0000","last_change":"2024-09-10T14:28:28.876685+0000","last_active":"2024-09-10T14:32:18.806646+0000","last_peered":"2024-09-10T14:32:18.806646+0000","last_clean":"2024-09-10T14:32:18.806646+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:32:18.806646+0000","last_undegraded":"2024-09-10T14:32:18.806646+0000","last_fullsized":"2024-09-10T14:32:18.806646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.935806+0000","last_change":"2024-09-10T14:32:32.935858+0000","last_active":"2024-09-10T14:32:32.935806+0000","last_peered":"2024-09-10T14:32:32.935806+0000","last_clean":"2024-09-10T14:32:32.935806+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:32:32.935806+0000","last_undegraded":"2024-09-10T14:32:32.935806+0000","last_fullsized":"2024-09-10T14:32:32.935806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.935608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:34.956315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.504401+0000","last_change":"2024-09-10T14:32:31.504474+0000","last_active":"2024-09-10T14:32:31.504401+0000","last_peered":"2024-09-10T14:32:31.504401+0000","last_clean":"2024-09-10T14:32:31.504401+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:32:31.504401+0000","last_undegraded":"2024-09-10T14:32:31.504401+0000","last_fullsized":"2024-09-10T14:32:31.504401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.504210+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:27.467975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:08.789382+0000","last_change":"2024-09-10T14:28:36.945615+0000","last_active":"2024-09-10T14:31:08.789382+0000","last_peered":"2024-09-10T14:31:08.789382+0000","last_clean":"2024-09-10T14:31:08.789382+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:31:08.789382+0000","last_undegraded":"2024-09-10T14:31:08.789382+0000","last_fullsized":"2024-09-10T14:31:08.789382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.406498+0000","last_change":"2024-09-10T14:28:38.949225+0000","last_active":"2024-09-10T14:31:44.406498+0000","last_peered":"2024-09-10T14:31:44.406498+0000","last_clean":"2024-09-10T14:31:44.406498+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:31:44.406498+0000","last_undegraded":"2024-09-10T14:31:44.406498+0000","last_fullsized":"2024-09-10T14:31:44.406498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.245024+0000","last_change":"2024-09-10T14:28:30.857745+0000","last_active":"2024-09-10T14:31:44.245024+0000","last_peered":"2024-09-10T14:31:44.245024+0000","last_clean":"2024-09-10T14:31:44.245024+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:31:44.245024+0000","last_undegraded":"2024-09-10T14:31:44.245024+0000","last_fullsized":"2024-09-10T14:31:44.245024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.290052+0000","last_change":"2024-09-10T14:28:28.904511+0000","last_active":"2024-09-10T14:32:19.290052+0000","last_peered":"2024-09-10T14:32:19.290052+0000","last_clean":"2024-09-10T14:32:19.290052+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:32:19.290052+0000","last_undegraded":"2024-09-10T14:32:19.290052+0000","last_fullsized":"2024-09-10T14:32:19.290052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.985028+0000","last_change":"2024-09-10T14:32:28.985098+0000","last_active":"2024-09-10T14:32:28.985028+0000","last_peered":"2024-09-10T14:32:28.985028+0000","last_clean":"2024-09-10T14:32:28.985028+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:32:28.985028+0000","last_undegraded":"2024-09-10T14:32:28.985028+0000","last_fullsized":"2024-09-10T14:32:28.985028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.984841+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:32.529664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'36","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.396932+0000","last_change":"2024-09-10T14:28:34.914339+0000","last_active":"2024-09-10T14:32:15.396932+0000","last_peered":"2024-09-10T14:32:15.396932+0000","last_clean":"2024-09-10T14:32:15.396932+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:32:15.396932+0000","last_undegraded":"2024-09-10T14:32:15.396932+0000","last_fullsized":"2024-09-10T14:32:15.396932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:33.852015+0000","last_clean_scrub_stamp":"2024-09-10T14:28:33.852015+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:07.781424+0000","last_change":"2024-09-10T14:28:36.924970+0000","last_active":"2024-09-10T14:31:07.781424+0000","last_peered":"2024-09-10T14:31:07.781424+0000","last_clean":"2024-09-10T14:31:07.781424+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:31:07.781424+0000","last_undegraded":"2024-09-10T14:31:07.781424+0000","last_fullsized":"2024-09-10T14:31:07.781424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787012+0000","last_change":"2024-09-10T14:28:38.949254+0000","last_active":"2024-09-10T14:30:58.787012+0000","last_peered":"2024-09-10T14:30:58.787012+0000","last_clean":"2024-09-10T14:30:58.787012+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:30:58.787012+0000","last_undegraded":"2024-09-10T14:30:58.787012+0000","last_fullsized":"2024-09-10T14:30:58.787012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.967772+0000","last_change":"2024-09-10T14:32:37.967908+0000","last_active":"2024-09-10T14:32:37.967772+0000","last_peered":"2024-09-10T14:32:37.967772+0000","last_clean":"2024-09-10T14:32:37.967772+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:32:37.967772+0000","last_undegraded":"2024-09-10T14:32:37.967772+0000","last_fullsized":"2024-09-10T14:32:37.967772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.967539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:44.664554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758416+0000","last_change":"2024-09-10T14:28:28.876974+0000","last_active":"2024-09-10T14:32:19.758416+0000","last_peered":"2024-09-10T14:32:19.758416+0000","last_clean":"2024-09-10T14:32:19.758416+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:32:19.758416+0000","last_undegraded":"2024-09-10T14:32:19.758416+0000","last_fullsized":"2024-09-10T14:32:19.758416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.775679+0000","last_change":"2024-09-10T14:28:30.861035+0000","last_active":"2024-09-10T14:30:42.775679+0000","last_peered":"2024-09-10T14:30:42.775679+0000","last_clean":"2024-09-10T14:30:42.775679+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:30:42.775679+0000","last_undegraded":"2024-09-10T14:30:42.775679+0000","last_fullsized":"2024-09-10T14:30:42.775679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.003441+0000","last_change":"2024-09-10T14:28:28.880673+0000","last_active":"2024-09-10T14:30:43.003441+0000","last_peered":"2024-09-10T14:30:43.003441+0000","last_clean":"2024-09-10T14:30:43.003441+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:30:43.003441+0000","last_undegraded":"2024-09-10T14:30:43.003441+0000","last_fullsized":"2024-09-10T14:30:43.003441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'9","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.323963+0000","last_change":"2024-09-10T14:28:30.876383+0000","last_active":"2024-09-10T14:31:44.323963+0000","last_peered":"2024-09-10T14:31:44.323963+0000","last_clean":"2024-09-10T14:31:44.323963+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:31:44.323963+0000","last_undegraded":"2024-09-10T14:31:44.323963+0000","last_fullsized":"2024-09-10T14:31:44.323963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241103+0000","last_change":"2024-09-10T14:28:28.892938+0000","last_active":"2024-09-10T14:32:20.241103+0000","last_peered":"2024-09-10T14:32:20.241103+0000","last_clean":"2024-09-10T14:32:20.241103+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:32:20.241103+0000","last_undegraded":"2024-09-10T14:32:20.241103+0000","last_fullsized":"2024-09-10T14:32:20.241103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.775558+0000","last_change":"2024-09-10T14:28:30.863758+0000","last_active":"2024-09-10T14:30:42.775558+0000","last_peered":"2024-09-10T14:30:42.775558+0000","last_clean":"2024-09-10T14:30:42.775558+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:30:42.775558+0000","last_undegraded":"2024-09-10T14:30:42.775558+0000","last_fullsized":"2024-09-10T14:30:42.775558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:37.774353+0000","last_change":"2024-09-10T14:28:28.880499+0000","last_active":"2024-09-10T14:30:37.774353+0000","last_peered":"2024-09-10T14:30:37.774353+0000","last_clean":"2024-09-10T14:30:37.774353+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:30:37.774353+0000","last_undegraded":"2024-09-10T14:30:37.774353+0000","last_fullsized":"2024-09-10T14:30:37.774353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.755170+0000","last_change":"2024-09-10T14:28:30.886667+0000","last_active":"2024-09-10T14:31:43.755170+0000","last_peered":"2024-09-10T14:31:43.755170+0000","last_clean":"2024-09-10T14:31:43.755170+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:31:43.755170+0000","last_undegraded":"2024-09-10T14:31:43.755170+0000","last_fullsized":"2024-09-10T14:31:43.755170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.775581+0000","last_change":"2024-09-10T14:28:28.908422+0000","last_active":"2024-09-10T14:30:42.775581+0000","last_peered":"2024-09-10T14:30:42.775581+0000","last_clean":"2024-09-10T14:30:42.775581+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:30:42.775581+0000","last_undegraded":"2024-09-10T14:30:42.775581+0000","last_fullsized":"2024-09-10T14:30:42.775581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:38.780074+0000","last_change":"2024-09-10T14:28:30.886359+0000","last_active":"2024-09-10T14:30:38.780074+0000","last_peered":"2024-09-10T14:30:38.780074+0000","last_clean":"2024-09-10T14:30:38.780074+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:30:38.780074+0000","last_undegraded":"2024-09-10T14:30:38.780074+0000","last_fullsized":"2024-09-10T14:30:38.780074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:38.780154+0000","last_change":"2024-09-10T14:28:28.899480+0000","last_active":"2024-09-10T14:30:38.780154+0000","last_peered":"2024-09-10T14:30:38.780154+0000","last_clean":"2024-09-10T14:30:38.780154+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:30:38.780154+0000","last_undegraded":"2024-09-10T14:30:38.780154+0000","last_fullsized":"2024-09-10T14:30:38.780154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.176080+0000","last_change":"2024-09-10T14:28:30.881839+0000","last_active":"2024-09-10T14:31:44.176080+0000","last_peered":"2024-09-10T14:31:44.176080+0000","last_clean":"2024-09-10T14:31:44.176080+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:31:44.176080+0000","last_undegraded":"2024-09-10T14:31:44.176080+0000","last_fullsized":"2024-09-10T14:31:44.176080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:39.774437+0000","last_change":"2024-09-10T14:28:28.913505+0000","last_active":"2024-09-10T14:30:39.774437+0000","last_peered":"2024-09-10T14:30:39.774437+0000","last_clean":"2024-09-10T14:30:39.774437+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:30:39.774437+0000","last_undegraded":"2024-09-10T14:30:39.774437+0000","last_fullsized":"2024-09-10T14:30:39.774437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.089141+0000","last_change":"2024-09-10T14:28:30.887181+0000","last_active":"2024-09-10T14:31:44.089141+0000","last_peered":"2024-09-10T14:31:44.089141+0000","last_clean":"2024-09-10T14:31:44.089141+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:31:44.089141+0000","last_undegraded":"2024-09-10T14:31:44.089141+0000","last_fullsized":"2024-09-10T14:31:44.089141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:42.775765+0000","last_change":"2024-09-10T14:28:28.878802+0000","last_active":"2024-09-10T14:30:42.775765+0000","last_peered":"2024-09-10T14:30:42.775765+0000","last_clean":"2024-09-10T14:30:42.775765+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:30:42.775765+0000","last_undegraded":"2024-09-10T14:30:42.775765+0000","last_fullsized":"2024-09-10T14:30:42.775765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.890221+0000","last_change":"2024-09-10T14:28:30.873038+0000","last_active":"2024-09-10T14:31:43.890221+0000","last_peered":"2024-09-10T14:31:43.890221+0000","last_clean":"2024-09-10T14:31:43.890221+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:31:43.890221+0000","last_undegraded":"2024-09-10T14:31:43.890221+0000","last_fullsized":"2024-09-10T14:31:43.890221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:38.781525+0000","last_change":"2024-09-10T14:28:28.893263+0000","last_active":"2024-09-10T14:30:38.781525+0000","last_peered":"2024-09-10T14:30:38.781525+0000","last_clean":"2024-09-10T14:30:38.781525+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:30:38.781525+0000","last_undegraded":"2024-09-10T14:30:38.781525+0000","last_fullsized":"2024-09-10T14:30:38.781525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.090759+0000","last_change":"2024-09-10T14:28:30.885304+0000","last_active":"2024-09-10T14:31:44.090759+0000","last_peered":"2024-09-10T14:31:44.090759+0000","last_clean":"2024-09-10T14:31:44.090759+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:31:44.090759+0000","last_undegraded":"2024-09-10T14:31:44.090759+0000","last_fullsized":"2024-09-10T14:31:44.090759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776866+0000","last_change":"2024-09-10T14:28:28.879959+0000","last_active":"2024-09-10T14:30:47.776866+0000","last_peered":"2024-09-10T14:30:47.776866+0000","last_clean":"2024-09-10T14:30:47.776866+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:30:47.776866+0000","last_undegraded":"2024-09-10T14:30:47.776866+0000","last_fullsized":"2024-09-10T14:30:47.776866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.091573+0000","last_change":"2024-09-10T14:28:30.875900+0000","last_active":"2024-09-10T14:31:44.091573+0000","last_peered":"2024-09-10T14:31:44.091573+0000","last_clean":"2024-09-10T14:31:44.091573+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:31:44.091573+0000","last_undegraded":"2024-09-10T14:31:44.091573+0000","last_fullsized":"2024-09-10T14:31:44.091573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.781191+0000","last_change":"2024-09-10T14:28:28.888402+0000","last_active":"2024-09-10T14:30:43.781191+0000","last_peered":"2024-09-10T14:30:43.781191+0000","last_clean":"2024-09-10T14:30:43.781191+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:30:43.781191+0000","last_undegraded":"2024-09-10T14:30:43.781191+0000","last_fullsized":"2024-09-10T14:30:43.781191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.754093+0000","last_change":"2024-09-10T14:28:30.883269+0000","last_active":"2024-09-10T14:31:43.754093+0000","last_peered":"2024-09-10T14:31:43.754093+0000","last_clean":"2024-09-10T14:31:43.754093+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:31:43.754093+0000","last_undegraded":"2024-09-10T14:31:43.754093+0000","last_fullsized":"2024-09-10T14:31:43.754093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.781250+0000","last_change":"2024-09-10T14:28:28.906234+0000","last_active":"2024-09-10T14:30:43.781250+0000","last_peered":"2024-09-10T14:30:43.781250+0000","last_clean":"2024-09-10T14:30:43.781250+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:30:43.781250+0000","last_undegraded":"2024-09-10T14:30:43.781250+0000","last_fullsized":"2024-09-10T14:30:43.781250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.243928+0000","last_change":"2024-09-10T14:28:30.886081+0000","last_active":"2024-09-10T14:31:44.243928+0000","last_peered":"2024-09-10T14:31:44.243928+0000","last_clean":"2024-09-10T14:31:44.243928+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:31:44.243928+0000","last_undegraded":"2024-09-10T14:31:44.243928+0000","last_fullsized":"2024-09-10T14:31:44.243928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.782984+0000","last_change":"2024-09-10T14:28:28.890888+0000","last_active":"2024-09-10T14:30:43.782984+0000","last_peered":"2024-09-10T14:30:43.782984+0000","last_clean":"2024-09-10T14:30:43.782984+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:30:43.782984+0000","last_undegraded":"2024-09-10T14:30:43.782984+0000","last_fullsized":"2024-09-10T14:30:43.782984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.175799+0000","last_change":"2024-09-10T14:28:30.866941+0000","last_active":"2024-09-10T14:31:44.175799+0000","last_peered":"2024-09-10T14:31:44.175799+0000","last_clean":"2024-09-10T14:31:44.175799+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:31:44.175799+0000","last_undegraded":"2024-09-10T14:31:44.175799+0000","last_fullsized":"2024-09-10T14:31:44.175799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:43.783108+0000","last_change":"2024-09-10T14:28:28.880438+0000","last_active":"2024-09-10T14:30:43.783108+0000","last_peered":"2024-09-10T14:30:43.783108+0000","last_clean":"2024-09-10T14:30:43.783108+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:30:43.783108+0000","last_undegraded":"2024-09-10T14:30:43.783108+0000","last_fullsized":"2024-09-10T14:30:43.783108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'14","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.389074+0000","last_change":"2024-09-10T14:32:38.389144+0000","last_active":"2024-09-10T14:32:38.389074+0000","last_peered":"2024-09-10T14:32:38.389074+0000","last_clean":"2024-09-10T14:32:38.389074+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:32:38.389074+0000","last_undegraded":"2024-09-10T14:32:38.389074+0000","last_fullsized":"2024-09-10T14:32:38.389074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.388866+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:33.424139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:49.776799+0000","last_change":"2024-09-10T14:28:28.914161+0000","last_active":"2024-09-10T14:30:49.776799+0000","last_peered":"2024-09-10T14:30:49.776799+0000","last_clean":"2024-09-10T14:30:49.776799+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:30:49.776799+0000","last_undegraded":"2024-09-10T14:30:49.776799+0000","last_fullsized":"2024-09-10T14:30:49.776799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244308+0000","last_change":"2024-09-10T14:28:30.862241+0000","last_active":"2024-09-10T14:31:44.244308+0000","last_peered":"2024-09-10T14:31:44.244308+0000","last_clean":"2024-09-10T14:31:44.244308+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:31:44.244308+0000","last_undegraded":"2024-09-10T14:31:44.244308+0000","last_fullsized":"2024-09-10T14:31:44.244308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.653690+0000","last_change":"2024-09-10T14:28:28.879289+0000","last_active":"2024-09-10T14:31:43.653690+0000","last_peered":"2024-09-10T14:31:43.653690+0000","last_clean":"2024-09-10T14:31:43.653690+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:31:43.653690+0000","last_undegraded":"2024-09-10T14:31:43.653690+0000","last_fullsized":"2024-09-10T14:31:43.653690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784107+0000","last_change":"2024-09-10T14:28:28.892314+0000","last_active":"2024-09-10T14:30:48.784107+0000","last_peered":"2024-09-10T14:30:48.784107+0000","last_clean":"2024-09-10T14:30:48.784107+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:30:48.784107+0000","last_undegraded":"2024-09-10T14:30:48.784107+0000","last_fullsized":"2024-09-10T14:30:48.784107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244488+0000","last_change":"2024-09-10T14:28:30.891092+0000","last_active":"2024-09-10T14:31:44.244488+0000","last_peered":"2024-09-10T14:31:44.244488+0000","last_clean":"2024-09-10T14:31:44.244488+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:31:44.244488+0000","last_undegraded":"2024-09-10T14:31:44.244488+0000","last_fullsized":"2024-09-10T14:31:44.244488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.510213+0000","last_change":"2024-09-10T14:28:28.881653+0000","last_active":"2024-09-10T14:32:15.510213+0000","last_peered":"2024-09-10T14:32:15.510213+0000","last_clean":"2024-09-10T14:32:15.510213+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:32:15.510213+0000","last_undegraded":"2024-09-10T14:32:15.510213+0000","last_fullsized":"2024-09-10T14:32:15.510213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.785224+0000","last_change":"2024-09-10T14:28:30.887038+0000","last_active":"2024-09-10T14:30:58.785224+0000","last_peered":"2024-09-10T14:30:58.785224+0000","last_clean":"2024-09-10T14:30:58.785224+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:30:58.785224+0000","last_undegraded":"2024-09-10T14:30:58.785224+0000","last_fullsized":"2024-09-10T14:30:58.785224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1489,"ondisk_log_size":1489,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":474,"ondisk_log_size":474,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640314,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":750039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673018,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":162767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673018,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1052672,"data_stored":750219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":161599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:32:41.064 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.065 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.065 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.065 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.065 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.065 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.065 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.065 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.065 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.066 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.067 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.068 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.068 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.068 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.068 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.068 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.068 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.068 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.068 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.069 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.069 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.069 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.069 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.069 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.069 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.069 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.069 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.070 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.070 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.070 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.070 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.070 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.070 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.070 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.070 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.071 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.071 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.071 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.071 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.071 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.071 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.071 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.071 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.072 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.072 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.072 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.072 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.072 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.072 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.072 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.072 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.073 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.073 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.073 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.073 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.073 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T14:28:14.781430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.073 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.073 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.074 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.075 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.075 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.075 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.075 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.075 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.075 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.075 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.075 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.076 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.076 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.076 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.076 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.076 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.076 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.076 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.076 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.077 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.077 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.077 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.077 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.077 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.077 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.077 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.077 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.078 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.078 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.078 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.078 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.078 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.078 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.078 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.079 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.080 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.080 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.080 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.080 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.080 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.080 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.080 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.080 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.081 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.081 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.081 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.081 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.081 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.081 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.081 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.081 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.082 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.082 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.082 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.082 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.082 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.082 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.082 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.082 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.083 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.083 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.083 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.083 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.083 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T14:28:33.852015+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.083 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.083 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.084 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.084 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.084 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.084 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.084 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.084 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.084 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.084 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.085 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.085 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.085 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.085 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.085 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.085 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.085 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.085 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.086 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.086 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.086 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.086 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.086 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.086 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.087 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.087 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.087 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.087 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.087 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.087 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.087 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.087 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.088 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.088 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.088 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.088 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:32:41.088 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T14:33:01.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:33:01.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.219+0000 7fb3937a5640 1 Processor -- start 2024-09-10T14:33:01.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.219+0000 7fb3937a5640 1 -- start start 2024-09-10T14:33:01.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb3937a5640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb38c06dbd0 0x7fb38c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:01.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb3937a5640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb38c071c10 con 0x7fb38c06d0e0 2024-09-10T14:33:01.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb3937a5640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb38c072230 con 0x7fb38c06dbd0 2024-09-10T14:33:01.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb391541640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb38c06d0e0 0x7fb38c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57252/0 (socket says 172.21.15.52:57252) 2024-09-10T14:33:01.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb391541640 1 -- 172.21.15.52:0/1633997992 learned_addr learned my addr 172.21.15.52:0/1633997992 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:33:01.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb390d40640 1 --2- 172.21.15.52:0/1633997992 >> v2:172.21.15.52:3300/0 conn(0x7fb38c06dbd0 0x7fb38c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:01.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602856145 0 0) 0x7fb38c071c10 con 0x7fb38c06d0e0 2024-09-10T14:33:01.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb378003530 con 0x7fb38c06d0e0 2024-09-10T14:33:01.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2424764627 0 0) 0x7fb378003530 con 0x7fb38c06d0e0 2024-09-10T14:33:01.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 >> v2:172.21.15.52:3300/0 conn(0x7fb38c06dbd0 msgr2=0x7fb38c131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T14:33:01.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 --2- 172.21.15.52:0/1633997992 >> v2:172.21.15.52:3300/0 conn(0x7fb38c06dbd0 0x7fb38c131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:01.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38c0709e0 con 0x7fb38c06d0e0 2024-09-10T14:33:01.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2797159469 0 0) 0x7fb3880015b0 con 0x7fb38c06d0e0 2024-09-10T14:33:01.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 >> v1:172.21.15.52:6789/0 conn(0x7fb38c06d0e0 legacy=0x7fb38c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:01.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 --2- 172.21.15.52:0/1633997992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb378003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:01.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c072230 con 0x7fb3780039c0 2024-09-10T14:33:01.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb391541640 1 --2- 172.21.15.52:0/1633997992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb378003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:01.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb391541640 1 -- 172.21.15.52:0/1633997992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb378003530 con 0x7fb3780039c0 2024-09-10T14:33:01.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb391541640 1 --2- 172.21.15.52:0/1633997992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb378003dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c0e0 tx=0x7fb38801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade9c77f66aca8f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:01.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb388007cb0 con 0x7fb3780039c0 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3880a9070 con 0x7fb3780039c0 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.223+0000 7fb383fff640 1 -- 172.21.15.52:0/1633997992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb388005b80 con 0x7fb3780039c0 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- 172.21.15.52:0/1633997992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 msgr2=0x7fb378003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 --2- 172.21.15.52:0/1633997992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb378003dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c0e0 tx=0x7fb38801cca0 comp rx=0 tx=0).stop 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- 172.21.15.52:0/1633997992 shutdown_connections 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 --2- 172.21.15.52:0/1633997992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb378003dc0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 --2- 172.21.15.52:0/1633997992 >> v2:172.21.15.52:3300/0 conn(0x7fb38c06dbd0 0x7fb38c131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- 172.21.15.52:0/1633997992 >> 172.21.15.52:0/1633997992 conn(0x7fb38c099a50 msgr2=0x7fb38c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- 172.21.15.52:0/1633997992 shutdown_connections 2024-09-10T14:33:01.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- 172.21.15.52:0/1633997992 wait complete. 2024-09-10T14:33:01.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 Processor -- start 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- start start 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb38c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c134d40 con 0x7fb3780039c0 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb391541640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb38c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb391541640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb38c06e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55306/0 (socket says 172.21.15.52:55306) 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb391541640 1 -- 172.21.15.52:0/2028043540 learned_addr learned my addr 172.21.15.52:0/2028043540 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb391541640 1 -- 172.21.15.52:0/2028043540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38c072710 con 0x7fb3780039c0 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb391541640 1 --2- 172.21.15.52:0/2028043540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb38c06e1f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb38801a8d0 tx=0x7fb378005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb381ffb640 1 -- 172.21.15.52:0/2028043540 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3880bc070 con 0x7fb3780039c0 2024-09-10T14:33:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb381ffb640 1 -- 172.21.15.52:0/2028043540 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb388004920 con 0x7fb3780039c0 2024-09-10T14:33:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38c096470 con 0x7fb3780039c0 2024-09-10T14:33:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb381ffb640 1 -- 172.21.15.52:0/2028043540 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb388004c20 con 0x7fb3780039c0 2024-09-10T14:33:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38c1220f0 con 0x7fb3780039c0 2024-09-10T14:33:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb381ffb640 1 -- 172.21.15.52:0/2028043540 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb3880bf070 con 0x7fb3780039c0 2024-09-10T14:33:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb38c121f20 con 0x7fb3780039c0 2024-09-10T14:33:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb381ffb640 1 --2- 172.21.15.52:0/2028043540 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb370035db0 0x7fb370038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.227+0000 7fb381ffb640 1 -- 172.21.15.52:0/2028043540 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7fb3880b4070 con 0x7fb3780039c0 2024-09-10T14:33:01.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.231+0000 7fb390d40640 1 --2- 172.21.15.52:0/2028043540 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb370035db0 0x7fb370038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:01.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.231+0000 7fb390d40640 1 --2- 172.21.15.52:0/2028043540 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb370035db0 0x7fb370038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009950 tx=0x7fb37c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:01.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.235+0000 7fb381ffb640 1 -- 172.21.15.52:0/2028043540 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb388016890 con 0x7fb3780039c0 2024-09-10T14:33:01.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.395+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb38c073790 con 0x7fb370035db0 2024-09-10T14:33:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.439+0000 7fb381ffb640 1 -- 172.21.15.52:0/2028043540 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662309 (secure 0 0 0) 0x7fb38c073790 con 0x7fb370035db0 2024-09-10T14:33:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:33:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb370035db0 msgr2=0x7fb370038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 --2- 172.21.15.52:0/2028043540 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb370035db0 0x7fb370038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009950 tx=0x7fb37c009190 comp rx=0 tx=0).stop 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 msgr2=0x7fb38c06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 --2- 172.21.15.52:0/2028043540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb38c06e1f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb38801a8d0 tx=0x7fb378005840 comp rx=0 tx=0).stop 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 shutdown_connections 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 --2- 172.21.15.52:0/2028043540 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7fb370035db0 0x7fb370038270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 --2- 172.21.15.52:0/2028043540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb3780039c0 0x7fb38c06e1f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 >> 172.21.15.52:0/2028043540 conn(0x7fb38c099a50 msgr2=0x7fb38c08afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:33:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 shutdown_connections 2024-09-10T14:33:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:01.447+0000 7fb3937a5640 1 -- 172.21.15.52:0/2028043540 wait complete. 2024-09-10T14:33:01.468 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-10T14:33:00.821625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4786,"ondisk_log_size":4786,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148528,"kb_used_data":2992,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338832,"statfs":{"total":386547056640,"available":386394963968,"internally_reserved":0,"allocated":3063808,"data_stored":1824624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1488,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007104"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.333576+0000","last_change":"2024-09-10T14:32:56.333644+0000","last_active":"2024-09-10T14:32:56.333576+0000","last_peered":"2024-09-10T14:32:56.333576+0000","last_clean":"2024-09-10T14:32:56.333576+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:32:56.333576+0000","last_undegraded":"2024-09-10T14:32:56.333576+0000","last_fullsized":"2024-09-10T14:32:56.333576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:56.333364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:56.333364+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.333364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:41.861748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.951460+0000","last_change":"2024-09-10T14:32:49.951520+0000","last_active":"2024-09-10T14:32:49.951460+0000","last_peered":"2024-09-10T14:32:49.951460+0000","last_clean":"2024-09-10T14:32:49.951460+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:32:49.951460+0000","last_undegraded":"2024-09-10T14:32:49.951460+0000","last_fullsized":"2024-09-10T14:32:49.951460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:49.951238+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:49.951238+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.951238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:14.016136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806930+0000","last_change":"2024-09-10T14:28:28.880130+0000","last_active":"2024-09-10T14:32:18.806930+0000","last_peered":"2024-09-10T14:32:18.806930+0000","last_clean":"2024-09-10T14:32:18.806930+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:32:18.806930+0000","last_undegraded":"2024-09-10T14:32:18.806930+0000","last_fullsized":"2024-09-10T14:32:18.806930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.457066+0000","last_change":"2024-09-10T14:32:54.457127+0000","last_active":"2024-09-10T14:32:54.457066+0000","last_peered":"2024-09-10T14:32:54.457066+0000","last_clean":"2024-09-10T14:32:54.457066+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:32:54.457066+0000","last_undegraded":"2024-09-10T14:32:54.457066+0000","last_fullsized":"2024-09-10T14:32:54.457066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:54.456884+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:54.456884+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.456884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:16:26.826166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241571+0000","last_change":"2024-09-10T14:28:28.879906+0000","last_active":"2024-09-10T14:32:20.241571+0000","last_peered":"2024-09-10T14:32:20.241571+0000","last_clean":"2024-09-10T14:32:20.241571+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:32:20.241571+0000","last_undegraded":"2024-09-10T14:32:20.241571+0000","last_fullsized":"2024-09-10T14:32:20.241571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.465749+0000","last_change":"2024-09-10T14:32:53.465827+0000","last_active":"2024-09-10T14:32:53.465749+0000","last_peered":"2024-09-10T14:32:53.465749+0000","last_clean":"2024-09-10T14:32:53.465749+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:32:53.465749+0000","last_undegraded":"2024-09-10T14:32:53.465749+0000","last_fullsized":"2024-09-10T14:32:53.465749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:53.465523+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:53.465523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.465523+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:51.914175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758630+0000","last_change":"2024-09-10T14:28:28.893233+0000","last_active":"2024-09-10T14:32:19.758630+0000","last_peered":"2024-09-10T14:32:19.758630+0000","last_clean":"2024-09-10T14:32:19.758630+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:32:19.758630+0000","last_undegraded":"2024-09-10T14:32:19.758630+0000","last_fullsized":"2024-09-10T14:32:19.758630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.473640+0000","last_change":"2024-09-10T14:32:56.473761+0000","last_active":"2024-09-10T14:32:56.473640+0000","last_peered":"2024-09-10T14:32:56.473640+0000","last_clean":"2024-09-10T14:32:56.473640+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:32:56.473640+0000","last_undegraded":"2024-09-10T14:32:56.473640+0000","last_fullsized":"2024-09-10T14:32:56.473640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:56.473347+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:56.473347+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.473347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:32.723316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786983+0000","last_change":"2024-09-10T14:28:28.883653+0000","last_active":"2024-09-10T14:30:58.786983+0000","last_peered":"2024-09-10T14:30:58.786983+0000","last_clean":"2024-09-10T14:30:58.786983+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:30:58.786983+0000","last_undegraded":"2024-09-10T14:30:58.786983+0000","last_fullsized":"2024-09-10T14:30:58.786983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.995921+0000","last_change":"2024-09-10T14:32:39.996050+0000","last_active":"2024-09-10T14:32:39.995921+0000","last_peered":"2024-09-10T14:32:39.995921+0000","last_clean":"2024-09-10T14:32:39.995921+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:32:39.995921+0000","last_undegraded":"2024-09-10T14:32:39.995921+0000","last_fullsized":"2024-09-10T14:32:39.995921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:39.995698+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:39.995698+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.995698+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:22.900509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:59.779105+0000","last_change":"2024-09-10T14:28:28.910148+0000","last_active":"2024-09-10T14:30:59.779105+0000","last_peered":"2024-09-10T14:30:59.779105+0000","last_clean":"2024-09-10T14:30:59.779105+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:30:59.779105+0000","last_undegraded":"2024-09-10T14:30:59.779105+0000","last_fullsized":"2024-09-10T14:30:59.779105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.242210+0000","last_change":"2024-09-10T14:28:30.875024+0000","last_active":"2024-09-10T14:32:20.242210+0000","last_peered":"2024-09-10T14:32:20.242210+0000","last_clean":"2024-09-10T14:32:20.242210+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:32:20.242210+0000","last_undegraded":"2024-09-10T14:32:20.242210+0000","last_fullsized":"2024-09-10T14:32:20.242210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786825+0000","last_change":"2024-09-10T14:28:28.890726+0000","last_active":"2024-09-10T14:30:58.786825+0000","last_peered":"2024-09-10T14:30:58.786825+0000","last_clean":"2024-09-10T14:30:58.786825+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:30:58.786825+0000","last_undegraded":"2024-09-10T14:30:58.786825+0000","last_fullsized":"2024-09-10T14:30:58.786825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.405165+0000","last_change":"2024-09-10T14:32:51.405229+0000","last_active":"2024-09-10T14:32:51.405165+0000","last_peered":"2024-09-10T14:32:51.405165+0000","last_clean":"2024-09-10T14:32:51.405165+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:32:51.405165+0000","last_undegraded":"2024-09-10T14:32:51.405165+0000","last_fullsized":"2024-09-10T14:32:51.405165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:51.404964+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:51.404964+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.404964+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:47.758064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:02.780314+0000","last_change":"2024-09-10T14:28:28.876209+0000","last_active":"2024-09-10T14:31:02.780314+0000","last_peered":"2024-09-10T14:31:02.780314+0000","last_clean":"2024-09-10T14:31:02.780314+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:31:02.780314+0000","last_undegraded":"2024-09-10T14:31:02.780314+0000","last_fullsized":"2024-09-10T14:31:02.780314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.359805+0000","last_change":"2024-09-10T14:32:57.359868+0000","last_active":"2024-09-10T14:32:57.359805+0000","last_peered":"2024-09-10T14:32:57.359805+0000","last_clean":"2024-09-10T14:32:57.359805+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:32:57.359805+0000","last_undegraded":"2024-09-10T14:32:57.359805+0000","last_fullsized":"2024-09-10T14:32:57.359805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:57.359620+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:57.359620+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.359620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:49.137266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.175732+0000","last_change":"2024-09-10T14:28:30.875126+0000","last_active":"2024-09-10T14:31:44.175732+0000","last_peered":"2024-09-10T14:31:44.175732+0000","last_clean":"2024-09-10T14:31:44.175732+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:31:44.175732+0000","last_undegraded":"2024-09-10T14:31:44.175732+0000","last_fullsized":"2024-09-10T14:31:44.175732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783982+0000","last_change":"2024-09-10T14:28:28.902646+0000","last_active":"2024-09-10T14:30:53.783982+0000","last_peered":"2024-09-10T14:30:53.783982+0000","last_clean":"2024-09-10T14:30:53.783982+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:30:53.783982+0000","last_undegraded":"2024-09-10T14:30:53.783982+0000","last_fullsized":"2024-09-10T14:30:53.783982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.912378+0000","last_change":"2024-09-10T14:32:54.912446+0000","last_active":"2024-09-10T14:32:54.912378+0000","last_peered":"2024-09-10T14:32:54.912378+0000","last_clean":"2024-09-10T14:32:54.912378+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:32:54.912378+0000","last_undegraded":"2024-09-10T14:32:54.912378+0000","last_fullsized":"2024-09-10T14:32:54.912378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:54.912155+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:54.912155+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.912155+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:20.379495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.427459+0000","last_change":"2024-09-10T14:32:50.427495+0000","last_active":"2024-09-10T14:32:50.427459+0000","last_peered":"2024-09-10T14:32:50.427459+0000","last_clean":"2024-09-10T14:32:50.427459+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:32:50.427459+0000","last_undegraded":"2024-09-10T14:32:50.427459+0000","last_fullsized":"2024-09-10T14:32:50.427459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:50.427322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:50.427322+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.427322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:22.901578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.984172+0000","last_change":"2024-09-10T14:32:50.984319+0000","last_active":"2024-09-10T14:32:50.984172+0000","last_peered":"2024-09-10T14:32:50.984172+0000","last_clean":"2024-09-10T14:32:50.984172+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:32:50.984172+0000","last_undegraded":"2024-09-10T14:32:50.984172+0000","last_fullsized":"2024-09-10T14:32:50.984172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:50.983924+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:50.983924+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.983924+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:21.745837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783859+0000","last_change":"2024-09-10T14:28:28.904198+0000","last_active":"2024-09-10T14:30:53.783859+0000","last_peered":"2024-09-10T14:30:53.783859+0000","last_clean":"2024-09-10T14:30:53.783859+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:30:53.783859+0000","last_undegraded":"2024-09-10T14:30:53.783859+0000","last_fullsized":"2024-09-10T14:30:53.783859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.270362+0000","last_change":"2024-09-10T14:32:45.270427+0000","last_active":"2024-09-10T14:32:45.270362+0000","last_peered":"2024-09-10T14:32:45.270362+0000","last_clean":"2024-09-10T14:32:45.270362+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:32:45.270362+0000","last_undegraded":"2024-09-10T14:32:45.270362+0000","last_fullsized":"2024-09-10T14:32:45.270362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:45.270174+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:45.270174+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.270174+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.086726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783788+0000","last_change":"2024-09-10T14:28:28.888634+0000","last_active":"2024-09-10T14:30:53.783788+0000","last_peered":"2024-09-10T14:30:53.783788+0000","last_clean":"2024-09-10T14:30:53.783788+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:30:53.783788+0000","last_undegraded":"2024-09-10T14:30:53.783788+0000","last_fullsized":"2024-09-10T14:30:53.783788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.379496+0000","last_change":"2024-09-10T14:32:55.379622+0000","last_active":"2024-09-10T14:32:55.379496+0000","last_peered":"2024-09-10T14:32:55.379496+0000","last_clean":"2024-09-10T14:32:55.379496+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:32:55.379496+0000","last_undegraded":"2024-09-10T14:32:55.379496+0000","last_fullsized":"2024-09-10T14:32:55.379496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:55.379196+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:55.379196+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.379196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:18.941696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.151406+0000","last_change":"2024-09-10T14:32:56.151476+0000","last_active":"2024-09-10T14:32:56.151406+0000","last_peered":"2024-09-10T14:32:56.151406+0000","last_clean":"2024-09-10T14:32:56.151406+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:32:56.151406+0000","last_undegraded":"2024-09-10T14:32:56.151406+0000","last_fullsized":"2024-09-10T14:32:56.151406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:56.151206+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:56.151206+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.151206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:12.336091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.935392+0000","last_change":"2024-09-10T14:32:41.935455+0000","last_active":"2024-09-10T14:32:41.935392+0000","last_peered":"2024-09-10T14:32:41.935392+0000","last_clean":"2024-09-10T14:32:41.935392+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:32:41.935392+0000","last_undegraded":"2024-09-10T14:32:41.935392+0000","last_fullsized":"2024-09-10T14:32:41.935392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:41.935185+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:41.935185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.935185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:14.532819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784264+0000","last_change":"2024-09-10T14:28:28.891649+0000","last_active":"2024-09-10T14:30:48.784264+0000","last_peered":"2024-09-10T14:30:48.784264+0000","last_clean":"2024-09-10T14:30:48.784264+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:30:48.784264+0000","last_undegraded":"2024-09-10T14:30:48.784264+0000","last_fullsized":"2024-09-10T14:30:48.784264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'35","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.267414+0000","last_change":"2024-09-10T14:28:38.936524+0000","last_active":"2024-09-10T14:31:44.267414+0000","last_peered":"2024-09-10T14:31:44.267414+0000","last_clean":"2024-09-10T14:31:44.267414+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:31:44.267414+0000","last_undegraded":"2024-09-10T14:31:44.267414+0000","last_fullsized":"2024-09-10T14:31:44.267414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:29.785850+0000","last_change":"2024-09-10T14:29:07.798075+0000","last_active":"2024-09-10T14:31:29.785850+0000","last_peered":"2024-09-10T14:31:29.785850+0000","last_clean":"2024-09-10T14:31:29.785850+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:31:29.785850+0000","last_undegraded":"2024-09-10T14:31:29.785850+0000","last_fullsized":"2024-09-10T14:31:29.785850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784316+0000","last_change":"2024-09-10T14:28:28.894485+0000","last_active":"2024-09-10T14:30:48.784316+0000","last_peered":"2024-09-10T14:30:48.784316+0000","last_clean":"2024-09-10T14:30:48.784316+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:30:48.784316+0000","last_undegraded":"2024-09-10T14:30:48.784316+0000","last_fullsized":"2024-09-10T14:30:48.784316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.424000+0000","last_change":"2024-09-10T14:32:21.424117+0000","last_active":"2024-09-10T14:32:21.424000+0000","last_peered":"2024-09-10T14:32:21.424000+0000","last_clean":"2024-09-10T14:32:21.424000+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:32:21.424000+0000","last_undegraded":"2024-09-10T14:32:21.424000+0000","last_fullsized":"2024-09-10T14:32:21.424000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.423759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:32.872552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'38","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.452564+0000","last_change":"2024-09-10T14:32:49.452638+0000","last_active":"2024-09-10T14:32:49.452564+0000","last_peered":"2024-09-10T14:32:49.452564+0000","last_clean":"2024-09-10T14:32:49.452564+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:32:49.452564+0000","last_undegraded":"2024-09-10T14:32:49.452564+0000","last_fullsized":"2024-09-10T14:32:49.452564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-10T14:32:49.452381+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-10T14:32:49.452381+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.452381+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:49.443135+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.955541+0000","last_change":"2024-09-10T14:32:34.955641+0000","last_active":"2024-09-10T14:32:34.955541+0000","last_peered":"2024-09-10T14:32:34.955541+0000","last_clean":"2024-09-10T14:32:34.955541+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:32:34.955541+0000","last_undegraded":"2024-09-10T14:32:34.955541+0000","last_fullsized":"2024-09-10T14:32:34.955541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.955261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:29:53.485810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.786268+0000","last_change":"2024-09-10T14:28:38.938155+0000","last_active":"2024-09-10T14:31:03.786268+0000","last_peered":"2024-09-10T14:31:03.786268+0000","last_clean":"2024-09-10T14:31:03.786268+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:31:03.786268+0000","last_undegraded":"2024-09-10T14:31:03.786268+0000","last_fullsized":"2024-09-10T14:31:03.786268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.754518+0000","last_change":"2024-09-10T14:28:30.876193+0000","last_active":"2024-09-10T14:31:43.754518+0000","last_peered":"2024-09-10T14:31:43.754518+0000","last_clean":"2024-09-10T14:31:43.754518+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:31:43.754518+0000","last_undegraded":"2024-09-10T14:31:43.754518+0000","last_fullsized":"2024-09-10T14:31:43.754518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.507638+0000","last_change":"2024-09-10T14:28:28.895357+0000","last_active":"2024-09-10T14:32:15.507638+0000","last_peered":"2024-09-10T14:32:15.507638+0000","last_clean":"2024-09-10T14:32:15.507638+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:32:15.507638+0000","last_undegraded":"2024-09-10T14:32:15.507638+0000","last_fullsized":"2024-09-10T14:32:15.507638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.253009+0000","last_change":"2024-09-10T14:32:38.253066+0000","last_active":"2024-09-10T14:32:38.253009+0000","last_peered":"2024-09-10T14:32:38.253009+0000","last_clean":"2024-09-10T14:32:38.253009+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:32:38.253009+0000","last_undegraded":"2024-09-10T14:32:38.253009+0000","last_fullsized":"2024-09-10T14:32:38.253009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.252795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.252795+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.252795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:01.166001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.994838+0000","last_change":"2024-09-10T14:32:24.994910+0000","last_active":"2024-09-10T14:32:24.994838+0000","last_peered":"2024-09-10T14:32:24.994838+0000","last_clean":"2024-09-10T14:32:24.994838+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:32:24.994838+0000","last_undegraded":"2024-09-10T14:32:24.994838+0000","last_fullsized":"2024-09-10T14:32:24.994838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.994665+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:23.745673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.984911+0000","last_change":"2024-09-10T14:32:30.985015+0000","last_active":"2024-09-10T14:32:30.984911+0000","last_peered":"2024-09-10T14:32:30.984911+0000","last_clean":"2024-09-10T14:32:30.984911+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:32:30.984911+0000","last_undegraded":"2024-09-10T14:32:30.984911+0000","last_fullsized":"2024-09-10T14:32:30.984911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.984682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:15.495746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:12.782442+0000","last_change":"2024-09-10T14:28:38.928569+0000","last_active":"2024-09-10T14:31:12.782442+0000","last_peered":"2024-09-10T14:31:12.782442+0000","last_clean":"2024-09-10T14:31:12.782442+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:31:12.782442+0000","last_undegraded":"2024-09-10T14:31:12.782442+0000","last_fullsized":"2024-09-10T14:31:12.782442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.461039+0000","last_change":"2024-09-10T14:32:57.461098+0000","last_active":"2024-09-10T14:32:57.461039+0000","last_peered":"2024-09-10T14:32:57.461039+0000","last_clean":"2024-09-10T14:32:57.461039+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:32:57.461039+0000","last_undegraded":"2024-09-10T14:32:57.461039+0000","last_fullsized":"2024-09-10T14:32:57.461039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:57.460865+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:57.460865+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.460865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:14.564410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.511521+0000","last_change":"2024-09-10T14:28:28.890448+0000","last_active":"2024-09-10T14:32:15.511521+0000","last_peered":"2024-09-10T14:32:15.511521+0000","last_clean":"2024-09-10T14:32:15.511521+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:32:15.511521+0000","last_undegraded":"2024-09-10T14:32:15.511521+0000","last_fullsized":"2024-09-10T14:32:15.511521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.218936+0000","last_change":"2024-09-10T14:32:37.218999+0000","last_active":"2024-09-10T14:32:37.218936+0000","last_peered":"2024-09-10T14:32:37.218936+0000","last_clean":"2024-09-10T14:32:37.218936+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:32:37.218936+0000","last_undegraded":"2024-09-10T14:32:37.218936+0000","last_fullsized":"2024-09-10T14:32:37.218936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.218734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:20.123545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.492091+0000","last_change":"2024-09-10T14:32:28.492161+0000","last_active":"2024-09-10T14:32:28.492091+0000","last_peered":"2024-09-10T14:32:28.492091+0000","last_clean":"2024-09-10T14:32:28.492091+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:32:28.492091+0000","last_undegraded":"2024-09-10T14:32:28.492091+0000","last_fullsized":"2024-09-10T14:32:28.492091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.491906+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:07.716285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":406,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.438865+0000","last_change":"2024-09-10T14:32:51.439000+0000","last_active":"2024-09-10T14:32:51.438865+0000","last_peered":"2024-09-10T14:32:51.438865+0000","last_clean":"2024-09-10T14:32:51.438865+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:32:51.438865+0000","last_undegraded":"2024-09-10T14:32:51.438865+0000","last_fullsized":"2024-09-10T14:32:51.438865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-10T14:32:51.438638+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-10T14:32:51.438638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.438638+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:47.269056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.358983+0000","last_change":"2024-09-10T14:32:43.359041+0000","last_active":"2024-09-10T14:32:43.358983+0000","last_peered":"2024-09-10T14:32:43.358983+0000","last_clean":"2024-09-10T14:32:43.358983+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:32:43.358983+0000","last_undegraded":"2024-09-10T14:32:43.358983+0000","last_fullsized":"2024-09-10T14:32:43.358983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:43.358788+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:43.358788+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.358788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:40.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.254283+0000","last_change":"2024-09-10T14:32:48.254423+0000","last_active":"2024-09-10T14:32:48.254283+0000","last_peered":"2024-09-10T14:32:48.254283+0000","last_clean":"2024-09-10T14:32:48.254283+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:32:48.254283+0000","last_undegraded":"2024-09-10T14:32:48.254283+0000","last_fullsized":"2024-09-10T14:32:48.254283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:48.254057+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:48.254057+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.254057+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:25.991922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.782295+0000","last_change":"2024-09-10T14:28:28.898609+0000","last_active":"2024-09-10T14:30:48.782295+0000","last_peered":"2024-09-10T14:30:48.782295+0000","last_clean":"2024-09-10T14:30:48.782295+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:30:48.782295+0000","last_undegraded":"2024-09-10T14:30:48.782295+0000","last_fullsized":"2024-09-10T14:30:48.782295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'5","reported_seq":240,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.464976+0000","last_change":"2024-09-10T14:32:24.465044+0000","last_active":"2024-09-10T14:32:24.464976+0000","last_peered":"2024-09-10T14:32:24.464976+0000","last_clean":"2024-09-10T14:32:24.464976+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:32:24.464976+0000","last_undegraded":"2024-09-10T14:32:24.464976+0000","last_fullsized":"2024-09-10T14:32:24.464976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.464758+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:15.815013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.479093+0000","last_change":"2024-09-10T14:32:29.479227+0000","last_active":"2024-09-10T14:32:29.479093+0000","last_peered":"2024-09-10T14:32:29.479093+0000","last_clean":"2024-09-10T14:32:29.479093+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:32:29.479093+0000","last_undegraded":"2024-09-10T14:32:29.479093+0000","last_fullsized":"2024-09-10T14:32:29.479093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.478794+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:53.505918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.041869+0000","last_change":"2024-09-10T14:32:24.041931+0000","last_active":"2024-09-10T14:32:24.041869+0000","last_peered":"2024-09-10T14:32:24.041869+0000","last_clean":"2024-09-10T14:32:24.041869+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:32:24.041869+0000","last_undegraded":"2024-09-10T14:32:24.041869+0000","last_fullsized":"2024-09-10T14:32:24.041869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.041685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:10.399631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241846+0000","last_change":"2024-09-10T14:28:30.870811+0000","last_active":"2024-09-10T14:32:20.241846+0000","last_peered":"2024-09-10T14:32:20.241846+0000","last_clean":"2024-09-10T14:32:20.241846+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:32:20.241846+0000","last_undegraded":"2024-09-10T14:32:20.241846+0000","last_fullsized":"2024-09-10T14:32:20.241846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.364324+0000","last_change":"2024-09-10T14:32:58.364324+0000","last_active":"2024-09-10T14:32:58.364324+0000","last_peered":"2024-09-10T14:32:58.364324+0000","last_clean":"2024-09-10T14:32:58.364324+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:32:58.364324+0000","last_undegraded":"2024-09-10T14:32:58.364324+0000","last_fullsized":"2024-09-10T14:32:58.364324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:58.364049+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:58.364049+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.364049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:13.940048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.014533+0000","last_change":"2024-09-10T14:32:30.014533+0000","last_active":"2024-09-10T14:32:30.014533+0000","last_peered":"2024-09-10T14:32:30.014533+0000","last_clean":"2024-09-10T14:32:30.014533+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:32:30.014533+0000","last_undegraded":"2024-09-10T14:32:30.014533+0000","last_fullsized":"2024-09-10T14:32:30.014533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.014216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:20.605790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.517939+0000","last_change":"2024-09-10T14:32:34.517939+0000","last_active":"2024-09-10T14:32:34.517939+0000","last_peered":"2024-09-10T14:32:34.517939+0000","last_clean":"2024-09-10T14:32:34.517939+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:32:34.517939+0000","last_undegraded":"2024-09-10T14:32:34.517939+0000","last_fullsized":"2024-09-10T14:32:34.517939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.517813+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:15.055588+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.040409+0000","last_change":"2024-09-10T14:32:19.040437+0000","last_active":"2024-09-10T14:32:19.040409+0000","last_peered":"2024-09-10T14:32:19.040409+0000","last_clean":"2024-09-10T14:32:19.040409+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:32:19.040409+0000","last_undegraded":"2024-09-10T14:32:19.040409+0000","last_fullsized":"2024-09-10T14:32:19.040409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.040292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:34.054916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.402239+0000","last_change":"2024-09-10T14:32:39.402239+0000","last_active":"2024-09-10T14:32:39.402239+0000","last_peered":"2024-09-10T14:32:39.402239+0000","last_clean":"2024-09-10T14:32:39.402239+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:32:39.402239+0000","last_undegraded":"2024-09-10T14:32:39.402239+0000","last_fullsized":"2024-09-10T14:32:39.402239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.401987+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:54.650326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.972138+0000","last_change":"2024-09-10T14:32:52.972138+0000","last_active":"2024-09-10T14:32:52.972138+0000","last_peered":"2024-09-10T14:32:52.972138+0000","last_clean":"2024-09-10T14:32:52.972138+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:32:52.972138+0000","last_undegraded":"2024-09-10T14:32:52.972138+0000","last_fullsized":"2024-09-10T14:32:52.972138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:52.971889+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:52.971889+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.971889+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:26.022428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758312+0000","last_change":"2024-09-10T14:28:28.895275+0000","last_active":"2024-09-10T14:32:19.758312+0000","last_peered":"2024-09-10T14:32:19.758312+0000","last_clean":"2024-09-10T14:32:19.758312+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:32:19.758312+0000","last_undegraded":"2024-09-10T14:32:19.758312+0000","last_fullsized":"2024-09-10T14:32:19.758312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.242013+0000","last_change":"2024-09-10T14:32:42.242013+0000","last_active":"2024-09-10T14:32:42.242013+0000","last_peered":"2024-09-10T14:32:42.242013+0000","last_clean":"2024-09-10T14:32:42.242013+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:32:42.242013+0000","last_undegraded":"2024-09-10T14:32:42.242013+0000","last_fullsized":"2024-09-10T14:32:42.242013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.241760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.241760+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.241760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:14.535976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.442042+0000","last_change":"2024-09-10T14:32:39.442127+0000","last_active":"2024-09-10T14:32:39.442042+0000","last_peered":"2024-09-10T14:32:39.442042+0000","last_clean":"2024-09-10T14:32:39.442042+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:32:39.442042+0000","last_undegraded":"2024-09-10T14:32:39.442042+0000","last_fullsized":"2024-09-10T14:32:39.442042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:39.441831+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:39.441831+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.441831+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:50.008100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.039240+0000","last_change":"2024-09-10T14:32:27.039240+0000","last_active":"2024-09-10T14:32:27.039240+0000","last_peered":"2024-09-10T14:32:27.039240+0000","last_clean":"2024-09-10T14:32:27.039240+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:32:27.039240+0000","last_undegraded":"2024-09-10T14:32:27.039240+0000","last_fullsized":"2024-09-10T14:32:27.039240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.038840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:05.450794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'5","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.291972+0000","last_change":"2024-09-10T14:28:38.933258+0000","last_active":"2024-09-10T14:32:19.291972+0000","last_peered":"2024-09-10T14:32:19.291972+0000","last_clean":"2024-09-10T14:32:19.291972+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:32:19.291972+0000","last_undegraded":"2024-09-10T14:32:19.291972+0000","last_fullsized":"2024-09-10T14:32:19.291972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758668+0000","last_change":"2024-09-10T14:29:07.803940+0000","last_active":"2024-09-10T14:32:19.758668+0000","last_peered":"2024-09-10T14:32:19.758668+0000","last_clean":"2024-09-10T14:32:19.758668+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:32:19.758668+0000","last_undegraded":"2024-09-10T14:32:19.758668+0000","last_fullsized":"2024-09-10T14:32:19.758668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240903+0000","last_change":"2024-09-10T14:28:28.889610+0000","last_active":"2024-09-10T14:32:20.240903+0000","last_peered":"2024-09-10T14:32:20.240903+0000","last_clean":"2024-09-10T14:32:20.240903+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:32:20.240903+0000","last_undegraded":"2024-09-10T14:32:20.240903+0000","last_fullsized":"2024-09-10T14:32:20.240903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.261253+0000","last_change":"2024-09-10T14:32:41.261308+0000","last_active":"2024-09-10T14:32:41.261253+0000","last_peered":"2024-09-10T14:32:41.261253+0000","last_clean":"2024-09-10T14:32:41.261253+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:32:41.261253+0000","last_undegraded":"2024-09-10T14:32:41.261253+0000","last_fullsized":"2024-09-10T14:32:41.261253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.261061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.261061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.261061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:33.177795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'47","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.415162+0000","last_change":"2024-09-10T14:32:27.415162+0000","last_active":"2024-09-10T14:32:27.415162+0000","last_peered":"2024-09-10T14:32:27.415162+0000","last_clean":"2024-09-10T14:32:27.415162+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:32:27.415162+0000","last_undegraded":"2024-09-10T14:32:27.415162+0000","last_fullsized":"2024-09-10T14:32:27.415162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.414901+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:51.152227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.166376+0000","last_change":"2024-09-10T14:32:31.166376+0000","last_active":"2024-09-10T14:32:31.166376+0000","last_peered":"2024-09-10T14:32:31.166376+0000","last_clean":"2024-09-10T14:32:31.166376+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:32:31.166376+0000","last_undegraded":"2024-09-10T14:32:31.166376+0000","last_fullsized":"2024-09-10T14:32:31.166376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.166120+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:33.186827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:52.778155+0000","last_change":"2024-09-10T14:28:38.936021+0000","last_active":"2024-09-10T14:30:52.778155+0000","last_peered":"2024-09-10T14:30:52.778155+0000","last_clean":"2024-09-10T14:30:52.778155+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:30:52.778155+0000","last_undegraded":"2024-09-10T14:30:52.778155+0000","last_fullsized":"2024-09-10T14:30:52.778155+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'12","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.390997+0000","last_change":"2024-09-10T14:32:47.391058+0000","last_active":"2024-09-10T14:32:47.390997+0000","last_peered":"2024-09-10T14:32:47.390997+0000","last_clean":"2024-09-10T14:32:47.390997+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:32:47.390997+0000","last_undegraded":"2024-09-10T14:32:47.390997+0000","last_fullsized":"2024-09-10T14:32:47.390997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:47.390803+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:47.390803+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.390803+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:07.854725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240876+0000","last_change":"2024-09-10T14:28:28.884739+0000","last_active":"2024-09-10T14:32:20.240876+0000","last_peered":"2024-09-10T14:32:20.240876+0000","last_clean":"2024-09-10T14:32:20.240876+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:32:20.240876+0000","last_undegraded":"2024-09-10T14:32:20.240876+0000","last_fullsized":"2024-09-10T14:32:20.240876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"36'2","reported_seq":233,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.252127+0000","last_change":"2024-09-10T14:32:36.252127+0000","last_active":"2024-09-10T14:32:36.252127+0000","last_peered":"2024-09-10T14:32:36.252127+0000","last_clean":"2024-09-10T14:32:36.252127+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:32:36.252127+0000","last_undegraded":"2024-09-10T14:32:36.252127+0000","last_fullsized":"2024-09-10T14:32:36.252127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.251846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:51:42.564689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'64","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.463817+0000","last_change":"2024-09-10T14:32:33.463817+0000","last_active":"2024-09-10T14:32:33.463817+0000","last_peered":"2024-09-10T14:32:33.463817+0000","last_clean":"2024-09-10T14:32:33.463817+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:32:33.463817+0000","last_undegraded":"2024-09-10T14:32:33.463817+0000","last_fullsized":"2024-09-10T14:32:33.463817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'64","last_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_deep_scrub":"36'64","last_deep_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.463523+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:28.060036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.053813+0000","last_change":"2024-09-10T14:32:21.053813+0000","last_active":"2024-09-10T14:32:21.053813+0000","last_peered":"2024-09-10T14:32:21.053813+0000","last_clean":"2024-09-10T14:32:21.053813+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:32:21.053813+0000","last_undegraded":"2024-09-10T14:32:21.053813+0000","last_fullsized":"2024-09-10T14:32:21.053813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.053565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:23.410520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'23","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.286036+0000","last_change":"2024-09-10T14:32:47.286108+0000","last_active":"2024-09-10T14:32:47.286036+0000","last_peered":"2024-09-10T14:32:47.286036+0000","last_clean":"2024-09-10T14:32:47.286036+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:32:47.286036+0000","last_undegraded":"2024-09-10T14:32:47.286036+0000","last_fullsized":"2024-09-10T14:32:47.286036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-10T14:32:47.285847+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-10T14:32:47.285847+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.285847+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:11.350745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'3","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.325782+0000","last_change":"2024-09-10T14:28:30.878590+0000","last_active":"2024-09-10T14:31:44.325782+0000","last_peered":"2024-09-10T14:31:44.325782+0000","last_clean":"2024-09-10T14:31:44.325782+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:31:44.325782+0000","last_undegraded":"2024-09-10T14:31:44.325782+0000","last_fullsized":"2024-09-10T14:31:44.325782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776975+0000","last_change":"2024-09-10T14:28:28.877127+0000","last_active":"2024-09-10T14:30:47.776975+0000","last_peered":"2024-09-10T14:30:47.776975+0000","last_clean":"2024-09-10T14:30:47.776975+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:30:47.776975+0000","last_undegraded":"2024-09-10T14:30:47.776975+0000","last_fullsized":"2024-09-10T14:30:47.776975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.417840+0000","last_change":"2024-09-10T14:32:41.417891+0000","last_active":"2024-09-10T14:32:41.417840+0000","last_peered":"2024-09-10T14:32:41.417840+0000","last_clean":"2024-09-10T14:32:41.417840+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:32:41.417840+0000","last_undegraded":"2024-09-10T14:32:41.417840+0000","last_fullsized":"2024-09-10T14:32:41.417840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.417613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.417613+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.417613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:31.173045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.040219+0000","last_change":"2024-09-10T14:32:26.040293+0000","last_active":"2024-09-10T14:32:26.040219+0000","last_peered":"2024-09-10T14:32:26.040219+0000","last_clean":"2024-09-10T14:32:26.040219+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:32:26.040219+0000","last_undegraded":"2024-09-10T14:32:26.040219+0000","last_fullsized":"2024-09-10T14:32:26.040219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.040008+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:55.634620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.785831+0000","last_change":"2024-09-10T14:28:36.946071+0000","last_active":"2024-09-10T14:30:53.785831+0000","last_peered":"2024-09-10T14:30:53.785831+0000","last_clean":"2024-09-10T14:30:53.785831+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:30:53.785831+0000","last_undegraded":"2024-09-10T14:30:53.785831+0000","last_fullsized":"2024-09-10T14:30:53.785831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:35.865409+0000","last_clean_scrub_stamp":"2024-09-10T14:28:35.865409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243371+0000","last_change":"2024-09-10T14:28:38.941887+0000","last_active":"2024-09-10T14:32:20.243371+0000","last_peered":"2024-09-10T14:32:20.243371+0000","last_clean":"2024-09-10T14:32:20.243371+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:32:20.243371+0000","last_undegraded":"2024-09-10T14:32:20.243371+0000","last_fullsized":"2024-09-10T14:32:20.243371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.478515+0000","last_change":"2024-09-10T14:32:32.478577+0000","last_active":"2024-09-10T14:32:32.478515+0000","last_peered":"2024-09-10T14:32:32.478515+0000","last_clean":"2024-09-10T14:32:32.478515+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:32:32.478515+0000","last_undegraded":"2024-09-10T14:32:32.478515+0000","last_fullsized":"2024-09-10T14:32:32.478515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.478327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:57.945668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240887+0000","last_change":"2024-09-10T14:28:28.891910+0000","last_active":"2024-09-10T14:32:20.240887+0000","last_peered":"2024-09-10T14:32:20.240887+0000","last_clean":"2024-09-10T14:32:20.240887+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:32:20.240887+0000","last_undegraded":"2024-09-10T14:32:20.240887+0000","last_fullsized":"2024-09-10T14:32:20.240887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.294136+0000","last_change":"2024-09-10T14:32:40.294294+0000","last_active":"2024-09-10T14:32:40.294136+0000","last_peered":"2024-09-10T14:32:40.294136+0000","last_clean":"2024-09-10T14:32:40.294136+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:32:40.294136+0000","last_undegraded":"2024-09-10T14:32:40.294136+0000","last_fullsized":"2024-09-10T14:32:40.294136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:40.293913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:40.293913+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.293913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:23.340331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.499266+0000","last_change":"2024-09-10T14:32:33.499425+0000","last_active":"2024-09-10T14:32:33.499266+0000","last_peered":"2024-09-10T14:32:33.499266+0000","last_clean":"2024-09-10T14:32:33.499266+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:32:33.499266+0000","last_undegraded":"2024-09-10T14:32:33.499266+0000","last_fullsized":"2024-09-10T14:32:33.499266+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.499022+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":445,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.396495+0000","last_change":"2024-09-10T14:32:22.396571+0000","last_active":"2024-09-10T14:32:22.396495+0000","last_peered":"2024-09-10T14:32:22.396495+0000","last_clean":"2024-09-10T14:32:22.396495+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:32:22.396495+0000","last_undegraded":"2024-09-10T14:32:22.396495+0000","last_fullsized":"2024-09-10T14:32:22.396495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.396275+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:50.169559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.808140+0000","last_change":"2024-09-10T14:28:38.936015+0000","last_active":"2024-09-10T14:32:18.808140+0000","last_peered":"2024-09-10T14:32:18.808140+0000","last_clean":"2024-09-10T14:32:18.808140+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:32:18.808140+0000","last_undegraded":"2024-09-10T14:32:18.808140+0000","last_fullsized":"2024-09-10T14:32:18.808140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.367982+0000","last_change":"2024-09-10T14:32:53.368051+0000","last_active":"2024-09-10T14:32:53.367982+0000","last_peered":"2024-09-10T14:32:53.367982+0000","last_clean":"2024-09-10T14:32:53.367982+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:32:53.367982+0000","last_undegraded":"2024-09-10T14:32:53.367982+0000","last_fullsized":"2024-09-10T14:32:53.367982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:53.367787+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:53.367787+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.367787+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.443273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240872+0000","last_change":"2024-09-10T14:28:28.890431+0000","last_active":"2024-09-10T14:32:20.240872+0000","last_peered":"2024-09-10T14:32:20.240872+0000","last_clean":"2024-09-10T14:32:20.240872+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:32:20.240872+0000","last_undegraded":"2024-09-10T14:32:20.240872+0000","last_fullsized":"2024-09-10T14:32:20.240872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":430,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.957431+0000","last_change":"2024-09-10T14:32:31.957497+0000","last_active":"2024-09-10T14:32:31.957431+0000","last_peered":"2024-09-10T14:32:31.957431+0000","last_clean":"2024-09-10T14:32:31.957431+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:32:31.957431+0000","last_undegraded":"2024-09-10T14:32:31.957431+0000","last_fullsized":"2024-09-10T14:32:31.957431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.957244+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:59.661372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.518441+0000","last_change":"2024-09-10T14:32:45.518513+0000","last_active":"2024-09-10T14:32:45.518441+0000","last_peered":"2024-09-10T14:32:45.518441+0000","last_clean":"2024-09-10T14:32:45.518441+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:32:45.518441+0000","last_undegraded":"2024-09-10T14:32:45.518441+0000","last_fullsized":"2024-09-10T14:32:45.518441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:45.518255+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:45.518255+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.518255+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:33.065215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":474,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.046172+0000","last_change":"2024-09-10T14:32:27.046231+0000","last_active":"2024-09-10T14:32:27.046172+0000","last_peered":"2024-09-10T14:32:27.046172+0000","last_clean":"2024-09-10T14:32:27.046172+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:32:27.046172+0000","last_undegraded":"2024-09-10T14:32:27.046172+0000","last_fullsized":"2024-09-10T14:32:27.046172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.045975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:13.403921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.470074+0000","last_change":"2024-09-10T14:32:31.470074+0000","last_active":"2024-09-10T14:32:31.470074+0000","last_peered":"2024-09-10T14:32:31.470074+0000","last_clean":"2024-09-10T14:32:31.470074+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:32:31.470074+0000","last_undegraded":"2024-09-10T14:32:31.470074+0000","last_fullsized":"2024-09-10T14:32:31.470074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.469828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:50.291732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.988464+0000","last_change":"2024-09-10T14:32:40.988547+0000","last_active":"2024-09-10T14:32:40.988464+0000","last_peered":"2024-09-10T14:32:40.988464+0000","last_clean":"2024-09-10T14:32:40.988464+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:32:40.988464+0000","last_undegraded":"2024-09-10T14:32:40.988464+0000","last_fullsized":"2024-09-10T14:32:40.988464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:40.988250+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:40.988250+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.988250+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:03.901456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240886+0000","last_change":"2024-09-10T14:28:28.894339+0000","last_active":"2024-09-10T14:32:20.240886+0000","last_peered":"2024-09-10T14:32:20.240886+0000","last_clean":"2024-09-10T14:32:20.240886+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:32:20.240886+0000","last_undegraded":"2024-09-10T14:32:20.240886+0000","last_fullsized":"2024-09-10T14:32:20.240886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.468611+0000","last_change":"2024-09-10T14:32:23.468662+0000","last_active":"2024-09-10T14:32:23.468611+0000","last_peered":"2024-09-10T14:32:23.468611+0000","last_clean":"2024-09-10T14:32:23.468611+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:32:23.468611+0000","last_undegraded":"2024-09-10T14:32:23.468611+0000","last_fullsized":"2024-09-10T14:32:23.468611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.468416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:16.409761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.022982+0000","last_change":"2024-09-10T14:32:28.023066+0000","last_active":"2024-09-10T14:32:28.022982+0000","last_peered":"2024-09-10T14:32:28.022982+0000","last_clean":"2024-09-10T14:32:28.022982+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:32:28.022982+0000","last_undegraded":"2024-09-10T14:32:28.022982+0000","last_fullsized":"2024-09-10T14:32:28.022982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.022782+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:04.020612+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.346377+0000","last_change":"2024-09-10T14:32:21.346431+0000","last_active":"2024-09-10T14:32:21.346377+0000","last_peered":"2024-09-10T14:32:21.346377+0000","last_clean":"2024-09-10T14:32:21.346377+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:32:21.346377+0000","last_undegraded":"2024-09-10T14:32:21.346377+0000","last_fullsized":"2024-09-10T14:32:21.346377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.346185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:37.786157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'15","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.896938+0000","last_change":"2024-09-10T14:32:42.896938+0000","last_active":"2024-09-10T14:32:42.896938+0000","last_peered":"2024-09-10T14:32:42.896938+0000","last_clean":"2024-09-10T14:32:42.896938+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:32:42.896938+0000","last_undegraded":"2024-09-10T14:32:42.896938+0000","last_fullsized":"2024-09-10T14:32:42.896938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:42.896656+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:42.896656+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.896656+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:25.943074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.450748+0000","last_change":"2024-09-10T14:32:36.450748+0000","last_active":"2024-09-10T14:32:36.450748+0000","last_peered":"2024-09-10T14:32:36.450748+0000","last_clean":"2024-09-10T14:32:36.450748+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:32:36.450748+0000","last_undegraded":"2024-09-10T14:32:36.450748+0000","last_fullsized":"2024-09-10T14:32:36.450748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.450484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:32.265283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":209,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.802861+0000","last_change":"2024-09-10T14:28:16.789816+0000","last_active":"2024-09-10T14:32:18.802861+0000","last_peered":"2024-09-10T14:32:18.802861+0000","last_clean":"2024-09-10T14:32:18.802861+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:32:18.802861+0000","last_undegraded":"2024-09-10T14:32:18.802861+0000","last_fullsized":"2024-09-10T14:32:18.802861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:14.781430+0000","last_clean_scrub_stamp":"2024-09-10T14:28:14.781430+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240704+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:32:20.240704+0000","last_peered":"2024-09-10T14:32:20.240704+0000","last_clean":"2024-09-10T14:32:20.240704+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:32:20.240704+0000","last_undegraded":"2024-09-10T14:32:20.240704+0000","last_fullsized":"2024-09-10T14:32:20.240704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240727+0000","last_change":"2024-09-10T14:28:28.892198+0000","last_active":"2024-09-10T14:32:20.240727+0000","last_peered":"2024-09-10T14:32:20.240727+0000","last_clean":"2024-09-10T14:32:20.240727+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:32:20.240727+0000","last_undegraded":"2024-09-10T14:32:20.240727+0000","last_fullsized":"2024-09-10T14:32:20.240727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.952793+0000","last_change":"2024-09-10T14:32:36.952793+0000","last_active":"2024-09-10T14:32:36.952793+0000","last_peered":"2024-09-10T14:32:36.952793+0000","last_clean":"2024-09-10T14:32:36.952793+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:32:36.952793+0000","last_undegraded":"2024-09-10T14:32:36.952793+0000","last_fullsized":"2024-09-10T14:32:36.952793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.952410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:45.541704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'90","reported_seq":183,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.479235+0000","last_change":"2024-09-10T14:32:48.479235+0000","last_active":"2024-09-10T14:32:48.479235+0000","last_peered":"2024-09-10T14:32:48.479235+0000","last_clean":"2024-09-10T14:32:48.479235+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:32:48.479235+0000","last_undegraded":"2024-09-10T14:32:48.479235+0000","last_fullsized":"2024-09-10T14:32:48.479235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-09-10T14:32:48.478990+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-09-10T14:32:48.478990+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.478990+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:01.329596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.266984+0000","last_change":"2024-09-10T14:32:43.266984+0000","last_active":"2024-09-10T14:32:43.266984+0000","last_peered":"2024-09-10T14:32:43.266984+0000","last_clean":"2024-09-10T14:32:43.266984+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:32:43.266984+0000","last_undegraded":"2024-09-10T14:32:43.266984+0000","last_fullsized":"2024-09-10T14:32:43.266984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:43.266713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:43.266713+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.266713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:55.597757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.463686+0000","last_change":"2024-09-10T14:32:27.463686+0000","last_active":"2024-09-10T14:32:27.463686+0000","last_peered":"2024-09-10T14:32:27.463686+0000","last_clean":"2024-09-10T14:32:27.463686+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:32:27.463686+0000","last_undegraded":"2024-09-10T14:32:27.463686+0000","last_fullsized":"2024-09-10T14:32:27.463686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.463440+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:01.315498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.420075+0000","last_change":"2024-09-10T14:32:58.420191+0000","last_active":"2024-09-10T14:32:58.420075+0000","last_peered":"2024-09-10T14:32:58.420075+0000","last_clean":"2024-09-10T14:32:58.420075+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:32:58.420075+0000","last_undegraded":"2024-09-10T14:32:58.420075+0000","last_fullsized":"2024-09-10T14:32:58.420075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:58.419787+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:58.419787+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.419787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:20.379479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.805659+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:32:18.805659+0000","last_peered":"2024-09-10T14:32:18.805659+0000","last_clean":"2024-09-10T14:32:18.805659+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:32:18.805659+0000","last_undegraded":"2024-09-10T14:32:18.805659+0000","last_fullsized":"2024-09-10T14:32:18.805659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806497+0000","last_change":"2024-09-10T14:28:28.873736+0000","last_active":"2024-09-10T14:32:18.806497+0000","last_peered":"2024-09-10T14:32:18.806497+0000","last_clean":"2024-09-10T14:32:18.806497+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:32:18.806497+0000","last_undegraded":"2024-09-10T14:32:18.806497+0000","last_fullsized":"2024-09-10T14:32:18.806497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.453049+0000","last_change":"2024-09-10T14:32:22.453049+0000","last_active":"2024-09-10T14:32:22.453049+0000","last_peered":"2024-09-10T14:32:22.453049+0000","last_clean":"2024-09-10T14:32:22.453049+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:32:22.453049+0000","last_undegraded":"2024-09-10T14:32:22.453049+0000","last_fullsized":"2024-09-10T14:32:22.453049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.452808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:07.398717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'292","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.028865+0000","last_change":"2024-09-10T14:32:22.028865+0000","last_active":"2024-09-10T14:32:22.028865+0000","last_peered":"2024-09-10T14:32:22.028865+0000","last_clean":"2024-09-10T14:32:22.028865+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:32:22.028865+0000","last_undegraded":"2024-09-10T14:32:22.028865+0000","last_fullsized":"2024-09-10T14:32:22.028865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'292","last_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_deep_scrub":"36'292","last_deep_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.028508+0000","objects_scrubbed":10,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:37.043133+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.471881+0000","last_change":"2024-09-10T14:32:47.471881+0000","last_active":"2024-09-10T14:32:47.471881+0000","last_peered":"2024-09-10T14:32:47.471881+0000","last_clean":"2024-09-10T14:32:47.471881+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:32:47.471881+0000","last_undegraded":"2024-09-10T14:32:47.471881+0000","last_fullsized":"2024-09-10T14:32:47.471881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:47.471638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:47.471638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.471638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:38.822368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.291750+0000","last_change":"2024-09-10T14:28:38.943158+0000","last_active":"2024-09-10T14:32:19.291750+0000","last_peered":"2024-09-10T14:32:19.291750+0000","last_clean":"2024-09-10T14:32:19.291750+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:32:19.291750+0000","last_undegraded":"2024-09-10T14:32:19.291750+0000","last_fullsized":"2024-09-10T14:32:19.291750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806929+0000","last_change":"2024-09-10T14:28:30.884260+0000","last_active":"2024-09-10T14:32:18.806929+0000","last_peered":"2024-09-10T14:32:18.806929+0000","last_clean":"2024-09-10T14:32:18.806929+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:32:18.806929+0000","last_undegraded":"2024-09-10T14:32:18.806929+0000","last_fullsized":"2024-09-10T14:32:18.806929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758240+0000","last_change":"2024-09-10T14:28:21.859213+0000","last_active":"2024-09-10T14:32:19.758240+0000","last_peered":"2024-09-10T14:32:19.758240+0000","last_clean":"2024-09-10T14:32:19.758240+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:32:19.758240+0000","last_undegraded":"2024-09-10T14:32:19.758240+0000","last_fullsized":"2024-09-10T14:32:19.758240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806569+0000","last_change":"2024-09-10T14:28:28.874080+0000","last_active":"2024-09-10T14:32:18.806569+0000","last_peered":"2024-09-10T14:32:18.806569+0000","last_clean":"2024-09-10T14:32:18.806569+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:32:18.806569+0000","last_undegraded":"2024-09-10T14:32:18.806569+0000","last_fullsized":"2024-09-10T14:32:18.806569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.335896+0000","last_change":"2024-09-10T14:32:44.335896+0000","last_active":"2024-09-10T14:32:44.335896+0000","last_peered":"2024-09-10T14:32:44.335896+0000","last_clean":"2024-09-10T14:32:44.335896+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:32:44.335896+0000","last_undegraded":"2024-09-10T14:32:44.335896+0000","last_fullsized":"2024-09-10T14:32:44.335896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:44.335653+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:44.335653+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.335653+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:10.314679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'24","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.504309+0000","last_change":"2024-09-10T14:32:36.504309+0000","last_active":"2024-09-10T14:32:36.504309+0000","last_peered":"2024-09-10T14:32:36.504309+0000","last_clean":"2024-09-10T14:32:36.504309+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:32:36.504309+0000","last_undegraded":"2024-09-10T14:32:36.504309+0000","last_fullsized":"2024-09-10T14:32:36.504309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.504009+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:54.102292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.223829+0000","last_change":"2024-09-10T14:32:35.223829+0000","last_active":"2024-09-10T14:32:35.223829+0000","last_peered":"2024-09-10T14:32:35.223829+0000","last_clean":"2024-09-10T14:32:35.223829+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:32:35.223829+0000","last_undegraded":"2024-09-10T14:32:35.223829+0000","last_fullsized":"2024-09-10T14:32:35.223829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.223582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:41.920597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.785584+0000","last_change":"2024-09-10T14:28:38.943308+0000","last_active":"2024-09-10T14:30:53.785584+0000","last_peered":"2024-09-10T14:30:53.785584+0000","last_clean":"2024-09-10T14:30:53.785584+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:30:53.785584+0000","last_undegraded":"2024-09-10T14:30:53.785584+0000","last_fullsized":"2024-09-10T14:30:53.785584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.202665+0000","last_change":"2024-09-10T14:32:51.202723+0000","last_active":"2024-09-10T14:32:51.202665+0000","last_peered":"2024-09-10T14:32:51.202665+0000","last_clean":"2024-09-10T14:32:51.202665+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:32:51.202665+0000","last_undegraded":"2024-09-10T14:32:51.202665+0000","last_fullsized":"2024-09-10T14:32:51.202665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:51.202477+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:51.202477+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.202477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:44.072182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240672+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:32:20.240672+0000","last_peered":"2024-09-10T14:32:20.240672+0000","last_clean":"2024-09-10T14:32:20.240672+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:32:20.240672+0000","last_undegraded":"2024-09-10T14:32:20.240672+0000","last_fullsized":"2024-09-10T14:32:20.240672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758284+0000","last_change":"2024-09-10T14:28:28.892687+0000","last_active":"2024-09-10T14:32:19.758284+0000","last_peered":"2024-09-10T14:32:19.758284+0000","last_clean":"2024-09-10T14:32:19.758284+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:32:19.758284+0000","last_undegraded":"2024-09-10T14:32:19.758284+0000","last_fullsized":"2024-09-10T14:32:19.758284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.202503+0000","last_change":"2024-09-10T14:32:34.202503+0000","last_active":"2024-09-10T14:32:34.202503+0000","last_peered":"2024-09-10T14:32:34.202503+0000","last_clean":"2024-09-10T14:32:34.202503+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:32:34.202503+0000","last_undegraded":"2024-09-10T14:32:34.202503+0000","last_fullsized":"2024-09-10T14:32:34.202503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.202259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:34.865922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.472613+0000","last_change":"2024-09-10T14:32:46.472613+0000","last_active":"2024-09-10T14:32:46.472613+0000","last_peered":"2024-09-10T14:32:46.472613+0000","last_clean":"2024-09-10T14:32:46.472613+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:32:46.472613+0000","last_undegraded":"2024-09-10T14:32:46.472613+0000","last_fullsized":"2024-09-10T14:32:46.472613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-10T14:32:46.472335+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-10T14:32:46.472335+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.472335+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:11:41.354491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.482747+0000","last_change":"2024-09-10T14:32:43.482747+0000","last_active":"2024-09-10T14:32:43.482747+0000","last_peered":"2024-09-10T14:32:43.482747+0000","last_clean":"2024-09-10T14:32:43.482747+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:32:43.482747+0000","last_undegraded":"2024-09-10T14:32:43.482747+0000","last_fullsized":"2024-09-10T14:32:43.482747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:43.482370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:43.482370+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.482370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:32.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.908593+0000","last_change":"2024-09-10T14:32:46.908593+0000","last_active":"2024-09-10T14:32:46.908593+0000","last_peered":"2024-09-10T14:32:46.908593+0000","last_clean":"2024-09-10T14:32:46.908593+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:32:46.908593+0000","last_undegraded":"2024-09-10T14:32:46.908593+0000","last_fullsized":"2024-09-10T14:32:46.908593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:46.908307+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:46.908307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.908307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:02.194310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.889550+0000","last_change":"2024-09-10T14:32:47.889610+0000","last_active":"2024-09-10T14:32:47.889550+0000","last_peered":"2024-09-10T14:32:47.889550+0000","last_clean":"2024-09-10T14:32:47.889550+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:32:47.889550+0000","last_undegraded":"2024-09-10T14:32:47.889550+0000","last_fullsized":"2024-09-10T14:32:47.889550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:47.889337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:47.889337+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.889337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:25:53.199083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.349827+0000","last_change":"2024-09-10T14:32:54.349892+0000","last_active":"2024-09-10T14:32:54.349827+0000","last_peered":"2024-09-10T14:32:54.349827+0000","last_clean":"2024-09-10T14:32:54.349827+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:32:54.349827+0000","last_undegraded":"2024-09-10T14:32:54.349827+0000","last_fullsized":"2024-09-10T14:32:54.349827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:54.349626+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:54.349626+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.349626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.122241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806442+0000","last_change":"2024-09-10T14:28:21.327700+0000","last_active":"2024-09-10T14:32:18.806442+0000","last_peered":"2024-09-10T14:32:18.806442+0000","last_clean":"2024-09-10T14:32:18.806442+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:32:18.806442+0000","last_undegraded":"2024-09-10T14:32:18.806442+0000","last_fullsized":"2024-09-10T14:32:18.806442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.204746+0000","last_change":"2024-09-10T14:29:07.784812+0000","last_active":"2024-09-10T14:32:15.204746+0000","last_peered":"2024-09-10T14:32:15.204746+0000","last_clean":"2024-09-10T14:32:15.204746+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:32:15.204746+0000","last_undegraded":"2024-09-10T14:32:15.204746+0000","last_fullsized":"2024-09-10T14:32:15.204746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'74","reported_seq":153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.093004+0000","last_change":"2024-09-10T14:32:29.093004+0000","last_active":"2024-09-10T14:32:29.093004+0000","last_peered":"2024-09-10T14:32:29.093004+0000","last_clean":"2024-09-10T14:32:29.093004+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:32:29.093004+0000","last_undegraded":"2024-09-10T14:32:29.093004+0000","last_fullsized":"2024-09-10T14:32:29.093004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.092705+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:13.603769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.438626+0000","last_change":"2024-09-10T14:32:24.438626+0000","last_active":"2024-09-10T14:32:24.438626+0000","last_peered":"2024-09-10T14:32:24.438626+0000","last_clean":"2024-09-10T14:32:24.438626+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:32:24.438626+0000","last_undegraded":"2024-09-10T14:32:24.438626+0000","last_fullsized":"2024-09-10T14:32:24.438626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.438373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:44.201354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:57.779310+0000","last_change":"2024-09-10T14:28:38.924566+0000","last_active":"2024-09-10T14:30:57.779310+0000","last_peered":"2024-09-10T14:30:57.779310+0000","last_clean":"2024-09-10T14:30:57.779310+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:30:57.779310+0000","last_undegraded":"2024-09-10T14:30:57.779310+0000","last_fullsized":"2024-09-10T14:30:57.779310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.900251+0000","last_change":"2024-09-10T14:32:43.900313+0000","last_active":"2024-09-10T14:32:43.900251+0000","last_peered":"2024-09-10T14:32:43.900251+0000","last_clean":"2024-09-10T14:32:43.900251+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:32:43.900251+0000","last_undegraded":"2024-09-10T14:32:43.900251+0000","last_fullsized":"2024-09-10T14:32:43.900251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:43.900061+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:43.900061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.900061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:35.816795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.216970+0000","last_change":"2024-09-10T14:32:52.217031+0000","last_active":"2024-09-10T14:32:52.216970+0000","last_peered":"2024-09-10T14:32:52.216970+0000","last_clean":"2024-09-10T14:32:52.216970+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:32:52.216970+0000","last_undegraded":"2024-09-10T14:32:52.216970+0000","last_fullsized":"2024-09-10T14:32:52.216970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:52.216776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:52.216776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.216776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:17.684116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240674+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:32:20.240674+0000","last_peered":"2024-09-10T14:32:20.240674+0000","last_clean":"2024-09-10T14:32:20.240674+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:32:20.240674+0000","last_undegraded":"2024-09-10T14:32:20.240674+0000","last_fullsized":"2024-09-10T14:32:20.240674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.399267+0000","last_change":"2024-09-10T14:32:28.399267+0000","last_active":"2024-09-10T14:32:28.399267+0000","last_peered":"2024-09-10T14:32:28.399267+0000","last_clean":"2024-09-10T14:32:28.399267+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:32:28.399267+0000","last_undegraded":"2024-09-10T14:32:28.399267+0000","last_fullsized":"2024-09-10T14:32:28.399267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.398875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:59.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'22","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.978344+0000","last_change":"2024-09-10T14:32:20.978344+0000","last_active":"2024-09-10T14:32:20.978344+0000","last_peered":"2024-09-10T14:32:20.978344+0000","last_clean":"2024-09-10T14:32:20.978344+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:32:20.978344+0000","last_undegraded":"2024-09-10T14:32:20.978344+0000","last_fullsized":"2024-09-10T14:32:20.978344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.978065+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:42.621330+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":390,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.978149+0000","last_change":"2024-09-10T14:32:22.978149+0000","last_active":"2024-09-10T14:32:22.978149+0000","last_peered":"2024-09-10T14:32:22.978149+0000","last_clean":"2024-09-10T14:32:22.978149+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:32:22.978149+0000","last_undegraded":"2024-09-10T14:32:22.978149+0000","last_fullsized":"2024-09-10T14:32:22.978149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.977905+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:38.553496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.747952+0000","last_change":"2024-09-10T14:28:38.937953+0000","last_active":"2024-09-10T14:31:43.747952+0000","last_peered":"2024-09-10T14:31:43.747952+0000","last_clean":"2024-09-10T14:31:43.747952+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:31:43.747952+0000","last_undegraded":"2024-09-10T14:31:43.747952+0000","last_fullsized":"2024-09-10T14:31:43.747952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.418284+0000","last_change":"2024-09-10T14:32:37.418352+0000","last_active":"2024-09-10T14:32:37.418284+0000","last_peered":"2024-09-10T14:32:37.418284+0000","last_clean":"2024-09-10T14:32:37.418284+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:32:37.418284+0000","last_undegraded":"2024-09-10T14:32:37.418284+0000","last_fullsized":"2024-09-10T14:32:37.418284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.418081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:08.888989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240992+0000","last_change":"2024-09-10T14:28:28.891219+0000","last_active":"2024-09-10T14:32:20.240992+0000","last_peered":"2024-09-10T14:32:20.240992+0000","last_clean":"2024-09-10T14:32:20.240992+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:32:20.240992+0000","last_undegraded":"2024-09-10T14:32:20.240992+0000","last_fullsized":"2024-09-10T14:32:20.240992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806376+0000","last_change":"2024-09-10T14:28:21.327784+0000","last_active":"2024-09-10T14:32:18.806376+0000","last_peered":"2024-09-10T14:32:18.806376+0000","last_clean":"2024-09-10T14:32:18.806376+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:32:18.806376+0000","last_undegraded":"2024-09-10T14:32:18.806376+0000","last_fullsized":"2024-09-10T14:32:18.806376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.448927+0000","last_change":"2024-09-10T14:32:29.448927+0000","last_active":"2024-09-10T14:32:29.448927+0000","last_peered":"2024-09-10T14:32:29.448927+0000","last_clean":"2024-09-10T14:32:29.448927+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:32:29.448927+0000","last_undegraded":"2024-09-10T14:32:29.448927+0000","last_fullsized":"2024-09-10T14:32:29.448927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.448685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:13.499393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.429507+0000","last_change":"2024-09-10T14:32:35.429507+0000","last_active":"2024-09-10T14:32:35.429507+0000","last_peered":"2024-09-10T14:32:35.429507+0000","last_clean":"2024-09-10T14:32:35.429507+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:32:35.429507+0000","last_undegraded":"2024-09-10T14:32:35.429507+0000","last_fullsized":"2024-09-10T14:32:35.429507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.429210+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:32.213391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":405,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.060686+0000","last_change":"2024-09-10T14:32:25.060686+0000","last_active":"2024-09-10T14:32:25.060686+0000","last_peered":"2024-09-10T14:32:25.060686+0000","last_clean":"2024-09-10T14:32:25.060686+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:32:25.060686+0000","last_undegraded":"2024-09-10T14:32:25.060686+0000","last_fullsized":"2024-09-10T14:32:25.060686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.060434+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:01.652381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783765+0000","last_change":"2024-09-10T14:28:38.934660+0000","last_active":"2024-09-10T14:30:53.783765+0000","last_peered":"2024-09-10T14:30:53.783765+0000","last_clean":"2024-09-10T14:30:53.783765+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:30:53.783765+0000","last_undegraded":"2024-09-10T14:30:53.783765+0000","last_fullsized":"2024-09-10T14:30:53.783765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.320535+0000","last_change":"2024-09-10T14:32:59.320601+0000","last_active":"2024-09-10T14:32:59.320535+0000","last_peered":"2024-09-10T14:32:59.320535+0000","last_clean":"2024-09-10T14:32:59.320535+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:32:59.320535+0000","last_undegraded":"2024-09-10T14:32:59.320535+0000","last_fullsized":"2024-09-10T14:32:59.320535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:59.320328+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:59.320328+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.320328+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:35.873871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.289852+0000","last_change":"2024-09-10T14:28:28.904513+0000","last_active":"2024-09-10T14:32:19.289852+0000","last_peered":"2024-09-10T14:32:19.289852+0000","last_clean":"2024-09-10T14:32:19.289852+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:32:19.289852+0000","last_undegraded":"2024-09-10T14:32:19.289852+0000","last_fullsized":"2024-09-10T14:32:19.289852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240704+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:32:20.240704+0000","last_peered":"2024-09-10T14:32:20.240704+0000","last_clean":"2024-09-10T14:32:20.240704+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:32:20.240704+0000","last_undegraded":"2024-09-10T14:32:20.240704+0000","last_fullsized":"2024-09-10T14:32:20.240704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.463375+0000","last_change":"2024-09-10T14:32:30.463375+0000","last_active":"2024-09-10T14:32:30.463375+0000","last_peered":"2024-09-10T14:32:30.463375+0000","last_clean":"2024-09-10T14:32:30.463375+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:32:30.463375+0000","last_undegraded":"2024-09-10T14:32:30.463375+0000","last_fullsized":"2024-09-10T14:32:30.463375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.463102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:57.418601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.519074+0000","last_change":"2024-09-10T14:32:30.519074+0000","last_active":"2024-09-10T14:32:30.519074+0000","last_peered":"2024-09-10T14:32:30.519074+0000","last_clean":"2024-09-10T14:32:30.519074+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:32:30.519074+0000","last_undegraded":"2024-09-10T14:32:30.519074+0000","last_fullsized":"2024-09-10T14:32:30.519074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'97","last_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_deep_scrub":"36'97","last_deep_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.518776+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:01.405166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.030434+0000","last_change":"2024-09-10T14:32:22.030434+0000","last_active":"2024-09-10T14:32:22.030434+0000","last_peered":"2024-09-10T14:32:22.030434+0000","last_clean":"2024-09-10T14:32:22.030434+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:32:22.030434+0000","last_undegraded":"2024-09-10T14:32:22.030434+0000","last_fullsized":"2024-09-10T14:32:22.030434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.030103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:44.176468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.500554+0000","last_change":"2024-09-10T14:32:35.500613+0000","last_active":"2024-09-10T14:32:35.500554+0000","last_peered":"2024-09-10T14:32:35.500554+0000","last_clean":"2024-09-10T14:32:35.500554+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:32:35.500554+0000","last_undegraded":"2024-09-10T14:32:35.500554+0000","last_fullsized":"2024-09-10T14:32:35.500554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:58.771563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.760097+0000","last_change":"2024-09-10T14:28:38.944786+0000","last_active":"2024-09-10T14:32:19.760097+0000","last_peered":"2024-09-10T14:32:19.760097+0000","last_clean":"2024-09-10T14:32:19.760097+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:32:19.760097+0000","last_undegraded":"2024-09-10T14:32:19.760097+0000","last_fullsized":"2024-09-10T14:32:19.760097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.091585+0000","last_change":"2024-09-10T14:28:30.877107+0000","last_active":"2024-09-10T14:31:44.091585+0000","last_peered":"2024-09-10T14:31:44.091585+0000","last_clean":"2024-09-10T14:31:44.091585+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:31:44.091585+0000","last_undegraded":"2024-09-10T14:31:44.091585+0000","last_fullsized":"2024-09-10T14:31:44.091585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.039741+0000","last_change":"2024-09-10T14:28:28.890437+0000","last_active":"2024-09-10T14:31:44.039741+0000","last_peered":"2024-09-10T14:31:44.039741+0000","last_clean":"2024-09-10T14:31:44.039741+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:31:44.039741+0000","last_undegraded":"2024-09-10T14:31:44.039741+0000","last_fullsized":"2024-09-10T14:31:44.039741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.968378+0000","last_change":"2024-09-10T14:32:33.968430+0000","last_active":"2024-09-10T14:32:33.968378+0000","last_peered":"2024-09-10T14:32:33.968378+0000","last_clean":"2024-09-10T14:32:33.968378+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:32:33.968378+0000","last_undegraded":"2024-09-10T14:32:33.968378+0000","last_fullsized":"2024-09-10T14:32:33.968378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.968186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.923144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.456123+0000","last_change":"2024-09-10T14:32:25.456201+0000","last_active":"2024-09-10T14:32:25.456123+0000","last_peered":"2024-09-10T14:32:25.456123+0000","last_clean":"2024-09-10T14:32:25.456123+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:32:25.456123+0000","last_undegraded":"2024-09-10T14:32:25.456123+0000","last_fullsized":"2024-09-10T14:32:25.456123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.455949+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:59.272502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.512785+0000","last_change":"2024-09-10T14:32:42.512838+0000","last_active":"2024-09-10T14:32:42.512785+0000","last_peered":"2024-09-10T14:32:42.512785+0000","last_clean":"2024-09-10T14:32:42.512785+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:32:42.512785+0000","last_undegraded":"2024-09-10T14:32:42.512785+0000","last_fullsized":"2024-09-10T14:32:42.512785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.512582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.512582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.512582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:04.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.807907+0000","last_change":"2024-09-10T14:28:38.919940+0000","last_active":"2024-09-10T14:32:18.807907+0000","last_peered":"2024-09-10T14:32:18.807907+0000","last_clean":"2024-09-10T14:32:18.807907+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:32:18.807907+0000","last_undegraded":"2024-09-10T14:32:18.807907+0000","last_fullsized":"2024-09-10T14:32:18.807907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.244941+0000","last_change":"2024-09-10T14:29:07.783673+0000","last_active":"2024-09-10T14:31:44.244941+0000","last_peered":"2024-09-10T14:31:44.244941+0000","last_clean":"2024-09-10T14:31:44.244941+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:31:44.244941+0000","last_undegraded":"2024-09-10T14:31:44.244941+0000","last_fullsized":"2024-09-10T14:31:44.244941+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.777937+0000","last_change":"2024-09-10T14:28:28.897051+0000","last_active":"2024-09-10T14:30:54.777937+0000","last_peered":"2024-09-10T14:30:54.777937+0000","last_clean":"2024-09-10T14:30:54.777937+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:30:54.777937+0000","last_undegraded":"2024-09-10T14:30:54.777937+0000","last_fullsized":"2024-09-10T14:30:54.777937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.411315+0000","last_change":"2024-09-10T14:32:20.411370+0000","last_active":"2024-09-10T14:32:20.411315+0000","last_peered":"2024-09-10T14:32:20.411315+0000","last_clean":"2024-09-10T14:32:20.411315+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:32:20.411315+0000","last_undegraded":"2024-09-10T14:32:20.411315+0000","last_fullsized":"2024-09-10T14:32:20.411315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.411095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:12.327829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.216223+0000","last_change":"2024-09-10T14:32:33.216290+0000","last_active":"2024-09-10T14:32:33.216223+0000","last_peered":"2024-09-10T14:32:33.216223+0000","last_clean":"2024-09-10T14:32:33.216223+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:32:33.216223+0000","last_undegraded":"2024-09-10T14:32:33.216223+0000","last_fullsized":"2024-09-10T14:32:33.216223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.216034+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:39:05.267034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.415549+0000","last_change":"2024-09-10T14:32:23.415600+0000","last_active":"2024-09-10T14:32:23.415549+0000","last_peered":"2024-09-10T14:32:23.415549+0000","last_clean":"2024-09-10T14:32:23.415549+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:32:23.415549+0000","last_undegraded":"2024-09-10T14:32:23.415549+0000","last_fullsized":"2024-09-10T14:32:23.415549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.415359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:40.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:12.782563+0000","last_change":"2024-09-10T14:28:38.936365+0000","last_active":"2024-09-10T14:31:12.782563+0000","last_peered":"2024-09-10T14:31:12.782563+0000","last_clean":"2024-09-10T14:31:12.782563+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:31:12.782563+0000","last_undegraded":"2024-09-10T14:31:12.782563+0000","last_fullsized":"2024-09-10T14:31:12.782563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:52.778001+0000","last_change":"2024-09-10T14:28:30.876200+0000","last_active":"2024-09-10T14:30:52.778001+0000","last_peered":"2024-09-10T14:30:52.778001+0000","last_clean":"2024-09-10T14:30:52.778001+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:30:52.778001+0000","last_undegraded":"2024-09-10T14:30:52.778001+0000","last_fullsized":"2024-09-10T14:30:52.778001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:54.778074+0000","last_change":"2024-09-10T14:28:28.895847+0000","last_active":"2024-09-10T14:30:54.778074+0000","last_peered":"2024-09-10T14:30:54.778074+0000","last_clean":"2024-09-10T14:30:54.778074+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:30:54.778074+0000","last_undegraded":"2024-09-10T14:30:54.778074+0000","last_fullsized":"2024-09-10T14:30:54.778074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.376521+0000","last_change":"2024-09-10T14:32:42.376579+0000","last_active":"2024-09-10T14:32:42.376521+0000","last_peered":"2024-09-10T14:32:42.376521+0000","last_clean":"2024-09-10T14:32:42.376521+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:32:42.376521+0000","last_undegraded":"2024-09-10T14:32:42.376521+0000","last_fullsized":"2024-09-10T14:32:42.376521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.376307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.376307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.376307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:00.174752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.137444+0000","last_change":"2024-09-10T14:32:30.137615+0000","last_active":"2024-09-10T14:32:30.137444+0000","last_peered":"2024-09-10T14:32:30.137444+0000","last_clean":"2024-09-10T14:32:30.137444+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:32:30.137444+0000","last_undegraded":"2024-09-10T14:32:30.137444+0000","last_fullsized":"2024-09-10T14:32:30.137444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.137220+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:57.841349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.938865+0000","last_change":"2024-09-10T14:32:19.938967+0000","last_active":"2024-09-10T14:32:19.938865+0000","last_peered":"2024-09-10T14:32:19.938865+0000","last_clean":"2024-09-10T14:32:19.938865+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:32:19.938865+0000","last_undegraded":"2024-09-10T14:32:19.938865+0000","last_fullsized":"2024-09-10T14:32:19.938865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.938638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:13.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:08.789525+0000","last_change":"2024-09-10T14:28:38.937605+0000","last_active":"2024-09-10T14:31:08.789525+0000","last_peered":"2024-09-10T14:31:08.789525+0000","last_clean":"2024-09-10T14:31:08.789525+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:31:08.789525+0000","last_undegraded":"2024-09-10T14:31:08.789525+0000","last_fullsized":"2024-09-10T14:31:08.789525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:29.785703+0000","last_change":"2024-09-10T14:29:07.787878+0000","last_active":"2024-09-10T14:31:29.785703+0000","last_peered":"2024-09-10T14:31:29.785703+0000","last_clean":"2024-09-10T14:31:29.785703+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:31:29.785703+0000","last_undegraded":"2024-09-10T14:31:29.785703+0000","last_fullsized":"2024-09-10T14:31:29.785703+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.783952+0000","last_change":"2024-09-10T14:28:28.902985+0000","last_active":"2024-09-10T14:30:53.783952+0000","last_peered":"2024-09-10T14:30:53.783952+0000","last_clean":"2024-09-10T14:30:53.783952+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:30:53.783952+0000","last_undegraded":"2024-09-10T14:30:53.783952+0000","last_fullsized":"2024-09-10T14:30:53.783952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.446212+0000","last_change":"2024-09-10T14:32:26.446266+0000","last_active":"2024-09-10T14:32:26.446212+0000","last_peered":"2024-09-10T14:32:26.446212+0000","last_clean":"2024-09-10T14:32:26.446212+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:32:26.446212+0000","last_undegraded":"2024-09-10T14:32:26.446212+0000","last_fullsized":"2024-09-10T14:32:26.446212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.446026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:41.594078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'39","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.497682+0000","last_change":"2024-09-10T14:32:32.497756+0000","last_active":"2024-09-10T14:32:32.497682+0000","last_peered":"2024-09-10T14:32:32.497682+0000","last_clean":"2024-09-10T14:32:32.497682+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:32:32.497682+0000","last_undegraded":"2024-09-10T14:32:32.497682+0000","last_fullsized":"2024-09-10T14:32:32.497682+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.497494+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:32.552961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.396694+0000","last_change":"2024-09-10T14:32:25.396828+0000","last_active":"2024-09-10T14:32:25.396694+0000","last_peered":"2024-09-10T14:32:25.396694+0000","last_clean":"2024-09-10T14:32:25.396694+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:32:25.396694+0000","last_undegraded":"2024-09-10T14:32:25.396694+0000","last_fullsized":"2024-09-10T14:32:25.396694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.396450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:54.696304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.242014+0000","last_change":"2024-09-10T14:28:30.877889+0000","last_active":"2024-09-10T14:32:20.242014+0000","last_peered":"2024-09-10T14:32:20.242014+0000","last_clean":"2024-09-10T14:32:20.242014+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:32:20.242014+0000","last_undegraded":"2024-09-10T14:32:20.242014+0000","last_fullsized":"2024-09-10T14:32:20.242014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:53.785401+0000","last_change":"2024-09-10T14:28:28.893360+0000","last_active":"2024-09-10T14:30:53.785401+0000","last_peered":"2024-09-10T14:30:53.785401+0000","last_clean":"2024-09-10T14:30:53.785401+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:30:53.785401+0000","last_undegraded":"2024-09-10T14:30:53.785401+0000","last_fullsized":"2024-09-10T14:30:53.785401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:09.781526+0000","last_change":"2024-09-10T14:29:08.790434+0000","last_active":"2024-09-10T14:31:09.781526+0000","last_peered":"2024-09-10T14:31:09.781526+0000","last_clean":"2024-09-10T14:31:09.781526+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:31:09.781526+0000","last_undegraded":"2024-09-10T14:31:09.781526+0000","last_fullsized":"2024-09-10T14:31:09.781526+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.180889+0000","last_change":"2024-09-10T14:32:32.180966+0000","last_active":"2024-09-10T14:32:32.180889+0000","last_peered":"2024-09-10T14:32:32.180889+0000","last_clean":"2024-09-10T14:32:32.180889+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:32:32.180889+0000","last_undegraded":"2024-09-10T14:32:32.180889+0000","last_fullsized":"2024-09-10T14:32:32.180889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.180675+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:49.216006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.442239+0000","last_change":"2024-09-10T14:32:26.442290+0000","last_active":"2024-09-10T14:32:26.442239+0000","last_peered":"2024-09-10T14:32:26.442239+0000","last_clean":"2024-09-10T14:32:26.442239+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:32:26.442239+0000","last_undegraded":"2024-09-10T14:32:26.442239+0000","last_fullsized":"2024-09-10T14:32:26.442239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.442018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:13.048162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:02.780381+0000","last_change":"2024-09-10T14:28:38.928679+0000","last_active":"2024-09-10T14:31:02.780381+0000","last_peered":"2024-09-10T14:31:02.780381+0000","last_clean":"2024-09-10T14:31:02.780381+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:31:02.780381+0000","last_undegraded":"2024-09-10T14:31:02.780381+0000","last_fullsized":"2024-09-10T14:31:02.780381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.807144+0000","last_change":"2024-09-10T14:28:30.881385+0000","last_active":"2024-09-10T14:32:18.807144+0000","last_peered":"2024-09-10T14:32:18.807144+0000","last_clean":"2024-09-10T14:32:18.807144+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:32:18.807144+0000","last_undegraded":"2024-09-10T14:32:18.807144+0000","last_fullsized":"2024-09-10T14:32:18.807144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.953758+0000","last_change":"2024-09-10T14:32:53.953816+0000","last_active":"2024-09-10T14:32:53.953758+0000","last_peered":"2024-09-10T14:32:53.953758+0000","last_clean":"2024-09-10T14:32:53.953758+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:32:53.953758+0000","last_undegraded":"2024-09-10T14:32:53.953758+0000","last_fullsized":"2024-09-10T14:32:53.953758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:53.953557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:53.953557+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.953557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:49.917322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.397408+0000","last_change":"2024-09-10T14:32:40.397408+0000","last_active":"2024-09-10T14:32:40.397408+0000","last_peered":"2024-09-10T14:32:40.397408+0000","last_clean":"2024-09-10T14:32:40.397408+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:32:40.397408+0000","last_undegraded":"2024-09-10T14:32:40.397408+0000","last_fullsized":"2024-09-10T14:32:40.397408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:40.397100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:40.397100+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.397100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:50.928172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'46","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.451034+0000","last_change":"2024-09-10T14:32:50.451198+0000","last_active":"2024-09-10T14:32:50.451034+0000","last_peered":"2024-09-10T14:32:50.451034+0000","last_clean":"2024-09-10T14:32:50.451034+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:32:50.451034+0000","last_undegraded":"2024-09-10T14:32:50.451034+0000","last_fullsized":"2024-09-10T14:32:50.451034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-10T14:32:50.450750+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-10T14:32:50.450750+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.450750+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:43.680846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.965124+0000","last_change":"2024-09-10T14:32:38.965177+0000","last_active":"2024-09-10T14:32:38.965124+0000","last_peered":"2024-09-10T14:32:38.965124+0000","last_clean":"2024-09-10T14:32:38.965124+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:32:38.965124+0000","last_undegraded":"2024-09-10T14:32:38.965124+0000","last_fullsized":"2024-09-10T14:32:38.965124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.964897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.964897+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.964897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:32.019878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786881+0000","last_change":"2024-09-10T14:28:38.943738+0000","last_active":"2024-09-10T14:30:58.786881+0000","last_peered":"2024-09-10T14:30:58.786881+0000","last_clean":"2024-09-10T14:30:58.786881+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:30:58.786881+0000","last_undegraded":"2024-09-10T14:30:58.786881+0000","last_fullsized":"2024-09-10T14:30:58.786881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.463872+0000","last_change":"2024-09-10T14:32:34.464002+0000","last_active":"2024-09-10T14:32:34.463872+0000","last_peered":"2024-09-10T14:32:34.463872+0000","last_clean":"2024-09-10T14:32:34.463872+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:32:34.463872+0000","last_undegraded":"2024-09-10T14:32:34.463872+0000","last_fullsized":"2024-09-10T14:32:34.463872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.463639+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:46.301912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.784980+0000","last_change":"2024-09-10T14:28:28.904304+0000","last_active":"2024-09-10T14:30:58.784980+0000","last_peered":"2024-09-10T14:30:58.784980+0000","last_clean":"2024-09-10T14:30:58.784980+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:30:58.784980+0000","last_undegraded":"2024-09-10T14:30:58.784980+0000","last_fullsized":"2024-09-10T14:30:58.784980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.435870+0000","last_change":"2024-09-10T14:32:38.435925+0000","last_active":"2024-09-10T14:32:38.435870+0000","last_peered":"2024-09-10T14:32:38.435870+0000","last_clean":"2024-09-10T14:32:38.435870+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:32:38.435870+0000","last_undegraded":"2024-09-10T14:32:38.435870+0000","last_fullsized":"2024-09-10T14:32:38.435870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.435674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:15.679874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.074597+0000","last_change":"2024-09-10T14:32:28.074597+0000","last_active":"2024-09-10T14:32:28.074597+0000","last_peered":"2024-09-10T14:32:28.074597+0000","last_clean":"2024-09-10T14:32:28.074597+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:32:28.074597+0000","last_undegraded":"2024-09-10T14:32:28.074597+0000","last_fullsized":"2024-09-10T14:32:28.074597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.074323+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:22.414417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.062808+0000","last_change":"2024-09-10T14:32:20.062808+0000","last_active":"2024-09-10T14:32:20.062808+0000","last_peered":"2024-09-10T14:32:20.062808+0000","last_clean":"2024-09-10T14:32:20.062808+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:32:20.062808+0000","last_undegraded":"2024-09-10T14:32:20.062808+0000","last_fullsized":"2024-09-10T14:32:20.062808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.062623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:35.638214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.893383+0000","last_change":"2024-09-10T14:28:38.940779+0000","last_active":"2024-09-10T14:31:43.893383+0000","last_peered":"2024-09-10T14:31:43.893383+0000","last_clean":"2024-09-10T14:31:43.893383+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:31:43.893383+0000","last_undegraded":"2024-09-10T14:31:43.893383+0000","last_fullsized":"2024-09-10T14:31:43.893383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.181120+0000","last_change":"2024-09-10T14:32:53.181182+0000","last_active":"2024-09-10T14:32:53.181120+0000","last_peered":"2024-09-10T14:32:53.181120+0000","last_clean":"2024-09-10T14:32:53.181120+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:32:53.181120+0000","last_undegraded":"2024-09-10T14:32:53.181120+0000","last_fullsized":"2024-09-10T14:32:53.181120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:53.180924+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:53.180924+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.180924+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:45.585973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786958+0000","last_change":"2024-09-10T14:28:28.890479+0000","last_active":"2024-09-10T14:30:58.786958+0000","last_peered":"2024-09-10T14:30:58.786958+0000","last_clean":"2024-09-10T14:30:58.786958+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:30:58.786958+0000","last_undegraded":"2024-09-10T14:30:58.786958+0000","last_fullsized":"2024-09-10T14:30:58.786958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.786425+0000","last_change":"2024-09-10T14:29:08.793243+0000","last_active":"2024-09-10T14:31:03.786425+0000","last_peered":"2024-09-10T14:31:03.786425+0000","last_clean":"2024-09-10T14:31:03.786425+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:31:03.786425+0000","last_undegraded":"2024-09-10T14:31:03.786425+0000","last_fullsized":"2024-09-10T14:31:03.786425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.479162+0000","last_change":"2024-09-10T14:32:44.479239+0000","last_active":"2024-09-10T14:32:44.479162+0000","last_peered":"2024-09-10T14:32:44.479162+0000","last_clean":"2024-09-10T14:32:44.479162+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:32:44.479162+0000","last_undegraded":"2024-09-10T14:32:44.479162+0000","last_fullsized":"2024-09-10T14:32:44.479162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:44.478972+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:44.478972+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.478972+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:24:49.335138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.385755+0000","last_change":"2024-09-10T14:32:20.385755+0000","last_active":"2024-09-10T14:32:20.385755+0000","last_peered":"2024-09-10T14:32:20.385755+0000","last_clean":"2024-09-10T14:32:20.385755+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:32:20.385755+0000","last_undegraded":"2024-09-10T14:32:20.385755+0000","last_fullsized":"2024-09-10T14:32:20.385755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.385473+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:25.661393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786652+0000","last_change":"2024-09-10T14:28:38.938263+0000","last_active":"2024-09-10T14:30:58.786652+0000","last_peered":"2024-09-10T14:30:58.786652+0000","last_clean":"2024-09-10T14:30:58.786652+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:30:58.786652+0000","last_undegraded":"2024-09-10T14:30:58.786652+0000","last_fullsized":"2024-09-10T14:30:58.786652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.447294+0000","last_change":"2024-09-10T14:32:49.447355+0000","last_active":"2024-09-10T14:32:49.447294+0000","last_peered":"2024-09-10T14:32:49.447294+0000","last_clean":"2024-09-10T14:32:49.447294+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:32:49.447294+0000","last_undegraded":"2024-09-10T14:32:49.447294+0000","last_fullsized":"2024-09-10T14:32:49.447294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:49.447079+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:49.447079+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.447079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:01.531653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.785073+0000","last_change":"2024-09-10T14:28:28.885941+0000","last_active":"2024-09-10T14:30:58.785073+0000","last_peered":"2024-09-10T14:30:58.785073+0000","last_clean":"2024-09-10T14:30:58.785073+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:30:58.785073+0000","last_undegraded":"2024-09-10T14:30:58.785073+0000","last_fullsized":"2024-09-10T14:30:58.785073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.954255+0000","last_change":"2024-09-10T14:32:35.954305+0000","last_active":"2024-09-10T14:32:35.954255+0000","last_peered":"2024-09-10T14:32:35.954255+0000","last_clean":"2024-09-10T14:32:35.954255+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:32:35.954255+0000","last_undegraded":"2024-09-10T14:32:35.954255+0000","last_fullsized":"2024-09-10T14:32:35.954255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.954067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:56.841551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'47","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.005299+0000","last_change":"2024-09-10T14:32:24.005471+0000","last_active":"2024-09-10T14:32:24.005299+0000","last_peered":"2024-09-10T14:32:24.005299+0000","last_clean":"2024-09-10T14:32:24.005299+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:32:24.005299+0000","last_undegraded":"2024-09-10T14:32:24.005299+0000","last_fullsized":"2024-09-10T14:32:24.005299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.005077+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:26.362032+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.075023+0000","last_change":"2024-09-10T14:32:23.075075+0000","last_active":"2024-09-10T14:32:23.075023+0000","last_peered":"2024-09-10T14:32:23.075023+0000","last_clean":"2024-09-10T14:32:23.075023+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:32:23.075023+0000","last_undegraded":"2024-09-10T14:32:23.075023+0000","last_fullsized":"2024-09-10T14:32:23.075023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.074819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:52.669431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.237589+0000","last_change":"2024-09-10T14:28:38.931948+0000","last_active":"2024-09-10T14:31:44.237589+0000","last_peered":"2024-09-10T14:31:44.237589+0000","last_clean":"2024-09-10T14:31:44.237589+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:31:44.237589+0000","last_undegraded":"2024-09-10T14:31:44.237589+0000","last_fullsized":"2024-09-10T14:31:44.237589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.350530+0000","last_change":"2024-09-10T14:32:46.350598+0000","last_active":"2024-09-10T14:32:46.350530+0000","last_peered":"2024-09-10T14:32:46.350530+0000","last_clean":"2024-09-10T14:32:46.350530+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:32:46.350530+0000","last_undegraded":"2024-09-10T14:32:46.350530+0000","last_fullsized":"2024-09-10T14:32:46.350530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:46.350348+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:46.350348+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.350348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:26.276494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'7","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.509888+0000","last_change":"2024-09-10T14:28:28.889060+0000","last_active":"2024-09-10T14:32:15.509888+0000","last_peered":"2024-09-10T14:32:15.509888+0000","last_clean":"2024-09-10T14:32:15.509888+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:32:15.509888+0000","last_undegraded":"2024-09-10T14:32:15.509888+0000","last_fullsized":"2024-09-10T14:32:15.509888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.460009+0000","last_change":"2024-09-10T14:32:37.460071+0000","last_active":"2024-09-10T14:32:37.460009+0000","last_peered":"2024-09-10T14:32:37.460009+0000","last_clean":"2024-09-10T14:32:37.460009+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:32:37.460009+0000","last_undegraded":"2024-09-10T14:32:37.460009+0000","last_fullsized":"2024-09-10T14:32:37.460009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.459813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:14.821058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.028479+0000","last_change":"2024-09-10T14:32:26.028627+0000","last_active":"2024-09-10T14:32:26.028479+0000","last_peered":"2024-09-10T14:32:26.028479+0000","last_clean":"2024-09-10T14:32:26.028479+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:32:26.028479+0000","last_undegraded":"2024-09-10T14:32:26.028479+0000","last_fullsized":"2024-09-10T14:32:26.028479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.028252+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:17.812152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.470537+0000","last_change":"2024-09-10T14:32:41.470597+0000","last_active":"2024-09-10T14:32:41.470537+0000","last_peered":"2024-09-10T14:32:41.470537+0000","last_clean":"2024-09-10T14:32:41.470537+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:32:41.470537+0000","last_undegraded":"2024-09-10T14:32:41.470537+0000","last_fullsized":"2024-09-10T14:32:41.470537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.470326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.470326+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.470326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:19.199667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.788457+0000","last_change":"2024-09-10T14:28:38.950672+0000","last_active":"2024-09-10T14:31:03.788457+0000","last_peered":"2024-09-10T14:31:03.788457+0000","last_clean":"2024-09-10T14:31:03.788457+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:31:03.788457+0000","last_undegraded":"2024-09-10T14:31:03.788457+0000","last_fullsized":"2024-09-10T14:31:03.788457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.090659+0000","last_change":"2024-09-10T14:28:30.877715+0000","last_active":"2024-09-10T14:31:44.090659+0000","last_peered":"2024-09-10T14:31:44.090659+0000","last_clean":"2024-09-10T14:31:44.090659+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:31:44.090659+0000","last_undegraded":"2024-09-10T14:31:44.090659+0000","last_fullsized":"2024-09-10T14:31:44.090659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806646+0000","last_change":"2024-09-10T14:28:28.876685+0000","last_active":"2024-09-10T14:32:18.806646+0000","last_peered":"2024-09-10T14:32:18.806646+0000","last_clean":"2024-09-10T14:32:18.806646+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:32:18.806646+0000","last_undegraded":"2024-09-10T14:32:18.806646+0000","last_fullsized":"2024-09-10T14:32:18.806646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.935806+0000","last_change":"2024-09-10T14:32:32.935858+0000","last_active":"2024-09-10T14:32:32.935806+0000","last_peered":"2024-09-10T14:32:32.935806+0000","last_clean":"2024-09-10T14:32:32.935806+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:32:32.935806+0000","last_undegraded":"2024-09-10T14:32:32.935806+0000","last_fullsized":"2024-09-10T14:32:32.935806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.935608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:34.956315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.504401+0000","last_change":"2024-09-10T14:32:31.504474+0000","last_active":"2024-09-10T14:32:31.504401+0000","last_peered":"2024-09-10T14:32:31.504401+0000","last_clean":"2024-09-10T14:32:31.504401+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:32:31.504401+0000","last_undegraded":"2024-09-10T14:32:31.504401+0000","last_fullsized":"2024-09-10T14:32:31.504401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.504210+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:27.467975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.434634+0000","last_change":"2024-09-10T14:32:55.434693+0000","last_active":"2024-09-10T14:32:55.434634+0000","last_peered":"2024-09-10T14:32:55.434634+0000","last_clean":"2024-09-10T14:32:55.434634+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:32:55.434634+0000","last_undegraded":"2024-09-10T14:32:55.434634+0000","last_fullsized":"2024-09-10T14:32:55.434634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:55.434450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:55.434450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.434450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:41.855323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.406498+0000","last_change":"2024-09-10T14:28:38.949225+0000","last_active":"2024-09-10T14:31:44.406498+0000","last_peered":"2024-09-10T14:31:44.406498+0000","last_clean":"2024-09-10T14:31:44.406498+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:31:44.406498+0000","last_undegraded":"2024-09-10T14:31:44.406498+0000","last_fullsized":"2024-09-10T14:31:44.406498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.357216+0000","last_change":"2024-09-10T14:32:45.357374+0000","last_active":"2024-09-10T14:32:45.357216+0000","last_peered":"2024-09-10T14:32:45.357216+0000","last_clean":"2024-09-10T14:32:45.357216+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:32:45.357216+0000","last_undegraded":"2024-09-10T14:32:45.357216+0000","last_fullsized":"2024-09-10T14:32:45.357216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:45.356988+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:45.356988+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.356988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:42.173829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.856166+0000","last_change":"2024-09-10T14:32:57.856228+0000","last_active":"2024-09-10T14:32:57.856166+0000","last_peered":"2024-09-10T14:32:57.856166+0000","last_clean":"2024-09-10T14:32:57.856166+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:32:57.856166+0000","last_undegraded":"2024-09-10T14:32:57.856166+0000","last_fullsized":"2024-09-10T14:32:57.856166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:57.855959+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:57.855959+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.855959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:19.355814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.985028+0000","last_change":"2024-09-10T14:32:28.985098+0000","last_active":"2024-09-10T14:32:28.985028+0000","last_peered":"2024-09-10T14:32:28.985028+0000","last_clean":"2024-09-10T14:32:28.985028+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:32:28.985028+0000","last_undegraded":"2024-09-10T14:32:28.985028+0000","last_fullsized":"2024-09-10T14:32:28.985028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.984841+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:32.529664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'41","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.464417+0000","last_change":"2024-09-10T14:32:52.464492+0000","last_active":"2024-09-10T14:32:52.464417+0000","last_peered":"2024-09-10T14:32:52.464417+0000","last_clean":"2024-09-10T14:32:52.464417+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:32:52.464417+0000","last_undegraded":"2024-09-10T14:32:52.464417+0000","last_fullsized":"2024-09-10T14:32:52.464417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-10T14:32:52.464237+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-10T14:32:52.464237+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.464237+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:29.213358+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.257705+0000","last_change":"2024-09-10T14:32:39.257759+0000","last_active":"2024-09-10T14:32:39.257705+0000","last_peered":"2024-09-10T14:32:39.257705+0000","last_clean":"2024-09-10T14:32:39.257705+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:32:39.257705+0000","last_undegraded":"2024-09-10T14:32:39.257705+0000","last_fullsized":"2024-09-10T14:32:39.257705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:39.257507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:39.257507+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.257507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:11.855142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.787012+0000","last_change":"2024-09-10T14:28:38.949254+0000","last_active":"2024-09-10T14:30:58.787012+0000","last_peered":"2024-09-10T14:30:58.787012+0000","last_clean":"2024-09-10T14:30:58.787012+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:30:58.787012+0000","last_undegraded":"2024-09-10T14:30:58.787012+0000","last_fullsized":"2024-09-10T14:30:58.787012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.967908+0000","last_change":"2024-09-10T14:32:37.967908+0000","last_active":"2024-09-10T14:32:37.967908+0000","last_peered":"2024-09-10T14:32:37.967908+0000","last_clean":"2024-09-10T14:32:37.967908+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:32:37.967908+0000","last_undegraded":"2024-09-10T14:32:37.967908+0000","last_fullsized":"2024-09-10T14:32:37.967908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.967539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:44.664554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.758416+0000","last_change":"2024-09-10T14:28:28.876974+0000","last_active":"2024-09-10T14:32:19.758416+0000","last_peered":"2024-09-10T14:32:19.758416+0000","last_clean":"2024-09-10T14:32:19.758416+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:32:19.758416+0000","last_undegraded":"2024-09-10T14:32:19.758416+0000","last_fullsized":"2024-09-10T14:32:19.758416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.283518+0000","last_change":"2024-09-10T14:32:49.283518+0000","last_active":"2024-09-10T14:32:49.283518+0000","last_peered":"2024-09-10T14:32:49.283518+0000","last_clean":"2024-09-10T14:32:49.283518+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:32:49.283518+0000","last_undegraded":"2024-09-10T14:32:49.283518+0000","last_fullsized":"2024-09-10T14:32:49.283518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:49.283250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:49.283250+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.283250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:33.333958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806567+0000","last_change":"2024-09-10T14:28:28.880673+0000","last_active":"2024-09-10T14:32:18.806567+0000","last_peered":"2024-09-10T14:32:18.806567+0000","last_clean":"2024-09-10T14:32:18.806567+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:32:18.806567+0000","last_undegraded":"2024-09-10T14:32:18.806567+0000","last_fullsized":"2024-09-10T14:32:18.806567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'9","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.242044+0000","last_change":"2024-09-10T14:28:30.876383+0000","last_active":"2024-09-10T14:32:20.242044+0000","last_peered":"2024-09-10T14:32:20.242044+0000","last_clean":"2024-09-10T14:32:20.242044+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:32:20.242044+0000","last_undegraded":"2024-09-10T14:32:20.242044+0000","last_fullsized":"2024-09-10T14:32:20.242044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241103+0000","last_change":"2024-09-10T14:28:28.892938+0000","last_active":"2024-09-10T14:32:20.241103+0000","last_peered":"2024-09-10T14:32:20.241103+0000","last_clean":"2024-09-10T14:32:20.241103+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:32:20.241103+0000","last_undegraded":"2024-09-10T14:32:20.241103+0000","last_fullsized":"2024-09-10T14:32:20.241103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.103739+0000","last_change":"2024-09-10T14:32:55.103798+0000","last_active":"2024-09-10T14:32:55.103739+0000","last_peered":"2024-09-10T14:32:55.103739+0000","last_clean":"2024-09-10T14:32:55.103739+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:32:55.103739+0000","last_undegraded":"2024-09-10T14:32:55.103739+0000","last_fullsized":"2024-09-10T14:32:55.103739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:55.103545+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:55.103545+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.103545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:16.603400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806841+0000","last_change":"2024-09-10T14:28:28.880499+0000","last_active":"2024-09-10T14:32:18.806841+0000","last_peered":"2024-09-10T14:32:18.806841+0000","last_clean":"2024-09-10T14:32:18.806841+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:32:18.806841+0000","last_undegraded":"2024-09-10T14:32:18.806841+0000","last_fullsized":"2024-09-10T14:32:18.806841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.267228+0000","last_change":"2024-09-10T14:32:46.267294+0000","last_active":"2024-09-10T14:32:46.267228+0000","last_peered":"2024-09-10T14:32:46.267228+0000","last_clean":"2024-09-10T14:32:46.267228+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:32:46.267228+0000","last_undegraded":"2024-09-10T14:32:46.267228+0000","last_fullsized":"2024-09-10T14:32:46.267228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:46.267037+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:46.267037+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.267037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:01.415089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.246325+0000","last_change":"2024-09-10T14:32:50.246325+0000","last_active":"2024-09-10T14:32:50.246325+0000","last_peered":"2024-09-10T14:32:50.246325+0000","last_clean":"2024-09-10T14:32:50.246325+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:32:50.246325+0000","last_undegraded":"2024-09-10T14:32:50.246325+0000","last_fullsized":"2024-09-10T14:32:50.246325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:50.246061+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:50.246061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.246061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:23.296600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.290553+0000","last_change":"2024-09-10T14:28:30.886359+0000","last_active":"2024-09-10T14:32:19.290553+0000","last_peered":"2024-09-10T14:32:19.290553+0000","last_clean":"2024-09-10T14:32:19.290553+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:32:19.290553+0000","last_undegraded":"2024-09-10T14:32:19.290553+0000","last_fullsized":"2024-09-10T14:32:19.290553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.290133+0000","last_change":"2024-09-10T14:28:28.899480+0000","last_active":"2024-09-10T14:32:19.290133+0000","last_peered":"2024-09-10T14:32:19.290133+0000","last_clean":"2024-09-10T14:32:19.290133+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:32:19.290133+0000","last_undegraded":"2024-09-10T14:32:19.290133+0000","last_fullsized":"2024-09-10T14:32:19.290133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.807040+0000","last_change":"2024-09-10T14:28:30.881839+0000","last_active":"2024-09-10T14:32:18.807040+0000","last_peered":"2024-09-10T14:32:18.807040+0000","last_clean":"2024-09-10T14:32:18.807040+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:32:18.807040+0000","last_undegraded":"2024-09-10T14:32:18.807040+0000","last_fullsized":"2024-09-10T14:32:18.807040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.369749+0000","last_change":"2024-09-10T14:32:52.369813+0000","last_active":"2024-09-10T14:32:52.369749+0000","last_peered":"2024-09-10T14:32:52.369749+0000","last_clean":"2024-09-10T14:32:52.369749+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:32:52.369749+0000","last_undegraded":"2024-09-10T14:32:52.369749+0000","last_fullsized":"2024-09-10T14:32:52.369749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:52.369554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:52.369554+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.369554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:48.344683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.924217+0000","last_change":"2024-09-10T14:32:44.924333+0000","last_active":"2024-09-10T14:32:44.924217+0000","last_peered":"2024-09-10T14:32:44.924217+0000","last_clean":"2024-09-10T14:32:44.924217+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:32:44.924217+0000","last_undegraded":"2024-09-10T14:32:44.924217+0000","last_fullsized":"2024-09-10T14:32:44.924217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:44.923988+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:44.923988+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.923988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:17.218205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.806749+0000","last_change":"2024-09-10T14:28:28.878802+0000","last_active":"2024-09-10T14:32:18.806749+0000","last_peered":"2024-09-10T14:32:18.806749+0000","last_clean":"2024-09-10T14:32:18.806749+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:32:18.806749+0000","last_undegraded":"2024-09-10T14:32:18.806749+0000","last_fullsized":"2024-09-10T14:32:18.806749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.900182+0000","last_change":"2024-09-10T14:32:56.900247+0000","last_active":"2024-09-10T14:32:56.900182+0000","last_peered":"2024-09-10T14:32:56.900182+0000","last_clean":"2024-09-10T14:32:56.900182+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:32:56.900182+0000","last_undegraded":"2024-09-10T14:32:56.900182+0000","last_fullsized":"2024-09-10T14:32:56.900182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:56.899972+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:56.899972+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.899972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:46.105631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241373+0000","last_change":"2024-09-10T14:28:28.893263+0000","last_active":"2024-09-10T14:32:20.241373+0000","last_peered":"2024-09-10T14:32:20.241373+0000","last_clean":"2024-09-10T14:32:20.241373+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:32:20.241373+0000","last_undegraded":"2024-09-10T14:32:20.241373+0000","last_fullsized":"2024-09-10T14:32:20.241373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.471529+0000","last_change":"2024-09-10T14:32:40.471594+0000","last_active":"2024-09-10T14:32:40.471529+0000","last_peered":"2024-09-10T14:32:40.471529+0000","last_clean":"2024-09-10T14:32:40.471529+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:32:40.471529+0000","last_undegraded":"2024-09-10T14:32:40.471529+0000","last_fullsized":"2024-09-10T14:32:40.471529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:40.471309+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:40.471309+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.471309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:15.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:47.776866+0000","last_change":"2024-09-10T14:28:28.879959+0000","last_active":"2024-09-10T14:30:47.776866+0000","last_peered":"2024-09-10T14:30:47.776866+0000","last_clean":"2024-09-10T14:30:47.776866+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:30:47.776866+0000","last_undegraded":"2024-09-10T14:30:47.776866+0000","last_fullsized":"2024-09-10T14:30:47.776866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.155492+0000","last_change":"2024-09-10T14:32:57.155550+0000","last_active":"2024-09-10T14:32:57.155492+0000","last_peered":"2024-09-10T14:32:57.155492+0000","last_clean":"2024-09-10T14:32:57.155492+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:32:57.155492+0000","last_undegraded":"2024-09-10T14:32:57.155492+0000","last_fullsized":"2024-09-10T14:32:57.155492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:57.155307+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:57.155307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.155307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:46.880813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.290203+0000","last_change":"2024-09-10T14:28:28.888402+0000","last_active":"2024-09-10T14:32:19.290203+0000","last_peered":"2024-09-10T14:32:19.290203+0000","last_clean":"2024-09-10T14:32:19.290203+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:32:19.290203+0000","last_undegraded":"2024-09-10T14:32:19.290203+0000","last_fullsized":"2024-09-10T14:32:19.290203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.754093+0000","last_change":"2024-09-10T14:28:30.883269+0000","last_active":"2024-09-10T14:31:43.754093+0000","last_peered":"2024-09-10T14:31:43.754093+0000","last_clean":"2024-09-10T14:31:43.754093+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:31:43.754093+0000","last_undegraded":"2024-09-10T14:31:43.754093+0000","last_fullsized":"2024-09-10T14:31:43.754093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.906586+0000","last_change":"2024-09-10T14:32:55.906586+0000","last_active":"2024-09-10T14:32:55.906586+0000","last_peered":"2024-09-10T14:32:55.906586+0000","last_clean":"2024-09-10T14:32:55.906586+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:32:55.906586+0000","last_undegraded":"2024-09-10T14:32:55.906586+0000","last_fullsized":"2024-09-10T14:32:55.906586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:55.906312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:55.906312+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.906312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:50.502825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.243928+0000","last_change":"2024-09-10T14:28:30.886081+0000","last_active":"2024-09-10T14:31:44.243928+0000","last_peered":"2024-09-10T14:31:44.243928+0000","last_clean":"2024-09-10T14:31:44.243928+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:31:44.243928+0000","last_undegraded":"2024-09-10T14:31:44.243928+0000","last_fullsized":"2024-09-10T14:31:44.243928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:29.826205+0000","last_clean_scrub_stamp":"2024-09-10T14:28:29.826205+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241184+0000","last_change":"2024-09-10T14:28:28.890888+0000","last_active":"2024-09-10T14:32:20.241184+0000","last_peered":"2024-09-10T14:32:20.241184+0000","last_clean":"2024-09-10T14:32:20.241184+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:32:20.241184+0000","last_undegraded":"2024-09-10T14:32:20.241184+0000","last_fullsized":"2024-09-10T14:32:20.241184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.938513+0000","last_change":"2024-09-10T14:32:48.938587+0000","last_active":"2024-09-10T14:32:48.938513+0000","last_peered":"2024-09-10T14:32:48.938513+0000","last_clean":"2024-09-10T14:32:48.938513+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:32:48.938513+0000","last_undegraded":"2024-09-10T14:32:48.938513+0000","last_fullsized":"2024-09-10T14:32:48.938513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:48.938333+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:48.938333+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.938333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:04.086385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241396+0000","last_change":"2024-09-10T14:28:28.880438+0000","last_active":"2024-09-10T14:32:20.241396+0000","last_peered":"2024-09-10T14:32:20.241396+0000","last_clean":"2024-09-10T14:32:20.241396+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:32:20.241396+0000","last_undegraded":"2024-09-10T14:32:20.241396+0000","last_fullsized":"2024-09-10T14:32:20.241396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'14","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.389074+0000","last_change":"2024-09-10T14:32:38.389144+0000","last_active":"2024-09-10T14:32:38.389074+0000","last_peered":"2024-09-10T14:32:38.389074+0000","last_clean":"2024-09-10T14:32:38.389074+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:32:38.389074+0000","last_undegraded":"2024-09-10T14:32:38.389074+0000","last_fullsized":"2024-09-10T14:32:38.389074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.388866+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:33.424139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.422269+0000","last_change":"2024-09-10T14:32:48.422326+0000","last_active":"2024-09-10T14:32:48.422269+0000","last_peered":"2024-09-10T14:32:48.422269+0000","last_clean":"2024-09-10T14:32:48.422269+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:32:48.422269+0000","last_undegraded":"2024-09-10T14:32:48.422269+0000","last_fullsized":"2024-09-10T14:32:48.422269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:48.422047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:48.422047+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.422047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:26.220031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.999876+0000","last_change":"2024-09-10T14:32:51.999876+0000","last_active":"2024-09-10T14:32:51.999876+0000","last_peered":"2024-09-10T14:32:51.999876+0000","last_clean":"2024-09-10T14:32:51.999876+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:32:51.999876+0000","last_undegraded":"2024-09-10T14:32:51.999876+0000","last_fullsized":"2024-09-10T14:32:51.999876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:51.999608+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:51.999608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.999608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:36.050316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:43.653690+0000","last_change":"2024-09-10T14:28:28.879289+0000","last_active":"2024-09-10T14:31:43.653690+0000","last_peered":"2024-09-10T14:31:43.653690+0000","last_clean":"2024-09-10T14:31:43.653690+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:31:43.653690+0000","last_undegraded":"2024-09-10T14:31:43.653690+0000","last_fullsized":"2024-09-10T14:31:43.653690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:48.784107+0000","last_change":"2024-09-10T14:28:28.892314+0000","last_active":"2024-09-10T14:30:48.784107+0000","last_peered":"2024-09-10T14:30:48.784107+0000","last_clean":"2024-09-10T14:30:48.784107+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:30:48.784107+0000","last_undegraded":"2024-09-10T14:30:48.784107+0000","last_fullsized":"2024-09-10T14:30:48.784107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.310359+0000","last_change":"2024-09-10T14:32:44.310500+0000","last_active":"2024-09-10T14:32:44.310359+0000","last_peered":"2024-09-10T14:32:44.310359+0000","last_clean":"2024-09-10T14:32:44.310359+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:32:44.310359+0000","last_undegraded":"2024-09-10T14:32:44.310359+0000","last_fullsized":"2024-09-10T14:32:44.310359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:44.310127+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:44.310127+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.310127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:59.596129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.134190+0000","last_change":"2024-09-10T14:32:54.134255+0000","last_active":"2024-09-10T14:32:54.134190+0000","last_peered":"2024-09-10T14:32:54.134190+0000","last_clean":"2024-09-10T14:32:54.134190+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:32:54.134190+0000","last_undegraded":"2024-09-10T14:32:54.134190+0000","last_fullsized":"2024-09-10T14:32:54.134190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:54.133994+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:54.133994+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.133994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:05.972266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.955718+0000","last_change":"2024-09-10T14:32:45.955850+0000","last_active":"2024-09-10T14:32:45.955718+0000","last_peered":"2024-09-10T14:32:45.955718+0000","last_clean":"2024-09-10T14:32:45.955718+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:32:45.955718+0000","last_undegraded":"2024-09-10T14:32:45.955718+0000","last_fullsized":"2024-09-10T14:32:45.955718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:45.955449+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:45.955449+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.955449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:58.286493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1530,"ondisk_log_size":1530,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640318,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":750039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673022,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":162767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673022,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335468,"statfs":{"total":96636764160,"available":96599519232,"internally_reserved":0,"allocated":1052672,"data_stored":750219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":161599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:33:01.479 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.479 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.479 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.479 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.480 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.480 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.480 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.480 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.480 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.480 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.480 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.481 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.481 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.481 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.481 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.481 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.481 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.481 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.482 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.482 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.482 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.482 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.482 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.482 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.483 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.483 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.483 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.483 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.483 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.483 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.484 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.484 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T14:28:35.865409+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.484 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.484 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.484 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.484 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.484 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T14:28:14.781430+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.485 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.486 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.486 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.486 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.486 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.486 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.486 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.487 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.487 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.487 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.487 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.487 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.487 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.487 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.487 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.488 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.488 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.488 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.488 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.488 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.488 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.488 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.489 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.489 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.489 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.489 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.489 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.489 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.489 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.489 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.490 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.490 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.490 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.490 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.490 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.490 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.490 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.491 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.491 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.491 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.491 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.491 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.491 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.491 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.492 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.492 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.492 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.492 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.492 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.492 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.492 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.493 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.493 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.493 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.493 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.493 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.493 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.493 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.493 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T14:28:29.826205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.494 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.494 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.494 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.494 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:01.494 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T14:33:21.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:33:21.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f42a1af6640 1 Processor -- start 2024-09-10T14:33:21.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f42a1af6640 1 -- start start 2024-09-10T14:33:21.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f42a1af6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f429c127c00 0x7f429c127fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:21.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f42a1af6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f429c06e970 con 0x7f429c128520 2024-09-10T14:33:21.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f42a1af6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f429c070270 con 0x7f429c127c00 2024-09-10T14:33:21.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f429b7fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f429c127c00 0x7f429c127fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:21.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f429affd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f429c128520 0x7f429c12af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40914/0 (socket says 172.21.15.52:40914) 2024-09-10T14:33:21.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f429affd640 1 -- 172.21.15.52:0/88931044 learned_addr learned my addr 172.21.15.52:0/88931044 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:33:21.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f429b7fe640 1 -- 172.21.15.52:0/88931044 >> v1:172.21.15.52:6789/0 conn(0x7f429c128520 legacy=0x7f429c12af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:21.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f429b7fe640 1 -- 172.21.15.52:0/88931044 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c070580 con 0x7f429c127c00 2024-09-10T14:33:21.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.627+0000 7f429a7fc640 1 -- 172.21.15.52:0/88931044 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525986013 0 0) 0x7f429c06e970 con 0x7f429c128520 2024-09-10T14:33:21.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f429b7fe640 1 --2- 172.21.15.52:0/88931044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c127fe0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f428c009740 tx=0x7f428c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6696f1436518b7d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:21.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f429a7fc640 1 -- 172.21.15.52:0/88931044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c0b0070 con 0x7f429c127c00 2024-09-10T14:33:21.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f429a7fc640 1 -- 172.21.15.52:0/88931044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428c0ab530 con 0x7f429c127c00 2024-09-10T14:33:21.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f429a7fc640 1 -- 172.21.15.52:0/88931044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c0ab830 con 0x7f429c127c00 2024-09-10T14:33:21.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 -- 172.21.15.52:0/88931044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 msgr2=0x7f429c127fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:21.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 --2- 172.21.15.52:0/88931044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c127fe0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f428c009740 tx=0x7f428c01c310 comp rx=0 tx=0).stop 2024-09-10T14:33:21.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 -- 172.21.15.52:0/88931044 shutdown_connections 2024-09-10T14:33:21.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 --2- 172.21.15.52:0/88931044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c127fe0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:21.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 -- 172.21.15.52:0/88931044 >> 172.21.15.52:0/88931044 conn(0x7f429c099a50 msgr2=0x7f429c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:33:21.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 -- 172.21.15.52:0/88931044 shutdown_connections 2024-09-10T14:33:21.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 -- 172.21.15.52:0/88931044 wait complete. 2024-09-10T14:33:21.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 Processor -- start 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 -- start start 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c1333a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f42a1af6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f429c12b9d0 con 0x7f429c127c00 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f429b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c1333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f429b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c1333a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44626/0 (socket says 172.21.15.52:44626) 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.631+0000 7f429b7fe640 1 -- 172.21.15.52:0/1216604447 learned_addr learned my addr 172.21.15.52:0/1216604447 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f429b7fe640 1 -- 172.21.15.52:0/1216604447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c127800 con 0x7f429c127c00 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f429b7fe640 1 --2- 172.21.15.52:0/1216604447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c1333a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f428c019fa0 tx=0x7f428c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:21.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f4283fff640 1 -- 172.21.15.52:0/1216604447 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c0bb070 con 0x7f429c127c00 2024-09-10T14:33:21.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429c126b40 con 0x7f429c127c00 2024-09-10T14:33:21.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f4283fff640 1 -- 172.21.15.52:0/1216604447 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428c0abe40 con 0x7f429c127c00 2024-09-10T14:33:21.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f4283fff640 1 -- 172.21.15.52:0/1216604447 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c0b0040 con 0x7f429c127c00 2024-09-10T14:33:21.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f429c08b410 con 0x7f429c127c00 2024-09-10T14:33:21.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429c127fe0 con 0x7f429c127c00 2024-09-10T14:33:21.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f4283fff640 1 -- 172.21.15.52:0/1216604447 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f428c004150 con 0x7f429c127c00 2024-09-10T14:33:21.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f4283fff640 1 --2- 172.21.15.52:0/1216604447 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4288035db0 0x7f4288038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:21.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f4283fff640 1 -- 172.21.15.52:0/1216604447 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f428c0e38e0 con 0x7f429c127c00 2024-09-10T14:33:21.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f429affd640 1 --2- 172.21.15.52:0/1216604447 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4288035db0 0x7f4288038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:21.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.635+0000 7f429affd640 1 --2- 172.21.15.52:0/1216604447 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4288035db0 0x7f4288038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4290007fd0 tx=0x7f4290007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:21.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.639+0000 7f4283fff640 1 -- 172.21.15.52:0/1216604447 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f428c015ff0 con 0x7f429c127c00 2024-09-10T14:33:21.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.803+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f429c073790 con 0x7f4288035db0 2024-09-10T14:33:21.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.847+0000 7f4283fff640 1 -- 172.21.15.52:0/1216604447 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665328 (secure 0 0 0) 0x7f429c073790 con 0x7f4288035db0 2024-09-10T14:33:21.860 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:33:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:33:21.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.855+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4288035db0 msgr2=0x7f4288038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:21.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.855+0000 7f42a1af6640 1 --2- 172.21.15.52:0/1216604447 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4288035db0 0x7f4288038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4290007fd0 tx=0x7f4290007980 comp rx=0 tx=0).stop 2024-09-10T14:33:21.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.855+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 msgr2=0x7f429c1333a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:21.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.855+0000 7f42a1af6640 1 --2- 172.21.15.52:0/1216604447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c1333a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f428c019fa0 tx=0x7f428c01abb0 comp rx=0 tx=0).stop 2024-09-10T14:33:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.859+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 shutdown_connections 2024-09-10T14:33:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.859+0000 7f42a1af6640 1 --2- 172.21.15.52:0/1216604447 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4288035db0 0x7f4288038270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.859+0000 7f42a1af6640 1 --2- 172.21.15.52:0/1216604447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f429c127c00 0x7f429c1333a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.859+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 >> 172.21.15.52:0/1216604447 conn(0x7f429c099a50 msgr2=0x7f429c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:33:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.859+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 shutdown_connections 2024-09-10T14:33:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:21.859+0000 7f42a1af6640 1 -- 172.21.15.52:0/1216604447 wait complete. 2024-09-10T14:33:21.884 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-09-10T14:33:20.832406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4793,"ondisk_log_size":4793,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152688,"kb_used_data":2992,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334672,"statfs":{"total":386547056640,"available":386390704128,"internally_reserved":0,"allocated":3063808,"data_stored":1824624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006959"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.333576+0000","last_change":"2024-09-10T14:32:56.333644+0000","last_active":"2024-09-10T14:32:56.333576+0000","last_peered":"2024-09-10T14:32:56.333576+0000","last_clean":"2024-09-10T14:32:56.333576+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:32:56.333576+0000","last_undegraded":"2024-09-10T14:32:56.333576+0000","last_fullsized":"2024-09-10T14:32:56.333576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:56.333364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:56.333364+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.333364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:41.861748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.951460+0000","last_change":"2024-09-10T14:32:49.951520+0000","last_active":"2024-09-10T14:32:49.951460+0000","last_peered":"2024-09-10T14:32:49.951460+0000","last_clean":"2024-09-10T14:32:49.951460+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:32:49.951460+0000","last_undegraded":"2024-09-10T14:32:49.951460+0000","last_fullsized":"2024-09-10T14:32:49.951460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:49.951238+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:49.951238+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.951238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:14.016136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.163991+0000","last_change":"2024-09-10T14:33:02.164062+0000","last_active":"2024-09-10T14:33:02.163991+0000","last_peered":"2024-09-10T14:33:02.163991+0000","last_clean":"2024-09-10T14:33:02.163991+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:33:02.163991+0000","last_undegraded":"2024-09-10T14:33:02.163991+0000","last_fullsized":"2024-09-10T14:33:02.163991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:02.163779+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:02.163779+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.163779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:38.005621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.457066+0000","last_change":"2024-09-10T14:32:54.457127+0000","last_active":"2024-09-10T14:32:54.457066+0000","last_peered":"2024-09-10T14:32:54.457066+0000","last_clean":"2024-09-10T14:32:54.457066+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:32:54.457066+0000","last_undegraded":"2024-09-10T14:32:54.457066+0000","last_fullsized":"2024-09-10T14:32:54.457066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:54.456884+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:54.456884+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.456884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:16:26.826166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241571+0000","last_change":"2024-09-10T14:28:28.879906+0000","last_active":"2024-09-10T14:32:20.241571+0000","last_peered":"2024-09-10T14:32:20.241571+0000","last_clean":"2024-09-10T14:32:20.241571+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:32:20.241571+0000","last_undegraded":"2024-09-10T14:32:20.241571+0000","last_fullsized":"2024-09-10T14:32:20.241571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.465749+0000","last_change":"2024-09-10T14:32:53.465827+0000","last_active":"2024-09-10T14:32:53.465749+0000","last_peered":"2024-09-10T14:32:53.465749+0000","last_clean":"2024-09-10T14:32:53.465749+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:32:53.465749+0000","last_undegraded":"2024-09-10T14:32:53.465749+0000","last_fullsized":"2024-09-10T14:32:53.465749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:53.465523+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:53.465523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.465523+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:51.914175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.343626+0000","last_change":"2024-09-10T14:33:04.343688+0000","last_active":"2024-09-10T14:33:04.343626+0000","last_peered":"2024-09-10T14:33:04.343626+0000","last_clean":"2024-09-10T14:33:04.343626+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:33:04.343626+0000","last_undegraded":"2024-09-10T14:33:04.343626+0000","last_fullsized":"2024-09-10T14:33:04.343626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:04.343430+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:04.343430+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.343430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:27.120451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.473640+0000","last_change":"2024-09-10T14:32:56.473761+0000","last_active":"2024-09-10T14:32:56.473640+0000","last_peered":"2024-09-10T14:32:56.473640+0000","last_clean":"2024-09-10T14:32:56.473640+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:32:56.473640+0000","last_undegraded":"2024-09-10T14:32:56.473640+0000","last_fullsized":"2024-09-10T14:32:56.473640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:56.473347+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:56.473347+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.473347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:32.723316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:30:58.786983+0000","last_change":"2024-09-10T14:28:28.883653+0000","last_active":"2024-09-10T14:30:58.786983+0000","last_peered":"2024-09-10T14:30:58.786983+0000","last_clean":"2024-09-10T14:30:58.786983+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:30:58.786983+0000","last_undegraded":"2024-09-10T14:30:58.786983+0000","last_fullsized":"2024-09-10T14:30:58.786983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.995921+0000","last_change":"2024-09-10T14:32:39.996050+0000","last_active":"2024-09-10T14:32:39.995921+0000","last_peered":"2024-09-10T14:32:39.995921+0000","last_clean":"2024-09-10T14:32:39.995921+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:32:39.995921+0000","last_undegraded":"2024-09-10T14:32:39.995921+0000","last_fullsized":"2024-09-10T14:32:39.995921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:39.995698+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:39.995698+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.995698+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:22.900509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.352706+0000","last_change":"2024-09-10T14:33:00.352765+0000","last_active":"2024-09-10T14:33:00.352706+0000","last_peered":"2024-09-10T14:33:00.352706+0000","last_clean":"2024-09-10T14:33:00.352706+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:33:00.352706+0000","last_undegraded":"2024-09-10T14:33:00.352706+0000","last_fullsized":"2024-09-10T14:33:00.352706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:00.352497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:00.352497+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.352497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:55.705813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.417479+0000","last_change":"2024-09-10T14:33:06.417621+0000","last_active":"2024-09-10T14:33:06.417479+0000","last_peered":"2024-09-10T14:33:06.417479+0000","last_clean":"2024-09-10T14:33:06.417479+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:33:06.417479+0000","last_undegraded":"2024-09-10T14:33:06.417479+0000","last_fullsized":"2024-09-10T14:33:06.417479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:06.417247+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:06.417247+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.417247+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:40.374665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.424632+0000","last_change":"2024-09-10T14:33:14.424692+0000","last_active":"2024-09-10T14:33:14.424632+0000","last_peered":"2024-09-10T14:33:14.424632+0000","last_clean":"2024-09-10T14:33:14.424632+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:33:14.424632+0000","last_undegraded":"2024-09-10T14:33:14.424632+0000","last_fullsized":"2024-09-10T14:33:14.424632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:14.424436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:14.424436+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.424436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:52.256808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.405165+0000","last_change":"2024-09-10T14:32:51.405229+0000","last_active":"2024-09-10T14:32:51.405165+0000","last_peered":"2024-09-10T14:32:51.405165+0000","last_clean":"2024-09-10T14:32:51.405165+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:32:51.405165+0000","last_undegraded":"2024-09-10T14:32:51.405165+0000","last_fullsized":"2024-09-10T14:32:51.405165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:51.404964+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:51.404964+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.404964+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:47.758064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.122736+0000","last_change":"2024-09-10T14:33:09.122924+0000","last_active":"2024-09-10T14:33:09.122736+0000","last_peered":"2024-09-10T14:33:09.122736+0000","last_clean":"2024-09-10T14:33:09.122736+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:33:09.122736+0000","last_undegraded":"2024-09-10T14:33:09.122736+0000","last_fullsized":"2024-09-10T14:33:09.122736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.122486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.122486+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.122486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:12.627096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.359805+0000","last_change":"2024-09-10T14:32:57.359868+0000","last_active":"2024-09-10T14:32:57.359805+0000","last_peered":"2024-09-10T14:32:57.359805+0000","last_clean":"2024-09-10T14:32:57.359805+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:32:57.359805+0000","last_undegraded":"2024-09-10T14:32:57.359805+0000","last_fullsized":"2024-09-10T14:32:57.359805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:57.359620+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:57.359620+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.359620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:49.137266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.445514+0000","last_change":"2024-09-10T14:33:05.445514+0000","last_active":"2024-09-10T14:33:05.445514+0000","last_peered":"2024-09-10T14:33:05.445514+0000","last_clean":"2024-09-10T14:33:05.445514+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:33:05.445514+0000","last_undegraded":"2024-09-10T14:33:05.445514+0000","last_fullsized":"2024-09-10T14:33:05.445514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:05.445236+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:05.445236+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.445236+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:44.643741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.797572+0000","last_change":"2024-09-10T14:33:10.797572+0000","last_active":"2024-09-10T14:33:10.797572+0000","last_peered":"2024-09-10T14:33:10.797572+0000","last_clean":"2024-09-10T14:33:10.797572+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:33:10.797572+0000","last_undegraded":"2024-09-10T14:33:10.797572+0000","last_fullsized":"2024-09-10T14:33:10.797572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.797175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.797175+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.797175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:54.603044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.912446+0000","last_change":"2024-09-10T14:32:54.912446+0000","last_active":"2024-09-10T14:32:54.912446+0000","last_peered":"2024-09-10T14:32:54.912446+0000","last_clean":"2024-09-10T14:32:54.912446+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:32:54.912446+0000","last_undegraded":"2024-09-10T14:32:54.912446+0000","last_fullsized":"2024-09-10T14:32:54.912446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:54.912155+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:54.912155+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.912155+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:20.379495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.427495+0000","last_change":"2024-09-10T14:32:50.427495+0000","last_active":"2024-09-10T14:32:50.427495+0000","last_peered":"2024-09-10T14:32:50.427495+0000","last_clean":"2024-09-10T14:32:50.427495+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:32:50.427495+0000","last_undegraded":"2024-09-10T14:32:50.427495+0000","last_fullsized":"2024-09-10T14:32:50.427495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:50.427322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:50.427322+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.427322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:22.901578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.984319+0000","last_change":"2024-09-10T14:32:50.984319+0000","last_active":"2024-09-10T14:32:50.984319+0000","last_peered":"2024-09-10T14:32:50.984319+0000","last_clean":"2024-09-10T14:32:50.984319+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:32:50.984319+0000","last_undegraded":"2024-09-10T14:32:50.984319+0000","last_fullsized":"2024-09-10T14:32:50.984319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:50.983924+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:50.983924+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.983924+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:21.745837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.812070+0000","last_change":"2024-09-10T14:33:03.812070+0000","last_active":"2024-09-10T14:33:03.812070+0000","last_peered":"2024-09-10T14:33:03.812070+0000","last_clean":"2024-09-10T14:33:03.812070+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:33:03.812070+0000","last_undegraded":"2024-09-10T14:33:03.812070+0000","last_fullsized":"2024-09-10T14:33:03.812070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.811688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.811688+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.811688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:49:37.732318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.270362+0000","last_change":"2024-09-10T14:32:45.270427+0000","last_active":"2024-09-10T14:32:45.270362+0000","last_peered":"2024-09-10T14:32:45.270362+0000","last_clean":"2024-09-10T14:32:45.270362+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:32:45.270362+0000","last_undegraded":"2024-09-10T14:32:45.270362+0000","last_fullsized":"2024-09-10T14:32:45.270362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:45.270174+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:45.270174+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.270174+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.086726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.792289+0000","last_change":"2024-09-10T14:33:07.792289+0000","last_active":"2024-09-10T14:33:07.792289+0000","last_peered":"2024-09-10T14:33:07.792289+0000","last_clean":"2024-09-10T14:33:07.792289+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:33:07.792289+0000","last_undegraded":"2024-09-10T14:33:07.792289+0000","last_fullsized":"2024-09-10T14:33:07.792289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:07.791861+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:07.791861+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.791861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:08.077505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.379496+0000","last_change":"2024-09-10T14:32:55.379622+0000","last_active":"2024-09-10T14:32:55.379496+0000","last_peered":"2024-09-10T14:32:55.379496+0000","last_clean":"2024-09-10T14:32:55.379496+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:32:55.379496+0000","last_undegraded":"2024-09-10T14:32:55.379496+0000","last_fullsized":"2024-09-10T14:32:55.379496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:55.379196+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:55.379196+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.379196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:18.941696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.151406+0000","last_change":"2024-09-10T14:32:56.151476+0000","last_active":"2024-09-10T14:32:56.151406+0000","last_peered":"2024-09-10T14:32:56.151406+0000","last_clean":"2024-09-10T14:32:56.151406+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:32:56.151406+0000","last_undegraded":"2024-09-10T14:32:56.151406+0000","last_fullsized":"2024-09-10T14:32:56.151406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:56.151206+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:56.151206+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.151206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:12.336091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.935392+0000","last_change":"2024-09-10T14:32:41.935455+0000","last_active":"2024-09-10T14:32:41.935392+0000","last_peered":"2024-09-10T14:32:41.935392+0000","last_clean":"2024-09-10T14:32:41.935392+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:32:41.935392+0000","last_undegraded":"2024-09-10T14:32:41.935392+0000","last_fullsized":"2024-09-10T14:32:41.935392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:41.935185+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:41.935185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.935185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:14.532819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241489+0000","last_change":"2024-09-10T14:28:28.891649+0000","last_active":"2024-09-10T14:32:20.241489+0000","last_peered":"2024-09-10T14:32:20.241489+0000","last_clean":"2024-09-10T14:32:20.241489+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:32:20.241489+0000","last_undegraded":"2024-09-10T14:32:20.241489+0000","last_fullsized":"2024-09-10T14:32:20.241489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'36","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.785091+0000","last_change":"2024-09-10T14:33:16.785151+0000","last_active":"2024-09-10T14:33:16.785091+0000","last_peered":"2024-09-10T14:33:16.785091+0000","last_clean":"2024-09-10T14:33:16.785091+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:33:16.785091+0000","last_undegraded":"2024-09-10T14:33:16.785091+0000","last_fullsized":"2024-09-10T14:33:16.785091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:33:16.784905+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:33:16.784905+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.784905+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:16:49.154188+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.378169+0000","last_change":"2024-09-10T14:33:14.378223+0000","last_active":"2024-09-10T14:33:14.378169+0000","last_peered":"2024-09-10T14:33:14.378169+0000","last_clean":"2024-09-10T14:33:14.378169+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:33:14.378169+0000","last_undegraded":"2024-09-10T14:33:14.378169+0000","last_fullsized":"2024-09-10T14:33:14.378169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:14.377949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:14.377949+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.377949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:21.128189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.444163+0000","last_change":"2024-09-10T14:33:09.444227+0000","last_active":"2024-09-10T14:33:09.444163+0000","last_peered":"2024-09-10T14:33:09.444163+0000","last_clean":"2024-09-10T14:33:09.444163+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:33:09.444163+0000","last_undegraded":"2024-09-10T14:33:09.444163+0000","last_fullsized":"2024-09-10T14:33:09.444163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.443934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.443934+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.443934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:31.721931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.424000+0000","last_change":"2024-09-10T14:32:21.424117+0000","last_active":"2024-09-10T14:32:21.424000+0000","last_peered":"2024-09-10T14:32:21.424000+0000","last_clean":"2024-09-10T14:32:21.424000+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:32:21.424000+0000","last_undegraded":"2024-09-10T14:32:21.424000+0000","last_fullsized":"2024-09-10T14:32:21.424000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.423759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:32.872552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'38","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.452564+0000","last_change":"2024-09-10T14:32:49.452638+0000","last_active":"2024-09-10T14:32:49.452564+0000","last_peered":"2024-09-10T14:32:49.452564+0000","last_clean":"2024-09-10T14:32:49.452564+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:32:49.452564+0000","last_undegraded":"2024-09-10T14:32:49.452564+0000","last_fullsized":"2024-09-10T14:32:49.452564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-10T14:32:49.452381+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-10T14:32:49.452381+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.452381+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:49.443135+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.955541+0000","last_change":"2024-09-10T14:32:34.955641+0000","last_active":"2024-09-10T14:32:34.955541+0000","last_peered":"2024-09-10T14:32:34.955541+0000","last_clean":"2024-09-10T14:32:34.955541+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:32:34.955541+0000","last_undegraded":"2024-09-10T14:32:34.955541+0000","last_fullsized":"2024-09-10T14:32:34.955541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.955261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:29:53.485810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.770712+0000","last_change":"2024-09-10T14:33:17.770774+0000","last_active":"2024-09-10T14:33:17.770712+0000","last_peered":"2024-09-10T14:33:17.770712+0000","last_clean":"2024-09-10T14:33:17.770712+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:33:17.770712+0000","last_undegraded":"2024-09-10T14:33:17.770712+0000","last_fullsized":"2024-09-10T14:33:17.770712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-10T14:33:17.770519+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-10T14:33:17.770519+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.770519+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:25.981664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.489208+0000","last_change":"2024-09-10T14:33:04.489328+0000","last_active":"2024-09-10T14:33:04.489208+0000","last_peered":"2024-09-10T14:33:04.489208+0000","last_clean":"2024-09-10T14:33:04.489208+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:33:04.489208+0000","last_undegraded":"2024-09-10T14:33:04.489208+0000","last_fullsized":"2024-09-10T14:33:04.489208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:04.488935+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:04.488935+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.488935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:37.290775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.332832+0000","last_change":"2024-09-10T14:33:06.332832+0000","last_active":"2024-09-10T14:33:06.332832+0000","last_peered":"2024-09-10T14:33:06.332832+0000","last_clean":"2024-09-10T14:33:06.332832+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:33:06.332832+0000","last_undegraded":"2024-09-10T14:33:06.332832+0000","last_fullsized":"2024-09-10T14:33:06.332832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:06.332586+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:06.332586+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.332586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:25.365994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.253066+0000","last_change":"2024-09-10T14:32:38.253066+0000","last_active":"2024-09-10T14:32:38.253066+0000","last_peered":"2024-09-10T14:32:38.253066+0000","last_clean":"2024-09-10T14:32:38.253066+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:32:38.253066+0000","last_undegraded":"2024-09-10T14:32:38.253066+0000","last_fullsized":"2024-09-10T14:32:38.253066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.252795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.252795+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.252795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:01.166001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.994838+0000","last_change":"2024-09-10T14:32:24.994910+0000","last_active":"2024-09-10T14:32:24.994838+0000","last_peered":"2024-09-10T14:32:24.994838+0000","last_clean":"2024-09-10T14:32:24.994838+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:32:24.994838+0000","last_undegraded":"2024-09-10T14:32:24.994838+0000","last_fullsized":"2024-09-10T14:32:24.994838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.994665+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:23.745673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.984911+0000","last_change":"2024-09-10T14:32:30.985015+0000","last_active":"2024-09-10T14:32:30.984911+0000","last_peered":"2024-09-10T14:32:30.984911+0000","last_clean":"2024-09-10T14:32:30.984911+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:32:30.984911+0000","last_undegraded":"2024-09-10T14:32:30.984911+0000","last_fullsized":"2024-09-10T14:32:30.984911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.984682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:15.495746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.155343+0000","last_change":"2024-09-10T14:33:16.155401+0000","last_active":"2024-09-10T14:33:16.155343+0000","last_peered":"2024-09-10T14:33:16.155343+0000","last_clean":"2024-09-10T14:33:16.155343+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:33:16.155343+0000","last_undegraded":"2024-09-10T14:33:16.155343+0000","last_fullsized":"2024-09-10T14:33:16.155343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:16.155149+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:16.155149+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.155149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:52.405119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.461039+0000","last_change":"2024-09-10T14:32:57.461098+0000","last_active":"2024-09-10T14:32:57.461039+0000","last_peered":"2024-09-10T14:32:57.461039+0000","last_clean":"2024-09-10T14:32:57.461039+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:32:57.461039+0000","last_undegraded":"2024-09-10T14:32:57.461039+0000","last_fullsized":"2024-09-10T14:32:57.461039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:57.460865+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:57.460865+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.460865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:14.564410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.467965+0000","last_change":"2024-09-10T14:33:16.468037+0000","last_active":"2024-09-10T14:33:16.467965+0000","last_peered":"2024-09-10T14:33:16.467965+0000","last_clean":"2024-09-10T14:33:16.467965+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:33:16.467965+0000","last_undegraded":"2024-09-10T14:33:16.467965+0000","last_fullsized":"2024-09-10T14:33:16.467965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:16.467773+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:16.467773+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.467773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:45.412113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.218936+0000","last_change":"2024-09-10T14:32:37.218999+0000","last_active":"2024-09-10T14:32:37.218936+0000","last_peered":"2024-09-10T14:32:37.218936+0000","last_clean":"2024-09-10T14:32:37.218936+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:32:37.218936+0000","last_undegraded":"2024-09-10T14:32:37.218936+0000","last_fullsized":"2024-09-10T14:32:37.218936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.218734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:20.123545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.492161+0000","last_change":"2024-09-10T14:32:28.492161+0000","last_active":"2024-09-10T14:32:28.492161+0000","last_peered":"2024-09-10T14:32:28.492161+0000","last_clean":"2024-09-10T14:32:28.492161+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:32:28.492161+0000","last_undegraded":"2024-09-10T14:32:28.492161+0000","last_fullsized":"2024-09-10T14:32:28.492161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.491906+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:07.716285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":406,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.438865+0000","last_change":"2024-09-10T14:32:51.439000+0000","last_active":"2024-09-10T14:32:51.438865+0000","last_peered":"2024-09-10T14:32:51.438865+0000","last_clean":"2024-09-10T14:32:51.438865+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:32:51.438865+0000","last_undegraded":"2024-09-10T14:32:51.438865+0000","last_fullsized":"2024-09-10T14:32:51.438865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-10T14:32:51.438638+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-10T14:32:51.438638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.438638+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:47.269056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.358983+0000","last_change":"2024-09-10T14:32:43.359041+0000","last_active":"2024-09-10T14:32:43.358983+0000","last_peered":"2024-09-10T14:32:43.358983+0000","last_clean":"2024-09-10T14:32:43.358983+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:32:43.358983+0000","last_undegraded":"2024-09-10T14:32:43.358983+0000","last_fullsized":"2024-09-10T14:32:43.358983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:43.358788+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:43.358788+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.358788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:40.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.254283+0000","last_change":"2024-09-10T14:32:48.254423+0000","last_active":"2024-09-10T14:32:48.254283+0000","last_peered":"2024-09-10T14:32:48.254283+0000","last_clean":"2024-09-10T14:32:48.254283+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:32:48.254283+0000","last_undegraded":"2024-09-10T14:32:48.254283+0000","last_fullsized":"2024-09-10T14:32:48.254283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:48.254057+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:48.254057+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.254057+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:25.991922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.761849+0000","last_change":"2024-09-10T14:33:08.761849+0000","last_active":"2024-09-10T14:33:08.761849+0000","last_peered":"2024-09-10T14:33:08.761849+0000","last_clean":"2024-09-10T14:33:08.761849+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:33:08.761849+0000","last_undegraded":"2024-09-10T14:33:08.761849+0000","last_fullsized":"2024-09-10T14:33:08.761849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:08.761592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:08.761592+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.761592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:10.906663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'5","reported_seq":240,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.464976+0000","last_change":"2024-09-10T14:32:24.465044+0000","last_active":"2024-09-10T14:32:24.464976+0000","last_peered":"2024-09-10T14:32:24.464976+0000","last_clean":"2024-09-10T14:32:24.464976+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:32:24.464976+0000","last_undegraded":"2024-09-10T14:32:24.464976+0000","last_fullsized":"2024-09-10T14:32:24.464976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.464758+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:15.815013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.479093+0000","last_change":"2024-09-10T14:32:29.479227+0000","last_active":"2024-09-10T14:32:29.479093+0000","last_peered":"2024-09-10T14:32:29.479093+0000","last_clean":"2024-09-10T14:32:29.479093+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:32:29.479093+0000","last_undegraded":"2024-09-10T14:32:29.479093+0000","last_fullsized":"2024-09-10T14:32:29.479093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.478794+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:53.505918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.041931+0000","last_change":"2024-09-10T14:32:24.041931+0000","last_active":"2024-09-10T14:32:24.041931+0000","last_peered":"2024-09-10T14:32:24.041931+0000","last_clean":"2024-09-10T14:32:24.041931+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:32:24.041931+0000","last_undegraded":"2024-09-10T14:32:24.041931+0000","last_fullsized":"2024-09-10T14:32:24.041931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.041685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:10.399631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.466264+0000","last_change":"2024-09-10T14:33:08.466320+0000","last_active":"2024-09-10T14:33:08.466264+0000","last_peered":"2024-09-10T14:33:08.466264+0000","last_clean":"2024-09-10T14:33:08.466264+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:33:08.466264+0000","last_undegraded":"2024-09-10T14:33:08.466264+0000","last_fullsized":"2024-09-10T14:33:08.466264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:33:08.466083+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:33:08.466083+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.466083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:15.113294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.364324+0000","last_change":"2024-09-10T14:32:58.364324+0000","last_active":"2024-09-10T14:32:58.364324+0000","last_peered":"2024-09-10T14:32:58.364324+0000","last_clean":"2024-09-10T14:32:58.364324+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:32:58.364324+0000","last_undegraded":"2024-09-10T14:32:58.364324+0000","last_fullsized":"2024-09-10T14:32:58.364324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:58.364049+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:58.364049+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.364049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:13.940048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.014533+0000","last_change":"2024-09-10T14:32:30.014533+0000","last_active":"2024-09-10T14:32:30.014533+0000","last_peered":"2024-09-10T14:32:30.014533+0000","last_clean":"2024-09-10T14:32:30.014533+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:32:30.014533+0000","last_undegraded":"2024-09-10T14:32:30.014533+0000","last_fullsized":"2024-09-10T14:32:30.014533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.014216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:20.605790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.517939+0000","last_change":"2024-09-10T14:32:34.517939+0000","last_active":"2024-09-10T14:32:34.517939+0000","last_peered":"2024-09-10T14:32:34.517939+0000","last_clean":"2024-09-10T14:32:34.517939+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:32:34.517939+0000","last_undegraded":"2024-09-10T14:32:34.517939+0000","last_fullsized":"2024-09-10T14:32:34.517939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.517813+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:15.055588+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.040437+0000","last_change":"2024-09-10T14:32:19.040437+0000","last_active":"2024-09-10T14:32:19.040437+0000","last_peered":"2024-09-10T14:32:19.040437+0000","last_clean":"2024-09-10T14:32:19.040437+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:32:19.040437+0000","last_undegraded":"2024-09-10T14:32:19.040437+0000","last_fullsized":"2024-09-10T14:32:19.040437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.040292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:34.054916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.402239+0000","last_change":"2024-09-10T14:32:39.402239+0000","last_active":"2024-09-10T14:32:39.402239+0000","last_peered":"2024-09-10T14:32:39.402239+0000","last_clean":"2024-09-10T14:32:39.402239+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:32:39.402239+0000","last_undegraded":"2024-09-10T14:32:39.402239+0000","last_fullsized":"2024-09-10T14:32:39.402239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.401987+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:54.650326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.972138+0000","last_change":"2024-09-10T14:32:52.972138+0000","last_active":"2024-09-10T14:32:52.972138+0000","last_peered":"2024-09-10T14:32:52.972138+0000","last_clean":"2024-09-10T14:32:52.972138+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:32:52.972138+0000","last_undegraded":"2024-09-10T14:32:52.972138+0000","last_fullsized":"2024-09-10T14:32:52.972138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:52.971889+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:52.971889+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.971889+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:26.022428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.372100+0000","last_change":"2024-09-10T14:33:05.372164+0000","last_active":"2024-09-10T14:33:05.372100+0000","last_peered":"2024-09-10T14:33:05.372100+0000","last_clean":"2024-09-10T14:33:05.372100+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:33:05.372100+0000","last_undegraded":"2024-09-10T14:33:05.372100+0000","last_fullsized":"2024-09-10T14:33:05.372100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.371906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.371906+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.371906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:27.083822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.242013+0000","last_change":"2024-09-10T14:32:42.242013+0000","last_active":"2024-09-10T14:32:42.242013+0000","last_peered":"2024-09-10T14:32:42.242013+0000","last_clean":"2024-09-10T14:32:42.242013+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:32:42.242013+0000","last_undegraded":"2024-09-10T14:32:42.242013+0000","last_fullsized":"2024-09-10T14:32:42.242013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.241760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.241760+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.241760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:14.535976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.442127+0000","last_change":"2024-09-10T14:32:39.442127+0000","last_active":"2024-09-10T14:32:39.442127+0000","last_peered":"2024-09-10T14:32:39.442127+0000","last_clean":"2024-09-10T14:32:39.442127+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:32:39.442127+0000","last_undegraded":"2024-09-10T14:32:39.442127+0000","last_fullsized":"2024-09-10T14:32:39.442127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:39.441831+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:39.441831+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.441831+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:50.008100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.039240+0000","last_change":"2024-09-10T14:32:27.039240+0000","last_active":"2024-09-10T14:32:27.039240+0000","last_peered":"2024-09-10T14:32:27.039240+0000","last_clean":"2024-09-10T14:32:27.039240+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:32:27.039240+0000","last_undegraded":"2024-09-10T14:32:27.039240+0000","last_fullsized":"2024-09-10T14:32:27.039240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.038840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:05.450794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.823525+0000","last_change":"2024-09-10T14:33:14.823588+0000","last_active":"2024-09-10T14:33:14.823525+0000","last_peered":"2024-09-10T14:33:14.823525+0000","last_clean":"2024-09-10T14:33:14.823525+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:33:14.823525+0000","last_undegraded":"2024-09-10T14:33:14.823525+0000","last_fullsized":"2024-09-10T14:33:14.823525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:14.823317+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:14.823317+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.823317+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:51.572439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.339953+0000","last_change":"2024-09-10T14:33:15.340102+0000","last_active":"2024-09-10T14:33:15.339953+0000","last_peered":"2024-09-10T14:33:15.339953+0000","last_clean":"2024-09-10T14:33:15.339953+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:33:15.339953+0000","last_undegraded":"2024-09-10T14:33:15.339953+0000","last_fullsized":"2024-09-10T14:33:15.339953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:15.339732+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:15.339732+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.339732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.260627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240903+0000","last_change":"2024-09-10T14:28:28.889610+0000","last_active":"2024-09-10T14:32:20.240903+0000","last_peered":"2024-09-10T14:32:20.240903+0000","last_clean":"2024-09-10T14:32:20.240903+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:32:20.240903+0000","last_undegraded":"2024-09-10T14:32:20.240903+0000","last_fullsized":"2024-09-10T14:32:20.240903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.261308+0000","last_change":"2024-09-10T14:32:41.261308+0000","last_active":"2024-09-10T14:32:41.261308+0000","last_peered":"2024-09-10T14:32:41.261308+0000","last_clean":"2024-09-10T14:32:41.261308+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:32:41.261308+0000","last_undegraded":"2024-09-10T14:32:41.261308+0000","last_fullsized":"2024-09-10T14:32:41.261308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.261061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.261061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.261061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:33.177795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'47","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.415162+0000","last_change":"2024-09-10T14:32:27.415162+0000","last_active":"2024-09-10T14:32:27.415162+0000","last_peered":"2024-09-10T14:32:27.415162+0000","last_clean":"2024-09-10T14:32:27.415162+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:32:27.415162+0000","last_undegraded":"2024-09-10T14:32:27.415162+0000","last_fullsized":"2024-09-10T14:32:27.415162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.414901+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:51.152227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.166376+0000","last_change":"2024-09-10T14:32:31.166376+0000","last_active":"2024-09-10T14:32:31.166376+0000","last_peered":"2024-09-10T14:32:31.166376+0000","last_clean":"2024-09-10T14:32:31.166376+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:32:31.166376+0000","last_undegraded":"2024-09-10T14:32:31.166376+0000","last_fullsized":"2024-09-10T14:32:31.166376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.166120+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:33.186827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.807752+0000","last_change":"2024-09-10T14:28:38.936021+0000","last_active":"2024-09-10T14:32:18.807752+0000","last_peered":"2024-09-10T14:32:18.807752+0000","last_clean":"2024-09-10T14:32:18.807752+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:32:18.807752+0000","last_undegraded":"2024-09-10T14:32:18.807752+0000","last_fullsized":"2024-09-10T14:32:18.807752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'12","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.391058+0000","last_change":"2024-09-10T14:32:47.391058+0000","last_active":"2024-09-10T14:32:47.391058+0000","last_peered":"2024-09-10T14:32:47.391058+0000","last_clean":"2024-09-10T14:32:47.391058+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:32:47.391058+0000","last_undegraded":"2024-09-10T14:32:47.391058+0000","last_fullsized":"2024-09-10T14:32:47.391058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:47.390803+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:47.390803+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.390803+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:07.854725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240876+0000","last_change":"2024-09-10T14:28:28.884739+0000","last_active":"2024-09-10T14:32:20.240876+0000","last_peered":"2024-09-10T14:32:20.240876+0000","last_clean":"2024-09-10T14:32:20.240876+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:32:20.240876+0000","last_undegraded":"2024-09-10T14:32:20.240876+0000","last_fullsized":"2024-09-10T14:32:20.240876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"36'2","reported_seq":233,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.252127+0000","last_change":"2024-09-10T14:32:36.252127+0000","last_active":"2024-09-10T14:32:36.252127+0000","last_peered":"2024-09-10T14:32:36.252127+0000","last_clean":"2024-09-10T14:32:36.252127+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:32:36.252127+0000","last_undegraded":"2024-09-10T14:32:36.252127+0000","last_fullsized":"2024-09-10T14:32:36.252127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.251846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:51:42.564689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'64","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.463817+0000","last_change":"2024-09-10T14:32:33.463817+0000","last_active":"2024-09-10T14:32:33.463817+0000","last_peered":"2024-09-10T14:32:33.463817+0000","last_clean":"2024-09-10T14:32:33.463817+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:32:33.463817+0000","last_undegraded":"2024-09-10T14:32:33.463817+0000","last_fullsized":"2024-09-10T14:32:33.463817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'64","last_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_deep_scrub":"36'64","last_deep_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.463523+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:28.060036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.053813+0000","last_change":"2024-09-10T14:32:21.053813+0000","last_active":"2024-09-10T14:32:21.053813+0000","last_peered":"2024-09-10T14:32:21.053813+0000","last_clean":"2024-09-10T14:32:21.053813+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:32:21.053813+0000","last_undegraded":"2024-09-10T14:32:21.053813+0000","last_fullsized":"2024-09-10T14:32:21.053813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.053565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:23.410520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'23","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.286108+0000","last_change":"2024-09-10T14:32:47.286108+0000","last_active":"2024-09-10T14:32:47.286108+0000","last_peered":"2024-09-10T14:32:47.286108+0000","last_clean":"2024-09-10T14:32:47.286108+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:32:47.286108+0000","last_undegraded":"2024-09-10T14:32:47.286108+0000","last_fullsized":"2024-09-10T14:32:47.286108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-10T14:32:47.285847+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-10T14:32:47.285847+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.285847+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:11.350745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.833610+0000","last_change":"2024-09-10T14:32:58.833610+0000","last_active":"2024-09-10T14:32:58.833610+0000","last_peered":"2024-09-10T14:32:58.833610+0000","last_clean":"2024-09-10T14:32:58.833610+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:32:58.833610+0000","last_undegraded":"2024-09-10T14:32:58.833610+0000","last_fullsized":"2024-09-10T14:32:58.833610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:58.833329+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:58.833329+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.833329+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:15.018214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.106324+0000","last_change":"2024-09-10T14:33:11.106497+0000","last_active":"2024-09-10T14:33:11.106324+0000","last_peered":"2024-09-10T14:33:11.106324+0000","last_clean":"2024-09-10T14:33:11.106324+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:33:11.106324+0000","last_undegraded":"2024-09-10T14:33:11.106324+0000","last_fullsized":"2024-09-10T14:33:11.106324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:11.106093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:11.106093+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.106093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:42.567754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.417891+0000","last_change":"2024-09-10T14:32:41.417891+0000","last_active":"2024-09-10T14:32:41.417891+0000","last_peered":"2024-09-10T14:32:41.417891+0000","last_clean":"2024-09-10T14:32:41.417891+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:32:41.417891+0000","last_undegraded":"2024-09-10T14:32:41.417891+0000","last_fullsized":"2024-09-10T14:32:41.417891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.417613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.417613+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.417613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:31.173045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.040293+0000","last_change":"2024-09-10T14:32:26.040293+0000","last_active":"2024-09-10T14:32:26.040293+0000","last_peered":"2024-09-10T14:32:26.040293+0000","last_clean":"2024-09-10T14:32:26.040293+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:32:26.040293+0000","last_undegraded":"2024-09-10T14:32:26.040293+0000","last_fullsized":"2024-09-10T14:32:26.040293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.040008+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:55.634620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.412041+0000","last_change":"2024-09-10T14:32:59.412041+0000","last_active":"2024-09-10T14:32:59.412041+0000","last_peered":"2024-09-10T14:32:59.412041+0000","last_clean":"2024-09-10T14:32:59.412041+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:32:59.412041+0000","last_undegraded":"2024-09-10T14:32:59.412041+0000","last_fullsized":"2024-09-10T14:32:59.412041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:59.411794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:59.411794+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.411794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:24.669220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243371+0000","last_change":"2024-09-10T14:28:38.941887+0000","last_active":"2024-09-10T14:32:20.243371+0000","last_peered":"2024-09-10T14:32:20.243371+0000","last_clean":"2024-09-10T14:32:20.243371+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:32:20.243371+0000","last_undegraded":"2024-09-10T14:32:20.243371+0000","last_fullsized":"2024-09-10T14:32:20.243371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.478577+0000","last_change":"2024-09-10T14:32:32.478577+0000","last_active":"2024-09-10T14:32:32.478577+0000","last_peered":"2024-09-10T14:32:32.478577+0000","last_clean":"2024-09-10T14:32:32.478577+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:32:32.478577+0000","last_undegraded":"2024-09-10T14:32:32.478577+0000","last_fullsized":"2024-09-10T14:32:32.478577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.478327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:57.945668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240887+0000","last_change":"2024-09-10T14:28:28.891910+0000","last_active":"2024-09-10T14:32:20.240887+0000","last_peered":"2024-09-10T14:32:20.240887+0000","last_clean":"2024-09-10T14:32:20.240887+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:32:20.240887+0000","last_undegraded":"2024-09-10T14:32:20.240887+0000","last_fullsized":"2024-09-10T14:32:20.240887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.294294+0000","last_change":"2024-09-10T14:32:40.294294+0000","last_active":"2024-09-10T14:32:40.294294+0000","last_peered":"2024-09-10T14:32:40.294294+0000","last_clean":"2024-09-10T14:32:40.294294+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:32:40.294294+0000","last_undegraded":"2024-09-10T14:32:40.294294+0000","last_fullsized":"2024-09-10T14:32:40.294294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:40.293913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:40.293913+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.293913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:23.340331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.499425+0000","last_change":"2024-09-10T14:32:33.499425+0000","last_active":"2024-09-10T14:32:33.499425+0000","last_peered":"2024-09-10T14:32:33.499425+0000","last_clean":"2024-09-10T14:32:33.499425+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:32:33.499425+0000","last_undegraded":"2024-09-10T14:32:33.499425+0000","last_fullsized":"2024-09-10T14:32:33.499425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.499022+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.396571+0000","last_change":"2024-09-10T14:32:22.396571+0000","last_active":"2024-09-10T14:32:22.396571+0000","last_peered":"2024-09-10T14:32:22.396571+0000","last_clean":"2024-09-10T14:32:22.396571+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:32:22.396571+0000","last_undegraded":"2024-09-10T14:32:22.396571+0000","last_fullsized":"2024-09-10T14:32:22.396571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.396275+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:50.169559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'12","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.808140+0000","last_change":"2024-09-10T14:28:38.936015+0000","last_active":"2024-09-10T14:32:18.808140+0000","last_peered":"2024-09-10T14:32:18.808140+0000","last_clean":"2024-09-10T14:32:18.808140+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:32:18.808140+0000","last_undegraded":"2024-09-10T14:32:18.808140+0000","last_fullsized":"2024-09-10T14:32:18.808140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.368051+0000","last_change":"2024-09-10T14:32:53.368051+0000","last_active":"2024-09-10T14:32:53.368051+0000","last_peered":"2024-09-10T14:32:53.368051+0000","last_clean":"2024-09-10T14:32:53.368051+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:32:53.368051+0000","last_undegraded":"2024-09-10T14:32:53.368051+0000","last_fullsized":"2024-09-10T14:32:53.368051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:53.367787+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:53.367787+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.367787+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.443273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240872+0000","last_change":"2024-09-10T14:28:28.890431+0000","last_active":"2024-09-10T14:32:20.240872+0000","last_peered":"2024-09-10T14:32:20.240872+0000","last_clean":"2024-09-10T14:32:20.240872+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:32:20.240872+0000","last_undegraded":"2024-09-10T14:32:20.240872+0000","last_fullsized":"2024-09-10T14:32:20.240872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.957497+0000","last_change":"2024-09-10T14:32:31.957497+0000","last_active":"2024-09-10T14:32:31.957497+0000","last_peered":"2024-09-10T14:32:31.957497+0000","last_clean":"2024-09-10T14:32:31.957497+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:32:31.957497+0000","last_undegraded":"2024-09-10T14:32:31.957497+0000","last_fullsized":"2024-09-10T14:32:31.957497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.957244+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:59.661372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.518513+0000","last_change":"2024-09-10T14:32:45.518513+0000","last_active":"2024-09-10T14:32:45.518513+0000","last_peered":"2024-09-10T14:32:45.518513+0000","last_clean":"2024-09-10T14:32:45.518513+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:32:45.518513+0000","last_undegraded":"2024-09-10T14:32:45.518513+0000","last_fullsized":"2024-09-10T14:32:45.518513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:45.518255+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:45.518255+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.518255+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:33.065215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":475,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.046231+0000","last_change":"2024-09-10T14:32:27.046231+0000","last_active":"2024-09-10T14:32:27.046231+0000","last_peered":"2024-09-10T14:32:27.046231+0000","last_clean":"2024-09-10T14:32:27.046231+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:32:27.046231+0000","last_undegraded":"2024-09-10T14:32:27.046231+0000","last_fullsized":"2024-09-10T14:32:27.046231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.045975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:13.403921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.470074+0000","last_change":"2024-09-10T14:32:31.470074+0000","last_active":"2024-09-10T14:32:31.470074+0000","last_peered":"2024-09-10T14:32:31.470074+0000","last_clean":"2024-09-10T14:32:31.470074+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:32:31.470074+0000","last_undegraded":"2024-09-10T14:32:31.470074+0000","last_fullsized":"2024-09-10T14:32:31.470074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.469828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:50.291732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.988547+0000","last_change":"2024-09-10T14:32:40.988547+0000","last_active":"2024-09-10T14:32:40.988547+0000","last_peered":"2024-09-10T14:32:40.988547+0000","last_clean":"2024-09-10T14:32:40.988547+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:32:40.988547+0000","last_undegraded":"2024-09-10T14:32:40.988547+0000","last_fullsized":"2024-09-10T14:32:40.988547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:40.988250+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:40.988250+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.988250+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:03.901456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.470613+0000","last_change":"2024-09-10T14:33:10.470677+0000","last_active":"2024-09-10T14:33:10.470613+0000","last_peered":"2024-09-10T14:33:10.470613+0000","last_clean":"2024-09-10T14:33:10.470613+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:33:10.470613+0000","last_undegraded":"2024-09-10T14:33:10.470613+0000","last_fullsized":"2024-09-10T14:33:10.470613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.470416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.470416+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.470416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:00.133222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.468662+0000","last_change":"2024-09-10T14:32:23.468662+0000","last_active":"2024-09-10T14:32:23.468662+0000","last_peered":"2024-09-10T14:32:23.468662+0000","last_clean":"2024-09-10T14:32:23.468662+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:32:23.468662+0000","last_undegraded":"2024-09-10T14:32:23.468662+0000","last_fullsized":"2024-09-10T14:32:23.468662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.468416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:16.409761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.023066+0000","last_change":"2024-09-10T14:32:28.023066+0000","last_active":"2024-09-10T14:32:28.023066+0000","last_peered":"2024-09-10T14:32:28.023066+0000","last_clean":"2024-09-10T14:32:28.023066+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:32:28.023066+0000","last_undegraded":"2024-09-10T14:32:28.023066+0000","last_fullsized":"2024-09-10T14:32:28.023066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.022782+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:04.020612+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.346431+0000","last_change":"2024-09-10T14:32:21.346431+0000","last_active":"2024-09-10T14:32:21.346431+0000","last_peered":"2024-09-10T14:32:21.346431+0000","last_clean":"2024-09-10T14:32:21.346431+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:32:21.346431+0000","last_undegraded":"2024-09-10T14:32:21.346431+0000","last_fullsized":"2024-09-10T14:32:21.346431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.346185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:37.786157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'15","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.896938+0000","last_change":"2024-09-10T14:32:42.896938+0000","last_active":"2024-09-10T14:32:42.896938+0000","last_peered":"2024-09-10T14:32:42.896938+0000","last_clean":"2024-09-10T14:32:42.896938+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:32:42.896938+0000","last_undegraded":"2024-09-10T14:32:42.896938+0000","last_fullsized":"2024-09-10T14:32:42.896938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:42.896656+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:42.896656+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.896656+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:25.943074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.450748+0000","last_change":"2024-09-10T14:32:36.450748+0000","last_active":"2024-09-10T14:32:36.450748+0000","last_peered":"2024-09-10T14:32:36.450748+0000","last_clean":"2024-09-10T14:32:36.450748+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:32:36.450748+0000","last_undegraded":"2024-09-10T14:32:36.450748+0000","last_fullsized":"2024-09-10T14:32:36.450748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.450484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:32.265283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.835924+0000","last_change":"2024-09-10T14:33:04.836002+0000","last_active":"2024-09-10T14:33:04.835924+0000","last_peered":"2024-09-10T14:33:04.835924+0000","last_clean":"2024-09-10T14:33:04.835924+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:33:04.835924+0000","last_undegraded":"2024-09-10T14:33:04.835924+0000","last_fullsized":"2024-09-10T14:33:04.835924+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-10T14:33:04.835705+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-10T14:33:04.835705+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.835705+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:55:10.228765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240704+0000","last_change":"2024-09-10T14:28:21.323874+0000","last_active":"2024-09-10T14:32:20.240704+0000","last_peered":"2024-09-10T14:32:20.240704+0000","last_clean":"2024-09-10T14:32:20.240704+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:32:20.240704+0000","last_undegraded":"2024-09-10T14:32:20.240704+0000","last_fullsized":"2024-09-10T14:32:20.240704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240727+0000","last_change":"2024-09-10T14:28:28.892198+0000","last_active":"2024-09-10T14:32:20.240727+0000","last_peered":"2024-09-10T14:32:20.240727+0000","last_clean":"2024-09-10T14:32:20.240727+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:32:20.240727+0000","last_undegraded":"2024-09-10T14:32:20.240727+0000","last_fullsized":"2024-09-10T14:32:20.240727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.952793+0000","last_change":"2024-09-10T14:32:36.952793+0000","last_active":"2024-09-10T14:32:36.952793+0000","last_peered":"2024-09-10T14:32:36.952793+0000","last_clean":"2024-09-10T14:32:36.952793+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:32:36.952793+0000","last_undegraded":"2024-09-10T14:32:36.952793+0000","last_fullsized":"2024-09-10T14:32:36.952793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.952410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:45.541704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'90","reported_seq":183,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.479235+0000","last_change":"2024-09-10T14:32:48.479235+0000","last_active":"2024-09-10T14:32:48.479235+0000","last_peered":"2024-09-10T14:32:48.479235+0000","last_clean":"2024-09-10T14:32:48.479235+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:32:48.479235+0000","last_undegraded":"2024-09-10T14:32:48.479235+0000","last_fullsized":"2024-09-10T14:32:48.479235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-09-10T14:32:48.478990+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-09-10T14:32:48.478990+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.478990+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:01.329596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.266984+0000","last_change":"2024-09-10T14:32:43.266984+0000","last_active":"2024-09-10T14:32:43.266984+0000","last_peered":"2024-09-10T14:32:43.266984+0000","last_clean":"2024-09-10T14:32:43.266984+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:32:43.266984+0000","last_undegraded":"2024-09-10T14:32:43.266984+0000","last_fullsized":"2024-09-10T14:32:43.266984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:43.266713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:43.266713+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.266713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:55.597757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.463686+0000","last_change":"2024-09-10T14:32:27.463686+0000","last_active":"2024-09-10T14:32:27.463686+0000","last_peered":"2024-09-10T14:32:27.463686+0000","last_clean":"2024-09-10T14:32:27.463686+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:32:27.463686+0000","last_undegraded":"2024-09-10T14:32:27.463686+0000","last_fullsized":"2024-09-10T14:32:27.463686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.463440+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:01.315498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.420075+0000","last_change":"2024-09-10T14:32:58.420191+0000","last_active":"2024-09-10T14:32:58.420075+0000","last_peered":"2024-09-10T14:32:58.420075+0000","last_clean":"2024-09-10T14:32:58.420075+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:32:58.420075+0000","last_undegraded":"2024-09-10T14:32:58.420075+0000","last_fullsized":"2024-09-10T14:32:58.420075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:58.419787+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:58.419787+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.419787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:20.379479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:18.805659+0000","last_change":"2024-09-10T14:28:21.323789+0000","last_active":"2024-09-10T14:32:18.805659+0000","last_peered":"2024-09-10T14:32:18.805659+0000","last_clean":"2024-09-10T14:32:18.805659+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:32:18.805659+0000","last_undegraded":"2024-09-10T14:32:18.805659+0000","last_fullsized":"2024-09-10T14:32:18.805659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.079949+0000","last_change":"2024-09-10T14:33:07.080019+0000","last_active":"2024-09-10T14:33:07.079949+0000","last_peered":"2024-09-10T14:33:07.079949+0000","last_clean":"2024-09-10T14:33:07.079949+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:33:07.079949+0000","last_undegraded":"2024-09-10T14:33:07.079949+0000","last_fullsized":"2024-09-10T14:33:07.079949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:07.079757+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:07.079757+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.079757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:47.031785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.453049+0000","last_change":"2024-09-10T14:32:22.453049+0000","last_active":"2024-09-10T14:32:22.453049+0000","last_peered":"2024-09-10T14:32:22.453049+0000","last_clean":"2024-09-10T14:32:22.453049+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:32:22.453049+0000","last_undegraded":"2024-09-10T14:32:22.453049+0000","last_fullsized":"2024-09-10T14:32:22.453049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.452808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:07.398717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'292","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.028865+0000","last_change":"2024-09-10T14:32:22.028865+0000","last_active":"2024-09-10T14:32:22.028865+0000","last_peered":"2024-09-10T14:32:22.028865+0000","last_clean":"2024-09-10T14:32:22.028865+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:32:22.028865+0000","last_undegraded":"2024-09-10T14:32:22.028865+0000","last_fullsized":"2024-09-10T14:32:22.028865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'292","last_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_deep_scrub":"36'292","last_deep_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.028508+0000","objects_scrubbed":10,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:37.043133+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.471881+0000","last_change":"2024-09-10T14:32:47.471881+0000","last_active":"2024-09-10T14:32:47.471881+0000","last_peered":"2024-09-10T14:32:47.471881+0000","last_clean":"2024-09-10T14:32:47.471881+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:32:47.471881+0000","last_undegraded":"2024-09-10T14:32:47.471881+0000","last_fullsized":"2024-09-10T14:32:47.471881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:47.471638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:47.471638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.471638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:38.822368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:18.801216+0000","last_change":"2024-09-10T14:33:18.801281+0000","last_active":"2024-09-10T14:33:18.801216+0000","last_peered":"2024-09-10T14:33:18.801216+0000","last_clean":"2024-09-10T14:33:18.801216+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:33:18.801216+0000","last_undegraded":"2024-09-10T14:33:18.801216+0000","last_fullsized":"2024-09-10T14:33:18.801216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:33:18.801021+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:33:18.801021+0000","last_clean_scrub_stamp":"2024-09-10T14:33:18.801021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:34.431828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.127208+0000","last_change":"2024-09-10T14:33:13.127336+0000","last_active":"2024-09-10T14:33:13.127208+0000","last_peered":"2024-09-10T14:33:13.127208+0000","last_clean":"2024-09-10T14:33:13.127208+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:33:13.127208+0000","last_undegraded":"2024-09-10T14:33:13.127208+0000","last_fullsized":"2024-09-10T14:33:13.127208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:13.126986+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:13.126986+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.126986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:19.523672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.366239+0000","last_change":"2024-09-10T14:33:01.366298+0000","last_active":"2024-09-10T14:33:01.366239+0000","last_peered":"2024-09-10T14:33:01.366239+0000","last_clean":"2024-09-10T14:33:01.366239+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:33:01.366239+0000","last_undegraded":"2024-09-10T14:33:01.366239+0000","last_fullsized":"2024-09-10T14:33:01.366239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:01.366030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:01.366030+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.366030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:31.331688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.104961+0000","last_change":"2024-09-10T14:33:08.105090+0000","last_active":"2024-09-10T14:33:08.104961+0000","last_peered":"2024-09-10T14:33:08.104961+0000","last_clean":"2024-09-10T14:33:08.104961+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:33:08.104961+0000","last_undegraded":"2024-09-10T14:33:08.104961+0000","last_fullsized":"2024-09-10T14:33:08.104961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:08.104703+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:08.104703+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.104703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.825132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.335896+0000","last_change":"2024-09-10T14:32:44.335896+0000","last_active":"2024-09-10T14:32:44.335896+0000","last_peered":"2024-09-10T14:32:44.335896+0000","last_clean":"2024-09-10T14:32:44.335896+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:32:44.335896+0000","last_undegraded":"2024-09-10T14:32:44.335896+0000","last_fullsized":"2024-09-10T14:32:44.335896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:44.335653+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:44.335653+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.335653+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:10.314679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'24","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.504309+0000","last_change":"2024-09-10T14:32:36.504309+0000","last_active":"2024-09-10T14:32:36.504309+0000","last_peered":"2024-09-10T14:32:36.504309+0000","last_clean":"2024-09-10T14:32:36.504309+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:32:36.504309+0000","last_undegraded":"2024-09-10T14:32:36.504309+0000","last_fullsized":"2024-09-10T14:32:36.504309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.504009+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:54.102292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.223829+0000","last_change":"2024-09-10T14:32:35.223829+0000","last_active":"2024-09-10T14:32:35.223829+0000","last_peered":"2024-09-10T14:32:35.223829+0000","last_clean":"2024-09-10T14:32:35.223829+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:32:35.223829+0000","last_undegraded":"2024-09-10T14:32:35.223829+0000","last_fullsized":"2024-09-10T14:32:35.223829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.223582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:41.920597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243217+0000","last_change":"2024-09-10T14:28:38.943308+0000","last_active":"2024-09-10T14:32:20.243217+0000","last_peered":"2024-09-10T14:32:20.243217+0000","last_clean":"2024-09-10T14:32:20.243217+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:32:20.243217+0000","last_undegraded":"2024-09-10T14:32:20.243217+0000","last_fullsized":"2024-09-10T14:32:20.243217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.202665+0000","last_change":"2024-09-10T14:32:51.202723+0000","last_active":"2024-09-10T14:32:51.202665+0000","last_peered":"2024-09-10T14:32:51.202665+0000","last_clean":"2024-09-10T14:32:51.202665+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:32:51.202665+0000","last_undegraded":"2024-09-10T14:32:51.202665+0000","last_fullsized":"2024-09-10T14:32:51.202665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:51.202477+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:51.202477+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.202477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:44.072182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240672+0000","last_change":"2024-09-10T14:28:21.325127+0000","last_active":"2024-09-10T14:32:20.240672+0000","last_peered":"2024-09-10T14:32:20.240672+0000","last_clean":"2024-09-10T14:32:20.240672+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:32:20.240672+0000","last_undegraded":"2024-09-10T14:32:20.240672+0000","last_fullsized":"2024-09-10T14:32:20.240672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.348723+0000","last_change":"2024-09-10T14:33:03.348790+0000","last_active":"2024-09-10T14:33:03.348723+0000","last_peered":"2024-09-10T14:33:03.348723+0000","last_clean":"2024-09-10T14:33:03.348723+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:33:03.348723+0000","last_undegraded":"2024-09-10T14:33:03.348723+0000","last_fullsized":"2024-09-10T14:33:03.348723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.348519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.348519+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.348519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:28.975289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.202503+0000","last_change":"2024-09-10T14:32:34.202503+0000","last_active":"2024-09-10T14:32:34.202503+0000","last_peered":"2024-09-10T14:32:34.202503+0000","last_clean":"2024-09-10T14:32:34.202503+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:32:34.202503+0000","last_undegraded":"2024-09-10T14:32:34.202503+0000","last_fullsized":"2024-09-10T14:32:34.202503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.202259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:34.865922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.472613+0000","last_change":"2024-09-10T14:32:46.472613+0000","last_active":"2024-09-10T14:32:46.472613+0000","last_peered":"2024-09-10T14:32:46.472613+0000","last_clean":"2024-09-10T14:32:46.472613+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:32:46.472613+0000","last_undegraded":"2024-09-10T14:32:46.472613+0000","last_fullsized":"2024-09-10T14:32:46.472613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-10T14:32:46.472335+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-10T14:32:46.472335+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.472335+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:11:41.354491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.482747+0000","last_change":"2024-09-10T14:32:43.482747+0000","last_active":"2024-09-10T14:32:43.482747+0000","last_peered":"2024-09-10T14:32:43.482747+0000","last_clean":"2024-09-10T14:32:43.482747+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:32:43.482747+0000","last_undegraded":"2024-09-10T14:32:43.482747+0000","last_fullsized":"2024-09-10T14:32:43.482747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:43.482370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:43.482370+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.482370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:32.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.908593+0000","last_change":"2024-09-10T14:32:46.908593+0000","last_active":"2024-09-10T14:32:46.908593+0000","last_peered":"2024-09-10T14:32:46.908593+0000","last_clean":"2024-09-10T14:32:46.908593+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:32:46.908593+0000","last_undegraded":"2024-09-10T14:32:46.908593+0000","last_fullsized":"2024-09-10T14:32:46.908593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:46.908307+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:46.908307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.908307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:02.194310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.889550+0000","last_change":"2024-09-10T14:32:47.889610+0000","last_active":"2024-09-10T14:32:47.889550+0000","last_peered":"2024-09-10T14:32:47.889550+0000","last_clean":"2024-09-10T14:32:47.889550+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:32:47.889550+0000","last_undegraded":"2024-09-10T14:32:47.889550+0000","last_fullsized":"2024-09-10T14:32:47.889550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:47.889337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:47.889337+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.889337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:25:53.199083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.349827+0000","last_change":"2024-09-10T14:32:54.349892+0000","last_active":"2024-09-10T14:32:54.349827+0000","last_peered":"2024-09-10T14:32:54.349827+0000","last_clean":"2024-09-10T14:32:54.349827+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:32:54.349827+0000","last_undegraded":"2024-09-10T14:32:54.349827+0000","last_fullsized":"2024-09-10T14:32:54.349827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:54.349626+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:54.349626+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.349626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.122241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.107484+0000","last_change":"2024-09-10T14:33:05.107539+0000","last_active":"2024-09-10T14:33:05.107484+0000","last_peered":"2024-09-10T14:33:05.107484+0000","last_clean":"2024-09-10T14:33:05.107484+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:33:05.107484+0000","last_undegraded":"2024-09-10T14:33:05.107484+0000","last_fullsized":"2024-09-10T14:33:05.107484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.107286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.107286+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.107286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:05.392930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.405071+0000","last_change":"2024-09-10T14:33:12.405071+0000","last_active":"2024-09-10T14:33:12.405071+0000","last_peered":"2024-09-10T14:33:12.405071+0000","last_clean":"2024-09-10T14:33:12.405071+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:33:12.405071+0000","last_undegraded":"2024-09-10T14:33:12.405071+0000","last_fullsized":"2024-09-10T14:33:12.405071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:12.404820+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:12.404820+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.404820+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.685015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'74","reported_seq":153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.093004+0000","last_change":"2024-09-10T14:32:29.093004+0000","last_active":"2024-09-10T14:32:29.093004+0000","last_peered":"2024-09-10T14:32:29.093004+0000","last_clean":"2024-09-10T14:32:29.093004+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:32:29.093004+0000","last_undegraded":"2024-09-10T14:32:29.093004+0000","last_fullsized":"2024-09-10T14:32:29.093004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.092705+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:13.603769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.438626+0000","last_change":"2024-09-10T14:32:24.438626+0000","last_active":"2024-09-10T14:32:24.438626+0000","last_peered":"2024-09-10T14:32:24.438626+0000","last_clean":"2024-09-10T14:32:24.438626+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:32:24.438626+0000","last_undegraded":"2024-09-10T14:32:24.438626+0000","last_fullsized":"2024-09-10T14:32:24.438626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.438373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:44.201354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.129819+0000","last_change":"2024-09-10T14:33:15.129881+0000","last_active":"2024-09-10T14:33:15.129819+0000","last_peered":"2024-09-10T14:33:15.129819+0000","last_clean":"2024-09-10T14:33:15.129819+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:33:15.129819+0000","last_undegraded":"2024-09-10T14:33:15.129819+0000","last_fullsized":"2024-09-10T14:33:15.129819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-10T14:33:15.129629+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-10T14:33:15.129629+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.129629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:01.550502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.900251+0000","last_change":"2024-09-10T14:32:43.900313+0000","last_active":"2024-09-10T14:32:43.900251+0000","last_peered":"2024-09-10T14:32:43.900251+0000","last_clean":"2024-09-10T14:32:43.900251+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:32:43.900251+0000","last_undegraded":"2024-09-10T14:32:43.900251+0000","last_fullsized":"2024-09-10T14:32:43.900251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:43.900061+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:43.900061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.900061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:35.816795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.216970+0000","last_change":"2024-09-10T14:32:52.217031+0000","last_active":"2024-09-10T14:32:52.216970+0000","last_peered":"2024-09-10T14:32:52.216970+0000","last_clean":"2024-09-10T14:32:52.216970+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:32:52.216970+0000","last_undegraded":"2024-09-10T14:32:52.216970+0000","last_fullsized":"2024-09-10T14:32:52.216970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:52.216776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:52.216776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.216776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:17.684116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240674+0000","last_change":"2024-09-10T14:28:21.325419+0000","last_active":"2024-09-10T14:32:20.240674+0000","last_peered":"2024-09-10T14:32:20.240674+0000","last_clean":"2024-09-10T14:32:20.240674+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:32:20.240674+0000","last_undegraded":"2024-09-10T14:32:20.240674+0000","last_fullsized":"2024-09-10T14:32:20.240674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.399267+0000","last_change":"2024-09-10T14:32:28.399267+0000","last_active":"2024-09-10T14:32:28.399267+0000","last_peered":"2024-09-10T14:32:28.399267+0000","last_clean":"2024-09-10T14:32:28.399267+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:32:28.399267+0000","last_undegraded":"2024-09-10T14:32:28.399267+0000","last_fullsized":"2024-09-10T14:32:28.399267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.398875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:59.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'22","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.978344+0000","last_change":"2024-09-10T14:32:20.978344+0000","last_active":"2024-09-10T14:32:20.978344+0000","last_peered":"2024-09-10T14:32:20.978344+0000","last_clean":"2024-09-10T14:32:20.978344+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:32:20.978344+0000","last_undegraded":"2024-09-10T14:32:20.978344+0000","last_fullsized":"2024-09-10T14:32:20.978344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.978065+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:42.621330+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":390,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.978149+0000","last_change":"2024-09-10T14:32:22.978149+0000","last_active":"2024-09-10T14:32:22.978149+0000","last_peered":"2024-09-10T14:32:22.978149+0000","last_clean":"2024-09-10T14:32:22.978149+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:32:22.978149+0000","last_undegraded":"2024-09-10T14:32:22.978149+0000","last_fullsized":"2024-09-10T14:32:22.978149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.977905+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:38.553496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.459799+0000","last_change":"2024-09-10T14:33:07.459799+0000","last_active":"2024-09-10T14:33:07.459799+0000","last_peered":"2024-09-10T14:33:07.459799+0000","last_clean":"2024-09-10T14:33:07.459799+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:33:07.459799+0000","last_undegraded":"2024-09-10T14:33:07.459799+0000","last_fullsized":"2024-09-10T14:33:07.459799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:07.459543+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:07.459543+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.459543+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:50.151279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.418284+0000","last_change":"2024-09-10T14:32:37.418352+0000","last_active":"2024-09-10T14:32:37.418284+0000","last_peered":"2024-09-10T14:32:37.418284+0000","last_clean":"2024-09-10T14:32:37.418284+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:32:37.418284+0000","last_undegraded":"2024-09-10T14:32:37.418284+0000","last_fullsized":"2024-09-10T14:32:37.418284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.418081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:08.888989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.498661+0000","last_change":"2024-09-10T14:33:17.498728+0000","last_active":"2024-09-10T14:33:17.498661+0000","last_peered":"2024-09-10T14:33:17.498661+0000","last_clean":"2024-09-10T14:33:17.498661+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:33:17.498661+0000","last_undegraded":"2024-09-10T14:33:17.498661+0000","last_fullsized":"2024-09-10T14:33:17.498661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:17.498459+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:17.498459+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.498459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:25.319966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.087189+0000","last_change":"2024-09-10T14:33:06.087245+0000","last_active":"2024-09-10T14:33:06.087189+0000","last_peered":"2024-09-10T14:33:06.087189+0000","last_clean":"2024-09-10T14:33:06.087189+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:33:06.087189+0000","last_undegraded":"2024-09-10T14:33:06.087189+0000","last_fullsized":"2024-09-10T14:33:06.087189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:06.086999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:06.086999+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.086999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:08.232070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.448927+0000","last_change":"2024-09-10T14:32:29.448927+0000","last_active":"2024-09-10T14:32:29.448927+0000","last_peered":"2024-09-10T14:32:29.448927+0000","last_clean":"2024-09-10T14:32:29.448927+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:32:29.448927+0000","last_undegraded":"2024-09-10T14:32:29.448927+0000","last_fullsized":"2024-09-10T14:32:29.448927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.448685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:13.499393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.429507+0000","last_change":"2024-09-10T14:32:35.429507+0000","last_active":"2024-09-10T14:32:35.429507+0000","last_peered":"2024-09-10T14:32:35.429507+0000","last_clean":"2024-09-10T14:32:35.429507+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:32:35.429507+0000","last_undegraded":"2024-09-10T14:32:35.429507+0000","last_fullsized":"2024-09-10T14:32:35.429507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.429210+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:32.213391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":405,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.060686+0000","last_change":"2024-09-10T14:32:25.060686+0000","last_active":"2024-09-10T14:32:25.060686+0000","last_peered":"2024-09-10T14:32:25.060686+0000","last_clean":"2024-09-10T14:32:25.060686+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:32:25.060686+0000","last_undegraded":"2024-09-10T14:32:25.060686+0000","last_fullsized":"2024-09-10T14:32:25.060686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.060434+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:01.652381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.824552+0000","last_change":"2024-09-10T14:33:15.824613+0000","last_active":"2024-09-10T14:33:15.824552+0000","last_peered":"2024-09-10T14:33:15.824552+0000","last_clean":"2024-09-10T14:33:15.824552+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:33:15.824552+0000","last_undegraded":"2024-09-10T14:33:15.824552+0000","last_fullsized":"2024-09-10T14:33:15.824552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-10T14:33:15.824338+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-10T14:33:15.824338+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.824338+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:52.564936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.320535+0000","last_change":"2024-09-10T14:32:59.320601+0000","last_active":"2024-09-10T14:32:59.320535+0000","last_peered":"2024-09-10T14:32:59.320535+0000","last_clean":"2024-09-10T14:32:59.320535+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:32:59.320535+0000","last_undegraded":"2024-09-10T14:32:59.320535+0000","last_fullsized":"2024-09-10T14:32:59.320535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:59.320328+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:59.320328+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.320328+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:35.873871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.786494+0000","last_change":"2024-09-10T14:32:59.786629+0000","last_active":"2024-09-10T14:32:59.786494+0000","last_peered":"2024-09-10T14:32:59.786494+0000","last_clean":"2024-09-10T14:32:59.786494+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:32:59.786494+0000","last_undegraded":"2024-09-10T14:32:59.786494+0000","last_fullsized":"2024-09-10T14:32:59.786494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:59.786205+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:59.786205+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.786205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:49.511711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.240704+0000","last_change":"2024-09-10T14:28:21.325801+0000","last_active":"2024-09-10T14:32:20.240704+0000","last_peered":"2024-09-10T14:32:20.240704+0000","last_clean":"2024-09-10T14:32:20.240704+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:32:20.240704+0000","last_undegraded":"2024-09-10T14:32:20.240704+0000","last_fullsized":"2024-09-10T14:32:20.240704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:18.297324+0000","last_clean_scrub_stamp":"2024-09-10T14:28:18.297324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.463375+0000","last_change":"2024-09-10T14:32:30.463375+0000","last_active":"2024-09-10T14:32:30.463375+0000","last_peered":"2024-09-10T14:32:30.463375+0000","last_clean":"2024-09-10T14:32:30.463375+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:32:30.463375+0000","last_undegraded":"2024-09-10T14:32:30.463375+0000","last_fullsized":"2024-09-10T14:32:30.463375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.463102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:57.418601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.519074+0000","last_change":"2024-09-10T14:32:30.519074+0000","last_active":"2024-09-10T14:32:30.519074+0000","last_peered":"2024-09-10T14:32:30.519074+0000","last_clean":"2024-09-10T14:32:30.519074+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:32:30.519074+0000","last_undegraded":"2024-09-10T14:32:30.519074+0000","last_fullsized":"2024-09-10T14:32:30.519074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'97","last_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_deep_scrub":"36'97","last_deep_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.518776+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:01.405166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.030434+0000","last_change":"2024-09-10T14:32:22.030434+0000","last_active":"2024-09-10T14:32:22.030434+0000","last_peered":"2024-09-10T14:32:22.030434+0000","last_clean":"2024-09-10T14:32:22.030434+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:32:22.030434+0000","last_undegraded":"2024-09-10T14:32:22.030434+0000","last_fullsized":"2024-09-10T14:32:22.030434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.030103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:44.176468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.500613+0000","last_change":"2024-09-10T14:32:35.500613+0000","last_active":"2024-09-10T14:32:35.500613+0000","last_peered":"2024-09-10T14:32:35.500613+0000","last_clean":"2024-09-10T14:32:35.500613+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:32:35.500613+0000","last_undegraded":"2024-09-10T14:32:35.500613+0000","last_fullsized":"2024-09-10T14:32:35.500613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:58.771563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.327446+0000","last_change":"2024-09-10T14:33:10.327507+0000","last_active":"2024-09-10T14:33:10.327446+0000","last_peered":"2024-09-10T14:33:10.327446+0000","last_clean":"2024-09-10T14:33:10.327446+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:33:10.327446+0000","last_undegraded":"2024-09-10T14:33:10.327446+0000","last_fullsized":"2024-09-10T14:33:10.327446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:10.327230+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:10.327230+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.327230+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:02.825425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.340093+0000","last_change":"2024-09-10T14:33:09.340093+0000","last_active":"2024-09-10T14:33:09.340093+0000","last_peered":"2024-09-10T14:33:09.340093+0000","last_clean":"2024-09-10T14:33:09.340093+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:33:09.340093+0000","last_undegraded":"2024-09-10T14:33:09.340093+0000","last_fullsized":"2024-09-10T14:33:09.340093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:33:09.339845+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:33:09.339845+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.339845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:13.502557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:18.458801+0000","last_change":"2024-09-10T14:33:18.458870+0000","last_active":"2024-09-10T14:33:18.458801+0000","last_peered":"2024-09-10T14:33:18.458801+0000","last_clean":"2024-09-10T14:33:18.458801+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:33:18.458801+0000","last_undegraded":"2024-09-10T14:33:18.458801+0000","last_fullsized":"2024-09-10T14:33:18.458801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:18.458581+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:18.458581+0000","last_clean_scrub_stamp":"2024-09-10T14:33:18.458581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:45.262719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.968430+0000","last_change":"2024-09-10T14:32:33.968430+0000","last_active":"2024-09-10T14:32:33.968430+0000","last_peered":"2024-09-10T14:32:33.968430+0000","last_clean":"2024-09-10T14:32:33.968430+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:32:33.968430+0000","last_undegraded":"2024-09-10T14:32:33.968430+0000","last_fullsized":"2024-09-10T14:32:33.968430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.968186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.923144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.456201+0000","last_change":"2024-09-10T14:32:25.456201+0000","last_active":"2024-09-10T14:32:25.456201+0000","last_peered":"2024-09-10T14:32:25.456201+0000","last_clean":"2024-09-10T14:32:25.456201+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:32:25.456201+0000","last_undegraded":"2024-09-10T14:32:25.456201+0000","last_fullsized":"2024-09-10T14:32:25.456201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.455949+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:59.272502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.512838+0000","last_change":"2024-09-10T14:32:42.512838+0000","last_active":"2024-09-10T14:32:42.512838+0000","last_peered":"2024-09-10T14:32:42.512838+0000","last_clean":"2024-09-10T14:32:42.512838+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:32:42.512838+0000","last_undegraded":"2024-09-10T14:32:42.512838+0000","last_fullsized":"2024-09-10T14:32:42.512838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.512582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.512582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.512582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:04.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.084205+0000","last_change":"2024-09-10T14:33:14.084271+0000","last_active":"2024-09-10T14:33:14.084205+0000","last_peered":"2024-09-10T14:33:14.084205+0000","last_clean":"2024-09-10T14:33:14.084205+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:33:14.084205+0000","last_undegraded":"2024-09-10T14:33:14.084205+0000","last_fullsized":"2024-09-10T14:33:14.084205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:33:14.084014+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:33:14.084014+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.084014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:55.111847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.373065+0000","last_change":"2024-09-10T14:33:11.373126+0000","last_active":"2024-09-10T14:33:11.373065+0000","last_peered":"2024-09-10T14:33:11.373065+0000","last_clean":"2024-09-10T14:33:11.373065+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:33:11.373065+0000","last_undegraded":"2024-09-10T14:33:11.373065+0000","last_fullsized":"2024-09-10T14:33:11.373065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:11.372880+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:11.372880+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.372880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:04.456691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.322933+0000","last_change":"2024-09-10T14:33:08.322933+0000","last_active":"2024-09-10T14:33:08.322933+0000","last_peered":"2024-09-10T14:33:08.322933+0000","last_clean":"2024-09-10T14:33:08.322933+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:33:08.322933+0000","last_undegraded":"2024-09-10T14:33:08.322933+0000","last_fullsized":"2024-09-10T14:33:08.322933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:08.322679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:08.322679+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.322679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:48.922910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.411370+0000","last_change":"2024-09-10T14:32:20.411370+0000","last_active":"2024-09-10T14:32:20.411370+0000","last_peered":"2024-09-10T14:32:20.411370+0000","last_clean":"2024-09-10T14:32:20.411370+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:32:20.411370+0000","last_undegraded":"2024-09-10T14:32:20.411370+0000","last_fullsized":"2024-09-10T14:32:20.411370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.411095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:12.327829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.216290+0000","last_change":"2024-09-10T14:32:33.216290+0000","last_active":"2024-09-10T14:32:33.216290+0000","last_peered":"2024-09-10T14:32:33.216290+0000","last_clean":"2024-09-10T14:32:33.216290+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:32:33.216290+0000","last_undegraded":"2024-09-10T14:32:33.216290+0000","last_fullsized":"2024-09-10T14:32:33.216290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.216034+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:39:05.267034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.415600+0000","last_change":"2024-09-10T14:32:23.415600+0000","last_active":"2024-09-10T14:32:23.415600+0000","last_peered":"2024-09-10T14:32:23.415600+0000","last_clean":"2024-09-10T14:32:23.415600+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:32:23.415600+0000","last_undegraded":"2024-09-10T14:32:23.415600+0000","last_fullsized":"2024-09-10T14:32:23.415600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.415359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:40.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:12.782563+0000","last_change":"2024-09-10T14:28:38.936365+0000","last_active":"2024-09-10T14:31:12.782563+0000","last_peered":"2024-09-10T14:31:12.782563+0000","last_clean":"2024-09-10T14:31:12.782563+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:31:12.782563+0000","last_undegraded":"2024-09-10T14:31:12.782563+0000","last_fullsized":"2024-09-10T14:31:12.782563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.119067+0000","last_change":"2024-09-10T14:32:59.119067+0000","last_active":"2024-09-10T14:32:59.119067+0000","last_peered":"2024-09-10T14:32:59.119067+0000","last_clean":"2024-09-10T14:32:59.119067+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:32:59.119067+0000","last_undegraded":"2024-09-10T14:32:59.119067+0000","last_fullsized":"2024-09-10T14:32:59.119067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:59.118814+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:59.118814+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.118814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.685082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.357531+0000","last_change":"2024-09-10T14:33:07.357531+0000","last_active":"2024-09-10T14:33:07.357531+0000","last_peered":"2024-09-10T14:33:07.357531+0000","last_clean":"2024-09-10T14:33:07.357531+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:33:07.357531+0000","last_undegraded":"2024-09-10T14:33:07.357531+0000","last_fullsized":"2024-09-10T14:33:07.357531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:07.357254+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:07.357254+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.357254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:53.771292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.376579+0000","last_change":"2024-09-10T14:32:42.376579+0000","last_active":"2024-09-10T14:32:42.376579+0000","last_peered":"2024-09-10T14:32:42.376579+0000","last_clean":"2024-09-10T14:32:42.376579+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:32:42.376579+0000","last_undegraded":"2024-09-10T14:32:42.376579+0000","last_fullsized":"2024-09-10T14:32:42.376579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.376307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.376307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.376307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:00.174752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.137615+0000","last_change":"2024-09-10T14:32:30.137615+0000","last_active":"2024-09-10T14:32:30.137615+0000","last_peered":"2024-09-10T14:32:30.137615+0000","last_clean":"2024-09-10T14:32:30.137615+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:32:30.137615+0000","last_undegraded":"2024-09-10T14:32:30.137615+0000","last_fullsized":"2024-09-10T14:32:30.137615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.137220+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:57.841349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.938967+0000","last_change":"2024-09-10T14:32:19.938967+0000","last_active":"2024-09-10T14:32:19.938967+0000","last_peered":"2024-09-10T14:32:19.938967+0000","last_clean":"2024-09-10T14:32:19.938967+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:32:19.938967+0000","last_undegraded":"2024-09-10T14:32:19.938967+0000","last_fullsized":"2024-09-10T14:32:19.938967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.938638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:13.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.459989+0000","last_change":"2024-09-10T14:33:03.460042+0000","last_active":"2024-09-10T14:33:03.459989+0000","last_peered":"2024-09-10T14:33:03.459989+0000","last_clean":"2024-09-10T14:33:03.459989+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:33:03.459989+0000","last_undegraded":"2024-09-10T14:33:03.459989+0000","last_fullsized":"2024-09-10T14:33:03.459989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.459797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.459797+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.459797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:52.465854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.406947+0000","last_change":"2024-09-10T14:33:13.407103+0000","last_active":"2024-09-10T14:33:13.406947+0000","last_peered":"2024-09-10T14:33:13.406947+0000","last_clean":"2024-09-10T14:33:13.406947+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:33:13.406947+0000","last_undegraded":"2024-09-10T14:33:13.406947+0000","last_fullsized":"2024-09-10T14:33:13.406947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:13.406701+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:13.406701+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.406701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:24.803644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.753358+0000","last_change":"2024-09-10T14:33:11.753358+0000","last_active":"2024-09-10T14:33:11.753358+0000","last_peered":"2024-09-10T14:33:11.753358+0000","last_clean":"2024-09-10T14:33:11.753358+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:33:11.753358+0000","last_undegraded":"2024-09-10T14:33:11.753358+0000","last_fullsized":"2024-09-10T14:33:11.753358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:11.753081+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:11.753081+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.753081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:15.257691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.446266+0000","last_change":"2024-09-10T14:32:26.446266+0000","last_active":"2024-09-10T14:32:26.446266+0000","last_peered":"2024-09-10T14:32:26.446266+0000","last_clean":"2024-09-10T14:32:26.446266+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:32:26.446266+0000","last_undegraded":"2024-09-10T14:32:26.446266+0000","last_fullsized":"2024-09-10T14:32:26.446266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.446026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:41.594078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'39","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.497756+0000","last_change":"2024-09-10T14:32:32.497756+0000","last_active":"2024-09-10T14:32:32.497756+0000","last_peered":"2024-09-10T14:32:32.497756+0000","last_clean":"2024-09-10T14:32:32.497756+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:32:32.497756+0000","last_undegraded":"2024-09-10T14:32:32.497756+0000","last_fullsized":"2024-09-10T14:32:32.497756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.497494+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:32.552961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.396828+0000","last_change":"2024-09-10T14:32:25.396828+0000","last_active":"2024-09-10T14:32:25.396828+0000","last_peered":"2024-09-10T14:32:25.396828+0000","last_clean":"2024-09-10T14:32:25.396828+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:32:25.396828+0000","last_undegraded":"2024-09-10T14:32:25.396828+0000","last_fullsized":"2024-09-10T14:32:25.396828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.396450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:54.696304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.428617+0000","last_change":"2024-09-10T14:33:00.428768+0000","last_active":"2024-09-10T14:33:00.428617+0000","last_peered":"2024-09-10T14:33:00.428617+0000","last_clean":"2024-09-10T14:33:00.428617+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:33:00.428617+0000","last_undegraded":"2024-09-10T14:33:00.428617+0000","last_fullsized":"2024-09-10T14:33:00.428617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:00.428387+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:00.428387+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.428387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:05.637821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.456004+0000","last_change":"2024-09-10T14:33:12.456004+0000","last_active":"2024-09-10T14:33:12.456004+0000","last_peered":"2024-09-10T14:33:12.456004+0000","last_clean":"2024-09-10T14:33:12.456004+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:33:12.456004+0000","last_undegraded":"2024-09-10T14:33:12.456004+0000","last_fullsized":"2024-09-10T14:33:12.456004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:12.455745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:12.455745+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.455745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:47.543012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.388113+0000","last_change":"2024-09-10T14:33:16.388166+0000","last_active":"2024-09-10T14:33:16.388113+0000","last_peered":"2024-09-10T14:33:16.388113+0000","last_clean":"2024-09-10T14:33:16.388113+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:33:16.388113+0000","last_undegraded":"2024-09-10T14:33:16.388113+0000","last_fullsized":"2024-09-10T14:33:16.388113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:16.387926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:16.387926+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.387926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:05.269165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.180889+0000","last_change":"2024-09-10T14:32:32.180966+0000","last_active":"2024-09-10T14:32:32.180889+0000","last_peered":"2024-09-10T14:32:32.180889+0000","last_clean":"2024-09-10T14:32:32.180889+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:32:32.180889+0000","last_undegraded":"2024-09-10T14:32:32.180889+0000","last_fullsized":"2024-09-10T14:32:32.180889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.180675+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:49.216006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.442239+0000","last_change":"2024-09-10T14:32:26.442290+0000","last_active":"2024-09-10T14:32:26.442239+0000","last_peered":"2024-09-10T14:32:26.442239+0000","last_clean":"2024-09-10T14:32:26.442239+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:32:26.442239+0000","last_undegraded":"2024-09-10T14:32:26.442239+0000","last_fullsized":"2024-09-10T14:32:26.442239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.442018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:13.048162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.122589+0000","last_change":"2024-09-10T14:33:17.122653+0000","last_active":"2024-09-10T14:33:17.122589+0000","last_peered":"2024-09-10T14:33:17.122589+0000","last_clean":"2024-09-10T14:33:17.122589+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:33:17.122589+0000","last_undegraded":"2024-09-10T14:33:17.122589+0000","last_fullsized":"2024-09-10T14:33:17.122589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:33:17.122374+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:33:17.122374+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.122374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:34.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.183816+0000","last_change":"2024-09-10T14:33:01.183874+0000","last_active":"2024-09-10T14:33:01.183816+0000","last_peered":"2024-09-10T14:33:01.183816+0000","last_clean":"2024-09-10T14:33:01.183816+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:33:01.183816+0000","last_undegraded":"2024-09-10T14:33:01.183816+0000","last_fullsized":"2024-09-10T14:33:01.183816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:01.183629+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:01.183629+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.183629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:49:35.104259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.953816+0000","last_change":"2024-09-10T14:32:53.953816+0000","last_active":"2024-09-10T14:32:53.953816+0000","last_peered":"2024-09-10T14:32:53.953816+0000","last_clean":"2024-09-10T14:32:53.953816+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:32:53.953816+0000","last_undegraded":"2024-09-10T14:32:53.953816+0000","last_fullsized":"2024-09-10T14:32:53.953816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:53.953557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:53.953557+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.953557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:49.917322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.397408+0000","last_change":"2024-09-10T14:32:40.397408+0000","last_active":"2024-09-10T14:32:40.397408+0000","last_peered":"2024-09-10T14:32:40.397408+0000","last_clean":"2024-09-10T14:32:40.397408+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:32:40.397408+0000","last_undegraded":"2024-09-10T14:32:40.397408+0000","last_fullsized":"2024-09-10T14:32:40.397408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:40.397100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:40.397100+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.397100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:50.928172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'46","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.451034+0000","last_change":"2024-09-10T14:32:50.451198+0000","last_active":"2024-09-10T14:32:50.451034+0000","last_peered":"2024-09-10T14:32:50.451034+0000","last_clean":"2024-09-10T14:32:50.451034+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:32:50.451034+0000","last_undegraded":"2024-09-10T14:32:50.451034+0000","last_fullsized":"2024-09-10T14:32:50.451034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-10T14:32:50.450750+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-10T14:32:50.450750+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.450750+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:43.680846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.965124+0000","last_change":"2024-09-10T14:32:38.965177+0000","last_active":"2024-09-10T14:32:38.965124+0000","last_peered":"2024-09-10T14:32:38.965124+0000","last_clean":"2024-09-10T14:32:38.965124+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:32:38.965124+0000","last_undegraded":"2024-09-10T14:32:38.965124+0000","last_fullsized":"2024-09-10T14:32:38.965124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.964897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.964897+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.964897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:32.019878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243723+0000","last_change":"2024-09-10T14:28:38.943738+0000","last_active":"2024-09-10T14:32:20.243723+0000","last_peered":"2024-09-10T14:32:20.243723+0000","last_clean":"2024-09-10T14:32:20.243723+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:32:20.243723+0000","last_undegraded":"2024-09-10T14:32:20.243723+0000","last_fullsized":"2024-09-10T14:32:20.243723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.463872+0000","last_change":"2024-09-10T14:32:34.464002+0000","last_active":"2024-09-10T14:32:34.463872+0000","last_peered":"2024-09-10T14:32:34.463872+0000","last_clean":"2024-09-10T14:32:34.463872+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:32:34.463872+0000","last_undegraded":"2024-09-10T14:32:34.463872+0000","last_fullsized":"2024-09-10T14:32:34.463872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.463639+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:46.301912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.766751+0000","last_change":"2024-09-10T14:33:01.766808+0000","last_active":"2024-09-10T14:33:01.766751+0000","last_peered":"2024-09-10T14:33:01.766751+0000","last_clean":"2024-09-10T14:33:01.766751+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:33:01.766751+0000","last_undegraded":"2024-09-10T14:33:01.766751+0000","last_fullsized":"2024-09-10T14:33:01.766751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:01.766540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:01.766540+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.766540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:12.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.435870+0000","last_change":"2024-09-10T14:32:38.435925+0000","last_active":"2024-09-10T14:32:38.435870+0000","last_peered":"2024-09-10T14:32:38.435870+0000","last_clean":"2024-09-10T14:32:38.435870+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:32:38.435870+0000","last_undegraded":"2024-09-10T14:32:38.435870+0000","last_fullsized":"2024-09-10T14:32:38.435870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.435674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:15.679874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.074597+0000","last_change":"2024-09-10T14:32:28.074597+0000","last_active":"2024-09-10T14:32:28.074597+0000","last_peered":"2024-09-10T14:32:28.074597+0000","last_clean":"2024-09-10T14:32:28.074597+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:32:28.074597+0000","last_undegraded":"2024-09-10T14:32:28.074597+0000","last_fullsized":"2024-09-10T14:32:28.074597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.074323+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:22.414417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.062808+0000","last_change":"2024-09-10T14:32:20.062808+0000","last_active":"2024-09-10T14:32:20.062808+0000","last_peered":"2024-09-10T14:32:20.062808+0000","last_clean":"2024-09-10T14:32:20.062808+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:32:20.062808+0000","last_undegraded":"2024-09-10T14:32:20.062808+0000","last_fullsized":"2024-09-10T14:32:20.062808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.062623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:35.638214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243770+0000","last_change":"2024-09-10T14:28:38.940779+0000","last_active":"2024-09-10T14:32:20.243770+0000","last_peered":"2024-09-10T14:32:20.243770+0000","last_clean":"2024-09-10T14:32:20.243770+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:32:20.243770+0000","last_undegraded":"2024-09-10T14:32:20.243770+0000","last_fullsized":"2024-09-10T14:32:20.243770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.181120+0000","last_change":"2024-09-10T14:32:53.181182+0000","last_active":"2024-09-10T14:32:53.181120+0000","last_peered":"2024-09-10T14:32:53.181120+0000","last_clean":"2024-09-10T14:32:53.181120+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:32:53.181120+0000","last_undegraded":"2024-09-10T14:32:53.181120+0000","last_fullsized":"2024-09-10T14:32:53.181120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:53.180924+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:53.180924+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.180924+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:45.585973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.446243+0000","last_change":"2024-09-10T14:33:13.446414+0000","last_active":"2024-09-10T14:33:13.446243+0000","last_peered":"2024-09-10T14:33:13.446243+0000","last_clean":"2024-09-10T14:33:13.446243+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:33:13.446243+0000","last_undegraded":"2024-09-10T14:33:13.446243+0000","last_fullsized":"2024-09-10T14:33:13.446243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:13.446014+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:13.446014+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.446014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:22.972308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.786425+0000","last_change":"2024-09-10T14:29:08.793243+0000","last_active":"2024-09-10T14:31:03.786425+0000","last_peered":"2024-09-10T14:31:03.786425+0000","last_clean":"2024-09-10T14:31:03.786425+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:31:03.786425+0000","last_undegraded":"2024-09-10T14:31:03.786425+0000","last_fullsized":"2024-09-10T14:31:03.786425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:31.838867+0000","last_clean_scrub_stamp":"2024-09-10T14:28:31.838867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.479162+0000","last_change":"2024-09-10T14:32:44.479239+0000","last_active":"2024-09-10T14:32:44.479162+0000","last_peered":"2024-09-10T14:32:44.479162+0000","last_clean":"2024-09-10T14:32:44.479162+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:32:44.479162+0000","last_undegraded":"2024-09-10T14:32:44.479162+0000","last_fullsized":"2024-09-10T14:32:44.479162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:44.478972+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:44.478972+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.478972+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:24:49.335138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.385755+0000","last_change":"2024-09-10T14:32:20.385755+0000","last_active":"2024-09-10T14:32:20.385755+0000","last_peered":"2024-09-10T14:32:20.385755+0000","last_clean":"2024-09-10T14:32:20.385755+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:32:20.385755+0000","last_undegraded":"2024-09-10T14:32:20.385755+0000","last_fullsized":"2024-09-10T14:32:20.385755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.385473+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:25.661393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.467356+0000","last_change":"2024-09-10T14:33:11.467356+0000","last_active":"2024-09-10T14:33:11.467356+0000","last_peered":"2024-09-10T14:33:11.467356+0000","last_clean":"2024-09-10T14:33:11.467356+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:33:11.467356+0000","last_undegraded":"2024-09-10T14:33:11.467356+0000","last_fullsized":"2024-09-10T14:33:11.467356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:11.467095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:11.467095+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.467095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:41.433173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.447294+0000","last_change":"2024-09-10T14:32:49.447355+0000","last_active":"2024-09-10T14:32:49.447294+0000","last_peered":"2024-09-10T14:32:49.447294+0000","last_clean":"2024-09-10T14:32:49.447294+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:32:49.447294+0000","last_undegraded":"2024-09-10T14:32:49.447294+0000","last_fullsized":"2024-09-10T14:32:49.447294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:49.447079+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:49.447079+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.447079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:01.531653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.854023+0000","last_change":"2024-09-10T14:33:05.854082+0000","last_active":"2024-09-10T14:33:05.854023+0000","last_peered":"2024-09-10T14:33:05.854023+0000","last_clean":"2024-09-10T14:33:05.854023+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:33:05.854023+0000","last_undegraded":"2024-09-10T14:33:05.854023+0000","last_fullsized":"2024-09-10T14:33:05.854023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.853820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.853820+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.853820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:14.746222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.954255+0000","last_change":"2024-09-10T14:32:35.954305+0000","last_active":"2024-09-10T14:32:35.954255+0000","last_peered":"2024-09-10T14:32:35.954255+0000","last_clean":"2024-09-10T14:32:35.954255+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:32:35.954255+0000","last_undegraded":"2024-09-10T14:32:35.954255+0000","last_fullsized":"2024-09-10T14:32:35.954255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.954067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:56.841551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'47","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.005299+0000","last_change":"2024-09-10T14:32:24.005471+0000","last_active":"2024-09-10T14:32:24.005299+0000","last_peered":"2024-09-10T14:32:24.005299+0000","last_clean":"2024-09-10T14:32:24.005299+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:32:24.005299+0000","last_undegraded":"2024-09-10T14:32:24.005299+0000","last_fullsized":"2024-09-10T14:32:24.005299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.005077+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:26.362032+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.075023+0000","last_change":"2024-09-10T14:32:23.075075+0000","last_active":"2024-09-10T14:32:23.075023+0000","last_peered":"2024-09-10T14:32:23.075023+0000","last_clean":"2024-09-10T14:32:23.075023+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:32:23.075023+0000","last_undegraded":"2024-09-10T14:32:23.075023+0000","last_fullsized":"2024-09-10T14:32:23.075023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.074819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:52.669431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.801775+0000","last_change":"2024-09-10T14:33:13.801833+0000","last_active":"2024-09-10T14:33:13.801775+0000","last_peered":"2024-09-10T14:33:13.801775+0000","last_clean":"2024-09-10T14:33:13.801775+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:33:13.801775+0000","last_undegraded":"2024-09-10T14:33:13.801775+0000","last_fullsized":"2024-09-10T14:33:13.801775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:33:13.801585+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:33:13.801585+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.801585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:09.632003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.350530+0000","last_change":"2024-09-10T14:32:46.350598+0000","last_active":"2024-09-10T14:32:46.350530+0000","last_peered":"2024-09-10T14:32:46.350530+0000","last_clean":"2024-09-10T14:32:46.350530+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:32:46.350530+0000","last_undegraded":"2024-09-10T14:32:46.350530+0000","last_fullsized":"2024-09-10T14:32:46.350530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:46.350348+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:46.350348+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.350348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:26.276494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'7","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:15.509888+0000","last_change":"2024-09-10T14:28:28.889060+0000","last_active":"2024-09-10T14:32:15.509888+0000","last_peered":"2024-09-10T14:32:15.509888+0000","last_clean":"2024-09-10T14:32:15.509888+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:32:15.509888+0000","last_undegraded":"2024-09-10T14:32:15.509888+0000","last_fullsized":"2024-09-10T14:32:15.509888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.460009+0000","last_change":"2024-09-10T14:32:37.460071+0000","last_active":"2024-09-10T14:32:37.460009+0000","last_peered":"2024-09-10T14:32:37.460009+0000","last_clean":"2024-09-10T14:32:37.460009+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:32:37.460009+0000","last_undegraded":"2024-09-10T14:32:37.460009+0000","last_fullsized":"2024-09-10T14:32:37.460009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.459813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:14.821058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.028479+0000","last_change":"2024-09-10T14:32:26.028627+0000","last_active":"2024-09-10T14:32:26.028479+0000","last_peered":"2024-09-10T14:32:26.028479+0000","last_clean":"2024-09-10T14:32:26.028479+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:32:26.028479+0000","last_undegraded":"2024-09-10T14:32:26.028479+0000","last_fullsized":"2024-09-10T14:32:26.028479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.028252+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:17.812152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.470537+0000","last_change":"2024-09-10T14:32:41.470597+0000","last_active":"2024-09-10T14:32:41.470537+0000","last_peered":"2024-09-10T14:32:41.470537+0000","last_clean":"2024-09-10T14:32:41.470537+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:32:41.470537+0000","last_undegraded":"2024-09-10T14:32:41.470537+0000","last_fullsized":"2024-09-10T14:32:41.470537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.470326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.470326+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.470326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:19.199667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:03.788457+0000","last_change":"2024-09-10T14:28:38.950672+0000","last_active":"2024-09-10T14:31:03.788457+0000","last_peered":"2024-09-10T14:31:03.788457+0000","last_clean":"2024-09-10T14:31:03.788457+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:31:03.788457+0000","last_undegraded":"2024-09-10T14:31:03.788457+0000","last_fullsized":"2024-09-10T14:31:03.788457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.423376+0000","last_change":"2024-09-10T14:33:01.423435+0000","last_active":"2024-09-10T14:33:01.423376+0000","last_peered":"2024-09-10T14:33:01.423376+0000","last_clean":"2024-09-10T14:33:01.423376+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:33:01.423376+0000","last_undegraded":"2024-09-10T14:33:01.423376+0000","last_fullsized":"2024-09-10T14:33:01.423376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:01.423168+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:01.423168+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.423168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:28.296896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.110339+0000","last_change":"2024-09-10T14:33:10.110407+0000","last_active":"2024-09-10T14:33:10.110339+0000","last_peered":"2024-09-10T14:33:10.110339+0000","last_clean":"2024-09-10T14:33:10.110339+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:33:10.110339+0000","last_undegraded":"2024-09-10T14:33:10.110339+0000","last_fullsized":"2024-09-10T14:33:10.110339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.110141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.110141+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.110141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:18.775525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.935806+0000","last_change":"2024-09-10T14:32:32.935858+0000","last_active":"2024-09-10T14:32:32.935806+0000","last_peered":"2024-09-10T14:32:32.935806+0000","last_clean":"2024-09-10T14:32:32.935806+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:32:32.935806+0000","last_undegraded":"2024-09-10T14:32:32.935806+0000","last_fullsized":"2024-09-10T14:32:32.935806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.935608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:34.956315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.504401+0000","last_change":"2024-09-10T14:32:31.504474+0000","last_active":"2024-09-10T14:32:31.504401+0000","last_peered":"2024-09-10T14:32:31.504401+0000","last_clean":"2024-09-10T14:32:31.504401+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:32:31.504401+0000","last_undegraded":"2024-09-10T14:32:31.504401+0000","last_fullsized":"2024-09-10T14:32:31.504401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.504210+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:27.467975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.434634+0000","last_change":"2024-09-10T14:32:55.434693+0000","last_active":"2024-09-10T14:32:55.434634+0000","last_peered":"2024-09-10T14:32:55.434634+0000","last_clean":"2024-09-10T14:32:55.434634+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:32:55.434634+0000","last_undegraded":"2024-09-10T14:32:55.434634+0000","last_fullsized":"2024-09-10T14:32:55.434634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:55.434450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:55.434450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.434450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:41.855323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:31:44.406498+0000","last_change":"2024-09-10T14:28:38.949225+0000","last_active":"2024-09-10T14:31:44.406498+0000","last_peered":"2024-09-10T14:31:44.406498+0000","last_clean":"2024-09-10T14:31:44.406498+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:31:44.406498+0000","last_undegraded":"2024-09-10T14:31:44.406498+0000","last_fullsized":"2024-09-10T14:31:44.406498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.357216+0000","last_change":"2024-09-10T14:32:45.357374+0000","last_active":"2024-09-10T14:32:45.357216+0000","last_peered":"2024-09-10T14:32:45.357216+0000","last_clean":"2024-09-10T14:32:45.357216+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:32:45.357216+0000","last_undegraded":"2024-09-10T14:32:45.357216+0000","last_fullsized":"2024-09-10T14:32:45.357216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:45.356988+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:45.356988+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.356988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:42.173829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.856166+0000","last_change":"2024-09-10T14:32:57.856228+0000","last_active":"2024-09-10T14:32:57.856166+0000","last_peered":"2024-09-10T14:32:57.856166+0000","last_clean":"2024-09-10T14:32:57.856166+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:32:57.856166+0000","last_undegraded":"2024-09-10T14:32:57.856166+0000","last_fullsized":"2024-09-10T14:32:57.856166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:57.855959+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:57.855959+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.855959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:19.355814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.985028+0000","last_change":"2024-09-10T14:32:28.985098+0000","last_active":"2024-09-10T14:32:28.985028+0000","last_peered":"2024-09-10T14:32:28.985028+0000","last_clean":"2024-09-10T14:32:28.985028+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:32:28.985028+0000","last_undegraded":"2024-09-10T14:32:28.985028+0000","last_fullsized":"2024-09-10T14:32:28.985028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.984841+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:32.529664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'41","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.464417+0000","last_change":"2024-09-10T14:32:52.464492+0000","last_active":"2024-09-10T14:32:52.464417+0000","last_peered":"2024-09-10T14:32:52.464417+0000","last_clean":"2024-09-10T14:32:52.464417+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:32:52.464417+0000","last_undegraded":"2024-09-10T14:32:52.464417+0000","last_fullsized":"2024-09-10T14:32:52.464417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-10T14:32:52.464237+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-10T14:32:52.464237+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.464237+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:29.213358+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.257705+0000","last_change":"2024-09-10T14:32:39.257759+0000","last_active":"2024-09-10T14:32:39.257705+0000","last_peered":"2024-09-10T14:32:39.257705+0000","last_clean":"2024-09-10T14:32:39.257705+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:32:39.257705+0000","last_undegraded":"2024-09-10T14:32:39.257705+0000","last_fullsized":"2024-09-10T14:32:39.257705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:39.257507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:39.257507+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.257507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:11.855142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243753+0000","last_change":"2024-09-10T14:28:38.949254+0000","last_active":"2024-09-10T14:32:20.243753+0000","last_peered":"2024-09-10T14:32:20.243753+0000","last_clean":"2024-09-10T14:32:20.243753+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:32:20.243753+0000","last_undegraded":"2024-09-10T14:32:20.243753+0000","last_fullsized":"2024-09-10T14:32:20.243753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.967908+0000","last_change":"2024-09-10T14:32:37.967908+0000","last_active":"2024-09-10T14:32:37.967908+0000","last_peered":"2024-09-10T14:32:37.967908+0000","last_clean":"2024-09-10T14:32:37.967908+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:32:37.967908+0000","last_undegraded":"2024-09-10T14:32:37.967908+0000","last_fullsized":"2024-09-10T14:32:37.967908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.967539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:44.664554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.362528+0000","last_change":"2024-09-10T14:33:02.362596+0000","last_active":"2024-09-10T14:33:02.362528+0000","last_peered":"2024-09-10T14:33:02.362528+0000","last_clean":"2024-09-10T14:33:02.362528+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:33:02.362528+0000","last_undegraded":"2024-09-10T14:33:02.362528+0000","last_fullsized":"2024-09-10T14:33:02.362528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:02.362272+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:02.362272+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.362272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:04.809531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.283518+0000","last_change":"2024-09-10T14:32:49.283518+0000","last_active":"2024-09-10T14:32:49.283518+0000","last_peered":"2024-09-10T14:32:49.283518+0000","last_clean":"2024-09-10T14:32:49.283518+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:32:49.283518+0000","last_undegraded":"2024-09-10T14:32:49.283518+0000","last_fullsized":"2024-09-10T14:32:49.283518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:49.283250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:49.283250+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.283250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:33.333958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.115744+0000","last_change":"2024-09-10T14:32:58.115819+0000","last_active":"2024-09-10T14:32:58.115744+0000","last_peered":"2024-09-10T14:32:58.115744+0000","last_clean":"2024-09-10T14:32:58.115744+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:32:58.115744+0000","last_undegraded":"2024-09-10T14:32:58.115744+0000","last_fullsized":"2024-09-10T14:32:58.115744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:58.115545+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:58.115545+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.115545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:53.150818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.415954+0000","last_change":"2024-09-10T14:33:02.416041+0000","last_active":"2024-09-10T14:33:02.415954+0000","last_peered":"2024-09-10T14:33:02.415954+0000","last_clean":"2024-09-10T14:33:02.415954+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:33:02.415954+0000","last_undegraded":"2024-09-10T14:33:02.415954+0000","last_fullsized":"2024-09-10T14:33:02.415954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:33:02.415764+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:33:02.415764+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.415764+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:30.721821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241103+0000","last_change":"2024-09-10T14:28:28.892938+0000","last_active":"2024-09-10T14:32:20.241103+0000","last_peered":"2024-09-10T14:32:20.241103+0000","last_clean":"2024-09-10T14:32:20.241103+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:32:20.241103+0000","last_undegraded":"2024-09-10T14:32:20.241103+0000","last_fullsized":"2024-09-10T14:32:20.241103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.103739+0000","last_change":"2024-09-10T14:32:55.103798+0000","last_active":"2024-09-10T14:32:55.103739+0000","last_peered":"2024-09-10T14:32:55.103739+0000","last_clean":"2024-09-10T14:32:55.103739+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:32:55.103739+0000","last_undegraded":"2024-09-10T14:32:55.103739+0000","last_fullsized":"2024-09-10T14:32:55.103739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:55.103545+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:55.103545+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.103545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:16.603400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.145434+0000","last_change":"2024-09-10T14:33:00.145500+0000","last_active":"2024-09-10T14:33:00.145434+0000","last_peered":"2024-09-10T14:33:00.145434+0000","last_clean":"2024-09-10T14:33:00.145434+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:33:00.145434+0000","last_undegraded":"2024-09-10T14:33:00.145434+0000","last_fullsized":"2024-09-10T14:33:00.145434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:00.145242+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:00.145242+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.145242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:00.136739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.267228+0000","last_change":"2024-09-10T14:32:46.267294+0000","last_active":"2024-09-10T14:32:46.267228+0000","last_peered":"2024-09-10T14:32:46.267228+0000","last_clean":"2024-09-10T14:32:46.267228+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:32:46.267228+0000","last_undegraded":"2024-09-10T14:32:46.267228+0000","last_fullsized":"2024-09-10T14:32:46.267228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:46.267037+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:46.267037+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.267037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:01.415089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.246325+0000","last_change":"2024-09-10T14:32:50.246325+0000","last_active":"2024-09-10T14:32:50.246325+0000","last_peered":"2024-09-10T14:32:50.246325+0000","last_clean":"2024-09-10T14:32:50.246325+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:32:50.246325+0000","last_undegraded":"2024-09-10T14:32:50.246325+0000","last_fullsized":"2024-09-10T14:32:50.246325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:50.246061+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:50.246061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.246061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:23.296600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.756326+0000","last_change":"2024-09-10T14:33:12.756384+0000","last_active":"2024-09-10T14:33:12.756326+0000","last_peered":"2024-09-10T14:33:12.756326+0000","last_clean":"2024-09-10T14:33:12.756326+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:33:12.756326+0000","last_undegraded":"2024-09-10T14:33:12.756326+0000","last_fullsized":"2024-09-10T14:33:12.756326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-10T14:33:12.756121+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-10T14:33:12.756121+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.756121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:21.421505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.806351+0000","last_change":"2024-09-10T14:33:09.806405+0000","last_active":"2024-09-10T14:33:09.806351+0000","last_peered":"2024-09-10T14:33:09.806351+0000","last_clean":"2024-09-10T14:33:09.806351+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:33:09.806351+0000","last_undegraded":"2024-09-10T14:33:09.806351+0000","last_fullsized":"2024-09-10T14:33:09.806351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.806154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.806154+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.806154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:49.758182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.148461+0000","last_change":"2024-09-10T14:33:03.148521+0000","last_active":"2024-09-10T14:33:03.148461+0000","last_peered":"2024-09-10T14:33:03.148461+0000","last_clean":"2024-09-10T14:33:03.148461+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:33:03.148461+0000","last_undegraded":"2024-09-10T14:33:03.148461+0000","last_fullsized":"2024-09-10T14:33:03.148461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:33:03.148265+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:33:03.148265+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.148265+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:12.040666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.369749+0000","last_change":"2024-09-10T14:32:52.369813+0000","last_active":"2024-09-10T14:32:52.369749+0000","last_peered":"2024-09-10T14:32:52.369749+0000","last_clean":"2024-09-10T14:32:52.369749+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:32:52.369749+0000","last_undegraded":"2024-09-10T14:32:52.369749+0000","last_fullsized":"2024-09-10T14:32:52.369749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:52.369554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:52.369554+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.369554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:48.344683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.924217+0000","last_change":"2024-09-10T14:32:44.924333+0000","last_active":"2024-09-10T14:32:44.924217+0000","last_peered":"2024-09-10T14:32:44.924217+0000","last_clean":"2024-09-10T14:32:44.924217+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:32:44.924217+0000","last_undegraded":"2024-09-10T14:32:44.924217+0000","last_fullsized":"2024-09-10T14:32:44.924217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:44.923988+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:44.923988+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.923988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:17.218205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.103117+0000","last_change":"2024-09-10T14:33:12.103188+0000","last_active":"2024-09-10T14:33:12.103117+0000","last_peered":"2024-09-10T14:33:12.103117+0000","last_clean":"2024-09-10T14:33:12.103117+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:33:12.103117+0000","last_undegraded":"2024-09-10T14:33:12.103117+0000","last_fullsized":"2024-09-10T14:33:12.103117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:12.102898+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:12.102898+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.102898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:00.368266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.900247+0000","last_change":"2024-09-10T14:32:56.900247+0000","last_active":"2024-09-10T14:32:56.900247+0000","last_peered":"2024-09-10T14:32:56.900247+0000","last_clean":"2024-09-10T14:32:56.900247+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:32:56.900247+0000","last_undegraded":"2024-09-10T14:32:56.900247+0000","last_fullsized":"2024-09-10T14:32:56.900247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:56.899972+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:56.899972+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.899972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:46.105631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241373+0000","last_change":"2024-09-10T14:28:28.893263+0000","last_active":"2024-09-10T14:32:20.241373+0000","last_peered":"2024-09-10T14:32:20.241373+0000","last_clean":"2024-09-10T14:32:20.241373+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:32:20.241373+0000","last_undegraded":"2024-09-10T14:32:20.241373+0000","last_fullsized":"2024-09-10T14:32:20.241373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.471594+0000","last_change":"2024-09-10T14:32:40.471594+0000","last_active":"2024-09-10T14:32:40.471594+0000","last_peered":"2024-09-10T14:32:40.471594+0000","last_clean":"2024-09-10T14:32:40.471594+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:32:40.471594+0000","last_undegraded":"2024-09-10T14:32:40.471594+0000","last_fullsized":"2024-09-10T14:32:40.471594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:40.471309+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:40.471309+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.471309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:15.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.134041+0000","last_change":"2024-09-10T14:33:04.134108+0000","last_active":"2024-09-10T14:33:04.134041+0000","last_peered":"2024-09-10T14:33:04.134041+0000","last_clean":"2024-09-10T14:33:04.134041+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:33:04.134041+0000","last_undegraded":"2024-09-10T14:33:04.134041+0000","last_fullsized":"2024-09-10T14:33:04.134041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:04.133848+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:04.133848+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.133848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:26.213488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.155550+0000","last_change":"2024-09-10T14:32:57.155550+0000","last_active":"2024-09-10T14:32:57.155550+0000","last_peered":"2024-09-10T14:32:57.155550+0000","last_clean":"2024-09-10T14:32:57.155550+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:32:57.155550+0000","last_undegraded":"2024-09-10T14:32:57.155550+0000","last_fullsized":"2024-09-10T14:32:57.155550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:57.155307+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:57.155307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.155307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:46.880813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.835504+0000","last_change":"2024-09-10T14:33:06.835626+0000","last_active":"2024-09-10T14:33:06.835504+0000","last_peered":"2024-09-10T14:33:06.835504+0000","last_clean":"2024-09-10T14:33:06.835504+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:33:06.835504+0000","last_undegraded":"2024-09-10T14:33:06.835504+0000","last_fullsized":"2024-09-10T14:33:06.835504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:06.835209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:06.835209+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.835209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:28.914849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.785422+0000","last_change":"2024-09-10T14:33:00.785422+0000","last_active":"2024-09-10T14:33:00.785422+0000","last_peered":"2024-09-10T14:33:00.785422+0000","last_clean":"2024-09-10T14:33:00.785422+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:33:00.785422+0000","last_undegraded":"2024-09-10T14:33:00.785422+0000","last_fullsized":"2024-09-10T14:33:00.785422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-10T14:33:00.785175+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-10T14:33:00.785175+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.785175+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:55.820447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.906586+0000","last_change":"2024-09-10T14:32:55.906586+0000","last_active":"2024-09-10T14:32:55.906586+0000","last_peered":"2024-09-10T14:32:55.906586+0000","last_clean":"2024-09-10T14:32:55.906586+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:32:55.906586+0000","last_undegraded":"2024-09-10T14:32:55.906586+0000","last_fullsized":"2024-09-10T14:32:55.906586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:55.906312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:55.906312+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.906312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:50.502825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.817003+0000","last_change":"2024-09-10T14:33:02.817003+0000","last_active":"2024-09-10T14:33:02.817003+0000","last_peered":"2024-09-10T14:33:02.817003+0000","last_clean":"2024-09-10T14:33:02.817003+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:33:02.817003+0000","last_undegraded":"2024-09-10T14:33:02.817003+0000","last_fullsized":"2024-09-10T14:33:02.817003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-10T14:33:02.816746+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-10T14:33:02.816746+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.816746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:02.808243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.439718+0000","last_change":"2024-09-10T14:33:15.439782+0000","last_active":"2024-09-10T14:33:15.439718+0000","last_peered":"2024-09-10T14:33:15.439718+0000","last_clean":"2024-09-10T14:33:15.439718+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:33:15.439718+0000","last_undegraded":"2024-09-10T14:33:15.439718+0000","last_fullsized":"2024-09-10T14:33:15.439718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:15.439516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:15.439516+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.439516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:23.916159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.938587+0000","last_change":"2024-09-10T14:32:48.938587+0000","last_active":"2024-09-10T14:32:48.938587+0000","last_peered":"2024-09-10T14:32:48.938587+0000","last_clean":"2024-09-10T14:32:48.938587+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:32:48.938587+0000","last_undegraded":"2024-09-10T14:32:48.938587+0000","last_fullsized":"2024-09-10T14:32:48.938587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:48.938333+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:48.938333+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.938333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:04.086385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241396+0000","last_change":"2024-09-10T14:28:28.880438+0000","last_active":"2024-09-10T14:32:20.241396+0000","last_peered":"2024-09-10T14:32:20.241396+0000","last_clean":"2024-09-10T14:32:20.241396+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:32:20.241396+0000","last_undegraded":"2024-09-10T14:32:20.241396+0000","last_fullsized":"2024-09-10T14:32:20.241396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'14","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.389144+0000","last_change":"2024-09-10T14:32:38.389144+0000","last_active":"2024-09-10T14:32:38.389144+0000","last_peered":"2024-09-10T14:32:38.389144+0000","last_clean":"2024-09-10T14:32:38.389144+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:32:38.389144+0000","last_undegraded":"2024-09-10T14:32:38.389144+0000","last_fullsized":"2024-09-10T14:32:38.389144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.388866+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:33.424139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.422326+0000","last_change":"2024-09-10T14:32:48.422326+0000","last_active":"2024-09-10T14:32:48.422326+0000","last_peered":"2024-09-10T14:32:48.422326+0000","last_clean":"2024-09-10T14:32:48.422326+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:32:48.422326+0000","last_undegraded":"2024-09-10T14:32:48.422326+0000","last_fullsized":"2024-09-10T14:32:48.422326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:48.422047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:48.422047+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.422047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:26.220031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.999876+0000","last_change":"2024-09-10T14:32:51.999876+0000","last_active":"2024-09-10T14:32:51.999876+0000","last_peered":"2024-09-10T14:32:51.999876+0000","last_clean":"2024-09-10T14:32:51.999876+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:32:51.999876+0000","last_undegraded":"2024-09-10T14:32:51.999876+0000","last_fullsized":"2024-09-10T14:32:51.999876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:51.999608+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:51.999608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.999608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:36.050316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241441+0000","last_change":"2024-09-10T14:28:28.879289+0000","last_active":"2024-09-10T14:32:20.241441+0000","last_peered":"2024-09-10T14:32:20.241441+0000","last_clean":"2024-09-10T14:32:20.241441+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:32:20.241441+0000","last_undegraded":"2024-09-10T14:32:20.241441+0000","last_fullsized":"2024-09-10T14:32:20.241441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.241469+0000","last_change":"2024-09-10T14:28:28.892314+0000","last_active":"2024-09-10T14:32:20.241469+0000","last_peered":"2024-09-10T14:32:20.241469+0000","last_clean":"2024-09-10T14:32:20.241469+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:32:20.241469+0000","last_undegraded":"2024-09-10T14:32:20.241469+0000","last_fullsized":"2024-09-10T14:32:20.241469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:27.816950+0000","last_clean_scrub_stamp":"2024-09-10T14:28:27.816950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.310359+0000","last_change":"2024-09-10T14:32:44.310500+0000","last_active":"2024-09-10T14:32:44.310359+0000","last_peered":"2024-09-10T14:32:44.310359+0000","last_clean":"2024-09-10T14:32:44.310359+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:32:44.310359+0000","last_undegraded":"2024-09-10T14:32:44.310359+0000","last_fullsized":"2024-09-10T14:32:44.310359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:44.310127+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:44.310127+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.310127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:59.596129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.134255+0000","last_change":"2024-09-10T14:32:54.134255+0000","last_active":"2024-09-10T14:32:54.134255+0000","last_peered":"2024-09-10T14:32:54.134255+0000","last_clean":"2024-09-10T14:32:54.134255+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:32:54.134255+0000","last_undegraded":"2024-09-10T14:32:54.134255+0000","last_fullsized":"2024-09-10T14:32:54.134255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:54.133994+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:54.133994+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.133994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:05.972266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.955718+0000","last_change":"2024-09-10T14:32:45.955850+0000","last_active":"2024-09-10T14:32:45.955718+0000","last_peered":"2024-09-10T14:32:45.955718+0000","last_clean":"2024-09-10T14:32:45.955718+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:32:45.955718+0000","last_undegraded":"2024-09-10T14:32:45.955718+0000","last_fullsized":"2024-09-10T14:32:45.955718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:45.955449+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:45.955449+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.955449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:58.286493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1530,"ondisk_log_size":1530,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640322,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":750039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673026,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":162767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673026,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1052672,"data_stored":750219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":161599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:33:21.899 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.899 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.900 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.900 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.901 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.901 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.901 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.901 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.901 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.901 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.902 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.902 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.902 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.902 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.902 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.903 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.903 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T14:28:18.297324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.903 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.904 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.904 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.904 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T14:28:31.838867+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.904 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.904 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.905 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.905 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.905 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.905 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.906 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.906 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.906 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T14:28:27.816950+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:21.906 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T14:33:41.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:33:42.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb9a84a640 1 Processor -- start 2024-09-10T14:33:42.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb9a84a640 1 -- start start 2024-09-10T14:33:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb9a84a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb9406dbd0 0x7ffb94131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb9a84a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb94071c10 con 0x7ffb9406d0e0 2024-09-10T14:33:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb9a84a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffb94072230 con 0x7ffb9406dbd0 2024-09-10T14:33:42.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb937fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb9406dbd0 0x7ffb94131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:42.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb93fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffb9406d0e0 0x7ffb9406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53846/0 (socket says 172.21.15.52:53846) 2024-09-10T14:33:42.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb93fff640 1 -- 172.21.15.52:0/1799155461 learned_addr learned my addr 172.21.15.52:0/1799155461 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:33:42.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb937fe640 1 -- 172.21.15.52:0/1799155461 >> v1:172.21.15.52:6789/0 conn(0x7ffb9406d0e0 legacy=0x7ffb9406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:42.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb937fe640 1 -- 172.21.15.52:0/1799155461 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb940709e0 con 0x7ffb9406dbd0 2024-09-10T14:33:42.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb937fe640 1 --2- 172.21.15.52:0/1799155461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406dbd0 0x7ffb94131e60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009d90 tx=0x7ffb8801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7dcb6f4f778fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb92ffd640 1 -- 172.21.15.52:0/1799155461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb880a6640 con 0x7ffb9406dbd0 2024-09-10T14:33:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb92ffd640 1 -- 172.21.15.52:0/1799155461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb880a67e0 con 0x7ffb9406dbd0 2024-09-10T14:33:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.039+0000 7ffb92ffd640 1 -- 172.21.15.52:0/1799155461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb880a6ae0 con 0x7ffb9406dbd0 2024-09-10T14:33:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- 172.21.15.52:0/1799155461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406dbd0 msgr2=0x7ffb94131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 --2- 172.21.15.52:0/1799155461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406dbd0 0x7ffb94131e60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009d90 tx=0x7ffb8801c8c0 comp rx=0 tx=0).stop 2024-09-10T14:33:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- 172.21.15.52:0/1799155461 shutdown_connections 2024-09-10T14:33:42.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 --2- 172.21.15.52:0/1799155461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406dbd0 0x7ffb94131e60 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:42.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- 172.21.15.52:0/1799155461 >> 172.21.15.52:0/1799155461 conn(0x7ffb94099a50 msgr2=0x7ffb940972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:33:42.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- 172.21.15.52:0/1799155461 shutdown_connections 2024-09-10T14:33:42.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- 172.21.15.52:0/1799155461 wait complete. 2024-09-10T14:33:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 Processor -- start 2024-09-10T14:33:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- start start 2024-09-10T14:33:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406d0e0 0x7ffb94129730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94134d40 con 0x7ffb9406d0e0 2024-09-10T14:33:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406d0e0 0x7ffb94129730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406d0e0 0x7ffb94129730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48526/0 (socket says 172.21.15.52:48526) 2024-09-10T14:33:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb93fff640 1 -- 172.21.15.52:0/2013735759 learned_addr learned my addr 172.21.15.52:0/2013735759 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:33:42.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb93fff640 1 -- 172.21.15.52:0/2013735759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9412a770 con 0x7ffb9406d0e0 2024-09-10T14:33:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb93fff640 1 --2- 172.21.15.52:0/2013735759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406d0e0 0x7ffb94129730 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400c480 tx=0x7ffb8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb90ff9640 1 -- 172.21.15.52:0/2013735759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb84017070 con 0x7ffb9406d0e0 2024-09-10T14:33:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb90ff9640 1 -- 172.21.15.52:0/2013735759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb84005c20 con 0x7ffb9406d0e0 2024-09-10T14:33:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb941291c0 con 0x7ffb9406d0e0 2024-09-10T14:33:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb90ff9640 1 -- 172.21.15.52:0/2013735759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb84007070 con 0x7ffb9406d0e0 2024-09-10T14:33:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb94129c70 con 0x7ffb9406d0e0 2024-09-10T14:33:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb90ff9640 1 -- 172.21.15.52:0/2013735759 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffb8401a070 con 0x7ffb9406d0e0 2024-09-10T14:33:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.043+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb9406d4c0 con 0x7ffb9406d0e0 2024-09-10T14:33:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.047+0000 7ffb90ff9640 1 --2- 172.21.15.52:0/2013735759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb80035db0 0x7ffb80038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:33:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.047+0000 7ffb90ff9640 1 -- 172.21.15.52:0/2013735759 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7ffb84048450 con 0x7ffb9406d0e0 2024-09-10T14:33:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.047+0000 7ffb937fe640 1 --2- 172.21.15.52:0/2013735759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb80035db0 0x7ffb80038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:33:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.047+0000 7ffb937fe640 1 --2- 172.21.15.52:0/2013735759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb80035db0 0x7ffb80038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffb880af000 tx=0x7ffb880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:33:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.051+0000 7ffb90ff9640 1 -- 172.21.15.52:0/2013735759 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffb84007210 con 0x7ffb9406d0e0 2024-09-10T14:33:42.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.215+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb94126d30 con 0x7ffb80035db0 2024-09-10T14:33:42.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.259+0000 7ffb90ff9640 1 -- 172.21.15.52:0/2013735759 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666240 (secure 0 0 0) 0x7ffb94126d30 con 0x7ffb80035db0 2024-09-10T14:33:42.271 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:33:42.279 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:33:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb80035db0 msgr2=0x7ffb80038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 --2- 172.21.15.52:0/2013735759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb80035db0 0x7ffb80038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffb880af000 tx=0x7ffb880a7000 comp rx=0 tx=0).stop 2024-09-10T14:33:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406d0e0 msgr2=0x7ffb94129730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:33:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 --2- 172.21.15.52:0/2013735759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406d0e0 0x7ffb94129730 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400c480 tx=0x7ffb8400c940 comp rx=0 tx=0).stop 2024-09-10T14:33:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 shutdown_connections 2024-09-10T14:33:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 --2- 172.21.15.52:0/2013735759 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7ffb80035db0 0x7ffb80038270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:42.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 --2- 172.21.15.52:0/2013735759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb9406d0e0 0x7ffb94129730 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:33:42.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 >> 172.21.15.52:0/2013735759 conn(0x7ffb94099a50 msgr2=0x7ffb9409b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:33:42.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 shutdown_connections 2024-09-10T14:33:42.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:33:42.267+0000 7ffb9a84a640 1 -- 172.21.15.52:0/2013735759 wait complete. 2024-09-10T14:33:42.291 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-10T14:33:40.842905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4796,"ondisk_log_size":4796,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152688,"kb_used_data":2992,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334672,"statfs":{"total":386547056640,"available":386390704128,"internally_reserved":0,"allocated":3063808,"data_stored":1824624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006800"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.333576+0000","last_change":"2024-09-10T14:32:56.333644+0000","last_active":"2024-09-10T14:32:56.333576+0000","last_peered":"2024-09-10T14:32:56.333576+0000","last_clean":"2024-09-10T14:32:56.333576+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:32:56.333576+0000","last_undegraded":"2024-09-10T14:32:56.333576+0000","last_fullsized":"2024-09-10T14:32:56.333576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:56.333364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:56.333364+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.333364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:41.861748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.951520+0000","last_change":"2024-09-10T14:32:49.951520+0000","last_active":"2024-09-10T14:32:49.951520+0000","last_peered":"2024-09-10T14:32:49.951520+0000","last_clean":"2024-09-10T14:32:49.951520+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:32:49.951520+0000","last_undegraded":"2024-09-10T14:32:49.951520+0000","last_fullsized":"2024-09-10T14:32:49.951520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:49.951238+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:49.951238+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.951238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:14.016136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.163991+0000","last_change":"2024-09-10T14:33:02.164062+0000","last_active":"2024-09-10T14:33:02.163991+0000","last_peered":"2024-09-10T14:33:02.163991+0000","last_clean":"2024-09-10T14:33:02.163991+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:33:02.163991+0000","last_undegraded":"2024-09-10T14:33:02.163991+0000","last_fullsized":"2024-09-10T14:33:02.163991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:02.163779+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:02.163779+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.163779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:38.005621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.457127+0000","last_change":"2024-09-10T14:32:54.457127+0000","last_active":"2024-09-10T14:32:54.457127+0000","last_peered":"2024-09-10T14:32:54.457127+0000","last_clean":"2024-09-10T14:32:54.457127+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:32:54.457127+0000","last_undegraded":"2024-09-10T14:32:54.457127+0000","last_fullsized":"2024-09-10T14:32:54.457127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:54.456884+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:54.456884+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.456884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:16:26.826166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:35.689609+0000","last_change":"2024-09-10T14:33:35.689670+0000","last_active":"2024-09-10T14:33:35.689609+0000","last_peered":"2024-09-10T14:33:35.689609+0000","last_clean":"2024-09-10T14:33:35.689609+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:33:35.689609+0000","last_undegraded":"2024-09-10T14:33:35.689609+0000","last_fullsized":"2024-09-10T14:33:35.689609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:35.689401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:35.689401+0000","last_clean_scrub_stamp":"2024-09-10T14:33:35.689401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:17.384236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.465827+0000","last_change":"2024-09-10T14:32:53.465827+0000","last_active":"2024-09-10T14:32:53.465827+0000","last_peered":"2024-09-10T14:32:53.465827+0000","last_clean":"2024-09-10T14:32:53.465827+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:32:53.465827+0000","last_undegraded":"2024-09-10T14:32:53.465827+0000","last_fullsized":"2024-09-10T14:32:53.465827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:53.465523+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:53.465523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.465523+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:51.914175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.343626+0000","last_change":"2024-09-10T14:33:04.343688+0000","last_active":"2024-09-10T14:33:04.343626+0000","last_peered":"2024-09-10T14:33:04.343626+0000","last_clean":"2024-09-10T14:33:04.343626+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:33:04.343626+0000","last_undegraded":"2024-09-10T14:33:04.343626+0000","last_fullsized":"2024-09-10T14:33:04.343626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:04.343430+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:04.343430+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.343430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:27.120451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.473761+0000","last_change":"2024-09-10T14:32:56.473761+0000","last_active":"2024-09-10T14:32:56.473761+0000","last_peered":"2024-09-10T14:32:56.473761+0000","last_clean":"2024-09-10T14:32:56.473761+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:32:56.473761+0000","last_undegraded":"2024-09-10T14:32:56.473761+0000","last_fullsized":"2024-09-10T14:32:56.473761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:56.473347+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:56.473347+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.473347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:32.723316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:28.746453+0000","last_change":"2024-09-10T14:33:28.746453+0000","last_active":"2024-09-10T14:33:28.746453+0000","last_peered":"2024-09-10T14:33:28.746453+0000","last_clean":"2024-09-10T14:33:28.746453+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:33:28.746453+0000","last_undegraded":"2024-09-10T14:33:28.746453+0000","last_fullsized":"2024-09-10T14:33:28.746453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:28.746201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:28.746201+0000","last_clean_scrub_stamp":"2024-09-10T14:33:28.746201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:39.886607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.995921+0000","last_change":"2024-09-10T14:32:39.996050+0000","last_active":"2024-09-10T14:32:39.995921+0000","last_peered":"2024-09-10T14:32:39.995921+0000","last_clean":"2024-09-10T14:32:39.995921+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:32:39.995921+0000","last_undegraded":"2024-09-10T14:32:39.995921+0000","last_fullsized":"2024-09-10T14:32:39.995921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:39.995698+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:39.995698+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.995698+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:22.900509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.352765+0000","last_change":"2024-09-10T14:33:00.352765+0000","last_active":"2024-09-10T14:33:00.352765+0000","last_peered":"2024-09-10T14:33:00.352765+0000","last_clean":"2024-09-10T14:33:00.352765+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:33:00.352765+0000","last_undegraded":"2024-09-10T14:33:00.352765+0000","last_fullsized":"2024-09-10T14:33:00.352765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:00.352497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:00.352497+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.352497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:55.705813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.417479+0000","last_change":"2024-09-10T14:33:06.417621+0000","last_active":"2024-09-10T14:33:06.417479+0000","last_peered":"2024-09-10T14:33:06.417479+0000","last_clean":"2024-09-10T14:33:06.417479+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:33:06.417479+0000","last_undegraded":"2024-09-10T14:33:06.417479+0000","last_fullsized":"2024-09-10T14:33:06.417479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:06.417247+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:06.417247+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.417247+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:40.374665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.424692+0000","last_change":"2024-09-10T14:33:14.424692+0000","last_active":"2024-09-10T14:33:14.424692+0000","last_peered":"2024-09-10T14:33:14.424692+0000","last_clean":"2024-09-10T14:33:14.424692+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:33:14.424692+0000","last_undegraded":"2024-09-10T14:33:14.424692+0000","last_fullsized":"2024-09-10T14:33:14.424692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:14.424436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:14.424436+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.424436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:52.256808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.405165+0000","last_change":"2024-09-10T14:32:51.405229+0000","last_active":"2024-09-10T14:32:51.405165+0000","last_peered":"2024-09-10T14:32:51.405165+0000","last_clean":"2024-09-10T14:32:51.405165+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:32:51.405165+0000","last_undegraded":"2024-09-10T14:32:51.405165+0000","last_fullsized":"2024-09-10T14:32:51.405165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:51.404964+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:51.404964+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.404964+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:47.758064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.122924+0000","last_change":"2024-09-10T14:33:09.122924+0000","last_active":"2024-09-10T14:33:09.122924+0000","last_peered":"2024-09-10T14:33:09.122924+0000","last_clean":"2024-09-10T14:33:09.122924+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:33:09.122924+0000","last_undegraded":"2024-09-10T14:33:09.122924+0000","last_fullsized":"2024-09-10T14:33:09.122924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.122486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.122486+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.122486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:12.627096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.359805+0000","last_change":"2024-09-10T14:32:57.359868+0000","last_active":"2024-09-10T14:32:57.359805+0000","last_peered":"2024-09-10T14:32:57.359805+0000","last_clean":"2024-09-10T14:32:57.359805+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:32:57.359805+0000","last_undegraded":"2024-09-10T14:32:57.359805+0000","last_fullsized":"2024-09-10T14:32:57.359805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:57.359620+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:57.359620+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.359620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:49.137266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.445514+0000","last_change":"2024-09-10T14:33:05.445514+0000","last_active":"2024-09-10T14:33:05.445514+0000","last_peered":"2024-09-10T14:33:05.445514+0000","last_clean":"2024-09-10T14:33:05.445514+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:33:05.445514+0000","last_undegraded":"2024-09-10T14:33:05.445514+0000","last_fullsized":"2024-09-10T14:33:05.445514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:05.445236+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:05.445236+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.445236+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:44.643741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.797572+0000","last_change":"2024-09-10T14:33:10.797572+0000","last_active":"2024-09-10T14:33:10.797572+0000","last_peered":"2024-09-10T14:33:10.797572+0000","last_clean":"2024-09-10T14:33:10.797572+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:33:10.797572+0000","last_undegraded":"2024-09-10T14:33:10.797572+0000","last_fullsized":"2024-09-10T14:33:10.797572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.797175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.797175+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.797175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:54.603044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.912446+0000","last_change":"2024-09-10T14:32:54.912446+0000","last_active":"2024-09-10T14:32:54.912446+0000","last_peered":"2024-09-10T14:32:54.912446+0000","last_clean":"2024-09-10T14:32:54.912446+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:32:54.912446+0000","last_undegraded":"2024-09-10T14:32:54.912446+0000","last_fullsized":"2024-09-10T14:32:54.912446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:54.912155+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:54.912155+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.912155+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:20.379495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.427495+0000","last_change":"2024-09-10T14:32:50.427495+0000","last_active":"2024-09-10T14:32:50.427495+0000","last_peered":"2024-09-10T14:32:50.427495+0000","last_clean":"2024-09-10T14:32:50.427495+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:32:50.427495+0000","last_undegraded":"2024-09-10T14:32:50.427495+0000","last_fullsized":"2024-09-10T14:32:50.427495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:50.427322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:50.427322+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.427322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:22.901578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.984319+0000","last_change":"2024-09-10T14:32:50.984319+0000","last_active":"2024-09-10T14:32:50.984319+0000","last_peered":"2024-09-10T14:32:50.984319+0000","last_clean":"2024-09-10T14:32:50.984319+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:32:50.984319+0000","last_undegraded":"2024-09-10T14:32:50.984319+0000","last_fullsized":"2024-09-10T14:32:50.984319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:50.983924+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:50.983924+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.983924+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:21.745837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.812070+0000","last_change":"2024-09-10T14:33:03.812070+0000","last_active":"2024-09-10T14:33:03.812070+0000","last_peered":"2024-09-10T14:33:03.812070+0000","last_clean":"2024-09-10T14:33:03.812070+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:33:03.812070+0000","last_undegraded":"2024-09-10T14:33:03.812070+0000","last_fullsized":"2024-09-10T14:33:03.812070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.811688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.811688+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.811688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:49:37.732318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.270427+0000","last_change":"2024-09-10T14:32:45.270427+0000","last_active":"2024-09-10T14:32:45.270427+0000","last_peered":"2024-09-10T14:32:45.270427+0000","last_clean":"2024-09-10T14:32:45.270427+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:32:45.270427+0000","last_undegraded":"2024-09-10T14:32:45.270427+0000","last_fullsized":"2024-09-10T14:32:45.270427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:45.270174+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:45.270174+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.270174+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.086726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.792289+0000","last_change":"2024-09-10T14:33:07.792289+0000","last_active":"2024-09-10T14:33:07.792289+0000","last_peered":"2024-09-10T14:33:07.792289+0000","last_clean":"2024-09-10T14:33:07.792289+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:33:07.792289+0000","last_undegraded":"2024-09-10T14:33:07.792289+0000","last_fullsized":"2024-09-10T14:33:07.792289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:07.791861+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:07.791861+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.791861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:08.077505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.379622+0000","last_change":"2024-09-10T14:32:55.379622+0000","last_active":"2024-09-10T14:32:55.379622+0000","last_peered":"2024-09-10T14:32:55.379622+0000","last_clean":"2024-09-10T14:32:55.379622+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:32:55.379622+0000","last_undegraded":"2024-09-10T14:32:55.379622+0000","last_fullsized":"2024-09-10T14:32:55.379622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:55.379196+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:55.379196+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.379196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:18.941696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.151476+0000","last_change":"2024-09-10T14:32:56.151476+0000","last_active":"2024-09-10T14:32:56.151476+0000","last_peered":"2024-09-10T14:32:56.151476+0000","last_clean":"2024-09-10T14:32:56.151476+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:32:56.151476+0000","last_undegraded":"2024-09-10T14:32:56.151476+0000","last_fullsized":"2024-09-10T14:32:56.151476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:56.151206+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:56.151206+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.151206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:12.336091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.935455+0000","last_change":"2024-09-10T14:32:41.935455+0000","last_active":"2024-09-10T14:32:41.935455+0000","last_peered":"2024-09-10T14:32:41.935455+0000","last_clean":"2024-09-10T14:32:41.935455+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:32:41.935455+0000","last_undegraded":"2024-09-10T14:32:41.935455+0000","last_fullsized":"2024-09-10T14:32:41.935455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:41.935185+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:41.935185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.935185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:14.532819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:19.478093+0000","last_change":"2024-09-10T14:33:19.478165+0000","last_active":"2024-09-10T14:33:19.478093+0000","last_peered":"2024-09-10T14:33:19.478093+0000","last_clean":"2024-09-10T14:33:19.478093+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:33:19.478093+0000","last_undegraded":"2024-09-10T14:33:19.478093+0000","last_fullsized":"2024-09-10T14:33:19.478093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:19.477886+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:19.477886+0000","last_clean_scrub_stamp":"2024-09-10T14:33:19.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:19.596444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'36","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.785151+0000","last_change":"2024-09-10T14:33:16.785151+0000","last_active":"2024-09-10T14:33:16.785151+0000","last_peered":"2024-09-10T14:33:16.785151+0000","last_clean":"2024-09-10T14:33:16.785151+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:33:16.785151+0000","last_undegraded":"2024-09-10T14:33:16.785151+0000","last_fullsized":"2024-09-10T14:33:16.785151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:33:16.784905+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:33:16.784905+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.784905+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:16:49.154188+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.378169+0000","last_change":"2024-09-10T14:33:14.378223+0000","last_active":"2024-09-10T14:33:14.378169+0000","last_peered":"2024-09-10T14:33:14.378169+0000","last_clean":"2024-09-10T14:33:14.378169+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:33:14.378169+0000","last_undegraded":"2024-09-10T14:33:14.378169+0000","last_fullsized":"2024-09-10T14:33:14.378169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:14.377949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:14.377949+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.377949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:21.128189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.444163+0000","last_change":"2024-09-10T14:33:09.444227+0000","last_active":"2024-09-10T14:33:09.444163+0000","last_peered":"2024-09-10T14:33:09.444163+0000","last_clean":"2024-09-10T14:33:09.444163+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:33:09.444163+0000","last_undegraded":"2024-09-10T14:33:09.444163+0000","last_fullsized":"2024-09-10T14:33:09.444163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.443934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.443934+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.443934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:31.721931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.424117+0000","last_change":"2024-09-10T14:32:21.424117+0000","last_active":"2024-09-10T14:32:21.424117+0000","last_peered":"2024-09-10T14:32:21.424117+0000","last_clean":"2024-09-10T14:32:21.424117+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:32:21.424117+0000","last_undegraded":"2024-09-10T14:32:21.424117+0000","last_fullsized":"2024-09-10T14:32:21.424117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.423759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:32.872552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'38","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.452638+0000","last_change":"2024-09-10T14:32:49.452638+0000","last_active":"2024-09-10T14:32:49.452638+0000","last_peered":"2024-09-10T14:32:49.452638+0000","last_clean":"2024-09-10T14:32:49.452638+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:32:49.452638+0000","last_undegraded":"2024-09-10T14:32:49.452638+0000","last_fullsized":"2024-09-10T14:32:49.452638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-10T14:32:49.452381+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-10T14:32:49.452381+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.452381+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:49.443135+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.955641+0000","last_change":"2024-09-10T14:32:34.955641+0000","last_active":"2024-09-10T14:32:34.955641+0000","last_peered":"2024-09-10T14:32:34.955641+0000","last_clean":"2024-09-10T14:32:34.955641+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:32:34.955641+0000","last_undegraded":"2024-09-10T14:32:34.955641+0000","last_fullsized":"2024-09-10T14:32:34.955641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.955261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:29:53.485810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.770774+0000","last_change":"2024-09-10T14:33:17.770774+0000","last_active":"2024-09-10T14:33:17.770774+0000","last_peered":"2024-09-10T14:33:17.770774+0000","last_clean":"2024-09-10T14:33:17.770774+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:33:17.770774+0000","last_undegraded":"2024-09-10T14:33:17.770774+0000","last_fullsized":"2024-09-10T14:33:17.770774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-10T14:33:17.770519+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-10T14:33:17.770519+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.770519+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:25.981664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.489328+0000","last_change":"2024-09-10T14:33:04.489328+0000","last_active":"2024-09-10T14:33:04.489328+0000","last_peered":"2024-09-10T14:33:04.489328+0000","last_clean":"2024-09-10T14:33:04.489328+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:33:04.489328+0000","last_undegraded":"2024-09-10T14:33:04.489328+0000","last_fullsized":"2024-09-10T14:33:04.489328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:04.488935+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:04.488935+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.488935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:37.290775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.332832+0000","last_change":"2024-09-10T14:33:06.332832+0000","last_active":"2024-09-10T14:33:06.332832+0000","last_peered":"2024-09-10T14:33:06.332832+0000","last_clean":"2024-09-10T14:33:06.332832+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:33:06.332832+0000","last_undegraded":"2024-09-10T14:33:06.332832+0000","last_fullsized":"2024-09-10T14:33:06.332832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:06.332586+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:06.332586+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.332586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:25.365994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.253066+0000","last_change":"2024-09-10T14:32:38.253066+0000","last_active":"2024-09-10T14:32:38.253066+0000","last_peered":"2024-09-10T14:32:38.253066+0000","last_clean":"2024-09-10T14:32:38.253066+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:32:38.253066+0000","last_undegraded":"2024-09-10T14:32:38.253066+0000","last_fullsized":"2024-09-10T14:32:38.253066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.252795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.252795+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.252795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:01.166001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.994910+0000","last_change":"2024-09-10T14:32:24.994910+0000","last_active":"2024-09-10T14:32:24.994910+0000","last_peered":"2024-09-10T14:32:24.994910+0000","last_clean":"2024-09-10T14:32:24.994910+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:32:24.994910+0000","last_undegraded":"2024-09-10T14:32:24.994910+0000","last_fullsized":"2024-09-10T14:32:24.994910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.994665+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:23.745673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.985015+0000","last_change":"2024-09-10T14:32:30.985015+0000","last_active":"2024-09-10T14:32:30.985015+0000","last_peered":"2024-09-10T14:32:30.985015+0000","last_clean":"2024-09-10T14:32:30.985015+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:32:30.985015+0000","last_undegraded":"2024-09-10T14:32:30.985015+0000","last_fullsized":"2024-09-10T14:32:30.985015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.984682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:15.495746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.155343+0000","last_change":"2024-09-10T14:33:16.155401+0000","last_active":"2024-09-10T14:33:16.155343+0000","last_peered":"2024-09-10T14:33:16.155343+0000","last_clean":"2024-09-10T14:33:16.155343+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:33:16.155343+0000","last_undegraded":"2024-09-10T14:33:16.155343+0000","last_fullsized":"2024-09-10T14:33:16.155343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:16.155149+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:16.155149+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.155149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:52.405119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.461098+0000","last_change":"2024-09-10T14:32:57.461098+0000","last_active":"2024-09-10T14:32:57.461098+0000","last_peered":"2024-09-10T14:32:57.461098+0000","last_clean":"2024-09-10T14:32:57.461098+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:32:57.461098+0000","last_undegraded":"2024-09-10T14:32:57.461098+0000","last_fullsized":"2024-09-10T14:32:57.461098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:57.460865+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:57.460865+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.460865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:14.564410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.467965+0000","last_change":"2024-09-10T14:33:16.468037+0000","last_active":"2024-09-10T14:33:16.467965+0000","last_peered":"2024-09-10T14:33:16.467965+0000","last_clean":"2024-09-10T14:33:16.467965+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:33:16.467965+0000","last_undegraded":"2024-09-10T14:33:16.467965+0000","last_fullsized":"2024-09-10T14:33:16.467965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:16.467773+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:16.467773+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.467773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:45.412113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.218999+0000","last_change":"2024-09-10T14:32:37.218999+0000","last_active":"2024-09-10T14:32:37.218999+0000","last_peered":"2024-09-10T14:32:37.218999+0000","last_clean":"2024-09-10T14:32:37.218999+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:32:37.218999+0000","last_undegraded":"2024-09-10T14:32:37.218999+0000","last_fullsized":"2024-09-10T14:32:37.218999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.218734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:20.123545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.492161+0000","last_change":"2024-09-10T14:32:28.492161+0000","last_active":"2024-09-10T14:32:28.492161+0000","last_peered":"2024-09-10T14:32:28.492161+0000","last_clean":"2024-09-10T14:32:28.492161+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:32:28.492161+0000","last_undegraded":"2024-09-10T14:32:28.492161+0000","last_fullsized":"2024-09-10T14:32:28.492161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.491906+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:07.716285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":407,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.439000+0000","last_change":"2024-09-10T14:32:51.439000+0000","last_active":"2024-09-10T14:32:51.439000+0000","last_peered":"2024-09-10T14:32:51.439000+0000","last_clean":"2024-09-10T14:32:51.439000+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:32:51.439000+0000","last_undegraded":"2024-09-10T14:32:51.439000+0000","last_fullsized":"2024-09-10T14:32:51.439000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-10T14:32:51.438638+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-10T14:32:51.438638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.438638+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:47.269056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.359041+0000","last_change":"2024-09-10T14:32:43.359041+0000","last_active":"2024-09-10T14:32:43.359041+0000","last_peered":"2024-09-10T14:32:43.359041+0000","last_clean":"2024-09-10T14:32:43.359041+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:32:43.359041+0000","last_undegraded":"2024-09-10T14:32:43.359041+0000","last_fullsized":"2024-09-10T14:32:43.359041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:43.358788+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:43.358788+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.358788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:40.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.254423+0000","last_change":"2024-09-10T14:32:48.254423+0000","last_active":"2024-09-10T14:32:48.254423+0000","last_peered":"2024-09-10T14:32:48.254423+0000","last_clean":"2024-09-10T14:32:48.254423+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:32:48.254423+0000","last_undegraded":"2024-09-10T14:32:48.254423+0000","last_fullsized":"2024-09-10T14:32:48.254423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:48.254057+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:48.254057+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.254057+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:25.991922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.761849+0000","last_change":"2024-09-10T14:33:08.761849+0000","last_active":"2024-09-10T14:33:08.761849+0000","last_peered":"2024-09-10T14:33:08.761849+0000","last_clean":"2024-09-10T14:33:08.761849+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:33:08.761849+0000","last_undegraded":"2024-09-10T14:33:08.761849+0000","last_fullsized":"2024-09-10T14:33:08.761849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:08.761592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:08.761592+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.761592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:10.906663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'5","reported_seq":241,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.465044+0000","last_change":"2024-09-10T14:32:24.465044+0000","last_active":"2024-09-10T14:32:24.465044+0000","last_peered":"2024-09-10T14:32:24.465044+0000","last_clean":"2024-09-10T14:32:24.465044+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:32:24.465044+0000","last_undegraded":"2024-09-10T14:32:24.465044+0000","last_fullsized":"2024-09-10T14:32:24.465044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.464758+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:15.815013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.479227+0000","last_change":"2024-09-10T14:32:29.479227+0000","last_active":"2024-09-10T14:32:29.479227+0000","last_peered":"2024-09-10T14:32:29.479227+0000","last_clean":"2024-09-10T14:32:29.479227+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:32:29.479227+0000","last_undegraded":"2024-09-10T14:32:29.479227+0000","last_fullsized":"2024-09-10T14:32:29.479227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.478794+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:53.505918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.041931+0000","last_change":"2024-09-10T14:32:24.041931+0000","last_active":"2024-09-10T14:32:24.041931+0000","last_peered":"2024-09-10T14:32:24.041931+0000","last_clean":"2024-09-10T14:32:24.041931+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:32:24.041931+0000","last_undegraded":"2024-09-10T14:32:24.041931+0000","last_fullsized":"2024-09-10T14:32:24.041931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.041685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:10.399631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.466264+0000","last_change":"2024-09-10T14:33:08.466320+0000","last_active":"2024-09-10T14:33:08.466264+0000","last_peered":"2024-09-10T14:33:08.466264+0000","last_clean":"2024-09-10T14:33:08.466264+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:33:08.466264+0000","last_undegraded":"2024-09-10T14:33:08.466264+0000","last_fullsized":"2024-09-10T14:33:08.466264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:33:08.466083+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:33:08.466083+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.466083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:15.113294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.364324+0000","last_change":"2024-09-10T14:32:58.364324+0000","last_active":"2024-09-10T14:32:58.364324+0000","last_peered":"2024-09-10T14:32:58.364324+0000","last_clean":"2024-09-10T14:32:58.364324+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:32:58.364324+0000","last_undegraded":"2024-09-10T14:32:58.364324+0000","last_fullsized":"2024-09-10T14:32:58.364324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:58.364049+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:58.364049+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.364049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:13.940048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.014533+0000","last_change":"2024-09-10T14:32:30.014533+0000","last_active":"2024-09-10T14:32:30.014533+0000","last_peered":"2024-09-10T14:32:30.014533+0000","last_clean":"2024-09-10T14:32:30.014533+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:32:30.014533+0000","last_undegraded":"2024-09-10T14:32:30.014533+0000","last_fullsized":"2024-09-10T14:32:30.014533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.014216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:20.605790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.517939+0000","last_change":"2024-09-10T14:32:34.517939+0000","last_active":"2024-09-10T14:32:34.517939+0000","last_peered":"2024-09-10T14:32:34.517939+0000","last_clean":"2024-09-10T14:32:34.517939+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:32:34.517939+0000","last_undegraded":"2024-09-10T14:32:34.517939+0000","last_fullsized":"2024-09-10T14:32:34.517939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.517813+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:15.055588+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.040437+0000","last_change":"2024-09-10T14:32:19.040437+0000","last_active":"2024-09-10T14:32:19.040437+0000","last_peered":"2024-09-10T14:32:19.040437+0000","last_clean":"2024-09-10T14:32:19.040437+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:32:19.040437+0000","last_undegraded":"2024-09-10T14:32:19.040437+0000","last_fullsized":"2024-09-10T14:32:19.040437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.040292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:34.054916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.402239+0000","last_change":"2024-09-10T14:32:39.402239+0000","last_active":"2024-09-10T14:32:39.402239+0000","last_peered":"2024-09-10T14:32:39.402239+0000","last_clean":"2024-09-10T14:32:39.402239+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:32:39.402239+0000","last_undegraded":"2024-09-10T14:32:39.402239+0000","last_fullsized":"2024-09-10T14:32:39.402239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.401987+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:54.650326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.972138+0000","last_change":"2024-09-10T14:32:52.972138+0000","last_active":"2024-09-10T14:32:52.972138+0000","last_peered":"2024-09-10T14:32:52.972138+0000","last_clean":"2024-09-10T14:32:52.972138+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:32:52.972138+0000","last_undegraded":"2024-09-10T14:32:52.972138+0000","last_fullsized":"2024-09-10T14:32:52.972138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:52.971889+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:52.971889+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.971889+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:26.022428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.372100+0000","last_change":"2024-09-10T14:33:05.372164+0000","last_active":"2024-09-10T14:33:05.372100+0000","last_peered":"2024-09-10T14:33:05.372100+0000","last_clean":"2024-09-10T14:33:05.372100+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:33:05.372100+0000","last_undegraded":"2024-09-10T14:33:05.372100+0000","last_fullsized":"2024-09-10T14:33:05.372100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.371906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.371906+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.371906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:27.083822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.242013+0000","last_change":"2024-09-10T14:32:42.242013+0000","last_active":"2024-09-10T14:32:42.242013+0000","last_peered":"2024-09-10T14:32:42.242013+0000","last_clean":"2024-09-10T14:32:42.242013+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:32:42.242013+0000","last_undegraded":"2024-09-10T14:32:42.242013+0000","last_fullsized":"2024-09-10T14:32:42.242013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.241760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.241760+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.241760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:14.535976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.442127+0000","last_change":"2024-09-10T14:32:39.442127+0000","last_active":"2024-09-10T14:32:39.442127+0000","last_peered":"2024-09-10T14:32:39.442127+0000","last_clean":"2024-09-10T14:32:39.442127+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:32:39.442127+0000","last_undegraded":"2024-09-10T14:32:39.442127+0000","last_fullsized":"2024-09-10T14:32:39.442127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:39.441831+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:39.441831+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.441831+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:50.008100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.039240+0000","last_change":"2024-09-10T14:32:27.039240+0000","last_active":"2024-09-10T14:32:27.039240+0000","last_peered":"2024-09-10T14:32:27.039240+0000","last_clean":"2024-09-10T14:32:27.039240+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:32:27.039240+0000","last_undegraded":"2024-09-10T14:32:27.039240+0000","last_fullsized":"2024-09-10T14:32:27.039240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.038840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:05.450794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.823525+0000","last_change":"2024-09-10T14:33:14.823588+0000","last_active":"2024-09-10T14:33:14.823525+0000","last_peered":"2024-09-10T14:33:14.823525+0000","last_clean":"2024-09-10T14:33:14.823525+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:33:14.823525+0000","last_undegraded":"2024-09-10T14:33:14.823525+0000","last_fullsized":"2024-09-10T14:33:14.823525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:14.823317+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:14.823317+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.823317+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:51.572439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.339953+0000","last_change":"2024-09-10T14:33:15.340102+0000","last_active":"2024-09-10T14:33:15.339953+0000","last_peered":"2024-09-10T14:33:15.339953+0000","last_clean":"2024-09-10T14:33:15.339953+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:33:15.339953+0000","last_undegraded":"2024-09-10T14:33:15.339953+0000","last_fullsized":"2024-09-10T14:33:15.339953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:15.339732+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:15.339732+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.339732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.260627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:22.558980+0000","last_change":"2024-09-10T14:33:22.559043+0000","last_active":"2024-09-10T14:33:22.558980+0000","last_peered":"2024-09-10T14:33:22.558980+0000","last_clean":"2024-09-10T14:33:22.558980+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:33:22.558980+0000","last_undegraded":"2024-09-10T14:33:22.558980+0000","last_fullsized":"2024-09-10T14:33:22.558980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:22.558764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:22.558764+0000","last_clean_scrub_stamp":"2024-09-10T14:33:22.558764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:38.514408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.261308+0000","last_change":"2024-09-10T14:32:41.261308+0000","last_active":"2024-09-10T14:32:41.261308+0000","last_peered":"2024-09-10T14:32:41.261308+0000","last_clean":"2024-09-10T14:32:41.261308+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:32:41.261308+0000","last_undegraded":"2024-09-10T14:32:41.261308+0000","last_fullsized":"2024-09-10T14:32:41.261308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.261061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.261061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.261061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:33.177795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'47","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.415162+0000","last_change":"2024-09-10T14:32:27.415162+0000","last_active":"2024-09-10T14:32:27.415162+0000","last_peered":"2024-09-10T14:32:27.415162+0000","last_clean":"2024-09-10T14:32:27.415162+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:32:27.415162+0000","last_undegraded":"2024-09-10T14:32:27.415162+0000","last_fullsized":"2024-09-10T14:32:27.415162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.414901+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:51.152227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.166376+0000","last_change":"2024-09-10T14:32:31.166376+0000","last_active":"2024-09-10T14:32:31.166376+0000","last_peered":"2024-09-10T14:32:31.166376+0000","last_clean":"2024-09-10T14:32:31.166376+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:32:31.166376+0000","last_undegraded":"2024-09-10T14:32:31.166376+0000","last_fullsized":"2024-09-10T14:32:31.166376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.166120+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:33.186827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:18.088880+0000","last_change":"2024-09-10T14:33:18.088936+0000","last_active":"2024-09-10T14:33:18.088880+0000","last_peered":"2024-09-10T14:33:18.088880+0000","last_clean":"2024-09-10T14:33:18.088880+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:33:18.088880+0000","last_undegraded":"2024-09-10T14:33:18.088880+0000","last_fullsized":"2024-09-10T14:33:18.088880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:18.088684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:18.088684+0000","last_clean_scrub_stamp":"2024-09-10T14:33:18.088684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:55.799130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'12","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.391058+0000","last_change":"2024-09-10T14:32:47.391058+0000","last_active":"2024-09-10T14:32:47.391058+0000","last_peered":"2024-09-10T14:32:47.391058+0000","last_clean":"2024-09-10T14:32:47.391058+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:32:47.391058+0000","last_undegraded":"2024-09-10T14:32:47.391058+0000","last_fullsized":"2024-09-10T14:32:47.391058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:47.390803+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:47.390803+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.390803+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:07.854725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:26.708915+0000","last_change":"2024-09-10T14:33:26.709043+0000","last_active":"2024-09-10T14:33:26.708915+0000","last_peered":"2024-09-10T14:33:26.708915+0000","last_clean":"2024-09-10T14:33:26.708915+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:33:26.708915+0000","last_undegraded":"2024-09-10T14:33:26.708915+0000","last_fullsized":"2024-09-10T14:33:26.708915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:26.708667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:26.708667+0000","last_clean_scrub_stamp":"2024-09-10T14:33:26.708667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:38.353927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"36'2","reported_seq":233,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.252127+0000","last_change":"2024-09-10T14:32:36.252127+0000","last_active":"2024-09-10T14:32:36.252127+0000","last_peered":"2024-09-10T14:32:36.252127+0000","last_clean":"2024-09-10T14:32:36.252127+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:32:36.252127+0000","last_undegraded":"2024-09-10T14:32:36.252127+0000","last_fullsized":"2024-09-10T14:32:36.252127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.251846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:51:42.564689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'64","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.463817+0000","last_change":"2024-09-10T14:32:33.463817+0000","last_active":"2024-09-10T14:32:33.463817+0000","last_peered":"2024-09-10T14:32:33.463817+0000","last_clean":"2024-09-10T14:32:33.463817+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:32:33.463817+0000","last_undegraded":"2024-09-10T14:32:33.463817+0000","last_fullsized":"2024-09-10T14:32:33.463817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'64","last_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_deep_scrub":"36'64","last_deep_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.463523+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:28.060036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.053813+0000","last_change":"2024-09-10T14:32:21.053813+0000","last_active":"2024-09-10T14:32:21.053813+0000","last_peered":"2024-09-10T14:32:21.053813+0000","last_clean":"2024-09-10T14:32:21.053813+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:32:21.053813+0000","last_undegraded":"2024-09-10T14:32:21.053813+0000","last_fullsized":"2024-09-10T14:32:21.053813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.053565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:23.410520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'23","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.286108+0000","last_change":"2024-09-10T14:32:47.286108+0000","last_active":"2024-09-10T14:32:47.286108+0000","last_peered":"2024-09-10T14:32:47.286108+0000","last_clean":"2024-09-10T14:32:47.286108+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:32:47.286108+0000","last_undegraded":"2024-09-10T14:32:47.286108+0000","last_fullsized":"2024-09-10T14:32:47.286108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-10T14:32:47.285847+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-10T14:32:47.285847+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.285847+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:11.350745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.833610+0000","last_change":"2024-09-10T14:32:58.833610+0000","last_active":"2024-09-10T14:32:58.833610+0000","last_peered":"2024-09-10T14:32:58.833610+0000","last_clean":"2024-09-10T14:32:58.833610+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:32:58.833610+0000","last_undegraded":"2024-09-10T14:32:58.833610+0000","last_fullsized":"2024-09-10T14:32:58.833610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:58.833329+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:58.833329+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.833329+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:15.018214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.106324+0000","last_change":"2024-09-10T14:33:11.106497+0000","last_active":"2024-09-10T14:33:11.106324+0000","last_peered":"2024-09-10T14:33:11.106324+0000","last_clean":"2024-09-10T14:33:11.106324+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:33:11.106324+0000","last_undegraded":"2024-09-10T14:33:11.106324+0000","last_fullsized":"2024-09-10T14:33:11.106324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:11.106093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:11.106093+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.106093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:42.567754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.417891+0000","last_change":"2024-09-10T14:32:41.417891+0000","last_active":"2024-09-10T14:32:41.417891+0000","last_peered":"2024-09-10T14:32:41.417891+0000","last_clean":"2024-09-10T14:32:41.417891+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:32:41.417891+0000","last_undegraded":"2024-09-10T14:32:41.417891+0000","last_fullsized":"2024-09-10T14:32:41.417891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.417613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.417613+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.417613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:31.173045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.040293+0000","last_change":"2024-09-10T14:32:26.040293+0000","last_active":"2024-09-10T14:32:26.040293+0000","last_peered":"2024-09-10T14:32:26.040293+0000","last_clean":"2024-09-10T14:32:26.040293+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:32:26.040293+0000","last_undegraded":"2024-09-10T14:32:26.040293+0000","last_fullsized":"2024-09-10T14:32:26.040293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.040008+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:55.634620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.412041+0000","last_change":"2024-09-10T14:32:59.412041+0000","last_active":"2024-09-10T14:32:59.412041+0000","last_peered":"2024-09-10T14:32:59.412041+0000","last_clean":"2024-09-10T14:32:59.412041+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:32:59.412041+0000","last_undegraded":"2024-09-10T14:32:59.412041+0000","last_fullsized":"2024-09-10T14:32:59.412041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:59.411794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:59.411794+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.411794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:24.669220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243371+0000","last_change":"2024-09-10T14:28:38.941887+0000","last_active":"2024-09-10T14:32:20.243371+0000","last_peered":"2024-09-10T14:32:20.243371+0000","last_clean":"2024-09-10T14:32:20.243371+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:32:20.243371+0000","last_undegraded":"2024-09-10T14:32:20.243371+0000","last_fullsized":"2024-09-10T14:32:20.243371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.478577+0000","last_change":"2024-09-10T14:32:32.478577+0000","last_active":"2024-09-10T14:32:32.478577+0000","last_peered":"2024-09-10T14:32:32.478577+0000","last_clean":"2024-09-10T14:32:32.478577+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:32:32.478577+0000","last_undegraded":"2024-09-10T14:32:32.478577+0000","last_fullsized":"2024-09-10T14:32:32.478577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.478327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:57.945668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:21.570254+0000","last_change":"2024-09-10T14:33:21.570325+0000","last_active":"2024-09-10T14:33:21.570254+0000","last_peered":"2024-09-10T14:33:21.570254+0000","last_clean":"2024-09-10T14:33:21.570254+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:33:21.570254+0000","last_undegraded":"2024-09-10T14:33:21.570254+0000","last_fullsized":"2024-09-10T14:33:21.570254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:21.570021+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:21.570021+0000","last_clean_scrub_stamp":"2024-09-10T14:33:21.570021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:13.308557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.294294+0000","last_change":"2024-09-10T14:32:40.294294+0000","last_active":"2024-09-10T14:32:40.294294+0000","last_peered":"2024-09-10T14:32:40.294294+0000","last_clean":"2024-09-10T14:32:40.294294+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:32:40.294294+0000","last_undegraded":"2024-09-10T14:32:40.294294+0000","last_fullsized":"2024-09-10T14:32:40.294294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:40.293913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:40.293913+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.293913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:23.340331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.499425+0000","last_change":"2024-09-10T14:32:33.499425+0000","last_active":"2024-09-10T14:32:33.499425+0000","last_peered":"2024-09-10T14:32:33.499425+0000","last_clean":"2024-09-10T14:32:33.499425+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:32:33.499425+0000","last_undegraded":"2024-09-10T14:32:33.499425+0000","last_fullsized":"2024-09-10T14:32:33.499425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.499022+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.396571+0000","last_change":"2024-09-10T14:32:22.396571+0000","last_active":"2024-09-10T14:32:22.396571+0000","last_peered":"2024-09-10T14:32:22.396571+0000","last_clean":"2024-09-10T14:32:22.396571+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:32:22.396571+0000","last_undegraded":"2024-09-10T14:32:22.396571+0000","last_fullsized":"2024-09-10T14:32:22.396571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.396275+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:50.169559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:19.052909+0000","last_change":"2024-09-10T14:33:19.052978+0000","last_active":"2024-09-10T14:33:19.052909+0000","last_peered":"2024-09-10T14:33:19.052909+0000","last_clean":"2024-09-10T14:33:19.052909+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:33:19.052909+0000","last_undegraded":"2024-09-10T14:33:19.052909+0000","last_fullsized":"2024-09-10T14:33:19.052909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-10T14:33:19.052723+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-10T14:33:19.052723+0000","last_clean_scrub_stamp":"2024-09-10T14:33:19.052723+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:44.310149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.368051+0000","last_change":"2024-09-10T14:32:53.368051+0000","last_active":"2024-09-10T14:32:53.368051+0000","last_peered":"2024-09-10T14:32:53.368051+0000","last_clean":"2024-09-10T14:32:53.368051+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:32:53.368051+0000","last_undegraded":"2024-09-10T14:32:53.368051+0000","last_fullsized":"2024-09-10T14:32:53.368051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:53.367787+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:53.367787+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.367787+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.443273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:20.529163+0000","last_change":"2024-09-10T14:33:20.529302+0000","last_active":"2024-09-10T14:33:20.529163+0000","last_peered":"2024-09-10T14:33:20.529163+0000","last_clean":"2024-09-10T14:33:20.529163+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:33:20.529163+0000","last_undegraded":"2024-09-10T14:33:20.529163+0000","last_fullsized":"2024-09-10T14:33:20.529163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:20.528875+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:20.528875+0000","last_clean_scrub_stamp":"2024-09-10T14:33:20.528875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:09.074771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.957497+0000","last_change":"2024-09-10T14:32:31.957497+0000","last_active":"2024-09-10T14:32:31.957497+0000","last_peered":"2024-09-10T14:32:31.957497+0000","last_clean":"2024-09-10T14:32:31.957497+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:32:31.957497+0000","last_undegraded":"2024-09-10T14:32:31.957497+0000","last_fullsized":"2024-09-10T14:32:31.957497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.957244+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:59.661372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.518513+0000","last_change":"2024-09-10T14:32:45.518513+0000","last_active":"2024-09-10T14:32:45.518513+0000","last_peered":"2024-09-10T14:32:45.518513+0000","last_clean":"2024-09-10T14:32:45.518513+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:32:45.518513+0000","last_undegraded":"2024-09-10T14:32:45.518513+0000","last_fullsized":"2024-09-10T14:32:45.518513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:45.518255+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:45.518255+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.518255+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:33.065215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":475,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.046231+0000","last_change":"2024-09-10T14:32:27.046231+0000","last_active":"2024-09-10T14:32:27.046231+0000","last_peered":"2024-09-10T14:32:27.046231+0000","last_clean":"2024-09-10T14:32:27.046231+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:32:27.046231+0000","last_undegraded":"2024-09-10T14:32:27.046231+0000","last_fullsized":"2024-09-10T14:32:27.046231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.045975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:13.403921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.470074+0000","last_change":"2024-09-10T14:32:31.470074+0000","last_active":"2024-09-10T14:32:31.470074+0000","last_peered":"2024-09-10T14:32:31.470074+0000","last_clean":"2024-09-10T14:32:31.470074+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:32:31.470074+0000","last_undegraded":"2024-09-10T14:32:31.470074+0000","last_fullsized":"2024-09-10T14:32:31.470074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.469828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:50.291732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.988547+0000","last_change":"2024-09-10T14:32:40.988547+0000","last_active":"2024-09-10T14:32:40.988547+0000","last_peered":"2024-09-10T14:32:40.988547+0000","last_clean":"2024-09-10T14:32:40.988547+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:32:40.988547+0000","last_undegraded":"2024-09-10T14:32:40.988547+0000","last_fullsized":"2024-09-10T14:32:40.988547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:40.988250+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:40.988250+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.988250+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:03.901456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.470613+0000","last_change":"2024-09-10T14:33:10.470677+0000","last_active":"2024-09-10T14:33:10.470613+0000","last_peered":"2024-09-10T14:33:10.470613+0000","last_clean":"2024-09-10T14:33:10.470613+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:33:10.470613+0000","last_undegraded":"2024-09-10T14:33:10.470613+0000","last_fullsized":"2024-09-10T14:33:10.470613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.470416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.470416+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.470416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:00.133222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.468662+0000","last_change":"2024-09-10T14:32:23.468662+0000","last_active":"2024-09-10T14:32:23.468662+0000","last_peered":"2024-09-10T14:32:23.468662+0000","last_clean":"2024-09-10T14:32:23.468662+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:32:23.468662+0000","last_undegraded":"2024-09-10T14:32:23.468662+0000","last_fullsized":"2024-09-10T14:32:23.468662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.468416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:16.409761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.023066+0000","last_change":"2024-09-10T14:32:28.023066+0000","last_active":"2024-09-10T14:32:28.023066+0000","last_peered":"2024-09-10T14:32:28.023066+0000","last_clean":"2024-09-10T14:32:28.023066+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:32:28.023066+0000","last_undegraded":"2024-09-10T14:32:28.023066+0000","last_fullsized":"2024-09-10T14:32:28.023066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.022782+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:04.020612+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.346431+0000","last_change":"2024-09-10T14:32:21.346431+0000","last_active":"2024-09-10T14:32:21.346431+0000","last_peered":"2024-09-10T14:32:21.346431+0000","last_clean":"2024-09-10T14:32:21.346431+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:32:21.346431+0000","last_undegraded":"2024-09-10T14:32:21.346431+0000","last_fullsized":"2024-09-10T14:32:21.346431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.346185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:37.786157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'15","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.896938+0000","last_change":"2024-09-10T14:32:42.896938+0000","last_active":"2024-09-10T14:32:42.896938+0000","last_peered":"2024-09-10T14:32:42.896938+0000","last_clean":"2024-09-10T14:32:42.896938+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:32:42.896938+0000","last_undegraded":"2024-09-10T14:32:42.896938+0000","last_fullsized":"2024-09-10T14:32:42.896938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:42.896656+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:42.896656+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.896656+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:25.943074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.450748+0000","last_change":"2024-09-10T14:32:36.450748+0000","last_active":"2024-09-10T14:32:36.450748+0000","last_peered":"2024-09-10T14:32:36.450748+0000","last_clean":"2024-09-10T14:32:36.450748+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:32:36.450748+0000","last_undegraded":"2024-09-10T14:32:36.450748+0000","last_fullsized":"2024-09-10T14:32:36.450748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.450484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:32.265283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.835924+0000","last_change":"2024-09-10T14:33:04.836002+0000","last_active":"2024-09-10T14:33:04.835924+0000","last_peered":"2024-09-10T14:33:04.835924+0000","last_clean":"2024-09-10T14:33:04.835924+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:33:04.835924+0000","last_undegraded":"2024-09-10T14:33:04.835924+0000","last_fullsized":"2024-09-10T14:33:04.835924+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-10T14:33:04.835705+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-10T14:33:04.835705+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.835705+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:55:10.228765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:32.734560+0000","last_change":"2024-09-10T14:33:32.734626+0000","last_active":"2024-09-10T14:33:32.734560+0000","last_peered":"2024-09-10T14:33:32.734560+0000","last_clean":"2024-09-10T14:33:32.734560+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:33:32.734560+0000","last_undegraded":"2024-09-10T14:33:32.734560+0000","last_fullsized":"2024-09-10T14:33:32.734560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:32.734372+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:32.734372+0000","last_clean_scrub_stamp":"2024-09-10T14:33:32.734372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:13.088342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:23.604305+0000","last_change":"2024-09-10T14:33:23.604443+0000","last_active":"2024-09-10T14:33:23.604305+0000","last_peered":"2024-09-10T14:33:23.604305+0000","last_clean":"2024-09-10T14:33:23.604305+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:33:23.604305+0000","last_undegraded":"2024-09-10T14:33:23.604305+0000","last_fullsized":"2024-09-10T14:33:23.604305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:23.604079+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:23.604079+0000","last_clean_scrub_stamp":"2024-09-10T14:33:23.604079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:26.490068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.952793+0000","last_change":"2024-09-10T14:32:36.952793+0000","last_active":"2024-09-10T14:32:36.952793+0000","last_peered":"2024-09-10T14:32:36.952793+0000","last_clean":"2024-09-10T14:32:36.952793+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:32:36.952793+0000","last_undegraded":"2024-09-10T14:32:36.952793+0000","last_fullsized":"2024-09-10T14:32:36.952793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.952410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:45.541704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'90","reported_seq":183,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.479235+0000","last_change":"2024-09-10T14:32:48.479235+0000","last_active":"2024-09-10T14:32:48.479235+0000","last_peered":"2024-09-10T14:32:48.479235+0000","last_clean":"2024-09-10T14:32:48.479235+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:32:48.479235+0000","last_undegraded":"2024-09-10T14:32:48.479235+0000","last_fullsized":"2024-09-10T14:32:48.479235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-09-10T14:32:48.478990+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-09-10T14:32:48.478990+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.478990+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:01.329596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.266984+0000","last_change":"2024-09-10T14:32:43.266984+0000","last_active":"2024-09-10T14:32:43.266984+0000","last_peered":"2024-09-10T14:32:43.266984+0000","last_clean":"2024-09-10T14:32:43.266984+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:32:43.266984+0000","last_undegraded":"2024-09-10T14:32:43.266984+0000","last_fullsized":"2024-09-10T14:32:43.266984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:43.266713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:43.266713+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.266713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:55.597757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.463686+0000","last_change":"2024-09-10T14:32:27.463686+0000","last_active":"2024-09-10T14:32:27.463686+0000","last_peered":"2024-09-10T14:32:27.463686+0000","last_clean":"2024-09-10T14:32:27.463686+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:32:27.463686+0000","last_undegraded":"2024-09-10T14:32:27.463686+0000","last_fullsized":"2024-09-10T14:32:27.463686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.463440+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:01.315498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.420075+0000","last_change":"2024-09-10T14:32:58.420191+0000","last_active":"2024-09-10T14:32:58.420075+0000","last_peered":"2024-09-10T14:32:58.420075+0000","last_clean":"2024-09-10T14:32:58.420075+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:32:58.420075+0000","last_undegraded":"2024-09-10T14:32:58.420075+0000","last_fullsized":"2024-09-10T14:32:58.420075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:58.419787+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:58.419787+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.419787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:20.379479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:29.788045+0000","last_change":"2024-09-10T14:33:29.788100+0000","last_active":"2024-09-10T14:33:29.788045+0000","last_peered":"2024-09-10T14:33:29.788045+0000","last_clean":"2024-09-10T14:33:29.788045+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:33:29.788045+0000","last_undegraded":"2024-09-10T14:33:29.788045+0000","last_fullsized":"2024-09-10T14:33:29.788045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:29.787826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:29.787826+0000","last_clean_scrub_stamp":"2024-09-10T14:33:29.787826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:04:09.380313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.079949+0000","last_change":"2024-09-10T14:33:07.080019+0000","last_active":"2024-09-10T14:33:07.079949+0000","last_peered":"2024-09-10T14:33:07.079949+0000","last_clean":"2024-09-10T14:33:07.079949+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:33:07.079949+0000","last_undegraded":"2024-09-10T14:33:07.079949+0000","last_fullsized":"2024-09-10T14:33:07.079949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:07.079757+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:07.079757+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.079757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:47.031785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.453049+0000","last_change":"2024-09-10T14:32:22.453049+0000","last_active":"2024-09-10T14:32:22.453049+0000","last_peered":"2024-09-10T14:32:22.453049+0000","last_clean":"2024-09-10T14:32:22.453049+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:32:22.453049+0000","last_undegraded":"2024-09-10T14:32:22.453049+0000","last_fullsized":"2024-09-10T14:32:22.453049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.452808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:07.398717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'292","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.028865+0000","last_change":"2024-09-10T14:32:22.028865+0000","last_active":"2024-09-10T14:32:22.028865+0000","last_peered":"2024-09-10T14:32:22.028865+0000","last_clean":"2024-09-10T14:32:22.028865+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:32:22.028865+0000","last_undegraded":"2024-09-10T14:32:22.028865+0000","last_fullsized":"2024-09-10T14:32:22.028865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'292","last_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_deep_scrub":"36'292","last_deep_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.028508+0000","objects_scrubbed":10,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:37.043133+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.471881+0000","last_change":"2024-09-10T14:32:47.471881+0000","last_active":"2024-09-10T14:32:47.471881+0000","last_peered":"2024-09-10T14:32:47.471881+0000","last_clean":"2024-09-10T14:32:47.471881+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:32:47.471881+0000","last_undegraded":"2024-09-10T14:32:47.471881+0000","last_fullsized":"2024-09-10T14:32:47.471881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:47.471638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:47.471638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.471638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:38.822368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:18.801216+0000","last_change":"2024-09-10T14:33:18.801281+0000","last_active":"2024-09-10T14:33:18.801216+0000","last_peered":"2024-09-10T14:33:18.801216+0000","last_clean":"2024-09-10T14:33:18.801216+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:33:18.801216+0000","last_undegraded":"2024-09-10T14:33:18.801216+0000","last_fullsized":"2024-09-10T14:33:18.801216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:33:18.801021+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:33:18.801021+0000","last_clean_scrub_stamp":"2024-09-10T14:33:18.801021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:34.431828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.127208+0000","last_change":"2024-09-10T14:33:13.127336+0000","last_active":"2024-09-10T14:33:13.127208+0000","last_peered":"2024-09-10T14:33:13.127208+0000","last_clean":"2024-09-10T14:33:13.127208+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:33:13.127208+0000","last_undegraded":"2024-09-10T14:33:13.127208+0000","last_fullsized":"2024-09-10T14:33:13.127208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:13.126986+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:13.126986+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.126986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:19.523672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.366239+0000","last_change":"2024-09-10T14:33:01.366298+0000","last_active":"2024-09-10T14:33:01.366239+0000","last_peered":"2024-09-10T14:33:01.366239+0000","last_clean":"2024-09-10T14:33:01.366239+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:33:01.366239+0000","last_undegraded":"2024-09-10T14:33:01.366239+0000","last_fullsized":"2024-09-10T14:33:01.366239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:01.366030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:01.366030+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.366030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:31.331688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.104961+0000","last_change":"2024-09-10T14:33:08.105090+0000","last_active":"2024-09-10T14:33:08.104961+0000","last_peered":"2024-09-10T14:33:08.104961+0000","last_clean":"2024-09-10T14:33:08.104961+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:33:08.104961+0000","last_undegraded":"2024-09-10T14:33:08.104961+0000","last_fullsized":"2024-09-10T14:33:08.104961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:08.104703+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:08.104703+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.104703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.825132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.335896+0000","last_change":"2024-09-10T14:32:44.335896+0000","last_active":"2024-09-10T14:32:44.335896+0000","last_peered":"2024-09-10T14:32:44.335896+0000","last_clean":"2024-09-10T14:32:44.335896+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:32:44.335896+0000","last_undegraded":"2024-09-10T14:32:44.335896+0000","last_fullsized":"2024-09-10T14:32:44.335896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:44.335653+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:44.335653+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.335653+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:10.314679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'24","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.504309+0000","last_change":"2024-09-10T14:32:36.504309+0000","last_active":"2024-09-10T14:32:36.504309+0000","last_peered":"2024-09-10T14:32:36.504309+0000","last_clean":"2024-09-10T14:32:36.504309+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:32:36.504309+0000","last_undegraded":"2024-09-10T14:32:36.504309+0000","last_fullsized":"2024-09-10T14:32:36.504309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.504009+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:54.102292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.223829+0000","last_change":"2024-09-10T14:32:35.223829+0000","last_active":"2024-09-10T14:32:35.223829+0000","last_peered":"2024-09-10T14:32:35.223829+0000","last_clean":"2024-09-10T14:32:35.223829+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:32:35.223829+0000","last_undegraded":"2024-09-10T14:32:35.223829+0000","last_fullsized":"2024-09-10T14:32:35.223829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.223582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:41.920597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243217+0000","last_change":"2024-09-10T14:28:38.943308+0000","last_active":"2024-09-10T14:32:20.243217+0000","last_peered":"2024-09-10T14:32:20.243217+0000","last_clean":"2024-09-10T14:32:20.243217+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:32:20.243217+0000","last_undegraded":"2024-09-10T14:32:20.243217+0000","last_fullsized":"2024-09-10T14:32:20.243217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.202665+0000","last_change":"2024-09-10T14:32:51.202723+0000","last_active":"2024-09-10T14:32:51.202665+0000","last_peered":"2024-09-10T14:32:51.202665+0000","last_clean":"2024-09-10T14:32:51.202665+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:32:51.202665+0000","last_undegraded":"2024-09-10T14:32:51.202665+0000","last_fullsized":"2024-09-10T14:32:51.202665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:51.202477+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:51.202477+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.202477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:44.072182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:31.747383+0000","last_change":"2024-09-10T14:33:31.747454+0000","last_active":"2024-09-10T14:33:31.747383+0000","last_peered":"2024-09-10T14:33:31.747383+0000","last_clean":"2024-09-10T14:33:31.747383+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:33:31.747383+0000","last_undegraded":"2024-09-10T14:33:31.747383+0000","last_fullsized":"2024-09-10T14:33:31.747383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:33:31.747174+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:33:31.747174+0000","last_clean_scrub_stamp":"2024-09-10T14:33:31.747174+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:45.297007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.348723+0000","last_change":"2024-09-10T14:33:03.348790+0000","last_active":"2024-09-10T14:33:03.348723+0000","last_peered":"2024-09-10T14:33:03.348723+0000","last_clean":"2024-09-10T14:33:03.348723+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:33:03.348723+0000","last_undegraded":"2024-09-10T14:33:03.348723+0000","last_fullsized":"2024-09-10T14:33:03.348723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.348519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.348519+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.348519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:28.975289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.202503+0000","last_change":"2024-09-10T14:32:34.202503+0000","last_active":"2024-09-10T14:32:34.202503+0000","last_peered":"2024-09-10T14:32:34.202503+0000","last_clean":"2024-09-10T14:32:34.202503+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:32:34.202503+0000","last_undegraded":"2024-09-10T14:32:34.202503+0000","last_fullsized":"2024-09-10T14:32:34.202503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.202259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:34.865922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.472613+0000","last_change":"2024-09-10T14:32:46.472613+0000","last_active":"2024-09-10T14:32:46.472613+0000","last_peered":"2024-09-10T14:32:46.472613+0000","last_clean":"2024-09-10T14:32:46.472613+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:32:46.472613+0000","last_undegraded":"2024-09-10T14:32:46.472613+0000","last_fullsized":"2024-09-10T14:32:46.472613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-10T14:32:46.472335+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-10T14:32:46.472335+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.472335+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:11:41.354491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.482747+0000","last_change":"2024-09-10T14:32:43.482747+0000","last_active":"2024-09-10T14:32:43.482747+0000","last_peered":"2024-09-10T14:32:43.482747+0000","last_clean":"2024-09-10T14:32:43.482747+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:32:43.482747+0000","last_undegraded":"2024-09-10T14:32:43.482747+0000","last_fullsized":"2024-09-10T14:32:43.482747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:43.482370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:43.482370+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.482370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:32.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.908593+0000","last_change":"2024-09-10T14:32:46.908593+0000","last_active":"2024-09-10T14:32:46.908593+0000","last_peered":"2024-09-10T14:32:46.908593+0000","last_clean":"2024-09-10T14:32:46.908593+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:32:46.908593+0000","last_undegraded":"2024-09-10T14:32:46.908593+0000","last_fullsized":"2024-09-10T14:32:46.908593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:46.908307+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:46.908307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.908307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:02.194310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.889550+0000","last_change":"2024-09-10T14:32:47.889610+0000","last_active":"2024-09-10T14:32:47.889550+0000","last_peered":"2024-09-10T14:32:47.889550+0000","last_clean":"2024-09-10T14:32:47.889550+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:32:47.889550+0000","last_undegraded":"2024-09-10T14:32:47.889550+0000","last_fullsized":"2024-09-10T14:32:47.889550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:47.889337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:47.889337+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.889337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:25:53.199083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.349827+0000","last_change":"2024-09-10T14:32:54.349892+0000","last_active":"2024-09-10T14:32:54.349827+0000","last_peered":"2024-09-10T14:32:54.349827+0000","last_clean":"2024-09-10T14:32:54.349827+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:32:54.349827+0000","last_undegraded":"2024-09-10T14:32:54.349827+0000","last_fullsized":"2024-09-10T14:32:54.349827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:54.349626+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:54.349626+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.349626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.122241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.107484+0000","last_change":"2024-09-10T14:33:05.107539+0000","last_active":"2024-09-10T14:33:05.107484+0000","last_peered":"2024-09-10T14:33:05.107484+0000","last_clean":"2024-09-10T14:33:05.107484+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:33:05.107484+0000","last_undegraded":"2024-09-10T14:33:05.107484+0000","last_fullsized":"2024-09-10T14:33:05.107484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.107286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.107286+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.107286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:05.392930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.405071+0000","last_change":"2024-09-10T14:33:12.405071+0000","last_active":"2024-09-10T14:33:12.405071+0000","last_peered":"2024-09-10T14:33:12.405071+0000","last_clean":"2024-09-10T14:33:12.405071+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:33:12.405071+0000","last_undegraded":"2024-09-10T14:33:12.405071+0000","last_fullsized":"2024-09-10T14:33:12.405071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:12.404820+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:12.404820+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.404820+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.685015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'74","reported_seq":153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.093004+0000","last_change":"2024-09-10T14:32:29.093004+0000","last_active":"2024-09-10T14:32:29.093004+0000","last_peered":"2024-09-10T14:32:29.093004+0000","last_clean":"2024-09-10T14:32:29.093004+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:32:29.093004+0000","last_undegraded":"2024-09-10T14:32:29.093004+0000","last_fullsized":"2024-09-10T14:32:29.093004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.092705+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:13.603769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.438626+0000","last_change":"2024-09-10T14:32:24.438626+0000","last_active":"2024-09-10T14:32:24.438626+0000","last_peered":"2024-09-10T14:32:24.438626+0000","last_clean":"2024-09-10T14:32:24.438626+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:32:24.438626+0000","last_undegraded":"2024-09-10T14:32:24.438626+0000","last_fullsized":"2024-09-10T14:32:24.438626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.438373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:44.201354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.129819+0000","last_change":"2024-09-10T14:33:15.129881+0000","last_active":"2024-09-10T14:33:15.129819+0000","last_peered":"2024-09-10T14:33:15.129819+0000","last_clean":"2024-09-10T14:33:15.129819+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:33:15.129819+0000","last_undegraded":"2024-09-10T14:33:15.129819+0000","last_fullsized":"2024-09-10T14:33:15.129819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-10T14:33:15.129629+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-10T14:33:15.129629+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.129629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:01.550502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.900251+0000","last_change":"2024-09-10T14:32:43.900313+0000","last_active":"2024-09-10T14:32:43.900251+0000","last_peered":"2024-09-10T14:32:43.900251+0000","last_clean":"2024-09-10T14:32:43.900251+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:32:43.900251+0000","last_undegraded":"2024-09-10T14:32:43.900251+0000","last_fullsized":"2024-09-10T14:32:43.900251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:43.900061+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:43.900061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.900061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:35.816795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.216970+0000","last_change":"2024-09-10T14:32:52.217031+0000","last_active":"2024-09-10T14:32:52.216970+0000","last_peered":"2024-09-10T14:32:52.216970+0000","last_clean":"2024-09-10T14:32:52.216970+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:32:52.216970+0000","last_undegraded":"2024-09-10T14:32:52.216970+0000","last_fullsized":"2024-09-10T14:32:52.216970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:52.216776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:52.216776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.216776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:17.684116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:30.765955+0000","last_change":"2024-09-10T14:33:30.766008+0000","last_active":"2024-09-10T14:33:30.765955+0000","last_peered":"2024-09-10T14:33:30.765955+0000","last_clean":"2024-09-10T14:33:30.765955+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:33:30.765955+0000","last_undegraded":"2024-09-10T14:33:30.765955+0000","last_fullsized":"2024-09-10T14:33:30.765955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:30.765753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:30.765753+0000","last_clean_scrub_stamp":"2024-09-10T14:33:30.765753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:53.920930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.399267+0000","last_change":"2024-09-10T14:32:28.399267+0000","last_active":"2024-09-10T14:32:28.399267+0000","last_peered":"2024-09-10T14:32:28.399267+0000","last_clean":"2024-09-10T14:32:28.399267+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:32:28.399267+0000","last_undegraded":"2024-09-10T14:32:28.399267+0000","last_fullsized":"2024-09-10T14:32:28.399267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.398875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:59.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'22","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.978344+0000","last_change":"2024-09-10T14:32:20.978344+0000","last_active":"2024-09-10T14:32:20.978344+0000","last_peered":"2024-09-10T14:32:20.978344+0000","last_clean":"2024-09-10T14:32:20.978344+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:32:20.978344+0000","last_undegraded":"2024-09-10T14:32:20.978344+0000","last_fullsized":"2024-09-10T14:32:20.978344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.978065+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:42.621330+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":390,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.978149+0000","last_change":"2024-09-10T14:32:22.978149+0000","last_active":"2024-09-10T14:32:22.978149+0000","last_peered":"2024-09-10T14:32:22.978149+0000","last_clean":"2024-09-10T14:32:22.978149+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:32:22.978149+0000","last_undegraded":"2024-09-10T14:32:22.978149+0000","last_fullsized":"2024-09-10T14:32:22.978149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.977905+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:38.553496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.459799+0000","last_change":"2024-09-10T14:33:07.459799+0000","last_active":"2024-09-10T14:33:07.459799+0000","last_peered":"2024-09-10T14:33:07.459799+0000","last_clean":"2024-09-10T14:33:07.459799+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:33:07.459799+0000","last_undegraded":"2024-09-10T14:33:07.459799+0000","last_fullsized":"2024-09-10T14:33:07.459799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:07.459543+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:07.459543+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.459543+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:50.151279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.418284+0000","last_change":"2024-09-10T14:32:37.418352+0000","last_active":"2024-09-10T14:32:37.418284+0000","last_peered":"2024-09-10T14:32:37.418284+0000","last_clean":"2024-09-10T14:32:37.418284+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:32:37.418284+0000","last_undegraded":"2024-09-10T14:32:37.418284+0000","last_fullsized":"2024-09-10T14:32:37.418284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.418081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:08.888989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.498661+0000","last_change":"2024-09-10T14:33:17.498728+0000","last_active":"2024-09-10T14:33:17.498661+0000","last_peered":"2024-09-10T14:33:17.498661+0000","last_clean":"2024-09-10T14:33:17.498661+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:33:17.498661+0000","last_undegraded":"2024-09-10T14:33:17.498661+0000","last_fullsized":"2024-09-10T14:33:17.498661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:17.498459+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:17.498459+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.498459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:25.319966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.087189+0000","last_change":"2024-09-10T14:33:06.087245+0000","last_active":"2024-09-10T14:33:06.087189+0000","last_peered":"2024-09-10T14:33:06.087189+0000","last_clean":"2024-09-10T14:33:06.087189+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:33:06.087189+0000","last_undegraded":"2024-09-10T14:33:06.087189+0000","last_fullsized":"2024-09-10T14:33:06.087189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:06.086999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:06.086999+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.086999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:08.232070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.448927+0000","last_change":"2024-09-10T14:32:29.448927+0000","last_active":"2024-09-10T14:32:29.448927+0000","last_peered":"2024-09-10T14:32:29.448927+0000","last_clean":"2024-09-10T14:32:29.448927+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:32:29.448927+0000","last_undegraded":"2024-09-10T14:32:29.448927+0000","last_fullsized":"2024-09-10T14:32:29.448927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.448685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:13.499393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.429507+0000","last_change":"2024-09-10T14:32:35.429507+0000","last_active":"2024-09-10T14:32:35.429507+0000","last_peered":"2024-09-10T14:32:35.429507+0000","last_clean":"2024-09-10T14:32:35.429507+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:32:35.429507+0000","last_undegraded":"2024-09-10T14:32:35.429507+0000","last_fullsized":"2024-09-10T14:32:35.429507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.429210+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:32.213391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":405,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.060686+0000","last_change":"2024-09-10T14:32:25.060686+0000","last_active":"2024-09-10T14:32:25.060686+0000","last_peered":"2024-09-10T14:32:25.060686+0000","last_clean":"2024-09-10T14:32:25.060686+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:32:25.060686+0000","last_undegraded":"2024-09-10T14:32:25.060686+0000","last_fullsized":"2024-09-10T14:32:25.060686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.060434+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:01.652381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.824552+0000","last_change":"2024-09-10T14:33:15.824613+0000","last_active":"2024-09-10T14:33:15.824552+0000","last_peered":"2024-09-10T14:33:15.824552+0000","last_clean":"2024-09-10T14:33:15.824552+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:33:15.824552+0000","last_undegraded":"2024-09-10T14:33:15.824552+0000","last_fullsized":"2024-09-10T14:33:15.824552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-10T14:33:15.824338+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-10T14:33:15.824338+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.824338+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:52.564936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.320535+0000","last_change":"2024-09-10T14:32:59.320601+0000","last_active":"2024-09-10T14:32:59.320535+0000","last_peered":"2024-09-10T14:32:59.320535+0000","last_clean":"2024-09-10T14:32:59.320535+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:32:59.320535+0000","last_undegraded":"2024-09-10T14:32:59.320535+0000","last_fullsized":"2024-09-10T14:32:59.320535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:59.320328+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:59.320328+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.320328+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:35.873871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.786494+0000","last_change":"2024-09-10T14:32:59.786629+0000","last_active":"2024-09-10T14:32:59.786494+0000","last_peered":"2024-09-10T14:32:59.786494+0000","last_clean":"2024-09-10T14:32:59.786494+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:32:59.786494+0000","last_undegraded":"2024-09-10T14:32:59.786494+0000","last_fullsized":"2024-09-10T14:32:59.786494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:59.786205+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:59.786205+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.786205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:49.511711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:33.718379+0000","last_change":"2024-09-10T14:33:33.718436+0000","last_active":"2024-09-10T14:33:33.718379+0000","last_peered":"2024-09-10T14:33:33.718379+0000","last_clean":"2024-09-10T14:33:33.718379+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:33:33.718379+0000","last_undegraded":"2024-09-10T14:33:33.718379+0000","last_fullsized":"2024-09-10T14:33:33.718379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:33.718178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:33.718178+0000","last_clean_scrub_stamp":"2024-09-10T14:33:33.718178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:08.534723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.463375+0000","last_change":"2024-09-10T14:32:30.463375+0000","last_active":"2024-09-10T14:32:30.463375+0000","last_peered":"2024-09-10T14:32:30.463375+0000","last_clean":"2024-09-10T14:32:30.463375+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:32:30.463375+0000","last_undegraded":"2024-09-10T14:32:30.463375+0000","last_fullsized":"2024-09-10T14:32:30.463375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.463102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:57.418601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.519074+0000","last_change":"2024-09-10T14:32:30.519074+0000","last_active":"2024-09-10T14:32:30.519074+0000","last_peered":"2024-09-10T14:32:30.519074+0000","last_clean":"2024-09-10T14:32:30.519074+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:32:30.519074+0000","last_undegraded":"2024-09-10T14:32:30.519074+0000","last_fullsized":"2024-09-10T14:32:30.519074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'97","last_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_deep_scrub":"36'97","last_deep_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.518776+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:01.405166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.030434+0000","last_change":"2024-09-10T14:32:22.030434+0000","last_active":"2024-09-10T14:32:22.030434+0000","last_peered":"2024-09-10T14:32:22.030434+0000","last_clean":"2024-09-10T14:32:22.030434+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:32:22.030434+0000","last_undegraded":"2024-09-10T14:32:22.030434+0000","last_fullsized":"2024-09-10T14:32:22.030434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.030103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:44.176468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.500613+0000","last_change":"2024-09-10T14:32:35.500613+0000","last_active":"2024-09-10T14:32:35.500613+0000","last_peered":"2024-09-10T14:32:35.500613+0000","last_clean":"2024-09-10T14:32:35.500613+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:32:35.500613+0000","last_undegraded":"2024-09-10T14:32:35.500613+0000","last_fullsized":"2024-09-10T14:32:35.500613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:58.771563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.327446+0000","last_change":"2024-09-10T14:33:10.327507+0000","last_active":"2024-09-10T14:33:10.327446+0000","last_peered":"2024-09-10T14:33:10.327446+0000","last_clean":"2024-09-10T14:33:10.327446+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:33:10.327446+0000","last_undegraded":"2024-09-10T14:33:10.327446+0000","last_fullsized":"2024-09-10T14:33:10.327446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:10.327230+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:10.327230+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.327230+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:02.825425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.340093+0000","last_change":"2024-09-10T14:33:09.340093+0000","last_active":"2024-09-10T14:33:09.340093+0000","last_peered":"2024-09-10T14:33:09.340093+0000","last_clean":"2024-09-10T14:33:09.340093+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:33:09.340093+0000","last_undegraded":"2024-09-10T14:33:09.340093+0000","last_fullsized":"2024-09-10T14:33:09.340093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:33:09.339845+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:33:09.339845+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.339845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:13.502557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:18.458801+0000","last_change":"2024-09-10T14:33:18.458870+0000","last_active":"2024-09-10T14:33:18.458801+0000","last_peered":"2024-09-10T14:33:18.458801+0000","last_clean":"2024-09-10T14:33:18.458801+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:33:18.458801+0000","last_undegraded":"2024-09-10T14:33:18.458801+0000","last_fullsized":"2024-09-10T14:33:18.458801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:18.458581+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:18.458581+0000","last_clean_scrub_stamp":"2024-09-10T14:33:18.458581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:45.262719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.968430+0000","last_change":"2024-09-10T14:32:33.968430+0000","last_active":"2024-09-10T14:32:33.968430+0000","last_peered":"2024-09-10T14:32:33.968430+0000","last_clean":"2024-09-10T14:32:33.968430+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:32:33.968430+0000","last_undegraded":"2024-09-10T14:32:33.968430+0000","last_fullsized":"2024-09-10T14:32:33.968430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.968186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.923144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.456201+0000","last_change":"2024-09-10T14:32:25.456201+0000","last_active":"2024-09-10T14:32:25.456201+0000","last_peered":"2024-09-10T14:32:25.456201+0000","last_clean":"2024-09-10T14:32:25.456201+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:32:25.456201+0000","last_undegraded":"2024-09-10T14:32:25.456201+0000","last_fullsized":"2024-09-10T14:32:25.456201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.455949+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:59.272502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.512838+0000","last_change":"2024-09-10T14:32:42.512838+0000","last_active":"2024-09-10T14:32:42.512838+0000","last_peered":"2024-09-10T14:32:42.512838+0000","last_clean":"2024-09-10T14:32:42.512838+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:32:42.512838+0000","last_undegraded":"2024-09-10T14:32:42.512838+0000","last_fullsized":"2024-09-10T14:32:42.512838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.512582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.512582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.512582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:04.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.084205+0000","last_change":"2024-09-10T14:33:14.084271+0000","last_active":"2024-09-10T14:33:14.084205+0000","last_peered":"2024-09-10T14:33:14.084205+0000","last_clean":"2024-09-10T14:33:14.084205+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:33:14.084205+0000","last_undegraded":"2024-09-10T14:33:14.084205+0000","last_fullsized":"2024-09-10T14:33:14.084205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:33:14.084014+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:33:14.084014+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.084014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:55.111847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.373065+0000","last_change":"2024-09-10T14:33:11.373126+0000","last_active":"2024-09-10T14:33:11.373065+0000","last_peered":"2024-09-10T14:33:11.373065+0000","last_clean":"2024-09-10T14:33:11.373065+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:33:11.373065+0000","last_undegraded":"2024-09-10T14:33:11.373065+0000","last_fullsized":"2024-09-10T14:33:11.373065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:11.372880+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:11.372880+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.372880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:04.456691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.322933+0000","last_change":"2024-09-10T14:33:08.322933+0000","last_active":"2024-09-10T14:33:08.322933+0000","last_peered":"2024-09-10T14:33:08.322933+0000","last_clean":"2024-09-10T14:33:08.322933+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:33:08.322933+0000","last_undegraded":"2024-09-10T14:33:08.322933+0000","last_fullsized":"2024-09-10T14:33:08.322933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:08.322679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:08.322679+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.322679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:48.922910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.411370+0000","last_change":"2024-09-10T14:32:20.411370+0000","last_active":"2024-09-10T14:32:20.411370+0000","last_peered":"2024-09-10T14:32:20.411370+0000","last_clean":"2024-09-10T14:32:20.411370+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:32:20.411370+0000","last_undegraded":"2024-09-10T14:32:20.411370+0000","last_fullsized":"2024-09-10T14:32:20.411370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.411095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:12.327829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.216290+0000","last_change":"2024-09-10T14:32:33.216290+0000","last_active":"2024-09-10T14:32:33.216290+0000","last_peered":"2024-09-10T14:32:33.216290+0000","last_clean":"2024-09-10T14:32:33.216290+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:32:33.216290+0000","last_undegraded":"2024-09-10T14:32:33.216290+0000","last_fullsized":"2024-09-10T14:32:33.216290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.216034+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:39:05.267034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.415600+0000","last_change":"2024-09-10T14:32:23.415600+0000","last_active":"2024-09-10T14:32:23.415600+0000","last_peered":"2024-09-10T14:32:23.415600+0000","last_clean":"2024-09-10T14:32:23.415600+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:32:23.415600+0000","last_undegraded":"2024-09-10T14:32:23.415600+0000","last_fullsized":"2024-09-10T14:32:23.415600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.415359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:40.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:20.058836+0000","last_change":"2024-09-10T14:33:20.058899+0000","last_active":"2024-09-10T14:33:20.058836+0000","last_peered":"2024-09-10T14:33:20.058836+0000","last_clean":"2024-09-10T14:33:20.058836+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:33:20.058836+0000","last_undegraded":"2024-09-10T14:33:20.058836+0000","last_fullsized":"2024-09-10T14:33:20.058836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:20.058589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:20.058589+0000","last_clean_scrub_stamp":"2024-09-10T14:33:20.058589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:25.268022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.119067+0000","last_change":"2024-09-10T14:32:59.119067+0000","last_active":"2024-09-10T14:32:59.119067+0000","last_peered":"2024-09-10T14:32:59.119067+0000","last_clean":"2024-09-10T14:32:59.119067+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:32:59.119067+0000","last_undegraded":"2024-09-10T14:32:59.119067+0000","last_fullsized":"2024-09-10T14:32:59.119067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:59.118814+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:59.118814+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.118814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.685082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.357531+0000","last_change":"2024-09-10T14:33:07.357531+0000","last_active":"2024-09-10T14:33:07.357531+0000","last_peered":"2024-09-10T14:33:07.357531+0000","last_clean":"2024-09-10T14:33:07.357531+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:33:07.357531+0000","last_undegraded":"2024-09-10T14:33:07.357531+0000","last_fullsized":"2024-09-10T14:33:07.357531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:07.357254+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:07.357254+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.357254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:53.771292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.376579+0000","last_change":"2024-09-10T14:32:42.376579+0000","last_active":"2024-09-10T14:32:42.376579+0000","last_peered":"2024-09-10T14:32:42.376579+0000","last_clean":"2024-09-10T14:32:42.376579+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:32:42.376579+0000","last_undegraded":"2024-09-10T14:32:42.376579+0000","last_fullsized":"2024-09-10T14:32:42.376579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.376307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.376307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.376307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:00.174752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.137615+0000","last_change":"2024-09-10T14:32:30.137615+0000","last_active":"2024-09-10T14:32:30.137615+0000","last_peered":"2024-09-10T14:32:30.137615+0000","last_clean":"2024-09-10T14:32:30.137615+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:32:30.137615+0000","last_undegraded":"2024-09-10T14:32:30.137615+0000","last_fullsized":"2024-09-10T14:32:30.137615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.137220+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:57.841349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.938967+0000","last_change":"2024-09-10T14:32:19.938967+0000","last_active":"2024-09-10T14:32:19.938967+0000","last_peered":"2024-09-10T14:32:19.938967+0000","last_clean":"2024-09-10T14:32:19.938967+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:32:19.938967+0000","last_undegraded":"2024-09-10T14:32:19.938967+0000","last_fullsized":"2024-09-10T14:32:19.938967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.938638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:13.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.460042+0000","last_change":"2024-09-10T14:33:03.460042+0000","last_active":"2024-09-10T14:33:03.460042+0000","last_peered":"2024-09-10T14:33:03.460042+0000","last_clean":"2024-09-10T14:33:03.460042+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:33:03.460042+0000","last_undegraded":"2024-09-10T14:33:03.460042+0000","last_fullsized":"2024-09-10T14:33:03.460042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.459797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.459797+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.459797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:52.465854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.406947+0000","last_change":"2024-09-10T14:33:13.407103+0000","last_active":"2024-09-10T14:33:13.406947+0000","last_peered":"2024-09-10T14:33:13.406947+0000","last_clean":"2024-09-10T14:33:13.406947+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:33:13.406947+0000","last_undegraded":"2024-09-10T14:33:13.406947+0000","last_fullsized":"2024-09-10T14:33:13.406947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:13.406701+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:13.406701+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.406701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:24.803644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.753358+0000","last_change":"2024-09-10T14:33:11.753358+0000","last_active":"2024-09-10T14:33:11.753358+0000","last_peered":"2024-09-10T14:33:11.753358+0000","last_clean":"2024-09-10T14:33:11.753358+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:33:11.753358+0000","last_undegraded":"2024-09-10T14:33:11.753358+0000","last_fullsized":"2024-09-10T14:33:11.753358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:11.753081+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:11.753081+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.753081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:15.257691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.446266+0000","last_change":"2024-09-10T14:32:26.446266+0000","last_active":"2024-09-10T14:32:26.446266+0000","last_peered":"2024-09-10T14:32:26.446266+0000","last_clean":"2024-09-10T14:32:26.446266+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:32:26.446266+0000","last_undegraded":"2024-09-10T14:32:26.446266+0000","last_fullsized":"2024-09-10T14:32:26.446266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.446026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:41.594078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'39","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.497756+0000","last_change":"2024-09-10T14:32:32.497756+0000","last_active":"2024-09-10T14:32:32.497756+0000","last_peered":"2024-09-10T14:32:32.497756+0000","last_clean":"2024-09-10T14:32:32.497756+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:32:32.497756+0000","last_undegraded":"2024-09-10T14:32:32.497756+0000","last_fullsized":"2024-09-10T14:32:32.497756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.497494+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:32.552961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.396828+0000","last_change":"2024-09-10T14:32:25.396828+0000","last_active":"2024-09-10T14:32:25.396828+0000","last_peered":"2024-09-10T14:32:25.396828+0000","last_clean":"2024-09-10T14:32:25.396828+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:32:25.396828+0000","last_undegraded":"2024-09-10T14:32:25.396828+0000","last_fullsized":"2024-09-10T14:32:25.396828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.396450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:54.696304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.428617+0000","last_change":"2024-09-10T14:33:00.428768+0000","last_active":"2024-09-10T14:33:00.428617+0000","last_peered":"2024-09-10T14:33:00.428617+0000","last_clean":"2024-09-10T14:33:00.428617+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:33:00.428617+0000","last_undegraded":"2024-09-10T14:33:00.428617+0000","last_fullsized":"2024-09-10T14:33:00.428617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:00.428387+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:00.428387+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.428387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:05.637821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.456004+0000","last_change":"2024-09-10T14:33:12.456004+0000","last_active":"2024-09-10T14:33:12.456004+0000","last_peered":"2024-09-10T14:33:12.456004+0000","last_clean":"2024-09-10T14:33:12.456004+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:33:12.456004+0000","last_undegraded":"2024-09-10T14:33:12.456004+0000","last_fullsized":"2024-09-10T14:33:12.456004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:12.455745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:12.455745+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.455745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:47.543012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.388113+0000","last_change":"2024-09-10T14:33:16.388166+0000","last_active":"2024-09-10T14:33:16.388113+0000","last_peered":"2024-09-10T14:33:16.388113+0000","last_clean":"2024-09-10T14:33:16.388113+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:33:16.388113+0000","last_undegraded":"2024-09-10T14:33:16.388113+0000","last_fullsized":"2024-09-10T14:33:16.388113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:16.387926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:16.387926+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.387926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:05.269165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.180966+0000","last_change":"2024-09-10T14:32:32.180966+0000","last_active":"2024-09-10T14:32:32.180966+0000","last_peered":"2024-09-10T14:32:32.180966+0000","last_clean":"2024-09-10T14:32:32.180966+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:32:32.180966+0000","last_undegraded":"2024-09-10T14:32:32.180966+0000","last_fullsized":"2024-09-10T14:32:32.180966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.180675+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:49.216006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.442290+0000","last_change":"2024-09-10T14:32:26.442290+0000","last_active":"2024-09-10T14:32:26.442290+0000","last_peered":"2024-09-10T14:32:26.442290+0000","last_clean":"2024-09-10T14:32:26.442290+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:32:26.442290+0000","last_undegraded":"2024-09-10T14:32:26.442290+0000","last_fullsized":"2024-09-10T14:32:26.442290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.442018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:13.048162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.122653+0000","last_change":"2024-09-10T14:33:17.122653+0000","last_active":"2024-09-10T14:33:17.122653+0000","last_peered":"2024-09-10T14:33:17.122653+0000","last_clean":"2024-09-10T14:33:17.122653+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:33:17.122653+0000","last_undegraded":"2024-09-10T14:33:17.122653+0000","last_fullsized":"2024-09-10T14:33:17.122653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:33:17.122374+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:33:17.122374+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.122374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:34.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.183816+0000","last_change":"2024-09-10T14:33:01.183874+0000","last_active":"2024-09-10T14:33:01.183816+0000","last_peered":"2024-09-10T14:33:01.183816+0000","last_clean":"2024-09-10T14:33:01.183816+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:33:01.183816+0000","last_undegraded":"2024-09-10T14:33:01.183816+0000","last_fullsized":"2024-09-10T14:33:01.183816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:01.183629+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:01.183629+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.183629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:49:35.104259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.953816+0000","last_change":"2024-09-10T14:32:53.953816+0000","last_active":"2024-09-10T14:32:53.953816+0000","last_peered":"2024-09-10T14:32:53.953816+0000","last_clean":"2024-09-10T14:32:53.953816+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:32:53.953816+0000","last_undegraded":"2024-09-10T14:32:53.953816+0000","last_fullsized":"2024-09-10T14:32:53.953816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:53.953557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:53.953557+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.953557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:49.917322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.397408+0000","last_change":"2024-09-10T14:32:40.397408+0000","last_active":"2024-09-10T14:32:40.397408+0000","last_peered":"2024-09-10T14:32:40.397408+0000","last_clean":"2024-09-10T14:32:40.397408+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:32:40.397408+0000","last_undegraded":"2024-09-10T14:32:40.397408+0000","last_fullsized":"2024-09-10T14:32:40.397408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:40.397100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:40.397100+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.397100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:50.928172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'46","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.451198+0000","last_change":"2024-09-10T14:32:50.451198+0000","last_active":"2024-09-10T14:32:50.451198+0000","last_peered":"2024-09-10T14:32:50.451198+0000","last_clean":"2024-09-10T14:32:50.451198+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:32:50.451198+0000","last_undegraded":"2024-09-10T14:32:50.451198+0000","last_fullsized":"2024-09-10T14:32:50.451198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-10T14:32:50.450750+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-10T14:32:50.450750+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.450750+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:43.680846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.965177+0000","last_change":"2024-09-10T14:32:38.965177+0000","last_active":"2024-09-10T14:32:38.965177+0000","last_peered":"2024-09-10T14:32:38.965177+0000","last_clean":"2024-09-10T14:32:38.965177+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:32:38.965177+0000","last_undegraded":"2024-09-10T14:32:38.965177+0000","last_fullsized":"2024-09-10T14:32:38.965177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.964897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.964897+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.964897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:32.019878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243723+0000","last_change":"2024-09-10T14:28:38.943738+0000","last_active":"2024-09-10T14:32:20.243723+0000","last_peered":"2024-09-10T14:32:20.243723+0000","last_clean":"2024-09-10T14:32:20.243723+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:32:20.243723+0000","last_undegraded":"2024-09-10T14:32:20.243723+0000","last_fullsized":"2024-09-10T14:32:20.243723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.464002+0000","last_change":"2024-09-10T14:32:34.464002+0000","last_active":"2024-09-10T14:32:34.464002+0000","last_peered":"2024-09-10T14:32:34.464002+0000","last_clean":"2024-09-10T14:32:34.464002+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:32:34.464002+0000","last_undegraded":"2024-09-10T14:32:34.464002+0000","last_fullsized":"2024-09-10T14:32:34.464002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.463639+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:46.301912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.766808+0000","last_change":"2024-09-10T14:33:01.766808+0000","last_active":"2024-09-10T14:33:01.766808+0000","last_peered":"2024-09-10T14:33:01.766808+0000","last_clean":"2024-09-10T14:33:01.766808+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:33:01.766808+0000","last_undegraded":"2024-09-10T14:33:01.766808+0000","last_fullsized":"2024-09-10T14:33:01.766808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:01.766540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:01.766540+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.766540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:12.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.435925+0000","last_change":"2024-09-10T14:32:38.435925+0000","last_active":"2024-09-10T14:32:38.435925+0000","last_peered":"2024-09-10T14:32:38.435925+0000","last_clean":"2024-09-10T14:32:38.435925+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:32:38.435925+0000","last_undegraded":"2024-09-10T14:32:38.435925+0000","last_fullsized":"2024-09-10T14:32:38.435925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.435674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:15.679874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.074597+0000","last_change":"2024-09-10T14:32:28.074597+0000","last_active":"2024-09-10T14:32:28.074597+0000","last_peered":"2024-09-10T14:32:28.074597+0000","last_clean":"2024-09-10T14:32:28.074597+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:32:28.074597+0000","last_undegraded":"2024-09-10T14:32:28.074597+0000","last_fullsized":"2024-09-10T14:32:28.074597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.074323+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:22.414417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.062808+0000","last_change":"2024-09-10T14:32:20.062808+0000","last_active":"2024-09-10T14:32:20.062808+0000","last_peered":"2024-09-10T14:32:20.062808+0000","last_clean":"2024-09-10T14:32:20.062808+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:32:20.062808+0000","last_undegraded":"2024-09-10T14:32:20.062808+0000","last_fullsized":"2024-09-10T14:32:20.062808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.062623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:35.638214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:38.641800+0000","last_change":"2024-09-10T14:33:38.641866+0000","last_active":"2024-09-10T14:33:38.641800+0000","last_peered":"2024-09-10T14:33:38.641800+0000","last_clean":"2024-09-10T14:33:38.641800+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:33:38.641800+0000","last_undegraded":"2024-09-10T14:33:38.641800+0000","last_fullsized":"2024-09-10T14:33:38.641800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:33:38.641611+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:33:38.641611+0000","last_clean_scrub_stamp":"2024-09-10T14:33:38.641611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:49.792288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.181182+0000","last_change":"2024-09-10T14:32:53.181182+0000","last_active":"2024-09-10T14:32:53.181182+0000","last_peered":"2024-09-10T14:32:53.181182+0000","last_clean":"2024-09-10T14:32:53.181182+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:32:53.181182+0000","last_undegraded":"2024-09-10T14:32:53.181182+0000","last_fullsized":"2024-09-10T14:32:53.181182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:53.180924+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:53.180924+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.180924+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:45.585973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.446414+0000","last_change":"2024-09-10T14:33:13.446414+0000","last_active":"2024-09-10T14:33:13.446414+0000","last_peered":"2024-09-10T14:33:13.446414+0000","last_clean":"2024-09-10T14:33:13.446414+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:33:13.446414+0000","last_undegraded":"2024-09-10T14:33:13.446414+0000","last_fullsized":"2024-09-10T14:33:13.446414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:13.446014+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:13.446014+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.446014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:22.972308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:19.813297+0000","last_change":"2024-09-10T14:33:19.813297+0000","last_active":"2024-09-10T14:33:19.813297+0000","last_peered":"2024-09-10T14:33:19.813297+0000","last_clean":"2024-09-10T14:33:19.813297+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:33:19.813297+0000","last_undegraded":"2024-09-10T14:33:19.813297+0000","last_fullsized":"2024-09-10T14:33:19.813297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:19.813063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:19.813063+0000","last_clean_scrub_stamp":"2024-09-10T14:33:19.813063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:44.798582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.479162+0000","last_change":"2024-09-10T14:32:44.479239+0000","last_active":"2024-09-10T14:32:44.479162+0000","last_peered":"2024-09-10T14:32:44.479162+0000","last_clean":"2024-09-10T14:32:44.479162+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:32:44.479162+0000","last_undegraded":"2024-09-10T14:32:44.479162+0000","last_fullsized":"2024-09-10T14:32:44.479162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:44.478972+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:44.478972+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.478972+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:24:49.335138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.385755+0000","last_change":"2024-09-10T14:32:20.385755+0000","last_active":"2024-09-10T14:32:20.385755+0000","last_peered":"2024-09-10T14:32:20.385755+0000","last_clean":"2024-09-10T14:32:20.385755+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:32:20.385755+0000","last_undegraded":"2024-09-10T14:32:20.385755+0000","last_fullsized":"2024-09-10T14:32:20.385755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.385473+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:25.661393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.467356+0000","last_change":"2024-09-10T14:33:11.467356+0000","last_active":"2024-09-10T14:33:11.467356+0000","last_peered":"2024-09-10T14:33:11.467356+0000","last_clean":"2024-09-10T14:33:11.467356+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:33:11.467356+0000","last_undegraded":"2024-09-10T14:33:11.467356+0000","last_fullsized":"2024-09-10T14:33:11.467356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:11.467095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:11.467095+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.467095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:41.433173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.447355+0000","last_change":"2024-09-10T14:32:49.447355+0000","last_active":"2024-09-10T14:32:49.447355+0000","last_peered":"2024-09-10T14:32:49.447355+0000","last_clean":"2024-09-10T14:32:49.447355+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:32:49.447355+0000","last_undegraded":"2024-09-10T14:32:49.447355+0000","last_fullsized":"2024-09-10T14:32:49.447355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:49.447079+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:49.447079+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.447079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:01.531653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.854082+0000","last_change":"2024-09-10T14:33:05.854082+0000","last_active":"2024-09-10T14:33:05.854082+0000","last_peered":"2024-09-10T14:33:05.854082+0000","last_clean":"2024-09-10T14:33:05.854082+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:33:05.854082+0000","last_undegraded":"2024-09-10T14:33:05.854082+0000","last_fullsized":"2024-09-10T14:33:05.854082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.853820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.853820+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.853820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:14.746222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.954305+0000","last_change":"2024-09-10T14:32:35.954305+0000","last_active":"2024-09-10T14:32:35.954305+0000","last_peered":"2024-09-10T14:32:35.954305+0000","last_clean":"2024-09-10T14:32:35.954305+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:32:35.954305+0000","last_undegraded":"2024-09-10T14:32:35.954305+0000","last_fullsized":"2024-09-10T14:32:35.954305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.954067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:56.841551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'47","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.005471+0000","last_change":"2024-09-10T14:32:24.005471+0000","last_active":"2024-09-10T14:32:24.005471+0000","last_peered":"2024-09-10T14:32:24.005471+0000","last_clean":"2024-09-10T14:32:24.005471+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:32:24.005471+0000","last_undegraded":"2024-09-10T14:32:24.005471+0000","last_fullsized":"2024-09-10T14:32:24.005471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.005077+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:26.362032+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.075075+0000","last_change":"2024-09-10T14:32:23.075075+0000","last_active":"2024-09-10T14:32:23.075075+0000","last_peered":"2024-09-10T14:32:23.075075+0000","last_clean":"2024-09-10T14:32:23.075075+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:32:23.075075+0000","last_undegraded":"2024-09-10T14:32:23.075075+0000","last_fullsized":"2024-09-10T14:32:23.075075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.074819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:52.669431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.801833+0000","last_change":"2024-09-10T14:33:13.801833+0000","last_active":"2024-09-10T14:33:13.801833+0000","last_peered":"2024-09-10T14:33:13.801833+0000","last_clean":"2024-09-10T14:33:13.801833+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:33:13.801833+0000","last_undegraded":"2024-09-10T14:33:13.801833+0000","last_fullsized":"2024-09-10T14:33:13.801833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:33:13.801585+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:33:13.801585+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.801585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:09.632003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.350598+0000","last_change":"2024-09-10T14:32:46.350598+0000","last_active":"2024-09-10T14:32:46.350598+0000","last_peered":"2024-09-10T14:32:46.350598+0000","last_clean":"2024-09-10T14:32:46.350598+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:32:46.350598+0000","last_undegraded":"2024-09-10T14:32:46.350598+0000","last_fullsized":"2024-09-10T14:32:46.350598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:46.350348+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:46.350348+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.350348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:26.276494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'7","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:24.630407+0000","last_change":"2024-09-10T14:33:24.630407+0000","last_active":"2024-09-10T14:33:24.630407+0000","last_peered":"2024-09-10T14:33:24.630407+0000","last_clean":"2024-09-10T14:33:24.630407+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:33:24.630407+0000","last_undegraded":"2024-09-10T14:33:24.630407+0000","last_fullsized":"2024-09-10T14:33:24.630407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-10T14:33:24.630146+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-10T14:33:24.630146+0000","last_clean_scrub_stamp":"2024-09-10T14:33:24.630146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:54.341106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.460071+0000","last_change":"2024-09-10T14:32:37.460071+0000","last_active":"2024-09-10T14:32:37.460071+0000","last_peered":"2024-09-10T14:32:37.460071+0000","last_clean":"2024-09-10T14:32:37.460071+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:32:37.460071+0000","last_undegraded":"2024-09-10T14:32:37.460071+0000","last_fullsized":"2024-09-10T14:32:37.460071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.459813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:14.821058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.028627+0000","last_change":"2024-09-10T14:32:26.028627+0000","last_active":"2024-09-10T14:32:26.028627+0000","last_peered":"2024-09-10T14:32:26.028627+0000","last_clean":"2024-09-10T14:32:26.028627+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:32:26.028627+0000","last_undegraded":"2024-09-10T14:32:26.028627+0000","last_fullsized":"2024-09-10T14:32:26.028627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.028252+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:17.812152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.470597+0000","last_change":"2024-09-10T14:32:41.470597+0000","last_active":"2024-09-10T14:32:41.470597+0000","last_peered":"2024-09-10T14:32:41.470597+0000","last_clean":"2024-09-10T14:32:41.470597+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:32:41.470597+0000","last_undegraded":"2024-09-10T14:32:41.470597+0000","last_fullsized":"2024-09-10T14:32:41.470597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.470326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.470326+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.470326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:19.199667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243856+0000","last_change":"2024-09-10T14:28:38.950672+0000","last_active":"2024-09-10T14:32:20.243856+0000","last_peered":"2024-09-10T14:32:20.243856+0000","last_clean":"2024-09-10T14:32:20.243856+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:32:20.243856+0000","last_undegraded":"2024-09-10T14:32:20.243856+0000","last_fullsized":"2024-09-10T14:32:20.243856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.423435+0000","last_change":"2024-09-10T14:33:01.423435+0000","last_active":"2024-09-10T14:33:01.423435+0000","last_peered":"2024-09-10T14:33:01.423435+0000","last_clean":"2024-09-10T14:33:01.423435+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:33:01.423435+0000","last_undegraded":"2024-09-10T14:33:01.423435+0000","last_fullsized":"2024-09-10T14:33:01.423435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:01.423168+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:01.423168+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.423168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:28.296896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.110339+0000","last_change":"2024-09-10T14:33:10.110407+0000","last_active":"2024-09-10T14:33:10.110339+0000","last_peered":"2024-09-10T14:33:10.110339+0000","last_clean":"2024-09-10T14:33:10.110339+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:33:10.110339+0000","last_undegraded":"2024-09-10T14:33:10.110339+0000","last_fullsized":"2024-09-10T14:33:10.110339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.110141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.110141+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.110141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:18.775525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.935858+0000","last_change":"2024-09-10T14:32:32.935858+0000","last_active":"2024-09-10T14:32:32.935858+0000","last_peered":"2024-09-10T14:32:32.935858+0000","last_clean":"2024-09-10T14:32:32.935858+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:32:32.935858+0000","last_undegraded":"2024-09-10T14:32:32.935858+0000","last_fullsized":"2024-09-10T14:32:32.935858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.935608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:34.956315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.504474+0000","last_change":"2024-09-10T14:32:31.504474+0000","last_active":"2024-09-10T14:32:31.504474+0000","last_peered":"2024-09-10T14:32:31.504474+0000","last_clean":"2024-09-10T14:32:31.504474+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:32:31.504474+0000","last_undegraded":"2024-09-10T14:32:31.504474+0000","last_fullsized":"2024-09-10T14:32:31.504474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.504210+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:27.467975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.434693+0000","last_change":"2024-09-10T14:32:55.434693+0000","last_active":"2024-09-10T14:32:55.434693+0000","last_peered":"2024-09-10T14:32:55.434693+0000","last_clean":"2024-09-10T14:32:55.434693+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:32:55.434693+0000","last_undegraded":"2024-09-10T14:32:55.434693+0000","last_fullsized":"2024-09-10T14:32:55.434693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:55.434450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:55.434450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.434450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:41.855323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243760+0000","last_change":"2024-09-10T14:28:38.949225+0000","last_active":"2024-09-10T14:32:20.243760+0000","last_peered":"2024-09-10T14:32:20.243760+0000","last_clean":"2024-09-10T14:32:20.243760+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:32:20.243760+0000","last_undegraded":"2024-09-10T14:32:20.243760+0000","last_fullsized":"2024-09-10T14:32:20.243760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.357374+0000","last_change":"2024-09-10T14:32:45.357374+0000","last_active":"2024-09-10T14:32:45.357374+0000","last_peered":"2024-09-10T14:32:45.357374+0000","last_clean":"2024-09-10T14:32:45.357374+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:32:45.357374+0000","last_undegraded":"2024-09-10T14:32:45.357374+0000","last_fullsized":"2024-09-10T14:32:45.357374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:45.356988+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:45.356988+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.356988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:42.173829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.856166+0000","last_change":"2024-09-10T14:32:57.856228+0000","last_active":"2024-09-10T14:32:57.856166+0000","last_peered":"2024-09-10T14:32:57.856166+0000","last_clean":"2024-09-10T14:32:57.856166+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:32:57.856166+0000","last_undegraded":"2024-09-10T14:32:57.856166+0000","last_fullsized":"2024-09-10T14:32:57.856166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:57.855959+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:57.855959+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.855959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:19.355814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.985098+0000","last_change":"2024-09-10T14:32:28.985098+0000","last_active":"2024-09-10T14:32:28.985098+0000","last_peered":"2024-09-10T14:32:28.985098+0000","last_clean":"2024-09-10T14:32:28.985098+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:32:28.985098+0000","last_undegraded":"2024-09-10T14:32:28.985098+0000","last_fullsized":"2024-09-10T14:32:28.985098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.984841+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:32.529664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'41","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.464492+0000","last_change":"2024-09-10T14:32:52.464492+0000","last_active":"2024-09-10T14:32:52.464492+0000","last_peered":"2024-09-10T14:32:52.464492+0000","last_clean":"2024-09-10T14:32:52.464492+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:32:52.464492+0000","last_undegraded":"2024-09-10T14:32:52.464492+0000","last_fullsized":"2024-09-10T14:32:52.464492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-10T14:32:52.464237+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-10T14:32:52.464237+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.464237+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:29.213358+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.257759+0000","last_change":"2024-09-10T14:32:39.257759+0000","last_active":"2024-09-10T14:32:39.257759+0000","last_peered":"2024-09-10T14:32:39.257759+0000","last_clean":"2024-09-10T14:32:39.257759+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:32:39.257759+0000","last_undegraded":"2024-09-10T14:32:39.257759+0000","last_fullsized":"2024-09-10T14:32:39.257759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:39.257507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:39.257507+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.257507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:11.855142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.243753+0000","last_change":"2024-09-10T14:28:38.949254+0000","last_active":"2024-09-10T14:32:20.243753+0000","last_peered":"2024-09-10T14:32:20.243753+0000","last_clean":"2024-09-10T14:32:20.243753+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:32:20.243753+0000","last_undegraded":"2024-09-10T14:32:20.243753+0000","last_fullsized":"2024-09-10T14:32:20.243753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:28:37.881030+0000","last_clean_scrub_stamp":"2024-09-10T14:28:37.881030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.967908+0000","last_change":"2024-09-10T14:32:37.967908+0000","last_active":"2024-09-10T14:32:37.967908+0000","last_peered":"2024-09-10T14:32:37.967908+0000","last_clean":"2024-09-10T14:32:37.967908+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:32:37.967908+0000","last_undegraded":"2024-09-10T14:32:37.967908+0000","last_fullsized":"2024-09-10T14:32:37.967908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.967539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:44.664554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.362528+0000","last_change":"2024-09-10T14:33:02.362596+0000","last_active":"2024-09-10T14:33:02.362528+0000","last_peered":"2024-09-10T14:33:02.362528+0000","last_clean":"2024-09-10T14:33:02.362528+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:33:02.362528+0000","last_undegraded":"2024-09-10T14:33:02.362528+0000","last_fullsized":"2024-09-10T14:33:02.362528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:02.362272+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:02.362272+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.362272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:04.809531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.283518+0000","last_change":"2024-09-10T14:32:49.283518+0000","last_active":"2024-09-10T14:32:49.283518+0000","last_peered":"2024-09-10T14:32:49.283518+0000","last_clean":"2024-09-10T14:32:49.283518+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:32:49.283518+0000","last_undegraded":"2024-09-10T14:32:49.283518+0000","last_fullsized":"2024-09-10T14:32:49.283518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:49.283250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:49.283250+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.283250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:33.333958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.115744+0000","last_change":"2024-09-10T14:32:58.115819+0000","last_active":"2024-09-10T14:32:58.115744+0000","last_peered":"2024-09-10T14:32:58.115744+0000","last_clean":"2024-09-10T14:32:58.115744+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:32:58.115744+0000","last_undegraded":"2024-09-10T14:32:58.115744+0000","last_fullsized":"2024-09-10T14:32:58.115744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:58.115545+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:58.115545+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.115545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:53.150818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.415954+0000","last_change":"2024-09-10T14:33:02.416041+0000","last_active":"2024-09-10T14:33:02.415954+0000","last_peered":"2024-09-10T14:33:02.415954+0000","last_clean":"2024-09-10T14:33:02.415954+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:33:02.415954+0000","last_undegraded":"2024-09-10T14:33:02.415954+0000","last_fullsized":"2024-09-10T14:33:02.415954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:33:02.415764+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:33:02.415764+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.415764+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:30.721821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:27.738357+0000","last_change":"2024-09-10T14:33:27.738539+0000","last_active":"2024-09-10T14:33:27.738357+0000","last_peered":"2024-09-10T14:33:27.738357+0000","last_clean":"2024-09-10T14:33:27.738357+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:33:27.738357+0000","last_undegraded":"2024-09-10T14:33:27.738357+0000","last_fullsized":"2024-09-10T14:33:27.738357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:27.738113+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:27.738113+0000","last_clean_scrub_stamp":"2024-09-10T14:33:27.738113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:22.606292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.103739+0000","last_change":"2024-09-10T14:32:55.103798+0000","last_active":"2024-09-10T14:32:55.103739+0000","last_peered":"2024-09-10T14:32:55.103739+0000","last_clean":"2024-09-10T14:32:55.103739+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:32:55.103739+0000","last_undegraded":"2024-09-10T14:32:55.103739+0000","last_fullsized":"2024-09-10T14:32:55.103739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:55.103545+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:55.103545+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.103545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:16.603400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.145434+0000","last_change":"2024-09-10T14:33:00.145500+0000","last_active":"2024-09-10T14:33:00.145434+0000","last_peered":"2024-09-10T14:33:00.145434+0000","last_clean":"2024-09-10T14:33:00.145434+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:33:00.145434+0000","last_undegraded":"2024-09-10T14:33:00.145434+0000","last_fullsized":"2024-09-10T14:33:00.145434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:00.145242+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:00.145242+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.145242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:00.136739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.267228+0000","last_change":"2024-09-10T14:32:46.267294+0000","last_active":"2024-09-10T14:32:46.267228+0000","last_peered":"2024-09-10T14:32:46.267228+0000","last_clean":"2024-09-10T14:32:46.267228+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:32:46.267228+0000","last_undegraded":"2024-09-10T14:32:46.267228+0000","last_fullsized":"2024-09-10T14:32:46.267228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:46.267037+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:46.267037+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.267037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:01.415089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.246325+0000","last_change":"2024-09-10T14:32:50.246325+0000","last_active":"2024-09-10T14:32:50.246325+0000","last_peered":"2024-09-10T14:32:50.246325+0000","last_clean":"2024-09-10T14:32:50.246325+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:32:50.246325+0000","last_undegraded":"2024-09-10T14:32:50.246325+0000","last_fullsized":"2024-09-10T14:32:50.246325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:50.246061+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:50.246061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.246061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:23.296600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.756326+0000","last_change":"2024-09-10T14:33:12.756384+0000","last_active":"2024-09-10T14:33:12.756326+0000","last_peered":"2024-09-10T14:33:12.756326+0000","last_clean":"2024-09-10T14:33:12.756326+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:33:12.756326+0000","last_undegraded":"2024-09-10T14:33:12.756326+0000","last_fullsized":"2024-09-10T14:33:12.756326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-10T14:33:12.756121+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-10T14:33:12.756121+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.756121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:21.421505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.806351+0000","last_change":"2024-09-10T14:33:09.806405+0000","last_active":"2024-09-10T14:33:09.806351+0000","last_peered":"2024-09-10T14:33:09.806351+0000","last_clean":"2024-09-10T14:33:09.806351+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:33:09.806351+0000","last_undegraded":"2024-09-10T14:33:09.806351+0000","last_fullsized":"2024-09-10T14:33:09.806351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.806154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.806154+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.806154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:49.758182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.148461+0000","last_change":"2024-09-10T14:33:03.148521+0000","last_active":"2024-09-10T14:33:03.148461+0000","last_peered":"2024-09-10T14:33:03.148461+0000","last_clean":"2024-09-10T14:33:03.148461+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:33:03.148461+0000","last_undegraded":"2024-09-10T14:33:03.148461+0000","last_fullsized":"2024-09-10T14:33:03.148461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:33:03.148265+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:33:03.148265+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.148265+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:12.040666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.369749+0000","last_change":"2024-09-10T14:32:52.369813+0000","last_active":"2024-09-10T14:32:52.369749+0000","last_peered":"2024-09-10T14:32:52.369749+0000","last_clean":"2024-09-10T14:32:52.369749+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:32:52.369749+0000","last_undegraded":"2024-09-10T14:32:52.369749+0000","last_fullsized":"2024-09-10T14:32:52.369749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:52.369554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:52.369554+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.369554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:48.344683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.924217+0000","last_change":"2024-09-10T14:32:44.924333+0000","last_active":"2024-09-10T14:32:44.924217+0000","last_peered":"2024-09-10T14:32:44.924217+0000","last_clean":"2024-09-10T14:32:44.924217+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:32:44.924217+0000","last_undegraded":"2024-09-10T14:32:44.924217+0000","last_fullsized":"2024-09-10T14:32:44.924217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:44.923988+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:44.923988+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.923988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:17.218205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.103117+0000","last_change":"2024-09-10T14:33:12.103188+0000","last_active":"2024-09-10T14:33:12.103117+0000","last_peered":"2024-09-10T14:33:12.103117+0000","last_clean":"2024-09-10T14:33:12.103117+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:33:12.103117+0000","last_undegraded":"2024-09-10T14:33:12.103117+0000","last_fullsized":"2024-09-10T14:33:12.103117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:12.102898+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:12.102898+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.102898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:00.368266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.900247+0000","last_change":"2024-09-10T14:32:56.900247+0000","last_active":"2024-09-10T14:32:56.900247+0000","last_peered":"2024-09-10T14:32:56.900247+0000","last_clean":"2024-09-10T14:32:56.900247+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:32:56.900247+0000","last_undegraded":"2024-09-10T14:32:56.900247+0000","last_fullsized":"2024-09-10T14:32:56.900247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:56.899972+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:56.899972+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.899972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:46.105631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:37.660678+0000","last_change":"2024-09-10T14:33:37.660738+0000","last_active":"2024-09-10T14:33:37.660678+0000","last_peered":"2024-09-10T14:33:37.660678+0000","last_clean":"2024-09-10T14:33:37.660678+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:33:37.660678+0000","last_undegraded":"2024-09-10T14:33:37.660678+0000","last_fullsized":"2024-09-10T14:33:37.660678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:37.660471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:37.660471+0000","last_clean_scrub_stamp":"2024-09-10T14:33:37.660471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:17.132064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.471594+0000","last_change":"2024-09-10T14:32:40.471594+0000","last_active":"2024-09-10T14:32:40.471594+0000","last_peered":"2024-09-10T14:32:40.471594+0000","last_clean":"2024-09-10T14:32:40.471594+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:32:40.471594+0000","last_undegraded":"2024-09-10T14:32:40.471594+0000","last_fullsized":"2024-09-10T14:32:40.471594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:40.471309+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:40.471309+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.471309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:15.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.134041+0000","last_change":"2024-09-10T14:33:04.134108+0000","last_active":"2024-09-10T14:33:04.134041+0000","last_peered":"2024-09-10T14:33:04.134041+0000","last_clean":"2024-09-10T14:33:04.134041+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:33:04.134041+0000","last_undegraded":"2024-09-10T14:33:04.134041+0000","last_fullsized":"2024-09-10T14:33:04.134041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:04.133848+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:04.133848+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.133848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:26.213488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.155550+0000","last_change":"2024-09-10T14:32:57.155550+0000","last_active":"2024-09-10T14:32:57.155550+0000","last_peered":"2024-09-10T14:32:57.155550+0000","last_clean":"2024-09-10T14:32:57.155550+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:32:57.155550+0000","last_undegraded":"2024-09-10T14:32:57.155550+0000","last_fullsized":"2024-09-10T14:32:57.155550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:57.155307+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:57.155307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.155307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:46.880813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.835504+0000","last_change":"2024-09-10T14:33:06.835626+0000","last_active":"2024-09-10T14:33:06.835504+0000","last_peered":"2024-09-10T14:33:06.835504+0000","last_clean":"2024-09-10T14:33:06.835504+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:33:06.835504+0000","last_undegraded":"2024-09-10T14:33:06.835504+0000","last_fullsized":"2024-09-10T14:33:06.835504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:06.835209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:06.835209+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.835209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:28.914849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.785422+0000","last_change":"2024-09-10T14:33:00.785422+0000","last_active":"2024-09-10T14:33:00.785422+0000","last_peered":"2024-09-10T14:33:00.785422+0000","last_clean":"2024-09-10T14:33:00.785422+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:33:00.785422+0000","last_undegraded":"2024-09-10T14:33:00.785422+0000","last_fullsized":"2024-09-10T14:33:00.785422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-10T14:33:00.785175+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-10T14:33:00.785175+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.785175+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:55.820447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.906586+0000","last_change":"2024-09-10T14:32:55.906586+0000","last_active":"2024-09-10T14:32:55.906586+0000","last_peered":"2024-09-10T14:32:55.906586+0000","last_clean":"2024-09-10T14:32:55.906586+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:32:55.906586+0000","last_undegraded":"2024-09-10T14:32:55.906586+0000","last_fullsized":"2024-09-10T14:32:55.906586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:55.906312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:55.906312+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.906312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:50.502825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.817003+0000","last_change":"2024-09-10T14:33:02.817003+0000","last_active":"2024-09-10T14:33:02.817003+0000","last_peered":"2024-09-10T14:33:02.817003+0000","last_clean":"2024-09-10T14:33:02.817003+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:33:02.817003+0000","last_undegraded":"2024-09-10T14:33:02.817003+0000","last_fullsized":"2024-09-10T14:33:02.817003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-10T14:33:02.816746+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-10T14:33:02.816746+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.816746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:02.808243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.439718+0000","last_change":"2024-09-10T14:33:15.439782+0000","last_active":"2024-09-10T14:33:15.439718+0000","last_peered":"2024-09-10T14:33:15.439718+0000","last_clean":"2024-09-10T14:33:15.439718+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:33:15.439718+0000","last_undegraded":"2024-09-10T14:33:15.439718+0000","last_fullsized":"2024-09-10T14:33:15.439718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:15.439516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:15.439516+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.439516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:23.916159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.938587+0000","last_change":"2024-09-10T14:32:48.938587+0000","last_active":"2024-09-10T14:32:48.938587+0000","last_peered":"2024-09-10T14:32:48.938587+0000","last_clean":"2024-09-10T14:32:48.938587+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:32:48.938587+0000","last_undegraded":"2024-09-10T14:32:48.938587+0000","last_fullsized":"2024-09-10T14:32:48.938587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:48.938333+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:48.938333+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.938333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:04.086385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:36.656574+0000","last_change":"2024-09-10T14:33:36.656635+0000","last_active":"2024-09-10T14:33:36.656574+0000","last_peered":"2024-09-10T14:33:36.656574+0000","last_clean":"2024-09-10T14:33:36.656574+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:33:36.656574+0000","last_undegraded":"2024-09-10T14:33:36.656574+0000","last_fullsized":"2024-09-10T14:33:36.656574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:36.656381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:36.656381+0000","last_clean_scrub_stamp":"2024-09-10T14:33:36.656381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:13.674099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'14","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.389144+0000","last_change":"2024-09-10T14:32:38.389144+0000","last_active":"2024-09-10T14:32:38.389144+0000","last_peered":"2024-09-10T14:32:38.389144+0000","last_clean":"2024-09-10T14:32:38.389144+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:32:38.389144+0000","last_undegraded":"2024-09-10T14:32:38.389144+0000","last_fullsized":"2024-09-10T14:32:38.389144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.388866+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:33.424139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.422326+0000","last_change":"2024-09-10T14:32:48.422326+0000","last_active":"2024-09-10T14:32:48.422326+0000","last_peered":"2024-09-10T14:32:48.422326+0000","last_clean":"2024-09-10T14:32:48.422326+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:32:48.422326+0000","last_undegraded":"2024-09-10T14:32:48.422326+0000","last_fullsized":"2024-09-10T14:32:48.422326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:48.422047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:48.422047+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.422047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:26.220031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.999876+0000","last_change":"2024-09-10T14:32:51.999876+0000","last_active":"2024-09-10T14:32:51.999876+0000","last_peered":"2024-09-10T14:32:51.999876+0000","last_clean":"2024-09-10T14:32:51.999876+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:32:51.999876+0000","last_undegraded":"2024-09-10T14:32:51.999876+0000","last_fullsized":"2024-09-10T14:32:51.999876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:51.999608+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:51.999608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.999608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:36.050316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:34.696623+0000","last_change":"2024-09-10T14:33:34.696785+0000","last_active":"2024-09-10T14:33:34.696623+0000","last_peered":"2024-09-10T14:33:34.696623+0000","last_clean":"2024-09-10T14:33:34.696623+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:33:34.696623+0000","last_undegraded":"2024-09-10T14:33:34.696623+0000","last_fullsized":"2024-09-10T14:33:34.696623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:34.696367+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:34.696367+0000","last_clean_scrub_stamp":"2024-09-10T14:33:34.696367+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:58.058808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:25.662294+0000","last_change":"2024-09-10T14:33:25.662353+0000","last_active":"2024-09-10T14:33:25.662294+0000","last_peered":"2024-09-10T14:33:25.662294+0000","last_clean":"2024-09-10T14:33:25.662294+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:33:25.662294+0000","last_undegraded":"2024-09-10T14:33:25.662294+0000","last_fullsized":"2024-09-10T14:33:25.662294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:25.662097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:25.662097+0000","last_clean_scrub_stamp":"2024-09-10T14:33:25.662097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:06.852054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.310500+0000","last_change":"2024-09-10T14:32:44.310500+0000","last_active":"2024-09-10T14:32:44.310500+0000","last_peered":"2024-09-10T14:32:44.310500+0000","last_clean":"2024-09-10T14:32:44.310500+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:32:44.310500+0000","last_undegraded":"2024-09-10T14:32:44.310500+0000","last_fullsized":"2024-09-10T14:32:44.310500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:44.310127+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:44.310127+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.310127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:59.596129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.134255+0000","last_change":"2024-09-10T14:32:54.134255+0000","last_active":"2024-09-10T14:32:54.134255+0000","last_peered":"2024-09-10T14:32:54.134255+0000","last_clean":"2024-09-10T14:32:54.134255+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:32:54.134255+0000","last_undegraded":"2024-09-10T14:32:54.134255+0000","last_fullsized":"2024-09-10T14:32:54.134255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:54.133994+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:54.133994+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.133994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:05.972266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.955850+0000","last_change":"2024-09-10T14:32:45.955850+0000","last_active":"2024-09-10T14:32:45.955850+0000","last_peered":"2024-09-10T14:32:45.955850+0000","last_clean":"2024-09-10T14:32:45.955850+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:32:45.955850+0000","last_undegraded":"2024-09-10T14:32:45.955850+0000","last_fullsized":"2024-09-10T14:32:45.955850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:45.955449+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:45.955449+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.955449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:58.286493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1530,"ondisk_log_size":1530,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640326,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":750039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673030,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":162767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673030,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1052672,"data_stored":750219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":161599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:33:42.303 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:42.303 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:42.304 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:42.305 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:42.305 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:42.305 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T14:28:37.881030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=28, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=14, tm_min=32, tm_sec=17, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T14:33:42.306 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T14:34:02.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T14:34:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b0ec52640 1 Processor -- start 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b0ec52640 1 -- start start 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b0ec52640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b0812e760 0x7f4b0812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b0ec52640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b080984f0 con 0x7f4b0812f1c0 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b0ec52640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4b08098dc0 con 0x7f4b0812e760 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b0c9ee640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b0812e760 0x7f4b0812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b07fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4b0812f1c0 0x7f4b0812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48368/0 (socket says 172.21.15.52:48368) 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b07fff640 1 -- 172.21.15.52:0/2504876821 learned_addr learned my addr 172.21.15.52:0/2504876821 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b0c9ee640 1 -- 172.21.15.52:0/2504876821 >> v1:172.21.15.52:6789/0 conn(0x7f4b0812f1c0 legacy=0x7f4b0812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b077fe640 1 -- 172.21.15.52:0/2504876821 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904442497 0 0) 0x7f4b080984f0 con 0x7f4b0812f1c0 2024-09-10T14:34:02.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.439+0000 7f4b0c9ee640 1 -- 172.21.15.52:0/2504876821 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0812f5a0 con 0x7f4b0812e760 2024-09-10T14:34:02.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0c9ee640 1 --2- 172.21.15.52:0/2504876821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b0812ec80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009740 tx=0x7f4af801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68beda84f0feed22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:34:02.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b077fe640 1 -- 172.21.15.52:0/2504876821 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af80b0070 con 0x7f4b0812e760 2024-09-10T14:34:02.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b077fe640 1 -- 172.21.15.52:0/2504876821 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af80ab530 con 0x7f4b0812e760 2024-09-10T14:34:02.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b077fe640 1 -- 172.21.15.52:0/2504876821 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af80ab830 con 0x7f4b0812e760 2024-09-10T14:34:02.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 -- 172.21.15.52:0/2504876821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 msgr2=0x7f4b0812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:34:02.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 --2- 172.21.15.52:0/2504876821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b0812ec80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009740 tx=0x7f4af801c400 comp rx=0 tx=0).stop 2024-09-10T14:34:02.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 -- 172.21.15.52:0/2504876821 shutdown_connections 2024-09-10T14:34:02.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 --2- 172.21.15.52:0/2504876821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b0812ec80 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:34:02.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 -- 172.21.15.52:0/2504876821 >> 172.21.15.52:0/2504876821 conn(0x7f4b080a10a0 msgr2=0x7f4b080a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:34:02.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 -- 172.21.15.52:0/2504876821 shutdown_connections 2024-09-10T14:34:02.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 -- 172.21.15.52:0/2504876821 wait complete. 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 Processor -- start 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.443+0000 7f4b0ec52640 1 -- start start 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0ec52640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b08130990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0ec52640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08136e30 con 0x7f4b0812e760 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0c9ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b08130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0c9ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b08130990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51050/0 (socket says 172.21.15.52:51050) 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0c9ee640 1 -- 172.21.15.52:0/6094182 learned_addr learned my addr 172.21.15.52:0/6094182 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0c9ee640 1 -- 172.21.15.52:0/6094182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b08132f20 con 0x7f4b0812e760 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0c9ee640 1 --2- 172.21.15.52:0/6094182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b08130990 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4af801a030 tx=0x7f4af801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b057fa640 1 -- 172.21.15.52:0/6094182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af80bb070 con 0x7f4b0812e760 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b057fa640 1 -- 172.21.15.52:0/6094182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af80abe40 con 0x7f4b0812e760 2024-09-10T14:34:02.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b081333e0 con 0x7f4b0812e760 2024-09-10T14:34:02.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b057fa640 1 -- 172.21.15.52:0/6094182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af80b0040 con 0x7f4b0812e760 2024-09-10T14:34:02.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b081310a0 con 0x7f4b0812e760 2024-09-10T14:34:02.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b057fa640 1 -- 172.21.15.52:0/6094182 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4af8004150 con 0x7f4b0812e760 2024-09-10T14:34:02.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b081322b0 con 0x7f4b0812e760 2024-09-10T14:34:02.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b057fa640 1 --2- 172.21.15.52:0/6094182 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4af4035db0 0x7f4af4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:34:02.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b057fa640 1 -- 172.21.15.52:0/6094182 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f4af80e3800 con 0x7f4b0812e760 2024-09-10T14:34:02.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b07fff640 1 --2- 172.21.15.52:0/6094182 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4af4035db0 0x7f4af4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:34:02.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.447+0000 7f4b07fff640 1 --2- 172.21.15.52:0/6094182 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4af4035db0 0x7f4af4038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4afc007fd0 tx=0x7f4afc007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:34:02.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.451+0000 7f4b057fa640 1 -- 172.21.15.52:0/6094182 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4af8015ff0 con 0x7f4b0812e760 2024-09-10T14:34:02.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.611+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 --> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b0812ec80 con 0x7f4af4035db0 2024-09-10T14:34:02.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.655+0000 7f4b057fa640 1 -- 172.21.15.52:0/6094182 <== mgr.4100 v2:172.21.15.151:6824/3605021146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666472 (secure 0 0 0) 0x7f4b0812ec80 con 0x7f4af4035db0 2024-09-10T14:34:02.668 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T14:34:02.674 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T14:34:02.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4af4035db0 msgr2=0x7f4af4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:34:02.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 --2- 172.21.15.52:0/6094182 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4af4035db0 0x7f4af4038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4afc007fd0 tx=0x7f4afc007980 comp rx=0 tx=0).stop 2024-09-10T14:34:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 msgr2=0x7f4b08130990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:34:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 --2- 172.21.15.52:0/6094182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b08130990 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4af801a030 tx=0x7f4af801ac40 comp rx=0 tx=0).stop 2024-09-10T14:34:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 shutdown_connections 2024-09-10T14:34:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 --2- 172.21.15.52:0/6094182 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f4af4035db0 0x7f4af4038270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:34:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 --2- 172.21.15.52:0/6094182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0812e760 0x7f4b08130990 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:34:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 >> 172.21.15.52:0/6094182 conn(0x7f4b080a10a0 msgr2=0x7f4b0812c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:34:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 shutdown_connections 2024-09-10T14:34:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.663+0000 7f4b0ec52640 1 -- 172.21.15.52:0/6094182 wait complete. 2024-09-10T14:34:02.689 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-09-10T14:34:00.853615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4798,"ondisk_log_size":4798,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152688,"kb_used_data":2992,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334672,"statfs":{"total":386547056640,"available":386390704128,"internally_reserved":0,"allocated":3063808,"data_stored":1824624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006816"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.333576+0000","last_change":"2024-09-10T14:32:56.333644+0000","last_active":"2024-09-10T14:32:56.333576+0000","last_peered":"2024-09-10T14:32:56.333576+0000","last_clean":"2024-09-10T14:32:56.333576+0000","last_became_active":"2024-09-10T14:28:28.909867+0000","last_became_peered":"2024-09-10T14:28:28.909867+0000","last_unstale":"2024-09-10T14:32:56.333576+0000","last_undegraded":"2024-09-10T14:32:56.333576+0000","last_fullsized":"2024-09-10T14:32:56.333576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:56.333364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:56.333364+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.333364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:41.861748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.951520+0000","last_change":"2024-09-10T14:32:49.951520+0000","last_active":"2024-09-10T14:32:49.951520+0000","last_peered":"2024-09-10T14:32:49.951520+0000","last_clean":"2024-09-10T14:32:49.951520+0000","last_became_active":"2024-09-10T14:28:30.866469+0000","last_became_peered":"2024-09-10T14:28:30.866469+0000","last_unstale":"2024-09-10T14:32:49.951520+0000","last_undegraded":"2024-09-10T14:32:49.951520+0000","last_fullsized":"2024-09-10T14:32:49.951520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:49.951238+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:49.951238+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.951238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:14.016136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.163991+0000","last_change":"2024-09-10T14:33:02.164062+0000","last_active":"2024-09-10T14:33:02.163991+0000","last_peered":"2024-09-10T14:33:02.163991+0000","last_clean":"2024-09-10T14:33:02.163991+0000","last_became_active":"2024-09-10T14:28:28.878154+0000","last_became_peered":"2024-09-10T14:28:28.878154+0000","last_unstale":"2024-09-10T14:33:02.163991+0000","last_undegraded":"2024-09-10T14:33:02.163991+0000","last_fullsized":"2024-09-10T14:33:02.163991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:02.163779+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:02.163779+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.163779+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:38.005621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.457127+0000","last_change":"2024-09-10T14:32:54.457127+0000","last_active":"2024-09-10T14:32:54.457127+0000","last_peered":"2024-09-10T14:32:54.457127+0000","last_clean":"2024-09-10T14:32:54.457127+0000","last_became_active":"2024-09-10T14:28:30.881751+0000","last_became_peered":"2024-09-10T14:28:30.881751+0000","last_unstale":"2024-09-10T14:32:54.457127+0000","last_undegraded":"2024-09-10T14:32:54.457127+0000","last_fullsized":"2024-09-10T14:32:54.457127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:54.456884+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:54.456884+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.456884+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:16:26.826166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:35.689609+0000","last_change":"2024-09-10T14:33:35.689670+0000","last_active":"2024-09-10T14:33:35.689609+0000","last_peered":"2024-09-10T14:33:35.689609+0000","last_clean":"2024-09-10T14:33:35.689609+0000","last_became_active":"2024-09-10T14:28:28.879060+0000","last_became_peered":"2024-09-10T14:28:28.879060+0000","last_unstale":"2024-09-10T14:33:35.689609+0000","last_undegraded":"2024-09-10T14:33:35.689609+0000","last_fullsized":"2024-09-10T14:33:35.689609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:35.689401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:35.689401+0000","last_clean_scrub_stamp":"2024-09-10T14:33:35.689401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:42:17.384236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'14","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.465827+0000","last_change":"2024-09-10T14:32:53.465827+0000","last_active":"2024-09-10T14:32:53.465827+0000","last_peered":"2024-09-10T14:32:53.465827+0000","last_clean":"2024-09-10T14:32:53.465827+0000","last_became_active":"2024-09-10T14:28:30.882202+0000","last_became_peered":"2024-09-10T14:28:30.882202+0000","last_unstale":"2024-09-10T14:32:53.465827+0000","last_undegraded":"2024-09-10T14:32:53.465827+0000","last_fullsized":"2024-09-10T14:32:53.465827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:53.465523+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:53.465523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.465523+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:51.914175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.343626+0000","last_change":"2024-09-10T14:33:04.343688+0000","last_active":"2024-09-10T14:33:04.343626+0000","last_peered":"2024-09-10T14:33:04.343626+0000","last_clean":"2024-09-10T14:33:04.343626+0000","last_became_active":"2024-09-10T14:28:28.892550+0000","last_became_peered":"2024-09-10T14:28:28.892550+0000","last_unstale":"2024-09-10T14:33:04.343626+0000","last_undegraded":"2024-09-10T14:33:04.343626+0000","last_fullsized":"2024-09-10T14:33:04.343626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:04.343430+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:04.343430+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.343430+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:05:27.120451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.473761+0000","last_change":"2024-09-10T14:32:56.473761+0000","last_active":"2024-09-10T14:32:56.473761+0000","last_peered":"2024-09-10T14:32:56.473761+0000","last_clean":"2024-09-10T14:32:56.473761+0000","last_became_active":"2024-09-10T14:28:30.878852+0000","last_became_peered":"2024-09-10T14:28:30.878852+0000","last_unstale":"2024-09-10T14:32:56.473761+0000","last_undegraded":"2024-09-10T14:32:56.473761+0000","last_fullsized":"2024-09-10T14:32:56.473761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:56.473347+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:56.473347+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.473347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:32.723316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:28.746453+0000","last_change":"2024-09-10T14:33:28.746453+0000","last_active":"2024-09-10T14:33:28.746453+0000","last_peered":"2024-09-10T14:33:28.746453+0000","last_clean":"2024-09-10T14:33:28.746453+0000","last_became_active":"2024-09-10T14:28:28.879683+0000","last_became_peered":"2024-09-10T14:28:28.879683+0000","last_unstale":"2024-09-10T14:33:28.746453+0000","last_undegraded":"2024-09-10T14:33:28.746453+0000","last_fullsized":"2024-09-10T14:33:28.746453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:28.746201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:28.746201+0000","last_clean_scrub_stamp":"2024-09-10T14:33:28.746201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:39.886607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.995921+0000","last_change":"2024-09-10T14:32:39.996050+0000","last_active":"2024-09-10T14:32:39.995921+0000","last_peered":"2024-09-10T14:32:39.995921+0000","last_clean":"2024-09-10T14:32:39.995921+0000","last_became_active":"2024-09-10T14:28:30.889506+0000","last_became_peered":"2024-09-10T14:28:30.889506+0000","last_unstale":"2024-09-10T14:32:39.995921+0000","last_undegraded":"2024-09-10T14:32:39.995921+0000","last_fullsized":"2024-09-10T14:32:39.995921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:39.995698+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:39.995698+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.995698+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:22.900509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.352765+0000","last_change":"2024-09-10T14:33:00.352765+0000","last_active":"2024-09-10T14:33:00.352765+0000","last_peered":"2024-09-10T14:33:00.352765+0000","last_clean":"2024-09-10T14:33:00.352765+0000","last_became_active":"2024-09-10T14:28:28.909310+0000","last_became_peered":"2024-09-10T14:28:28.909310+0000","last_unstale":"2024-09-10T14:33:00.352765+0000","last_undegraded":"2024-09-10T14:33:00.352765+0000","last_fullsized":"2024-09-10T14:33:00.352765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:00.352497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:00.352497+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.352497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:55.705813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"36'12","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.417479+0000","last_change":"2024-09-10T14:33:06.417621+0000","last_active":"2024-09-10T14:33:06.417479+0000","last_peered":"2024-09-10T14:33:06.417479+0000","last_clean":"2024-09-10T14:33:06.417479+0000","last_became_active":"2024-09-10T14:28:30.874645+0000","last_became_peered":"2024-09-10T14:28:30.874645+0000","last_unstale":"2024-09-10T14:33:06.417479+0000","last_undegraded":"2024-09-10T14:33:06.417479+0000","last_fullsized":"2024-09-10T14:33:06.417479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:06.417247+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:06.417247+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.417247+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:40.374665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.424692+0000","last_change":"2024-09-10T14:33:14.424692+0000","last_active":"2024-09-10T14:33:14.424692+0000","last_peered":"2024-09-10T14:33:14.424692+0000","last_clean":"2024-09-10T14:33:14.424692+0000","last_became_active":"2024-09-10T14:28:28.889950+0000","last_became_peered":"2024-09-10T14:28:28.889950+0000","last_unstale":"2024-09-10T14:33:14.424692+0000","last_undegraded":"2024-09-10T14:33:14.424692+0000","last_fullsized":"2024-09-10T14:33:14.424692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:14.424436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:14.424436+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.424436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:52.256808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"36'8","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.405165+0000","last_change":"2024-09-10T14:32:51.405229+0000","last_active":"2024-09-10T14:32:51.405165+0000","last_peered":"2024-09-10T14:32:51.405165+0000","last_clean":"2024-09-10T14:32:51.405165+0000","last_became_active":"2024-09-10T14:28:30.863209+0000","last_became_peered":"2024-09-10T14:28:30.863209+0000","last_unstale":"2024-09-10T14:32:51.405165+0000","last_undegraded":"2024-09-10T14:32:51.405165+0000","last_fullsized":"2024-09-10T14:32:51.405165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:51.404964+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:51.404964+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.404964+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:47.758064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.122924+0000","last_change":"2024-09-10T14:33:09.122924+0000","last_active":"2024-09-10T14:33:09.122924+0000","last_peered":"2024-09-10T14:33:09.122924+0000","last_clean":"2024-09-10T14:33:09.122924+0000","last_became_active":"2024-09-10T14:28:28.874613+0000","last_became_peered":"2024-09-10T14:28:28.874613+0000","last_unstale":"2024-09-10T14:33:09.122924+0000","last_undegraded":"2024-09-10T14:33:09.122924+0000","last_fullsized":"2024-09-10T14:33:09.122924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.122486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.122486+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.122486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:12.627096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.359805+0000","last_change":"2024-09-10T14:32:57.359868+0000","last_active":"2024-09-10T14:32:57.359805+0000","last_peered":"2024-09-10T14:32:57.359805+0000","last_clean":"2024-09-10T14:32:57.359805+0000","last_became_active":"2024-09-10T14:28:30.869958+0000","last_became_peered":"2024-09-10T14:28:30.869958+0000","last_unstale":"2024-09-10T14:32:57.359805+0000","last_undegraded":"2024-09-10T14:32:57.359805+0000","last_fullsized":"2024-09-10T14:32:57.359805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:57.359620+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:57.359620+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.359620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:49.137266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"36'12","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.445514+0000","last_change":"2024-09-10T14:33:05.445514+0000","last_active":"2024-09-10T14:33:05.445514+0000","last_peered":"2024-09-10T14:33:05.445514+0000","last_clean":"2024-09-10T14:33:05.445514+0000","last_became_active":"2024-09-10T14:28:30.873888+0000","last_became_peered":"2024-09-10T14:28:30.873888+0000","last_unstale":"2024-09-10T14:33:05.445514+0000","last_undegraded":"2024-09-10T14:33:05.445514+0000","last_fullsized":"2024-09-10T14:33:05.445514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:05.445236+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:05.445236+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.445236+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:44.643741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.797572+0000","last_change":"2024-09-10T14:33:10.797572+0000","last_active":"2024-09-10T14:33:10.797572+0000","last_peered":"2024-09-10T14:33:10.797572+0000","last_clean":"2024-09-10T14:33:10.797572+0000","last_became_active":"2024-09-10T14:28:28.899033+0000","last_became_peered":"2024-09-10T14:28:28.899033+0000","last_unstale":"2024-09-10T14:33:10.797572+0000","last_undegraded":"2024-09-10T14:33:10.797572+0000","last_fullsized":"2024-09-10T14:33:10.797572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.797175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.797175+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.797175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:54.603044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'22","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.912446+0000","last_change":"2024-09-10T14:32:54.912446+0000","last_active":"2024-09-10T14:32:54.912446+0000","last_peered":"2024-09-10T14:32:54.912446+0000","last_clean":"2024-09-10T14:32:54.912446+0000","last_became_active":"2024-09-10T14:28:30.871312+0000","last_became_peered":"2024-09-10T14:28:30.871312+0000","last_unstale":"2024-09-10T14:32:54.912446+0000","last_undegraded":"2024-09-10T14:32:54.912446+0000","last_fullsized":"2024-09-10T14:32:54.912446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:54.912155+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:54.912155+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.912155+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:20.379495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.427495+0000","last_change":"2024-09-10T14:32:50.427495+0000","last_active":"2024-09-10T14:32:50.427495+0000","last_peered":"2024-09-10T14:32:50.427495+0000","last_clean":"2024-09-10T14:32:50.427495+0000","last_became_active":"2024-09-10T14:28:28.911694+0000","last_became_peered":"2024-09-10T14:28:28.911694+0000","last_unstale":"2024-09-10T14:32:50.427495+0000","last_undegraded":"2024-09-10T14:32:50.427495+0000","last_fullsized":"2024-09-10T14:32:50.427495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:50.427322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:50.427322+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.427322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:22.901578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"36'14","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.984319+0000","last_change":"2024-09-10T14:32:50.984319+0000","last_active":"2024-09-10T14:32:50.984319+0000","last_peered":"2024-09-10T14:32:50.984319+0000","last_clean":"2024-09-10T14:32:50.984319+0000","last_became_active":"2024-09-10T14:28:30.866615+0000","last_became_peered":"2024-09-10T14:28:30.866615+0000","last_unstale":"2024-09-10T14:32:50.984319+0000","last_undegraded":"2024-09-10T14:32:50.984319+0000","last_fullsized":"2024-09-10T14:32:50.984319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:50.983924+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:50.983924+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.983924+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:21.745837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":74,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.812070+0000","last_change":"2024-09-10T14:33:03.812070+0000","last_active":"2024-09-10T14:33:03.812070+0000","last_peered":"2024-09-10T14:33:03.812070+0000","last_clean":"2024-09-10T14:33:03.812070+0000","last_became_active":"2024-09-10T14:28:28.898611+0000","last_became_peered":"2024-09-10T14:28:28.898611+0000","last_unstale":"2024-09-10T14:33:03.812070+0000","last_undegraded":"2024-09-10T14:33:03.812070+0000","last_fullsized":"2024-09-10T14:33:03.812070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.811688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.811688+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.811688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:49:37.732318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.270427+0000","last_change":"2024-09-10T14:32:45.270427+0000","last_active":"2024-09-10T14:32:45.270427+0000","last_peered":"2024-09-10T14:32:45.270427+0000","last_clean":"2024-09-10T14:32:45.270427+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:32:45.270427+0000","last_undegraded":"2024-09-10T14:32:45.270427+0000","last_fullsized":"2024-09-10T14:32:45.270427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:45.270174+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:45.270174+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.270174+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.086726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.792289+0000","last_change":"2024-09-10T14:33:07.792289+0000","last_active":"2024-09-10T14:33:07.792289+0000","last_peered":"2024-09-10T14:33:07.792289+0000","last_clean":"2024-09-10T14:33:07.792289+0000","last_became_active":"2024-09-10T14:28:28.888237+0000","last_became_peered":"2024-09-10T14:28:28.888237+0000","last_unstale":"2024-09-10T14:33:07.792289+0000","last_undegraded":"2024-09-10T14:33:07.792289+0000","last_fullsized":"2024-09-10T14:33:07.792289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:07.791861+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:07.791861+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.791861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:08.077505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"36'4","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.379622+0000","last_change":"2024-09-10T14:32:55.379622+0000","last_active":"2024-09-10T14:32:55.379622+0000","last_peered":"2024-09-10T14:32:55.379622+0000","last_clean":"2024-09-10T14:32:55.379622+0000","last_became_active":"2024-09-10T14:28:30.869972+0000","last_became_peered":"2024-09-10T14:28:30.869972+0000","last_unstale":"2024-09-10T14:32:55.379622+0000","last_undegraded":"2024-09-10T14:32:55.379622+0000","last_fullsized":"2024-09-10T14:32:55.379622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:55.379196+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:55.379196+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.379196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:18.941696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.151476+0000","last_change":"2024-09-10T14:32:56.151476+0000","last_active":"2024-09-10T14:32:56.151476+0000","last_peered":"2024-09-10T14:32:56.151476+0000","last_clean":"2024-09-10T14:32:56.151476+0000","last_became_active":"2024-09-10T14:28:28.876039+0000","last_became_peered":"2024-09-10T14:28:28.876039+0000","last_unstale":"2024-09-10T14:32:56.151476+0000","last_undegraded":"2024-09-10T14:32:56.151476+0000","last_fullsized":"2024-09-10T14:32:56.151476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:56.151206+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:56.151206+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.151206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:12.336091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.935455+0000","last_change":"2024-09-10T14:32:41.935455+0000","last_active":"2024-09-10T14:32:41.935455+0000","last_peered":"2024-09-10T14:32:41.935455+0000","last_clean":"2024-09-10T14:32:41.935455+0000","last_became_active":"2024-09-10T14:28:30.886076+0000","last_became_peered":"2024-09-10T14:28:30.886076+0000","last_unstale":"2024-09-10T14:32:41.935455+0000","last_undegraded":"2024-09-10T14:32:41.935455+0000","last_fullsized":"2024-09-10T14:32:41.935455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:41.935185+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:41.935185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.935185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:14.532819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:19.478093+0000","last_change":"2024-09-10T14:33:19.478165+0000","last_active":"2024-09-10T14:33:19.478093+0000","last_peered":"2024-09-10T14:33:19.478093+0000","last_clean":"2024-09-10T14:33:19.478093+0000","last_became_active":"2024-09-10T14:28:28.889734+0000","last_became_peered":"2024-09-10T14:28:28.889734+0000","last_unstale":"2024-09-10T14:33:19.478093+0000","last_undegraded":"2024-09-10T14:33:19.478093+0000","last_fullsized":"2024-09-10T14:33:19.478093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:19.477886+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:19.477886+0000","last_clean_scrub_stamp":"2024-09-10T14:33:19.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:19.596444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'36","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.785151+0000","last_change":"2024-09-10T14:33:16.785151+0000","last_active":"2024-09-10T14:33:16.785151+0000","last_peered":"2024-09-10T14:33:16.785151+0000","last_clean":"2024-09-10T14:33:16.785151+0000","last_became_active":"2024-09-10T14:28:38.935831+0000","last_became_peered":"2024-09-10T14:28:38.935831+0000","last_unstale":"2024-09-10T14:33:16.785151+0000","last_undegraded":"2024-09-10T14:33:16.785151+0000","last_fullsized":"2024-09-10T14:33:16.785151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:33:16.784905+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:33:16.784905+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.784905+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:16:49.154188+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.378223+0000","last_change":"2024-09-10T14:33:14.378223+0000","last_active":"2024-09-10T14:33:14.378223+0000","last_peered":"2024-09-10T14:33:14.378223+0000","last_clean":"2024-09-10T14:33:14.378223+0000","last_became_active":"2024-09-10T14:29:07.797149+0000","last_became_peered":"2024-09-10T14:29:07.797149+0000","last_unstale":"2024-09-10T14:33:14.378223+0000","last_undegraded":"2024-09-10T14:33:14.378223+0000","last_fullsized":"2024-09-10T14:33:14.378223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:14.377949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:14.377949+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.377949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:21.128189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.444163+0000","last_change":"2024-09-10T14:33:09.444227+0000","last_active":"2024-09-10T14:33:09.444163+0000","last_peered":"2024-09-10T14:33:09.444163+0000","last_clean":"2024-09-10T14:33:09.444163+0000","last_became_active":"2024-09-10T14:28:28.893952+0000","last_became_peered":"2024-09-10T14:28:28.893952+0000","last_unstale":"2024-09-10T14:33:09.444163+0000","last_undegraded":"2024-09-10T14:33:09.444163+0000","last_fullsized":"2024-09-10T14:33:09.444163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.443934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.443934+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.443934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:31.721931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.424117+0000","last_change":"2024-09-10T14:32:21.424117+0000","last_active":"2024-09-10T14:32:21.424117+0000","last_peered":"2024-09-10T14:32:21.424117+0000","last_clean":"2024-09-10T14:32:21.424117+0000","last_became_active":"2024-09-10T14:28:32.887830+0000","last_became_peered":"2024-09-10T14:28:32.887830+0000","last_unstale":"2024-09-10T14:32:21.424117+0000","last_undegraded":"2024-09-10T14:32:21.424117+0000","last_fullsized":"2024-09-10T14:32:21.424117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.423759+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.423759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:32.872552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'38","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.452638+0000","last_change":"2024-09-10T14:32:49.452638+0000","last_active":"2024-09-10T14:32:49.452638+0000","last_peered":"2024-09-10T14:32:49.452638+0000","last_clean":"2024-09-10T14:32:49.452638+0000","last_became_active":"2024-09-10T14:28:34.923719+0000","last_became_peered":"2024-09-10T14:28:34.923719+0000","last_unstale":"2024-09-10T14:32:49.452638+0000","last_undegraded":"2024-09-10T14:32:49.452638+0000","last_fullsized":"2024-09-10T14:32:49.452638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-10T14:32:49.452381+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-10T14:32:49.452381+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.452381+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:49.443135+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.955641+0000","last_change":"2024-09-10T14:32:34.955641+0000","last_active":"2024-09-10T14:32:34.955641+0000","last_peered":"2024-09-10T14:32:34.955641+0000","last_clean":"2024-09-10T14:32:34.955641+0000","last_became_active":"2024-09-10T14:28:36.938140+0000","last_became_peered":"2024-09-10T14:28:36.938140+0000","last_unstale":"2024-09-10T14:32:34.955641+0000","last_undegraded":"2024-09-10T14:32:34.955641+0000","last_fullsized":"2024-09-10T14:32:34.955641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.955261+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.955261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:29:53.485810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"36'7","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.770774+0000","last_change":"2024-09-10T14:33:17.770774+0000","last_active":"2024-09-10T14:33:17.770774+0000","last_peered":"2024-09-10T14:33:17.770774+0000","last_clean":"2024-09-10T14:33:17.770774+0000","last_became_active":"2024-09-10T14:28:38.937467+0000","last_became_peered":"2024-09-10T14:28:38.937467+0000","last_unstale":"2024-09-10T14:33:17.770774+0000","last_undegraded":"2024-09-10T14:33:17.770774+0000","last_fullsized":"2024-09-10T14:33:17.770774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-10T14:33:17.770519+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-10T14:33:17.770519+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.770519+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:25.981664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"36'2","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.489328+0000","last_change":"2024-09-10T14:33:04.489328+0000","last_active":"2024-09-10T14:33:04.489328+0000","last_peered":"2024-09-10T14:33:04.489328+0000","last_clean":"2024-09-10T14:33:04.489328+0000","last_became_active":"2024-09-10T14:28:30.875916+0000","last_became_peered":"2024-09-10T14:28:30.875916+0000","last_unstale":"2024-09-10T14:33:04.489328+0000","last_undegraded":"2024-09-10T14:33:04.489328+0000","last_fullsized":"2024-09-10T14:33:04.489328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:04.488935+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:04.488935+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.488935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:37.290775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.332832+0000","last_change":"2024-09-10T14:33:06.332832+0000","last_active":"2024-09-10T14:33:06.332832+0000","last_peered":"2024-09-10T14:33:06.332832+0000","last_clean":"2024-09-10T14:33:06.332832+0000","last_became_active":"2024-09-10T14:28:28.894675+0000","last_became_peered":"2024-09-10T14:28:28.894675+0000","last_unstale":"2024-09-10T14:33:06.332832+0000","last_undegraded":"2024-09-10T14:33:06.332832+0000","last_fullsized":"2024-09-10T14:33:06.332832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:06.332586+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:06.332586+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.332586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:25.365994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.253066+0000","last_change":"2024-09-10T14:32:38.253066+0000","last_active":"2024-09-10T14:32:38.253066+0000","last_peered":"2024-09-10T14:32:38.253066+0000","last_clean":"2024-09-10T14:32:38.253066+0000","last_became_active":"2024-09-10T14:28:32.877670+0000","last_became_peered":"2024-09-10T14:28:32.877670+0000","last_unstale":"2024-09-10T14:32:38.253066+0000","last_undegraded":"2024-09-10T14:32:38.253066+0000","last_fullsized":"2024-09-10T14:32:38.253066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.252795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.252795+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.252795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:01.166001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.994910+0000","last_change":"2024-09-10T14:32:24.994910+0000","last_active":"2024-09-10T14:32:24.994910+0000","last_peered":"2024-09-10T14:32:24.994910+0000","last_clean":"2024-09-10T14:32:24.994910+0000","last_became_active":"2024-09-10T14:28:34.888577+0000","last_became_peered":"2024-09-10T14:28:34.888577+0000","last_unstale":"2024-09-10T14:32:24.994910+0000","last_undegraded":"2024-09-10T14:32:24.994910+0000","last_fullsized":"2024-09-10T14:32:24.994910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-10T14:32:24.994665+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.994665+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:21:23.745673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.985015+0000","last_change":"2024-09-10T14:32:30.985015+0000","last_active":"2024-09-10T14:32:30.985015+0000","last_peered":"2024-09-10T14:32:30.985015+0000","last_clean":"2024-09-10T14:32:30.985015+0000","last_became_active":"2024-09-10T14:28:36.934134+0000","last_became_peered":"2024-09-10T14:28:36.934134+0000","last_unstale":"2024-09-10T14:32:30.985015+0000","last_undegraded":"2024-09-10T14:32:30.985015+0000","last_fullsized":"2024-09-10T14:32:30.985015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.984682+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.984682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:15.495746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.155401+0000","last_change":"2024-09-10T14:33:16.155401+0000","last_active":"2024-09-10T14:33:16.155401+0000","last_peered":"2024-09-10T14:33:16.155401+0000","last_clean":"2024-09-10T14:33:16.155401+0000","last_became_active":"2024-09-10T14:28:38.928023+0000","last_became_peered":"2024-09-10T14:28:38.928023+0000","last_unstale":"2024-09-10T14:33:16.155401+0000","last_undegraded":"2024-09-10T14:33:16.155401+0000","last_fullsized":"2024-09-10T14:33:16.155401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:16.155149+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:16.155149+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.155149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:52.405119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.461098+0000","last_change":"2024-09-10T14:32:57.461098+0000","last_active":"2024-09-10T14:32:57.461098+0000","last_peered":"2024-09-10T14:32:57.461098+0000","last_clean":"2024-09-10T14:32:57.461098+0000","last_became_active":"2024-09-10T14:28:30.878772+0000","last_became_peered":"2024-09-10T14:28:30.878772+0000","last_unstale":"2024-09-10T14:32:57.461098+0000","last_undegraded":"2024-09-10T14:32:57.461098+0000","last_fullsized":"2024-09-10T14:32:57.461098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:57.460865+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:57.460865+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.460865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:14.564410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.467965+0000","last_change":"2024-09-10T14:33:16.468037+0000","last_active":"2024-09-10T14:33:16.467965+0000","last_peered":"2024-09-10T14:33:16.467965+0000","last_clean":"2024-09-10T14:33:16.467965+0000","last_became_active":"2024-09-10T14:28:28.884682+0000","last_became_peered":"2024-09-10T14:28:28.884682+0000","last_unstale":"2024-09-10T14:33:16.467965+0000","last_undegraded":"2024-09-10T14:33:16.467965+0000","last_fullsized":"2024-09-10T14:33:16.467965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:16.467773+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:16.467773+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.467773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:45.412113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.218999+0000","last_change":"2024-09-10T14:32:37.218999+0000","last_active":"2024-09-10T14:32:37.218999+0000","last_peered":"2024-09-10T14:32:37.218999+0000","last_clean":"2024-09-10T14:32:37.218999+0000","last_became_active":"2024-09-10T14:28:32.877762+0000","last_became_peered":"2024-09-10T14:28:32.877762+0000","last_unstale":"2024-09-10T14:32:37.218999+0000","last_undegraded":"2024-09-10T14:32:37.218999+0000","last_fullsized":"2024-09-10T14:32:37.218999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.218734+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.218734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:20.123545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.492161+0000","last_change":"2024-09-10T14:32:28.492161+0000","last_active":"2024-09-10T14:32:28.492161+0000","last_peered":"2024-09-10T14:32:28.492161+0000","last_clean":"2024-09-10T14:32:28.492161+0000","last_became_active":"2024-09-10T14:28:34.898624+0000","last_became_peered":"2024-09-10T14:28:34.898624+0000","last_unstale":"2024-09-10T14:32:28.492161+0000","last_undegraded":"2024-09-10T14:32:28.492161+0000","last_fullsized":"2024-09-10T14:32:28.492161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:28.491906+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.491906+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:07.716285+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'286","reported_seq":407,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.439000+0000","last_change":"2024-09-10T14:32:51.439000+0000","last_active":"2024-09-10T14:32:51.439000+0000","last_peered":"2024-09-10T14:32:51.439000+0000","last_clean":"2024-09-10T14:32:51.439000+0000","last_became_active":"2024-09-10T14:28:36.943336+0000","last_became_peered":"2024-09-10T14:28:36.943336+0000","last_unstale":"2024-09-10T14:32:51.439000+0000","last_undegraded":"2024-09-10T14:32:51.439000+0000","last_fullsized":"2024-09-10T14:32:51.439000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-10T14:32:51.438638+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-10T14:32:51.438638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.438638+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:47.269056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"36'2","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.359041+0000","last_change":"2024-09-10T14:32:43.359041+0000","last_active":"2024-09-10T14:32:43.359041+0000","last_peered":"2024-09-10T14:32:43.359041+0000","last_clean":"2024-09-10T14:32:43.359041+0000","last_became_active":"2024-09-10T14:28:38.943771+0000","last_became_peered":"2024-09-10T14:28:38.943771+0000","last_unstale":"2024-09-10T14:32:43.359041+0000","last_undegraded":"2024-09-10T14:32:43.359041+0000","last_fullsized":"2024-09-10T14:32:43.359041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:43.358788+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:43.358788+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.358788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:40.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.254423+0000","last_change":"2024-09-10T14:32:48.254423+0000","last_active":"2024-09-10T14:32:48.254423+0000","last_peered":"2024-09-10T14:32:48.254423+0000","last_clean":"2024-09-10T14:32:48.254423+0000","last_became_active":"2024-09-10T14:28:30.884075+0000","last_became_peered":"2024-09-10T14:28:30.884075+0000","last_unstale":"2024-09-10T14:32:48.254423+0000","last_undegraded":"2024-09-10T14:32:48.254423+0000","last_fullsized":"2024-09-10T14:32:48.254423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:48.254057+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:48.254057+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.254057+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:25.991922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.761849+0000","last_change":"2024-09-10T14:33:08.761849+0000","last_active":"2024-09-10T14:33:08.761849+0000","last_peered":"2024-09-10T14:33:08.761849+0000","last_clean":"2024-09-10T14:33:08.761849+0000","last_became_active":"2024-09-10T14:28:28.888673+0000","last_became_peered":"2024-09-10T14:28:28.888673+0000","last_unstale":"2024-09-10T14:33:08.761849+0000","last_undegraded":"2024-09-10T14:33:08.761849+0000","last_fullsized":"2024-09-10T14:33:08.761849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:08.761592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:08.761592+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.761592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:10.906663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"36'5","reported_seq":241,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.465044+0000","last_change":"2024-09-10T14:32:24.465044+0000","last_active":"2024-09-10T14:32:24.465044+0000","last_peered":"2024-09-10T14:32:24.465044+0000","last_clean":"2024-09-10T14:32:24.465044+0000","last_became_active":"2024-09-10T14:28:32.887718+0000","last_became_peered":"2024-09-10T14:28:32.887718+0000","last_unstale":"2024-09-10T14:32:24.465044+0000","last_undegraded":"2024-09-10T14:32:24.465044+0000","last_fullsized":"2024-09-10T14:32:24.465044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:24.464758+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.464758+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:15.815013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.479227+0000","last_change":"2024-09-10T14:32:29.479227+0000","last_active":"2024-09-10T14:32:29.479227+0000","last_peered":"2024-09-10T14:32:29.479227+0000","last_clean":"2024-09-10T14:32:29.479227+0000","last_became_active":"2024-09-10T14:28:34.903687+0000","last_became_peered":"2024-09-10T14:28:34.903687+0000","last_unstale":"2024-09-10T14:32:29.479227+0000","last_undegraded":"2024-09-10T14:32:29.479227+0000","last_fullsized":"2024-09-10T14:32:29.479227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:29.478794+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.478794+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:53.505918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.041931+0000","last_change":"2024-09-10T14:32:24.041931+0000","last_active":"2024-09-10T14:32:24.041931+0000","last_peered":"2024-09-10T14:32:24.041931+0000","last_clean":"2024-09-10T14:32:24.041931+0000","last_became_active":"2024-09-10T14:28:36.901127+0000","last_became_peered":"2024-09-10T14:28:36.901127+0000","last_unstale":"2024-09-10T14:32:24.041931+0000","last_undegraded":"2024-09-10T14:32:24.041931+0000","last_fullsized":"2024-09-10T14:32:24.041931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:24.041685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.041685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:10.399631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.466264+0000","last_change":"2024-09-10T14:33:08.466320+0000","last_active":"2024-09-10T14:33:08.466264+0000","last_peered":"2024-09-10T14:33:08.466264+0000","last_clean":"2024-09-10T14:33:08.466264+0000","last_became_active":"2024-09-10T14:28:30.870445+0000","last_became_peered":"2024-09-10T14:28:30.870445+0000","last_unstale":"2024-09-10T14:33:08.466264+0000","last_undegraded":"2024-09-10T14:33:08.466264+0000","last_fullsized":"2024-09-10T14:33:08.466264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:33:08.466083+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:33:08.466083+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.466083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:15.113294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.364324+0000","last_change":"2024-09-10T14:32:58.364324+0000","last_active":"2024-09-10T14:32:58.364324+0000","last_peered":"2024-09-10T14:32:58.364324+0000","last_clean":"2024-09-10T14:32:58.364324+0000","last_became_active":"2024-09-10T14:28:28.909882+0000","last_became_peered":"2024-09-10T14:28:28.909882+0000","last_unstale":"2024-09-10T14:32:58.364324+0000","last_undegraded":"2024-09-10T14:32:58.364324+0000","last_fullsized":"2024-09-10T14:32:58.364324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:58.364049+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:58.364049+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.364049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:13.940048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.014533+0000","last_change":"2024-09-10T14:32:30.014533+0000","last_active":"2024-09-10T14:32:30.014533+0000","last_peered":"2024-09-10T14:32:30.014533+0000","last_clean":"2024-09-10T14:32:30.014533+0000","last_became_active":"2024-09-10T14:28:32.888130+0000","last_became_peered":"2024-09-10T14:28:32.888130+0000","last_unstale":"2024-09-10T14:32:30.014533+0000","last_undegraded":"2024-09-10T14:32:30.014533+0000","last_fullsized":"2024-09-10T14:32:30.014533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.014216+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.014216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:20.605790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.517939+0000","last_change":"2024-09-10T14:32:34.517939+0000","last_active":"2024-09-10T14:32:34.517939+0000","last_peered":"2024-09-10T14:32:34.517939+0000","last_clean":"2024-09-10T14:32:34.517939+0000","last_became_active":"2024-09-10T14:28:34.887057+0000","last_became_peered":"2024-09-10T14:28:34.887057+0000","last_unstale":"2024-09-10T14:32:34.517939+0000","last_undegraded":"2024-09-10T14:32:34.517939+0000","last_fullsized":"2024-09-10T14:32:34.517939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-10T14:32:34.517813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.517813+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:15.055588+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.040437+0000","last_change":"2024-09-10T14:32:19.040437+0000","last_active":"2024-09-10T14:32:19.040437+0000","last_peered":"2024-09-10T14:32:19.040437+0000","last_clean":"2024-09-10T14:32:19.040437+0000","last_became_active":"2024-09-10T14:28:36.913410+0000","last_became_peered":"2024-09-10T14:28:36.913410+0000","last_unstale":"2024-09-10T14:32:19.040437+0000","last_undegraded":"2024-09-10T14:32:19.040437+0000","last_fullsized":"2024-09-10T14:32:19.040437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.040292+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.040292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:34.054916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"36'3","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.402239+0000","last_change":"2024-09-10T14:32:39.402239+0000","last_active":"2024-09-10T14:32:39.402239+0000","last_peered":"2024-09-10T14:32:39.402239+0000","last_clean":"2024-09-10T14:32:39.402239+0000","last_became_active":"2024-09-10T14:28:38.933834+0000","last_became_peered":"2024-09-10T14:28:38.933834+0000","last_unstale":"2024-09-10T14:32:39.402239+0000","last_undegraded":"2024-09-10T14:32:39.402239+0000","last_fullsized":"2024-09-10T14:32:39.402239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:39.401987+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.401987+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:54.650326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.972138+0000","last_change":"2024-09-10T14:32:52.972138+0000","last_active":"2024-09-10T14:32:52.972138+0000","last_peered":"2024-09-10T14:32:52.972138+0000","last_clean":"2024-09-10T14:32:52.972138+0000","last_became_active":"2024-09-10T14:28:30.866574+0000","last_became_peered":"2024-09-10T14:28:30.866574+0000","last_unstale":"2024-09-10T14:32:52.972138+0000","last_undegraded":"2024-09-10T14:32:52.972138+0000","last_fullsized":"2024-09-10T14:32:52.972138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:52.971889+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:52.971889+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.971889+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:26.022428+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.372100+0000","last_change":"2024-09-10T14:33:05.372164+0000","last_active":"2024-09-10T14:33:05.372100+0000","last_peered":"2024-09-10T14:33:05.372100+0000","last_clean":"2024-09-10T14:33:05.372100+0000","last_became_active":"2024-09-10T14:28:28.893058+0000","last_became_peered":"2024-09-10T14:28:28.893058+0000","last_unstale":"2024-09-10T14:33:05.372100+0000","last_undegraded":"2024-09-10T14:33:05.372100+0000","last_fullsized":"2024-09-10T14:33:05.372100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.371906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.371906+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.371906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:27.083822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.242013+0000","last_change":"2024-09-10T14:32:42.242013+0000","last_active":"2024-09-10T14:32:42.242013+0000","last_peered":"2024-09-10T14:32:42.242013+0000","last_clean":"2024-09-10T14:32:42.242013+0000","last_became_active":"2024-09-10T14:28:32.876266+0000","last_became_peered":"2024-09-10T14:28:32.876266+0000","last_unstale":"2024-09-10T14:32:42.242013+0000","last_undegraded":"2024-09-10T14:32:42.242013+0000","last_fullsized":"2024-09-10T14:32:42.242013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.241760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.241760+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.241760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:14.535976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"36'36","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.442127+0000","last_change":"2024-09-10T14:32:39.442127+0000","last_active":"2024-09-10T14:32:39.442127+0000","last_peered":"2024-09-10T14:32:39.442127+0000","last_clean":"2024-09-10T14:32:39.442127+0000","last_became_active":"2024-09-10T14:28:34.913872+0000","last_became_peered":"2024-09-10T14:28:34.913872+0000","last_unstale":"2024-09-10T14:32:39.442127+0000","last_undegraded":"2024-09-10T14:32:39.442127+0000","last_fullsized":"2024-09-10T14:32:39.442127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:39.441831+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:39.441831+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.441831+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:50.008100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.039240+0000","last_change":"2024-09-10T14:32:27.039240+0000","last_active":"2024-09-10T14:32:27.039240+0000","last_peered":"2024-09-10T14:32:27.039240+0000","last_clean":"2024-09-10T14:32:27.039240+0000","last_became_active":"2024-09-10T14:28:36.923371+0000","last_became_peered":"2024-09-10T14:28:36.923371+0000","last_unstale":"2024-09-10T14:32:27.039240+0000","last_undegraded":"2024-09-10T14:32:27.039240+0000","last_fullsized":"2024-09-10T14:32:27.039240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:27.038840+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.038840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:05.450794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"36'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.823525+0000","last_change":"2024-09-10T14:33:14.823588+0000","last_active":"2024-09-10T14:33:14.823525+0000","last_peered":"2024-09-10T14:33:14.823525+0000","last_clean":"2024-09-10T14:33:14.823525+0000","last_became_active":"2024-09-10T14:28:38.932533+0000","last_became_peered":"2024-09-10T14:28:38.932533+0000","last_unstale":"2024-09-10T14:33:14.823525+0000","last_undegraded":"2024-09-10T14:33:14.823525+0000","last_fullsized":"2024-09-10T14:33:14.823525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:14.823317+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:14.823317+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.823317+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:51.572439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.339953+0000","last_change":"2024-09-10T14:33:15.340102+0000","last_active":"2024-09-10T14:33:15.339953+0000","last_peered":"2024-09-10T14:33:15.339953+0000","last_clean":"2024-09-10T14:33:15.339953+0000","last_became_active":"2024-09-10T14:29:07.803379+0000","last_became_peered":"2024-09-10T14:29:07.803379+0000","last_unstale":"2024-09-10T14:33:15.339953+0000","last_undegraded":"2024-09-10T14:33:15.339953+0000","last_fullsized":"2024-09-10T14:33:15.339953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:15.339732+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:15.339732+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.339732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.260627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:22.558980+0000","last_change":"2024-09-10T14:33:22.559043+0000","last_active":"2024-09-10T14:33:22.558980+0000","last_peered":"2024-09-10T14:33:22.558980+0000","last_clean":"2024-09-10T14:33:22.558980+0000","last_became_active":"2024-09-10T14:28:28.884862+0000","last_became_peered":"2024-09-10T14:28:28.884862+0000","last_unstale":"2024-09-10T14:33:22.558980+0000","last_undegraded":"2024-09-10T14:33:22.558980+0000","last_fullsized":"2024-09-10T14:33:22.558980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:22.558764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:22.558764+0000","last_clean_scrub_stamp":"2024-09-10T14:33:22.558764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:38.514408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.261308+0000","last_change":"2024-09-10T14:32:41.261308+0000","last_active":"2024-09-10T14:32:41.261308+0000","last_peered":"2024-09-10T14:32:41.261308+0000","last_clean":"2024-09-10T14:32:41.261308+0000","last_became_active":"2024-09-10T14:28:32.875976+0000","last_became_peered":"2024-09-10T14:28:32.875976+0000","last_unstale":"2024-09-10T14:32:41.261308+0000","last_undegraded":"2024-09-10T14:32:41.261308+0000","last_fullsized":"2024-09-10T14:32:41.261308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.261061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.261061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.261061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:33.177795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"36'47","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.415162+0000","last_change":"2024-09-10T14:32:27.415162+0000","last_active":"2024-09-10T14:32:27.415162+0000","last_peered":"2024-09-10T14:32:27.415162+0000","last_clean":"2024-09-10T14:32:27.415162+0000","last_became_active":"2024-09-10T14:28:34.909665+0000","last_became_peered":"2024-09-10T14:28:34.909665+0000","last_unstale":"2024-09-10T14:32:27.415162+0000","last_undegraded":"2024-09-10T14:32:27.415162+0000","last_fullsized":"2024-09-10T14:32:27.415162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:27.414901+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.414901+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:51.152227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":370,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.166376+0000","last_change":"2024-09-10T14:32:31.166376+0000","last_active":"2024-09-10T14:32:31.166376+0000","last_peered":"2024-09-10T14:32:31.166376+0000","last_clean":"2024-09-10T14:32:31.166376+0000","last_became_active":"2024-09-10T14:28:36.923713+0000","last_became_peered":"2024-09-10T14:28:36.923713+0000","last_unstale":"2024-09-10T14:32:31.166376+0000","last_undegraded":"2024-09-10T14:32:31.166376+0000","last_fullsized":"2024-09-10T14:32:31.166376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:31.166120+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.166120+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:33.186827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:18.088880+0000","last_change":"2024-09-10T14:33:18.088936+0000","last_active":"2024-09-10T14:33:18.088880+0000","last_peered":"2024-09-10T14:33:18.088880+0000","last_clean":"2024-09-10T14:33:18.088880+0000","last_became_active":"2024-09-10T14:28:38.935371+0000","last_became_peered":"2024-09-10T14:28:38.935371+0000","last_unstale":"2024-09-10T14:33:18.088880+0000","last_undegraded":"2024-09-10T14:33:18.088880+0000","last_fullsized":"2024-09-10T14:33:18.088880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:18.088684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:18.088684+0000","last_clean_scrub_stamp":"2024-09-10T14:33:18.088684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:55.799130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"36'12","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.391058+0000","last_change":"2024-09-10T14:32:47.391058+0000","last_active":"2024-09-10T14:32:47.391058+0000","last_peered":"2024-09-10T14:32:47.391058+0000","last_clean":"2024-09-10T14:32:47.391058+0000","last_became_active":"2024-09-10T14:28:30.859047+0000","last_became_peered":"2024-09-10T14:28:30.859047+0000","last_unstale":"2024-09-10T14:32:47.391058+0000","last_undegraded":"2024-09-10T14:32:47.391058+0000","last_fullsized":"2024-09-10T14:32:47.391058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:47.390803+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:47.390803+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.390803+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:07.854725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:26.708915+0000","last_change":"2024-09-10T14:33:26.709043+0000","last_active":"2024-09-10T14:33:26.708915+0000","last_peered":"2024-09-10T14:33:26.708915+0000","last_clean":"2024-09-10T14:33:26.708915+0000","last_became_active":"2024-09-10T14:28:28.884115+0000","last_became_peered":"2024-09-10T14:28:28.884115+0000","last_unstale":"2024-09-10T14:33:26.708915+0000","last_undegraded":"2024-09-10T14:33:26.708915+0000","last_fullsized":"2024-09-10T14:33:26.708915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:26.708667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:26.708667+0000","last_clean_scrub_stamp":"2024-09-10T14:33:26.708667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:38.353927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"36'2","reported_seq":233,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.252127+0000","last_change":"2024-09-10T14:32:36.252127+0000","last_active":"2024-09-10T14:32:36.252127+0000","last_peered":"2024-09-10T14:32:36.252127+0000","last_clean":"2024-09-10T14:32:36.252127+0000","last_became_active":"2024-09-10T14:28:32.882221+0000","last_became_peered":"2024-09-10T14:28:32.882221+0000","last_unstale":"2024-09-10T14:32:36.252127+0000","last_undegraded":"2024-09-10T14:32:36.252127+0000","last_fullsized":"2024-09-10T14:32:36.252127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:36.251846+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.251846+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:51:42.564689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"36'64","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.463817+0000","last_change":"2024-09-10T14:32:33.463817+0000","last_active":"2024-09-10T14:32:33.463817+0000","last_peered":"2024-09-10T14:32:33.463817+0000","last_clean":"2024-09-10T14:32:33.463817+0000","last_became_active":"2024-09-10T14:28:34.912840+0000","last_became_peered":"2024-09-10T14:28:34.912840+0000","last_unstale":"2024-09-10T14:32:33.463817+0000","last_undegraded":"2024-09-10T14:32:33.463817+0000","last_fullsized":"2024-09-10T14:32:33.463817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'64","last_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_deep_scrub":"36'64","last_deep_scrub_stamp":"2024-09-10T14:32:33.463523+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.463523+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:28.060036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.053813+0000","last_change":"2024-09-10T14:32:21.053813+0000","last_active":"2024-09-10T14:32:21.053813+0000","last_peered":"2024-09-10T14:32:21.053813+0000","last_clean":"2024-09-10T14:32:21.053813+0000","last_became_active":"2024-09-10T14:28:36.902861+0000","last_became_peered":"2024-09-10T14:28:36.902861+0000","last_unstale":"2024-09-10T14:32:21.053813+0000","last_undegraded":"2024-09-10T14:32:21.053813+0000","last_fullsized":"2024-09-10T14:32:21.053813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.053565+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.053565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:23.410520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"36'23","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.286108+0000","last_change":"2024-09-10T14:32:47.286108+0000","last_active":"2024-09-10T14:32:47.286108+0000","last_peered":"2024-09-10T14:32:47.286108+0000","last_clean":"2024-09-10T14:32:47.286108+0000","last_became_active":"2024-09-10T14:28:38.919153+0000","last_became_peered":"2024-09-10T14:28:38.919153+0000","last_unstale":"2024-09-10T14:32:47.286108+0000","last_undegraded":"2024-09-10T14:32:47.286108+0000","last_fullsized":"2024-09-10T14:32:47.286108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'23","last_scrub_stamp":"2024-09-10T14:32:47.285847+0000","last_deep_scrub":"36'23","last_deep_scrub_stamp":"2024-09-10T14:32:47.285847+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.285847+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:11.350745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.833610+0000","last_change":"2024-09-10T14:32:58.833610+0000","last_active":"2024-09-10T14:32:58.833610+0000","last_peered":"2024-09-10T14:32:58.833610+0000","last_clean":"2024-09-10T14:32:58.833610+0000","last_became_active":"2024-09-10T14:28:30.878019+0000","last_became_peered":"2024-09-10T14:28:30.878019+0000","last_unstale":"2024-09-10T14:32:58.833610+0000","last_undegraded":"2024-09-10T14:32:58.833610+0000","last_fullsized":"2024-09-10T14:32:58.833610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:58.833329+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:58.833329+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.833329+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:15.018214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.106324+0000","last_change":"2024-09-10T14:33:11.106497+0000","last_active":"2024-09-10T14:33:11.106324+0000","last_peered":"2024-09-10T14:33:11.106324+0000","last_clean":"2024-09-10T14:33:11.106324+0000","last_became_active":"2024-09-10T14:28:28.874394+0000","last_became_peered":"2024-09-10T14:28:28.874394+0000","last_unstale":"2024-09-10T14:33:11.106324+0000","last_undegraded":"2024-09-10T14:33:11.106324+0000","last_fullsized":"2024-09-10T14:33:11.106324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:11.106093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:11.106093+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.106093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:31:42.567754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.417891+0000","last_change":"2024-09-10T14:32:41.417891+0000","last_active":"2024-09-10T14:32:41.417891+0000","last_peered":"2024-09-10T14:32:41.417891+0000","last_clean":"2024-09-10T14:32:41.417891+0000","last_became_active":"2024-09-10T14:28:32.877757+0000","last_became_peered":"2024-09-10T14:28:32.877757+0000","last_unstale":"2024-09-10T14:32:41.417891+0000","last_undegraded":"2024-09-10T14:32:41.417891+0000","last_fullsized":"2024-09-10T14:32:41.417891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.417613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.417613+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.417613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:31.173045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.040293+0000","last_change":"2024-09-10T14:32:26.040293+0000","last_active":"2024-09-10T14:32:26.040293+0000","last_peered":"2024-09-10T14:32:26.040293+0000","last_clean":"2024-09-10T14:32:26.040293+0000","last_became_active":"2024-09-10T14:28:34.888639+0000","last_became_peered":"2024-09-10T14:28:34.888639+0000","last_unstale":"2024-09-10T14:32:26.040293+0000","last_undegraded":"2024-09-10T14:32:26.040293+0000","last_fullsized":"2024-09-10T14:32:26.040293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:26.040008+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.040008+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:55.634620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.412041+0000","last_change":"2024-09-10T14:32:59.412041+0000","last_active":"2024-09-10T14:32:59.412041+0000","last_peered":"2024-09-10T14:32:59.412041+0000","last_clean":"2024-09-10T14:32:59.412041+0000","last_became_active":"2024-09-10T14:28:36.944955+0000","last_became_peered":"2024-09-10T14:28:36.944955+0000","last_unstale":"2024-09-10T14:32:59.412041+0000","last_undegraded":"2024-09-10T14:32:59.412041+0000","last_fullsized":"2024-09-10T14:32:59.412041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:59.411794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:59.411794+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.411794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:24.669220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'8","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:39.663105+0000","last_change":"2024-09-10T14:33:39.663296+0000","last_active":"2024-09-10T14:33:39.663105+0000","last_peered":"2024-09-10T14:33:39.663105+0000","last_clean":"2024-09-10T14:33:39.663105+0000","last_became_active":"2024-09-10T14:28:38.934330+0000","last_became_peered":"2024-09-10T14:28:38.934330+0000","last_unstale":"2024-09-10T14:33:39.663105+0000","last_undegraded":"2024-09-10T14:33:39.663105+0000","last_fullsized":"2024-09-10T14:33:39.663105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:33:39.662886+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:33:39.662886+0000","last_clean_scrub_stamp":"2024-09-10T14:33:39.662886+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:24:14.595345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.478577+0000","last_change":"2024-09-10T14:32:32.478577+0000","last_active":"2024-09-10T14:32:32.478577+0000","last_peered":"2024-09-10T14:32:32.478577+0000","last_clean":"2024-09-10T14:32:32.478577+0000","last_became_active":"2024-09-10T14:28:30.890501+0000","last_became_peered":"2024-09-10T14:28:30.890501+0000","last_unstale":"2024-09-10T14:32:32.478577+0000","last_undegraded":"2024-09-10T14:32:32.478577+0000","last_fullsized":"2024-09-10T14:32:32.478577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:32.478327+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.478327+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:57.945668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:21.570254+0000","last_change":"2024-09-10T14:33:21.570325+0000","last_active":"2024-09-10T14:33:21.570254+0000","last_peered":"2024-09-10T14:33:21.570254+0000","last_clean":"2024-09-10T14:33:21.570254+0000","last_became_active":"2024-09-10T14:28:28.890631+0000","last_became_peered":"2024-09-10T14:28:28.890631+0000","last_unstale":"2024-09-10T14:33:21.570254+0000","last_undegraded":"2024-09-10T14:33:21.570254+0000","last_fullsized":"2024-09-10T14:33:21.570254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:21.570021+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:21.570021+0000","last_clean_scrub_stamp":"2024-09-10T14:33:21.570021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:13.308557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.294294+0000","last_change":"2024-09-10T14:32:40.294294+0000","last_active":"2024-09-10T14:32:40.294294+0000","last_peered":"2024-09-10T14:32:40.294294+0000","last_clean":"2024-09-10T14:32:40.294294+0000","last_became_active":"2024-09-10T14:28:32.876791+0000","last_became_peered":"2024-09-10T14:28:32.876791+0000","last_unstale":"2024-09-10T14:32:40.294294+0000","last_undegraded":"2024-09-10T14:32:40.294294+0000","last_fullsized":"2024-09-10T14:32:40.294294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:40.293913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:40.293913+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.293913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:23.340331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"36'45","reported_seq":106,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.499425+0000","last_change":"2024-09-10T14:32:33.499425+0000","last_active":"2024-09-10T14:32:33.499425+0000","last_peered":"2024-09-10T14:32:33.499425+0000","last_clean":"2024-09-10T14:32:33.499425+0000","last_became_active":"2024-09-10T14:28:34.896991+0000","last_became_peered":"2024-09-10T14:28:34.896991+0000","last_unstale":"2024-09-10T14:32:33.499425+0000","last_undegraded":"2024-09-10T14:32:33.499425+0000","last_fullsized":"2024-09-10T14:32:33.499425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-10T14:32:33.499022+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.499022+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.396571+0000","last_change":"2024-09-10T14:32:22.396571+0000","last_active":"2024-09-10T14:32:22.396571+0000","last_peered":"2024-09-10T14:32:22.396571+0000","last_clean":"2024-09-10T14:32:22.396571+0000","last_became_active":"2024-09-10T14:28:36.935764+0000","last_became_peered":"2024-09-10T14:28:36.935764+0000","last_unstale":"2024-09-10T14:32:22.396571+0000","last_undegraded":"2024-09-10T14:32:22.396571+0000","last_fullsized":"2024-09-10T14:32:22.396571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.396275+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.396275+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:50.169559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'13","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:19.052909+0000","last_change":"2024-09-10T14:33:19.052978+0000","last_active":"2024-09-10T14:33:19.052909+0000","last_peered":"2024-09-10T14:33:19.052909+0000","last_clean":"2024-09-10T14:33:19.052909+0000","last_became_active":"2024-09-10T14:28:38.935198+0000","last_became_peered":"2024-09-10T14:28:38.935198+0000","last_unstale":"2024-09-10T14:33:19.052909+0000","last_undegraded":"2024-09-10T14:33:19.052909+0000","last_fullsized":"2024-09-10T14:33:19.052909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-09-10T14:33:19.052723+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-09-10T14:33:19.052723+0000","last_clean_scrub_stamp":"2024-09-10T14:33:19.052723+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:12:44.310149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"36'14","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.368051+0000","last_change":"2024-09-10T14:32:53.368051+0000","last_active":"2024-09-10T14:32:53.368051+0000","last_peered":"2024-09-10T14:32:53.368051+0000","last_clean":"2024-09-10T14:32:53.368051+0000","last_became_active":"2024-09-10T14:28:30.868628+0000","last_became_peered":"2024-09-10T14:28:30.868628+0000","last_unstale":"2024-09-10T14:32:53.368051+0000","last_undegraded":"2024-09-10T14:32:53.368051+0000","last_fullsized":"2024-09-10T14:32:53.368051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:53.367787+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:53.367787+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.367787+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:38.443273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:20.529163+0000","last_change":"2024-09-10T14:33:20.529302+0000","last_active":"2024-09-10T14:33:20.529163+0000","last_peered":"2024-09-10T14:33:20.529163+0000","last_clean":"2024-09-10T14:33:20.529163+0000","last_became_active":"2024-09-10T14:28:28.884933+0000","last_became_peered":"2024-09-10T14:28:28.884933+0000","last_unstale":"2024-09-10T14:33:20.529163+0000","last_undegraded":"2024-09-10T14:33:20.529163+0000","last_fullsized":"2024-09-10T14:33:20.529163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:20.528875+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:20.528875+0000","last_clean_scrub_stamp":"2024-09-10T14:33:20.528875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:09.074771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":431,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.957497+0000","last_change":"2024-09-10T14:32:31.957497+0000","last_active":"2024-09-10T14:32:31.957497+0000","last_peered":"2024-09-10T14:32:31.957497+0000","last_clean":"2024-09-10T14:32:31.957497+0000","last_became_active":"2024-09-10T14:28:32.883668+0000","last_became_peered":"2024-09-10T14:28:32.883668+0000","last_unstale":"2024-09-10T14:32:31.957497+0000","last_undegraded":"2024-09-10T14:32:31.957497+0000","last_fullsized":"2024-09-10T14:32:31.957497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:32:31.957244+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.957244+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:59.661372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.518513+0000","last_change":"2024-09-10T14:32:45.518513+0000","last_active":"2024-09-10T14:32:45.518513+0000","last_peered":"2024-09-10T14:32:45.518513+0000","last_clean":"2024-09-10T14:32:45.518513+0000","last_became_active":"2024-09-10T14:28:34.925557+0000","last_became_peered":"2024-09-10T14:28:34.925557+0000","last_unstale":"2024-09-10T14:32:45.518513+0000","last_undegraded":"2024-09-10T14:32:45.518513+0000","last_fullsized":"2024-09-10T14:32:45.518513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:45.518255+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:45.518255+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.518255+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:33.065215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":475,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.046231+0000","last_change":"2024-09-10T14:32:27.046231+0000","last_active":"2024-09-10T14:32:27.046231+0000","last_peered":"2024-09-10T14:32:27.046231+0000","last_clean":"2024-09-10T14:32:27.046231+0000","last_became_active":"2024-09-10T14:28:36.921837+0000","last_became_peered":"2024-09-10T14:28:36.921837+0000","last_unstale":"2024-09-10T14:32:27.046231+0000","last_undegraded":"2024-09-10T14:32:27.046231+0000","last_fullsized":"2024-09-10T14:32:27.046231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:27.045975+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.045975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:13.403921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.470074+0000","last_change":"2024-09-10T14:32:31.470074+0000","last_active":"2024-09-10T14:32:31.470074+0000","last_peered":"2024-09-10T14:32:31.470074+0000","last_clean":"2024-09-10T14:32:31.470074+0000","last_became_active":"2024-09-10T14:28:38.928454+0000","last_became_peered":"2024-09-10T14:28:38.928454+0000","last_unstale":"2024-09-10T14:32:31.470074+0000","last_undegraded":"2024-09-10T14:32:31.470074+0000","last_fullsized":"2024-09-10T14:32:31.470074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:31.469828+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.469828+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:50.291732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.988547+0000","last_change":"2024-09-10T14:32:40.988547+0000","last_active":"2024-09-10T14:32:40.988547+0000","last_peered":"2024-09-10T14:32:40.988547+0000","last_clean":"2024-09-10T14:32:40.988547+0000","last_became_active":"2024-09-10T14:28:30.887039+0000","last_became_peered":"2024-09-10T14:28:30.887039+0000","last_unstale":"2024-09-10T14:32:40.988547+0000","last_undegraded":"2024-09-10T14:32:40.988547+0000","last_fullsized":"2024-09-10T14:32:40.988547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:40.988250+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:40.988250+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.988250+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:03.901456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.470613+0000","last_change":"2024-09-10T14:33:10.470677+0000","last_active":"2024-09-10T14:33:10.470613+0000","last_peered":"2024-09-10T14:33:10.470613+0000","last_clean":"2024-09-10T14:33:10.470613+0000","last_became_active":"2024-09-10T14:28:28.892349+0000","last_became_peered":"2024-09-10T14:28:28.892349+0000","last_unstale":"2024-09-10T14:33:10.470613+0000","last_undegraded":"2024-09-10T14:33:10.470613+0000","last_fullsized":"2024-09-10T14:33:10.470613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.470416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.470416+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.470416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:00.133222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.468662+0000","last_change":"2024-09-10T14:32:23.468662+0000","last_active":"2024-09-10T14:32:23.468662+0000","last_peered":"2024-09-10T14:32:23.468662+0000","last_clean":"2024-09-10T14:32:23.468662+0000","last_became_active":"2024-09-10T14:28:32.891130+0000","last_became_peered":"2024-09-10T14:28:32.891130+0000","last_unstale":"2024-09-10T14:32:23.468662+0000","last_undegraded":"2024-09-10T14:32:23.468662+0000","last_fullsized":"2024-09-10T14:32:23.468662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.468416+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.468416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:16.409761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'49","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.023066+0000","last_change":"2024-09-10T14:32:28.023066+0000","last_active":"2024-09-10T14:32:28.023066+0000","last_peered":"2024-09-10T14:32:28.023066+0000","last_clean":"2024-09-10T14:32:28.023066+0000","last_became_active":"2024-09-10T14:28:34.888491+0000","last_became_peered":"2024-09-10T14:28:34.888491+0000","last_unstale":"2024-09-10T14:32:28.023066+0000","last_undegraded":"2024-09-10T14:32:28.023066+0000","last_fullsized":"2024-09-10T14:32:28.023066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'49","last_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_deep_scrub":"36'49","last_deep_scrub_stamp":"2024-09-10T14:32:28.022782+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.022782+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:04.020612+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:21.346431+0000","last_change":"2024-09-10T14:32:21.346431+0000","last_active":"2024-09-10T14:32:21.346431+0000","last_peered":"2024-09-10T14:32:21.346431+0000","last_clean":"2024-09-10T14:32:21.346431+0000","last_became_active":"2024-09-10T14:28:36.937824+0000","last_became_peered":"2024-09-10T14:28:36.937824+0000","last_unstale":"2024-09-10T14:32:21.346431+0000","last_undegraded":"2024-09-10T14:32:21.346431+0000","last_fullsized":"2024-09-10T14:32:21.346431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:21.346185+0000","last_clean_scrub_stamp":"2024-09-10T14:32:21.346185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:37.786157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"36'15","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.896938+0000","last_change":"2024-09-10T14:32:42.896938+0000","last_active":"2024-09-10T14:32:42.896938+0000","last_peered":"2024-09-10T14:32:42.896938+0000","last_clean":"2024-09-10T14:32:42.896938+0000","last_became_active":"2024-09-10T14:28:38.910496+0000","last_became_peered":"2024-09-10T14:28:38.910496+0000","last_unstale":"2024-09-10T14:32:42.896938+0000","last_undegraded":"2024-09-10T14:32:42.896938+0000","last_fullsized":"2024-09-10T14:32:42.896938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:42.896656+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:42.896656+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.896656+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:25.943074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":59,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.450748+0000","last_change":"2024-09-10T14:32:36.450748+0000","last_active":"2024-09-10T14:32:36.450748+0000","last_peered":"2024-09-10T14:32:36.450748+0000","last_clean":"2024-09-10T14:32:36.450748+0000","last_became_active":"2024-09-10T14:28:30.890222+0000","last_became_peered":"2024-09-10T14:28:30.890222+0000","last_unstale":"2024-09-10T14:32:36.450748+0000","last_undegraded":"2024-09-10T14:32:36.450748+0000","last_fullsized":"2024-09-10T14:32:36.450748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:36.450484+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.450484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:32.265283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":219,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.835924+0000","last_change":"2024-09-10T14:33:04.836002+0000","last_active":"2024-09-10T14:33:04.835924+0000","last_peered":"2024-09-10T14:33:04.835924+0000","last_clean":"2024-09-10T14:33:04.835924+0000","last_became_active":"2024-09-10T14:28:16.787557+0000","last_became_peered":"2024-09-10T14:28:16.787557+0000","last_unstale":"2024-09-10T14:33:04.835924+0000","last_undegraded":"2024-09-10T14:33:04.835924+0000","last_fullsized":"2024-09-10T14:33:04.835924+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-10T14:33:04.835705+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-10T14:33:04.835705+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.835705+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:55:10.228765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:32.734560+0000","last_change":"2024-09-10T14:33:32.734626+0000","last_active":"2024-09-10T14:33:32.734560+0000","last_peered":"2024-09-10T14:33:32.734560+0000","last_clean":"2024-09-10T14:33:32.734560+0000","last_became_active":"2024-09-10T14:28:19.324704+0000","last_became_peered":"2024-09-10T14:28:19.324704+0000","last_unstale":"2024-09-10T14:33:32.734560+0000","last_undegraded":"2024-09-10T14:33:32.734560+0000","last_fullsized":"2024-09-10T14:33:32.734560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:32.734372+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:32.734372+0000","last_clean_scrub_stamp":"2024-09-10T14:33:32.734372+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:13.088342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00094945900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:23.604305+0000","last_change":"2024-09-10T14:33:23.604443+0000","last_active":"2024-09-10T14:33:23.604305+0000","last_peered":"2024-09-10T14:33:23.604305+0000","last_clean":"2024-09-10T14:33:23.604305+0000","last_became_active":"2024-09-10T14:28:28.891226+0000","last_became_peered":"2024-09-10T14:28:28.891226+0000","last_unstale":"2024-09-10T14:33:23.604305+0000","last_undegraded":"2024-09-10T14:33:23.604305+0000","last_fullsized":"2024-09-10T14:33:23.604305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:23.604079+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:23.604079+0000","last_clean_scrub_stamp":"2024-09-10T14:33:23.604079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:26.490068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.952793+0000","last_change":"2024-09-10T14:32:36.952793+0000","last_active":"2024-09-10T14:32:36.952793+0000","last_peered":"2024-09-10T14:32:36.952793+0000","last_clean":"2024-09-10T14:32:36.952793+0000","last_became_active":"2024-09-10T14:28:32.882686+0000","last_became_peered":"2024-09-10T14:28:32.882686+0000","last_unstale":"2024-09-10T14:32:36.952793+0000","last_undegraded":"2024-09-10T14:32:36.952793+0000","last_fullsized":"2024-09-10T14:32:36.952793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:36.952410+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.952410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:45.541704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'90","reported_seq":183,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.479235+0000","last_change":"2024-09-10T14:32:48.479235+0000","last_active":"2024-09-10T14:32:48.479235+0000","last_peered":"2024-09-10T14:32:48.479235+0000","last_clean":"2024-09-10T14:32:48.479235+0000","last_became_active":"2024-09-10T14:28:34.924382+0000","last_became_peered":"2024-09-10T14:28:34.924382+0000","last_unstale":"2024-09-10T14:32:48.479235+0000","last_undegraded":"2024-09-10T14:32:48.479235+0000","last_fullsized":"2024-09-10T14:32:48.479235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-09-10T14:32:48.478990+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-09-10T14:32:48.478990+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.478990+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:01.329596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.266984+0000","last_change":"2024-09-10T14:32:43.266984+0000","last_active":"2024-09-10T14:32:43.266984+0000","last_peered":"2024-09-10T14:32:43.266984+0000","last_clean":"2024-09-10T14:32:43.266984+0000","last_became_active":"2024-09-10T14:28:36.923711+0000","last_became_peered":"2024-09-10T14:28:36.923711+0000","last_unstale":"2024-09-10T14:32:43.266984+0000","last_undegraded":"2024-09-10T14:32:43.266984+0000","last_fullsized":"2024-09-10T14:32:43.266984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:43.266713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:43.266713+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.266713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:55.597757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:27.463686+0000","last_change":"2024-09-10T14:32:27.463686+0000","last_active":"2024-09-10T14:32:27.463686+0000","last_peered":"2024-09-10T14:32:27.463686+0000","last_clean":"2024-09-10T14:32:27.463686+0000","last_became_active":"2024-09-10T14:28:38.921834+0000","last_became_peered":"2024-09-10T14:28:38.921834+0000","last_unstale":"2024-09-10T14:32:27.463686+0000","last_undegraded":"2024-09-10T14:32:27.463686+0000","last_fullsized":"2024-09-10T14:32:27.463686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-10T14:32:27.463440+0000","last_clean_scrub_stamp":"2024-09-10T14:32:27.463440+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:01.315498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'6","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.420075+0000","last_change":"2024-09-10T14:32:58.420191+0000","last_active":"2024-09-10T14:32:58.420075+0000","last_peered":"2024-09-10T14:32:58.420075+0000","last_clean":"2024-09-10T14:32:58.420075+0000","last_became_active":"2024-09-10T14:28:30.877688+0000","last_became_peered":"2024-09-10T14:28:30.877688+0000","last_unstale":"2024-09-10T14:32:58.420075+0000","last_undegraded":"2024-09-10T14:32:58.420075+0000","last_fullsized":"2024-09-10T14:32:58.420075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:58.419787+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:58.419787+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.419787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:20.379479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:29.788045+0000","last_change":"2024-09-10T14:33:29.788100+0000","last_active":"2024-09-10T14:33:29.788045+0000","last_peered":"2024-09-10T14:33:29.788045+0000","last_clean":"2024-09-10T14:33:29.788045+0000","last_became_active":"2024-09-10T14:28:19.321874+0000","last_became_peered":"2024-09-10T14:28:19.321874+0000","last_unstale":"2024-09-10T14:33:29.788045+0000","last_undegraded":"2024-09-10T14:33:29.788045+0000","last_fullsized":"2024-09-10T14:33:29.788045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:29.787826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:29.787826+0000","last_clean_scrub_stamp":"2024-09-10T14:33:29.787826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:04:09.380313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00089950700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.079949+0000","last_change":"2024-09-10T14:33:07.080019+0000","last_active":"2024-09-10T14:33:07.079949+0000","last_peered":"2024-09-10T14:33:07.079949+0000","last_clean":"2024-09-10T14:33:07.079949+0000","last_became_active":"2024-09-10T14:28:28.872306+0000","last_became_peered":"2024-09-10T14:28:28.872306+0000","last_unstale":"2024-09-10T14:33:07.079949+0000","last_undegraded":"2024-09-10T14:33:07.079949+0000","last_fullsized":"2024-09-10T14:33:07.079949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:07.079757+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:07.079757+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.079757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:47.031785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.453049+0000","last_change":"2024-09-10T14:32:22.453049+0000","last_active":"2024-09-10T14:32:22.453049+0000","last_peered":"2024-09-10T14:32:22.453049+0000","last_clean":"2024-09-10T14:32:22.453049+0000","last_became_active":"2024-09-10T14:28:32.888023+0000","last_became_peered":"2024-09-10T14:28:32.888023+0000","last_unstale":"2024-09-10T14:32:22.453049+0000","last_undegraded":"2024-09-10T14:32:22.453049+0000","last_fullsized":"2024-09-10T14:32:22.453049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.452808+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.452808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:11:07.398717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'292","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.028865+0000","last_change":"2024-09-10T14:32:22.028865+0000","last_active":"2024-09-10T14:32:22.028865+0000","last_peered":"2024-09-10T14:32:22.028865+0000","last_clean":"2024-09-10T14:32:22.028865+0000","last_became_active":"2024-09-10T14:28:34.893950+0000","last_became_peered":"2024-09-10T14:28:34.893950+0000","last_unstale":"2024-09-10T14:32:22.028865+0000","last_undegraded":"2024-09-10T14:32:22.028865+0000","last_fullsized":"2024-09-10T14:32:22.028865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'292","last_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_deep_scrub":"36'292","last_deep_scrub_stamp":"2024-09-10T14:32:22.028508+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.028508+0000","objects_scrubbed":10,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:37.043133+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.471881+0000","last_change":"2024-09-10T14:32:47.471881+0000","last_active":"2024-09-10T14:32:47.471881+0000","last_peered":"2024-09-10T14:32:47.471881+0000","last_clean":"2024-09-10T14:32:47.471881+0000","last_became_active":"2024-09-10T14:28:36.942391+0000","last_became_peered":"2024-09-10T14:28:36.942391+0000","last_unstale":"2024-09-10T14:32:47.471881+0000","last_undegraded":"2024-09-10T14:32:47.471881+0000","last_fullsized":"2024-09-10T14:32:47.471881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:47.471638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:47.471638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.471638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:38.822368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"36'5","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:18.801216+0000","last_change":"2024-09-10T14:33:18.801281+0000","last_active":"2024-09-10T14:33:18.801216+0000","last_peered":"2024-09-10T14:33:18.801216+0000","last_clean":"2024-09-10T14:33:18.801216+0000","last_became_active":"2024-09-10T14:28:38.942399+0000","last_became_peered":"2024-09-10T14:28:38.942399+0000","last_unstale":"2024-09-10T14:33:18.801216+0000","last_undegraded":"2024-09-10T14:33:18.801216+0000","last_fullsized":"2024-09-10T14:33:18.801216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:33:18.801021+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:33:18.801021+0000","last_clean_scrub_stamp":"2024-09-10T14:33:18.801021+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:34.431828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.127208+0000","last_change":"2024-09-10T14:33:13.127336+0000","last_active":"2024-09-10T14:33:13.127208+0000","last_peered":"2024-09-10T14:33:13.127208+0000","last_clean":"2024-09-10T14:33:13.127208+0000","last_became_active":"2024-09-10T14:28:30.883578+0000","last_became_peered":"2024-09-10T14:28:30.883578+0000","last_unstale":"2024-09-10T14:33:13.127208+0000","last_undegraded":"2024-09-10T14:33:13.127208+0000","last_fullsized":"2024-09-10T14:33:13.127208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:13.126986+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:13.126986+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.126986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:19.523672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.366239+0000","last_change":"2024-09-10T14:33:01.366298+0000","last_active":"2024-09-10T14:33:01.366239+0000","last_peered":"2024-09-10T14:33:01.366239+0000","last_clean":"2024-09-10T14:33:01.366239+0000","last_became_active":"2024-09-10T14:28:19.321967+0000","last_became_peered":"2024-09-10T14:28:19.321967+0000","last_unstale":"2024-09-10T14:33:01.366239+0000","last_undegraded":"2024-09-10T14:33:01.366239+0000","last_fullsized":"2024-09-10T14:33:01.366239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:01.366030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:01.366030+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.366030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:31.331688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084084299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"36'4","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.104961+0000","last_change":"2024-09-10T14:33:08.105090+0000","last_active":"2024-09-10T14:33:08.104961+0000","last_peered":"2024-09-10T14:33:08.104961+0000","last_clean":"2024-09-10T14:33:08.104961+0000","last_became_active":"2024-09-10T14:28:28.872929+0000","last_became_peered":"2024-09-10T14:28:28.872929+0000","last_unstale":"2024-09-10T14:33:08.104961+0000","last_undegraded":"2024-09-10T14:33:08.104961+0000","last_fullsized":"2024-09-10T14:33:08.104961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:08.104703+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:08.104703+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.104703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:14.825132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.335896+0000","last_change":"2024-09-10T14:32:44.335896+0000","last_active":"2024-09-10T14:32:44.335896+0000","last_peered":"2024-09-10T14:32:44.335896+0000","last_clean":"2024-09-10T14:32:44.335896+0000","last_became_active":"2024-09-10T14:28:32.870485+0000","last_became_peered":"2024-09-10T14:28:32.870485+0000","last_unstale":"2024-09-10T14:32:44.335896+0000","last_undegraded":"2024-09-10T14:32:44.335896+0000","last_fullsized":"2024-09-10T14:32:44.335896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:44.335653+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:44.335653+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.335653+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:10.314679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'24","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:36.504309+0000","last_change":"2024-09-10T14:32:36.504309+0000","last_active":"2024-09-10T14:32:36.504309+0000","last_peered":"2024-09-10T14:32:36.504309+0000","last_clean":"2024-09-10T14:32:36.504309+0000","last_became_active":"2024-09-10T14:28:34.884088+0000","last_became_peered":"2024-09-10T14:28:34.884088+0000","last_unstale":"2024-09-10T14:32:36.504309+0000","last_undegraded":"2024-09-10T14:32:36.504309+0000","last_fullsized":"2024-09-10T14:32:36.504309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:36.504009+0000","last_clean_scrub_stamp":"2024-09-10T14:32:36.504009+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:54.102292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.223829+0000","last_change":"2024-09-10T14:32:35.223829+0000","last_active":"2024-09-10T14:32:35.223829+0000","last_peered":"2024-09-10T14:32:35.223829+0000","last_clean":"2024-09-10T14:32:35.223829+0000","last_became_active":"2024-09-10T14:28:36.923878+0000","last_became_peered":"2024-09-10T14:28:36.923878+0000","last_unstale":"2024-09-10T14:32:35.223829+0000","last_undegraded":"2024-09-10T14:32:35.223829+0000","last_fullsized":"2024-09-10T14:32:35.223829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.223582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.223582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:41.920597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:40.685275+0000","last_change":"2024-09-10T14:33:40.685392+0000","last_active":"2024-09-10T14:33:40.685275+0000","last_peered":"2024-09-10T14:33:40.685275+0000","last_clean":"2024-09-10T14:33:40.685275+0000","last_became_active":"2024-09-10T14:28:38.941660+0000","last_became_peered":"2024-09-10T14:28:38.941660+0000","last_unstale":"2024-09-10T14:33:40.685275+0000","last_undegraded":"2024-09-10T14:33:40.685275+0000","last_fullsized":"2024-09-10T14:33:40.685275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:40.685030+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:40.685030+0000","last_clean_scrub_stamp":"2024-09-10T14:33:40.685030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:48.925523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"36'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.202665+0000","last_change":"2024-09-10T14:32:51.202723+0000","last_active":"2024-09-10T14:32:51.202665+0000","last_peered":"2024-09-10T14:32:51.202665+0000","last_clean":"2024-09-10T14:32:51.202665+0000","last_became_active":"2024-09-10T14:28:30.862183+0000","last_became_peered":"2024-09-10T14:28:30.862183+0000","last_unstale":"2024-09-10T14:32:51.202665+0000","last_undegraded":"2024-09-10T14:32:51.202665+0000","last_fullsized":"2024-09-10T14:32:51.202665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:51.202477+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:51.202477+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.202477+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:44.072182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:31.747383+0000","last_change":"2024-09-10T14:33:31.747454+0000","last_active":"2024-09-10T14:33:31.747383+0000","last_peered":"2024-09-10T14:33:31.747383+0000","last_clean":"2024-09-10T14:33:31.747383+0000","last_became_active":"2024-09-10T14:28:19.321804+0000","last_became_peered":"2024-09-10T14:28:19.321804+0000","last_unstale":"2024-09-10T14:33:31.747383+0000","last_undegraded":"2024-09-10T14:33:31.747383+0000","last_fullsized":"2024-09-10T14:33:31.747383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:33:31.747174+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:33:31.747174+0000","last_clean_scrub_stamp":"2024-09-10T14:33:31.747174+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:45.297007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0021684830000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.348723+0000","last_change":"2024-09-10T14:33:03.348790+0000","last_active":"2024-09-10T14:33:03.348723+0000","last_peered":"2024-09-10T14:33:03.348723+0000","last_clean":"2024-09-10T14:33:03.348723+0000","last_became_active":"2024-09-10T14:28:28.891366+0000","last_became_peered":"2024-09-10T14:28:28.891366+0000","last_unstale":"2024-09-10T14:33:03.348723+0000","last_undegraded":"2024-09-10T14:33:03.348723+0000","last_fullsized":"2024-09-10T14:33:03.348723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.348519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.348519+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.348519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:28.975289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.202503+0000","last_change":"2024-09-10T14:32:34.202503+0000","last_active":"2024-09-10T14:32:34.202503+0000","last_peered":"2024-09-10T14:32:34.202503+0000","last_clean":"2024-09-10T14:32:34.202503+0000","last_became_active":"2024-09-10T14:28:32.885192+0000","last_became_peered":"2024-09-10T14:28:32.885192+0000","last_unstale":"2024-09-10T14:32:34.202503+0000","last_undegraded":"2024-09-10T14:32:34.202503+0000","last_fullsized":"2024-09-10T14:32:34.202503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:34.202259+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.202259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:34.865922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'20","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.472613+0000","last_change":"2024-09-10T14:32:46.472613+0000","last_active":"2024-09-10T14:32:46.472613+0000","last_peered":"2024-09-10T14:32:46.472613+0000","last_clean":"2024-09-10T14:32:46.472613+0000","last_became_active":"2024-09-10T14:28:34.924030+0000","last_became_peered":"2024-09-10T14:28:34.924030+0000","last_unstale":"2024-09-10T14:32:46.472613+0000","last_undegraded":"2024-09-10T14:32:46.472613+0000","last_fullsized":"2024-09-10T14:32:46.472613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'20","last_scrub_stamp":"2024-09-10T14:32:46.472335+0000","last_deep_scrub":"36'20","last_deep_scrub_stamp":"2024-09-10T14:32:46.472335+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.472335+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:11:41.354491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.482747+0000","last_change":"2024-09-10T14:32:43.482747+0000","last_active":"2024-09-10T14:32:43.482747+0000","last_peered":"2024-09-10T14:32:43.482747+0000","last_clean":"2024-09-10T14:32:43.482747+0000","last_became_active":"2024-09-10T14:28:36.942482+0000","last_became_peered":"2024-09-10T14:28:36.942482+0000","last_unstale":"2024-09-10T14:32:43.482747+0000","last_undegraded":"2024-09-10T14:32:43.482747+0000","last_fullsized":"2024-09-10T14:32:43.482747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:43.482370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:43.482370+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.482370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:32.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.908593+0000","last_change":"2024-09-10T14:32:46.908593+0000","last_active":"2024-09-10T14:32:46.908593+0000","last_peered":"2024-09-10T14:32:46.908593+0000","last_clean":"2024-09-10T14:32:46.908593+0000","last_became_active":"2024-09-10T14:28:38.926813+0000","last_became_peered":"2024-09-10T14:28:38.926813+0000","last_unstale":"2024-09-10T14:32:46.908593+0000","last_undegraded":"2024-09-10T14:32:46.908593+0000","last_fullsized":"2024-09-10T14:32:46.908593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:46.908307+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:46.908307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.908307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:02.194310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:47.889550+0000","last_change":"2024-09-10T14:32:47.889610+0000","last_active":"2024-09-10T14:32:47.889550+0000","last_peered":"2024-09-10T14:32:47.889550+0000","last_clean":"2024-09-10T14:32:47.889550+0000","last_became_active":"2024-09-10T14:28:30.886234+0000","last_became_peered":"2024-09-10T14:28:30.886234+0000","last_unstale":"2024-09-10T14:32:47.889550+0000","last_undegraded":"2024-09-10T14:32:47.889550+0000","last_fullsized":"2024-09-10T14:32:47.889550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:47.889337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:47.889337+0000","last_clean_scrub_stamp":"2024-09-10T14:32:47.889337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:25:53.199083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.349827+0000","last_change":"2024-09-10T14:32:54.349892+0000","last_active":"2024-09-10T14:32:54.349827+0000","last_peered":"2024-09-10T14:32:54.349827+0000","last_clean":"2024-09-10T14:32:54.349827+0000","last_became_active":"2024-09-10T14:28:28.910504+0000","last_became_peered":"2024-09-10T14:28:28.910504+0000","last_unstale":"2024-09-10T14:32:54.349827+0000","last_undegraded":"2024-09-10T14:32:54.349827+0000","last_fullsized":"2024-09-10T14:32:54.349827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:54.349626+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:54.349626+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.349626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.122241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.107484+0000","last_change":"2024-09-10T14:33:05.107539+0000","last_active":"2024-09-10T14:33:05.107484+0000","last_peered":"2024-09-10T14:33:05.107484+0000","last_clean":"2024-09-10T14:33:05.107484+0000","last_became_active":"2024-09-10T14:28:19.321469+0000","last_became_peered":"2024-09-10T14:28:19.321469+0000","last_unstale":"2024-09-10T14:33:05.107484+0000","last_undegraded":"2024-09-10T14:33:05.107484+0000","last_fullsized":"2024-09-10T14:33:05.107484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.107286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.107286+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.107286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:05.392930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001166675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.405071+0000","last_change":"2024-09-10T14:33:12.405071+0000","last_active":"2024-09-10T14:33:12.405071+0000","last_peered":"2024-09-10T14:33:12.405071+0000","last_clean":"2024-09-10T14:33:12.405071+0000","last_became_active":"2024-09-10T14:29:07.782166+0000","last_became_peered":"2024-09-10T14:29:07.782166+0000","last_unstale":"2024-09-10T14:33:12.405071+0000","last_undegraded":"2024-09-10T14:33:12.405071+0000","last_fullsized":"2024-09-10T14:33:12.405071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:12.404820+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:12.404820+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.404820+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.685015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'74","reported_seq":153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.093004+0000","last_change":"2024-09-10T14:32:29.093004+0000","last_active":"2024-09-10T14:32:29.093004+0000","last_peered":"2024-09-10T14:32:29.093004+0000","last_clean":"2024-09-10T14:32:29.093004+0000","last_became_active":"2024-09-10T14:28:34.893004+0000","last_became_peered":"2024-09-10T14:28:34.893004+0000","last_unstale":"2024-09-10T14:32:29.093004+0000","last_undegraded":"2024-09-10T14:32:29.093004+0000","last_fullsized":"2024-09-10T14:32:29.093004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-09-10T14:32:29.092705+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.092705+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:13.603769+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.438626+0000","last_change":"2024-09-10T14:32:24.438626+0000","last_active":"2024-09-10T14:32:24.438626+0000","last_peered":"2024-09-10T14:32:24.438626+0000","last_clean":"2024-09-10T14:32:24.438626+0000","last_became_active":"2024-09-10T14:28:36.917523+0000","last_became_peered":"2024-09-10T14:28:36.917523+0000","last_unstale":"2024-09-10T14:32:24.438626+0000","last_undegraded":"2024-09-10T14:32:24.438626+0000","last_fullsized":"2024-09-10T14:32:24.438626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:24.438373+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.438373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:44.201354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.129819+0000","last_change":"2024-09-10T14:33:15.129881+0000","last_active":"2024-09-10T14:33:15.129819+0000","last_peered":"2024-09-10T14:33:15.129819+0000","last_clean":"2024-09-10T14:33:15.129819+0000","last_became_active":"2024-09-10T14:28:38.923711+0000","last_became_peered":"2024-09-10T14:28:38.923711+0000","last_unstale":"2024-09-10T14:33:15.129819+0000","last_undegraded":"2024-09-10T14:33:15.129819+0000","last_fullsized":"2024-09-10T14:33:15.129819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-10T14:33:15.129629+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-10T14:33:15.129629+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.129629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:01.550502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:43.900251+0000","last_change":"2024-09-10T14:32:43.900313+0000","last_active":"2024-09-10T14:32:43.900251+0000","last_peered":"2024-09-10T14:32:43.900251+0000","last_clean":"2024-09-10T14:32:43.900251+0000","last_became_active":"2024-09-10T14:28:30.883757+0000","last_became_peered":"2024-09-10T14:28:30.883757+0000","last_unstale":"2024-09-10T14:32:43.900251+0000","last_undegraded":"2024-09-10T14:32:43.900251+0000","last_fullsized":"2024-09-10T14:32:43.900251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:43.900061+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:43.900061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:43.900061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:35.816795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.216970+0000","last_change":"2024-09-10T14:32:52.217031+0000","last_active":"2024-09-10T14:32:52.216970+0000","last_peered":"2024-09-10T14:32:52.216970+0000","last_clean":"2024-09-10T14:32:52.216970+0000","last_became_active":"2024-09-10T14:28:28.906062+0000","last_became_peered":"2024-09-10T14:28:28.906062+0000","last_unstale":"2024-09-10T14:32:52.216970+0000","last_undegraded":"2024-09-10T14:32:52.216970+0000","last_fullsized":"2024-09-10T14:32:52.216970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:52.216776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:52.216776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.216776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:17.684116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:30.765955+0000","last_change":"2024-09-10T14:33:30.766008+0000","last_active":"2024-09-10T14:33:30.765955+0000","last_peered":"2024-09-10T14:33:30.765955+0000","last_clean":"2024-09-10T14:33:30.765955+0000","last_became_active":"2024-09-10T14:28:19.321765+0000","last_became_peered":"2024-09-10T14:28:19.321765+0000","last_unstale":"2024-09-10T14:33:30.765955+0000","last_undegraded":"2024-09-10T14:33:30.765955+0000","last_fullsized":"2024-09-10T14:33:30.765955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:30.765753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:30.765753+0000","last_clean_scrub_stamp":"2024-09-10T14:33:30.765753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:53.920930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002465227,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.399267+0000","last_change":"2024-09-10T14:32:28.399267+0000","last_active":"2024-09-10T14:32:28.399267+0000","last_peered":"2024-09-10T14:32:28.399267+0000","last_clean":"2024-09-10T14:32:28.399267+0000","last_became_active":"2024-09-10T14:28:32.881878+0000","last_became_peered":"2024-09-10T14:28:32.881878+0000","last_unstale":"2024-09-10T14:32:28.399267+0000","last_undegraded":"2024-09-10T14:32:28.399267+0000","last_fullsized":"2024-09-10T14:32:28.399267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:28.398875+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.398875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:59.160788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"36'22","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.978344+0000","last_change":"2024-09-10T14:32:20.978344+0000","last_active":"2024-09-10T14:32:20.978344+0000","last_peered":"2024-09-10T14:32:20.978344+0000","last_clean":"2024-09-10T14:32:20.978344+0000","last_became_active":"2024-09-10T14:28:34.896029+0000","last_became_peered":"2024-09-10T14:28:34.896029+0000","last_unstale":"2024-09-10T14:32:20.978344+0000","last_undegraded":"2024-09-10T14:32:20.978344+0000","last_fullsized":"2024-09-10T14:32:20.978344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-10T14:32:20.978065+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.978065+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:42.621330+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":390,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.978149+0000","last_change":"2024-09-10T14:32:22.978149+0000","last_active":"2024-09-10T14:32:22.978149+0000","last_peered":"2024-09-10T14:32:22.978149+0000","last_clean":"2024-09-10T14:32:22.978149+0000","last_became_active":"2024-09-10T14:28:36.903759+0000","last_became_peered":"2024-09-10T14:28:36.903759+0000","last_unstale":"2024-09-10T14:32:22.978149+0000","last_undegraded":"2024-09-10T14:32:22.978149+0000","last_fullsized":"2024-09-10T14:32:22.978149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:22.977905+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.977905+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:38.553496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'6","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.459799+0000","last_change":"2024-09-10T14:33:07.459799+0000","last_active":"2024-09-10T14:33:07.459799+0000","last_peered":"2024-09-10T14:33:07.459799+0000","last_clean":"2024-09-10T14:33:07.459799+0000","last_became_active":"2024-09-10T14:28:38.937151+0000","last_became_peered":"2024-09-10T14:28:38.937151+0000","last_unstale":"2024-09-10T14:33:07.459799+0000","last_undegraded":"2024-09-10T14:33:07.459799+0000","last_fullsized":"2024-09-10T14:33:07.459799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:07.459543+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:07.459543+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.459543+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:50.151279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.418284+0000","last_change":"2024-09-10T14:32:37.418352+0000","last_active":"2024-09-10T14:32:37.418284+0000","last_peered":"2024-09-10T14:32:37.418284+0000","last_clean":"2024-09-10T14:32:37.418284+0000","last_became_active":"2024-09-10T14:28:30.888046+0000","last_became_peered":"2024-09-10T14:28:30.888046+0000","last_unstale":"2024-09-10T14:32:37.418284+0000","last_undegraded":"2024-09-10T14:32:37.418284+0000","last_fullsized":"2024-09-10T14:32:37.418284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:37.418081+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.418081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:08.888989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.498661+0000","last_change":"2024-09-10T14:33:17.498728+0000","last_active":"2024-09-10T14:33:17.498661+0000","last_peered":"2024-09-10T14:33:17.498661+0000","last_clean":"2024-09-10T14:33:17.498661+0000","last_became_active":"2024-09-10T14:28:28.890196+0000","last_became_peered":"2024-09-10T14:28:28.890196+0000","last_unstale":"2024-09-10T14:33:17.498661+0000","last_undegraded":"2024-09-10T14:33:17.498661+0000","last_fullsized":"2024-09-10T14:33:17.498661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:17.498459+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:17.498459+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.498459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:45:25.319966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.087189+0000","last_change":"2024-09-10T14:33:06.087245+0000","last_active":"2024-09-10T14:33:06.087189+0000","last_peered":"2024-09-10T14:33:06.087189+0000","last_clean":"2024-09-10T14:33:06.087189+0000","last_became_active":"2024-09-10T14:28:19.322238+0000","last_became_peered":"2024-09-10T14:28:19.322238+0000","last_unstale":"2024-09-10T14:33:06.087189+0000","last_undegraded":"2024-09-10T14:33:06.087189+0000","last_fullsized":"2024-09-10T14:33:06.087189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:06.086999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:06.086999+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.086999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:08.232070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013533289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:29.448927+0000","last_change":"2024-09-10T14:32:29.448927+0000","last_active":"2024-09-10T14:32:29.448927+0000","last_peered":"2024-09-10T14:32:29.448927+0000","last_clean":"2024-09-10T14:32:29.448927+0000","last_became_active":"2024-09-10T14:28:32.881341+0000","last_became_peered":"2024-09-10T14:28:32.881341+0000","last_unstale":"2024-09-10T14:32:29.448927+0000","last_undegraded":"2024-09-10T14:32:29.448927+0000","last_fullsized":"2024-09-10T14:32:29.448927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:29.448685+0000","last_clean_scrub_stamp":"2024-09-10T14:32:29.448685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:13.499393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.429507+0000","last_change":"2024-09-10T14:32:35.429507+0000","last_active":"2024-09-10T14:32:35.429507+0000","last_peered":"2024-09-10T14:32:35.429507+0000","last_clean":"2024-09-10T14:32:35.429507+0000","last_became_active":"2024-09-10T14:28:34.913793+0000","last_became_peered":"2024-09-10T14:28:34.913793+0000","last_unstale":"2024-09-10T14:32:35.429507+0000","last_undegraded":"2024-09-10T14:32:35.429507+0000","last_fullsized":"2024-09-10T14:32:35.429507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:35.429210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.429210+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:32.213391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":405,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.060686+0000","last_change":"2024-09-10T14:32:25.060686+0000","last_active":"2024-09-10T14:32:25.060686+0000","last_peered":"2024-09-10T14:32:25.060686+0000","last_clean":"2024-09-10T14:32:25.060686+0000","last_became_active":"2024-09-10T14:28:36.900849+0000","last_became_peered":"2024-09-10T14:28:36.900849+0000","last_unstale":"2024-09-10T14:32:25.060686+0000","last_undegraded":"2024-09-10T14:32:25.060686+0000","last_fullsized":"2024-09-10T14:32:25.060686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:25.060434+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.060434+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:01.652381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.824552+0000","last_change":"2024-09-10T14:33:15.824613+0000","last_active":"2024-09-10T14:33:15.824552+0000","last_peered":"2024-09-10T14:33:15.824552+0000","last_clean":"2024-09-10T14:33:15.824552+0000","last_became_active":"2024-09-10T14:28:38.933971+0000","last_became_peered":"2024-09-10T14:28:38.933971+0000","last_unstale":"2024-09-10T14:33:15.824552+0000","last_undegraded":"2024-09-10T14:33:15.824552+0000","last_fullsized":"2024-09-10T14:33:15.824552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-10T14:33:15.824338+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-10T14:33:15.824338+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.824338+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:52.564936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'8","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.320535+0000","last_change":"2024-09-10T14:32:59.320601+0000","last_active":"2024-09-10T14:32:59.320535+0000","last_peered":"2024-09-10T14:32:59.320535+0000","last_clean":"2024-09-10T14:32:59.320535+0000","last_became_active":"2024-09-10T14:28:30.871405+0000","last_became_peered":"2024-09-10T14:28:30.871405+0000","last_unstale":"2024-09-10T14:32:59.320535+0000","last_undegraded":"2024-09-10T14:32:59.320535+0000","last_fullsized":"2024-09-10T14:32:59.320535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:59.320328+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:59.320328+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.320328+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:35.873871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.786494+0000","last_change":"2024-09-10T14:32:59.786629+0000","last_active":"2024-09-10T14:32:59.786494+0000","last_peered":"2024-09-10T14:32:59.786494+0000","last_clean":"2024-09-10T14:32:59.786494+0000","last_became_active":"2024-09-10T14:28:28.904063+0000","last_became_peered":"2024-09-10T14:28:28.904063+0000","last_unstale":"2024-09-10T14:32:59.786494+0000","last_undegraded":"2024-09-10T14:32:59.786494+0000","last_fullsized":"2024-09-10T14:32:59.786494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:59.786205+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:59.786205+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.786205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:49.511711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:33.718379+0000","last_change":"2024-09-10T14:33:33.718436+0000","last_active":"2024-09-10T14:33:33.718379+0000","last_peered":"2024-09-10T14:33:33.718379+0000","last_clean":"2024-09-10T14:33:33.718379+0000","last_became_active":"2024-09-10T14:28:19.664779+0000","last_became_peered":"2024-09-10T14:28:19.664779+0000","last_unstale":"2024-09-10T14:33:33.718379+0000","last_undegraded":"2024-09-10T14:33:33.718379+0000","last_fullsized":"2024-09-10T14:33:33.718379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:33.718178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:33.718178+0000","last_clean_scrub_stamp":"2024-09-10T14:33:33.718178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:08.534723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027633750000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.463375+0000","last_change":"2024-09-10T14:32:30.463375+0000","last_active":"2024-09-10T14:32:30.463375+0000","last_peered":"2024-09-10T14:32:30.463375+0000","last_clean":"2024-09-10T14:32:30.463375+0000","last_became_active":"2024-09-10T14:28:32.875918+0000","last_became_peered":"2024-09-10T14:28:32.875918+0000","last_unstale":"2024-09-10T14:32:30.463375+0000","last_undegraded":"2024-09-10T14:32:30.463375+0000","last_fullsized":"2024-09-10T14:32:30.463375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:30.463102+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.463102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:57.418601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'97","reported_seq":193,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.519074+0000","last_change":"2024-09-10T14:32:30.519074+0000","last_active":"2024-09-10T14:32:30.519074+0000","last_peered":"2024-09-10T14:32:30.519074+0000","last_clean":"2024-09-10T14:32:30.519074+0000","last_became_active":"2024-09-10T14:28:34.898993+0000","last_became_peered":"2024-09-10T14:28:34.898993+0000","last_unstale":"2024-09-10T14:32:30.519074+0000","last_undegraded":"2024-09-10T14:32:30.519074+0000","last_fullsized":"2024-09-10T14:32:30.519074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'97","last_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_deep_scrub":"36'97","last_deep_scrub_stamp":"2024-09-10T14:32:30.518776+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.518776+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:01.405166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:22.030434+0000","last_change":"2024-09-10T14:32:22.030434+0000","last_active":"2024-09-10T14:32:22.030434+0000","last_peered":"2024-09-10T14:32:22.030434+0000","last_clean":"2024-09-10T14:32:22.030434+0000","last_became_active":"2024-09-10T14:28:36.902394+0000","last_became_peered":"2024-09-10T14:28:36.902394+0000","last_unstale":"2024-09-10T14:32:22.030434+0000","last_undegraded":"2024-09-10T14:32:22.030434+0000","last_fullsized":"2024-09-10T14:32:22.030434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:22.030103+0000","last_clean_scrub_stamp":"2024-09-10T14:32:22.030103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:44.176468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.500613+0000","last_change":"2024-09-10T14:32:35.500613+0000","last_active":"2024-09-10T14:32:35.500613+0000","last_peered":"2024-09-10T14:32:35.500613+0000","last_clean":"2024-09-10T14:32:35.500613+0000","last_became_active":"2024-09-10T14:28:38.929425+0000","last_became_peered":"2024-09-10T14:28:38.929425+0000","last_unstale":"2024-09-10T14:32:35.500613+0000","last_undegraded":"2024-09-10T14:32:35.500613+0000","last_fullsized":"2024-09-10T14:32:35.500613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.500353+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:58.771563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"36'4","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.327446+0000","last_change":"2024-09-10T14:33:10.327507+0000","last_active":"2024-09-10T14:33:10.327446+0000","last_peered":"2024-09-10T14:33:10.327446+0000","last_clean":"2024-09-10T14:33:10.327446+0000","last_became_active":"2024-09-10T14:28:38.941203+0000","last_became_peered":"2024-09-10T14:28:38.941203+0000","last_unstale":"2024-09-10T14:33:10.327446+0000","last_undegraded":"2024-09-10T14:33:10.327446+0000","last_fullsized":"2024-09-10T14:33:10.327446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:10.327230+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:10.327230+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.327230+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:02.825425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.340093+0000","last_change":"2024-09-10T14:33:09.340093+0000","last_active":"2024-09-10T14:33:09.340093+0000","last_peered":"2024-09-10T14:33:09.340093+0000","last_clean":"2024-09-10T14:33:09.340093+0000","last_became_active":"2024-09-10T14:28:30.876823+0000","last_became_peered":"2024-09-10T14:28:30.876823+0000","last_unstale":"2024-09-10T14:33:09.340093+0000","last_undegraded":"2024-09-10T14:33:09.340093+0000","last_fullsized":"2024-09-10T14:33:09.340093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:33:09.339845+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:33:09.339845+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.339845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:13.502557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:18.458801+0000","last_change":"2024-09-10T14:33:18.458870+0000","last_active":"2024-09-10T14:33:18.458801+0000","last_peered":"2024-09-10T14:33:18.458801+0000","last_clean":"2024-09-10T14:33:18.458801+0000","last_became_active":"2024-09-10T14:28:28.889247+0000","last_became_peered":"2024-09-10T14:28:28.889247+0000","last_unstale":"2024-09-10T14:33:18.458801+0000","last_undegraded":"2024-09-10T14:33:18.458801+0000","last_fullsized":"2024-09-10T14:33:18.458801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:18.458581+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:18.458581+0000","last_clean_scrub_stamp":"2024-09-10T14:33:18.458581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:45.262719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.968430+0000","last_change":"2024-09-10T14:32:33.968430+0000","last_active":"2024-09-10T14:32:33.968430+0000","last_peered":"2024-09-10T14:32:33.968430+0000","last_clean":"2024-09-10T14:32:33.968430+0000","last_became_active":"2024-09-10T14:28:32.882379+0000","last_became_peered":"2024-09-10T14:28:32.882379+0000","last_unstale":"2024-09-10T14:32:33.968430+0000","last_undegraded":"2024-09-10T14:32:33.968430+0000","last_fullsized":"2024-09-10T14:32:33.968430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:33.968186+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.968186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:36.923144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.456201+0000","last_change":"2024-09-10T14:32:25.456201+0000","last_active":"2024-09-10T14:32:25.456201+0000","last_peered":"2024-09-10T14:32:25.456201+0000","last_clean":"2024-09-10T14:32:25.456201+0000","last_became_active":"2024-09-10T14:28:34.907783+0000","last_became_peered":"2024-09-10T14:28:34.907783+0000","last_unstale":"2024-09-10T14:32:25.456201+0000","last_undegraded":"2024-09-10T14:32:25.456201+0000","last_fullsized":"2024-09-10T14:32:25.456201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-10T14:32:25.455949+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.455949+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:59.272502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.512838+0000","last_change":"2024-09-10T14:32:42.512838+0000","last_active":"2024-09-10T14:32:42.512838+0000","last_peered":"2024-09-10T14:32:42.512838+0000","last_clean":"2024-09-10T14:32:42.512838+0000","last_became_active":"2024-09-10T14:28:36.937376+0000","last_became_peered":"2024-09-10T14:28:36.937376+0000","last_unstale":"2024-09-10T14:32:42.512838+0000","last_undegraded":"2024-09-10T14:32:42.512838+0000","last_fullsized":"2024-09-10T14:32:42.512838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.512582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.512582+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.512582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:04.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:14.084205+0000","last_change":"2024-09-10T14:33:14.084271+0000","last_active":"2024-09-10T14:33:14.084205+0000","last_peered":"2024-09-10T14:33:14.084205+0000","last_clean":"2024-09-10T14:33:14.084205+0000","last_became_active":"2024-09-10T14:28:38.919274+0000","last_became_peered":"2024-09-10T14:28:38.919274+0000","last_unstale":"2024-09-10T14:33:14.084205+0000","last_undegraded":"2024-09-10T14:33:14.084205+0000","last_fullsized":"2024-09-10T14:33:14.084205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:33:14.084014+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:33:14.084014+0000","last_clean_scrub_stamp":"2024-09-10T14:33:14.084014+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:55.111847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"36'4","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.373126+0000","last_change":"2024-09-10T14:33:11.373126+0000","last_active":"2024-09-10T14:33:11.373126+0000","last_peered":"2024-09-10T14:33:11.373126+0000","last_clean":"2024-09-10T14:33:11.373126+0000","last_became_active":"2024-09-10T14:29:07.782817+0000","last_became_peered":"2024-09-10T14:29:07.782817+0000","last_unstale":"2024-09-10T14:33:11.373126+0000","last_undegraded":"2024-09-10T14:33:11.373126+0000","last_fullsized":"2024-09-10T14:33:11.373126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:11.372880+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:11.372880+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.372880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:04.456691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:08.322933+0000","last_change":"2024-09-10T14:33:08.322933+0000","last_active":"2024-09-10T14:33:08.322933+0000","last_peered":"2024-09-10T14:33:08.322933+0000","last_clean":"2024-09-10T14:33:08.322933+0000","last_became_active":"2024-09-10T14:28:28.896417+0000","last_became_peered":"2024-09-10T14:28:28.896417+0000","last_unstale":"2024-09-10T14:33:08.322933+0000","last_undegraded":"2024-09-10T14:33:08.322933+0000","last_fullsized":"2024-09-10T14:33:08.322933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:08.322679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:08.322679+0000","last_clean_scrub_stamp":"2024-09-10T14:33:08.322679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:48.922910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.411370+0000","last_change":"2024-09-10T14:32:20.411370+0000","last_active":"2024-09-10T14:32:20.411370+0000","last_peered":"2024-09-10T14:32:20.411370+0000","last_clean":"2024-09-10T14:32:20.411370+0000","last_became_active":"2024-09-10T14:28:32.888158+0000","last_became_peered":"2024-09-10T14:28:32.888158+0000","last_unstale":"2024-09-10T14:32:20.411370+0000","last_undegraded":"2024-09-10T14:32:20.411370+0000","last_fullsized":"2024-09-10T14:32:20.411370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.411095+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.411095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:12.327829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:33.216290+0000","last_change":"2024-09-10T14:32:33.216290+0000","last_active":"2024-09-10T14:32:33.216290+0000","last_peered":"2024-09-10T14:32:33.216290+0000","last_clean":"2024-09-10T14:32:33.216290+0000","last_became_active":"2024-09-10T14:28:34.882608+0000","last_became_peered":"2024-09-10T14:28:34.882608+0000","last_unstale":"2024-09-10T14:32:33.216290+0000","last_undegraded":"2024-09-10T14:32:33.216290+0000","last_fullsized":"2024-09-10T14:32:33.216290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:33.216034+0000","last_clean_scrub_stamp":"2024-09-10T14:32:33.216034+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:39:05.267034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.415600+0000","last_change":"2024-09-10T14:32:23.415600+0000","last_active":"2024-09-10T14:32:23.415600+0000","last_peered":"2024-09-10T14:32:23.415600+0000","last_clean":"2024-09-10T14:32:23.415600+0000","last_became_active":"2024-09-10T14:28:36.941954+0000","last_became_peered":"2024-09-10T14:28:36.941954+0000","last_unstale":"2024-09-10T14:32:23.415600+0000","last_undegraded":"2024-09-10T14:32:23.415600+0000","last_fullsized":"2024-09-10T14:32:23.415600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.415359+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.415359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:40.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:20.058899+0000","last_change":"2024-09-10T14:33:20.058899+0000","last_active":"2024-09-10T14:33:20.058899+0000","last_peered":"2024-09-10T14:33:20.058899+0000","last_clean":"2024-09-10T14:33:20.058899+0000","last_became_active":"2024-09-10T14:28:38.935559+0000","last_became_peered":"2024-09-10T14:28:38.935559+0000","last_unstale":"2024-09-10T14:33:20.058899+0000","last_undegraded":"2024-09-10T14:33:20.058899+0000","last_fullsized":"2024-09-10T14:33:20.058899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:20.058589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:20.058589+0000","last_clean_scrub_stamp":"2024-09-10T14:33:20.058589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:25.268022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:59.119067+0000","last_change":"2024-09-10T14:32:59.119067+0000","last_active":"2024-09-10T14:32:59.119067+0000","last_peered":"2024-09-10T14:32:59.119067+0000","last_clean":"2024-09-10T14:32:59.119067+0000","last_became_active":"2024-09-10T14:28:30.875516+0000","last_became_peered":"2024-09-10T14:28:30.875516+0000","last_unstale":"2024-09-10T14:32:59.119067+0000","last_undegraded":"2024-09-10T14:32:59.119067+0000","last_fullsized":"2024-09-10T14:32:59.119067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:59.118814+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:59.118814+0000","last_clean_scrub_stamp":"2024-09-10T14:32:59.118814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.685082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:07.357531+0000","last_change":"2024-09-10T14:33:07.357531+0000","last_active":"2024-09-10T14:33:07.357531+0000","last_peered":"2024-09-10T14:33:07.357531+0000","last_clean":"2024-09-10T14:33:07.357531+0000","last_became_active":"2024-09-10T14:28:28.894379+0000","last_became_peered":"2024-09-10T14:28:28.894379+0000","last_unstale":"2024-09-10T14:33:07.357531+0000","last_undegraded":"2024-09-10T14:33:07.357531+0000","last_fullsized":"2024-09-10T14:33:07.357531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:07.357254+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:07.357254+0000","last_clean_scrub_stamp":"2024-09-10T14:33:07.357254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:53.771292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:42.376579+0000","last_change":"2024-09-10T14:32:42.376579+0000","last_active":"2024-09-10T14:32:42.376579+0000","last_peered":"2024-09-10T14:32:42.376579+0000","last_clean":"2024-09-10T14:32:42.376579+0000","last_became_active":"2024-09-10T14:28:32.872145+0000","last_became_peered":"2024-09-10T14:28:32.872145+0000","last_unstale":"2024-09-10T14:32:42.376579+0000","last_undegraded":"2024-09-10T14:32:42.376579+0000","last_fullsized":"2024-09-10T14:32:42.376579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:42.376307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:42.376307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:42.376307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:00.174752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"36'48","reported_seq":123,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:30.137615+0000","last_change":"2024-09-10T14:32:30.137615+0000","last_active":"2024-09-10T14:32:30.137615+0000","last_peered":"2024-09-10T14:32:30.137615+0000","last_clean":"2024-09-10T14:32:30.137615+0000","last_became_active":"2024-09-10T14:28:34.882845+0000","last_became_peered":"2024-09-10T14:28:34.882845+0000","last_unstale":"2024-09-10T14:32:30.137615+0000","last_undegraded":"2024-09-10T14:32:30.137615+0000","last_fullsized":"2024-09-10T14:32:30.137615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-10T14:32:30.137220+0000","last_clean_scrub_stamp":"2024-09-10T14:32:30.137220+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:21:57.841349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:19.938967+0000","last_change":"2024-09-10T14:32:19.938967+0000","last_active":"2024-09-10T14:32:19.938967+0000","last_peered":"2024-09-10T14:32:19.938967+0000","last_clean":"2024-09-10T14:32:19.938967+0000","last_became_active":"2024-09-10T14:28:36.902466+0000","last_became_peered":"2024-09-10T14:28:36.902466+0000","last_unstale":"2024-09-10T14:32:19.938967+0000","last_undegraded":"2024-09-10T14:32:19.938967+0000","last_fullsized":"2024-09-10T14:32:19.938967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:19.938638+0000","last_clean_scrub_stamp":"2024-09-10T14:32:19.938638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:19:13.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.460042+0000","last_change":"2024-09-10T14:33:03.460042+0000","last_active":"2024-09-10T14:33:03.460042+0000","last_peered":"2024-09-10T14:33:03.460042+0000","last_clean":"2024-09-10T14:33:03.460042+0000","last_became_active":"2024-09-10T14:28:38.934516+0000","last_became_peered":"2024-09-10T14:28:38.934516+0000","last_unstale":"2024-09-10T14:33:03.460042+0000","last_undegraded":"2024-09-10T14:33:03.460042+0000","last_fullsized":"2024-09-10T14:33:03.460042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:03.459797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:03.459797+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.459797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:52.465854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'4","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.407103+0000","last_change":"2024-09-10T14:33:13.407103+0000","last_active":"2024-09-10T14:33:13.407103+0000","last_peered":"2024-09-10T14:33:13.407103+0000","last_clean":"2024-09-10T14:33:13.407103+0000","last_became_active":"2024-09-10T14:29:07.779038+0000","last_became_peered":"2024-09-10T14:29:07.779038+0000","last_unstale":"2024-09-10T14:33:13.407103+0000","last_undegraded":"2024-09-10T14:33:13.407103+0000","last_fullsized":"2024-09-10T14:33:13.407103+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:13.406701+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:13.406701+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.406701+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:24.803644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.753358+0000","last_change":"2024-09-10T14:33:11.753358+0000","last_active":"2024-09-10T14:33:11.753358+0000","last_peered":"2024-09-10T14:33:11.753358+0000","last_clean":"2024-09-10T14:33:11.753358+0000","last_became_active":"2024-09-10T14:28:28.899075+0000","last_became_peered":"2024-09-10T14:28:28.899075+0000","last_unstale":"2024-09-10T14:33:11.753358+0000","last_undegraded":"2024-09-10T14:33:11.753358+0000","last_fullsized":"2024-09-10T14:33:11.753358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:11.753081+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:11.753081+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.753081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:15.257691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.446266+0000","last_change":"2024-09-10T14:32:26.446266+0000","last_active":"2024-09-10T14:32:26.446266+0000","last_peered":"2024-09-10T14:32:26.446266+0000","last_clean":"2024-09-10T14:32:26.446266+0000","last_became_active":"2024-09-10T14:28:32.881427+0000","last_became_peered":"2024-09-10T14:28:32.881427+0000","last_unstale":"2024-09-10T14:32:26.446266+0000","last_undegraded":"2024-09-10T14:32:26.446266+0000","last_fullsized":"2024-09-10T14:32:26.446266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.446026+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.446026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:41.594078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'39","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.497756+0000","last_change":"2024-09-10T14:32:32.497756+0000","last_active":"2024-09-10T14:32:32.497756+0000","last_peered":"2024-09-10T14:32:32.497756+0000","last_clean":"2024-09-10T14:32:32.497756+0000","last_became_active":"2024-09-10T14:28:34.898101+0000","last_became_peered":"2024-09-10T14:28:34.898101+0000","last_unstale":"2024-09-10T14:32:32.497756+0000","last_undegraded":"2024-09-10T14:32:32.497756+0000","last_fullsized":"2024-09-10T14:32:32.497756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:32.497494+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.497494+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:32.552961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:25.396828+0000","last_change":"2024-09-10T14:32:25.396828+0000","last_active":"2024-09-10T14:32:25.396828+0000","last_peered":"2024-09-10T14:32:25.396828+0000","last_clean":"2024-09-10T14:32:25.396828+0000","last_became_active":"2024-09-10T14:28:36.910072+0000","last_became_peered":"2024-09-10T14:28:36.910072+0000","last_unstale":"2024-09-10T14:32:25.396828+0000","last_undegraded":"2024-09-10T14:32:25.396828+0000","last_fullsized":"2024-09-10T14:32:25.396828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:25.396450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:25.396450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:27:54.696304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.428617+0000","last_change":"2024-09-10T14:33:00.428768+0000","last_active":"2024-09-10T14:33:00.428617+0000","last_peered":"2024-09-10T14:33:00.428617+0000","last_clean":"2024-09-10T14:33:00.428617+0000","last_became_active":"2024-09-10T14:28:30.877565+0000","last_became_peered":"2024-09-10T14:28:30.877565+0000","last_unstale":"2024-09-10T14:33:00.428617+0000","last_undegraded":"2024-09-10T14:33:00.428617+0000","last_fullsized":"2024-09-10T14:33:00.428617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:33:00.428387+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:33:00.428387+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.428387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:05.637821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.456004+0000","last_change":"2024-09-10T14:33:12.456004+0000","last_active":"2024-09-10T14:33:12.456004+0000","last_peered":"2024-09-10T14:33:12.456004+0000","last_clean":"2024-09-10T14:33:12.456004+0000","last_became_active":"2024-09-10T14:28:28.891534+0000","last_became_peered":"2024-09-10T14:28:28.891534+0000","last_unstale":"2024-09-10T14:33:12.456004+0000","last_undegraded":"2024-09-10T14:33:12.456004+0000","last_fullsized":"2024-09-10T14:33:12.456004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:12.455745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:12.455745+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.455745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:47.543012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:16.388113+0000","last_change":"2024-09-10T14:33:16.388166+0000","last_active":"2024-09-10T14:33:16.388113+0000","last_peered":"2024-09-10T14:33:16.388113+0000","last_clean":"2024-09-10T14:33:16.388113+0000","last_became_active":"2024-09-10T14:29:08.789489+0000","last_became_peered":"2024-09-10T14:29:08.789489+0000","last_unstale":"2024-09-10T14:33:16.388113+0000","last_undegraded":"2024-09-10T14:33:16.388113+0000","last_fullsized":"2024-09-10T14:33:16.388113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:16.387926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:16.387926+0000","last_clean_scrub_stamp":"2024-09-10T14:33:16.387926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:05.269165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.180966+0000","last_change":"2024-09-10T14:32:32.180966+0000","last_active":"2024-09-10T14:32:32.180966+0000","last_peered":"2024-09-10T14:32:32.180966+0000","last_clean":"2024-09-10T14:32:32.180966+0000","last_became_active":"2024-09-10T14:28:34.882308+0000","last_became_peered":"2024-09-10T14:28:34.882308+0000","last_unstale":"2024-09-10T14:32:32.180966+0000","last_undegraded":"2024-09-10T14:32:32.180966+0000","last_fullsized":"2024-09-10T14:32:32.180966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-10T14:32:32.180675+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.180675+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:49.216006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.442290+0000","last_change":"2024-09-10T14:32:26.442290+0000","last_active":"2024-09-10T14:32:26.442290+0000","last_peered":"2024-09-10T14:32:26.442290+0000","last_clean":"2024-09-10T14:32:26.442290+0000","last_became_active":"2024-09-10T14:28:36.908369+0000","last_became_peered":"2024-09-10T14:28:36.908369+0000","last_unstale":"2024-09-10T14:32:26.442290+0000","last_undegraded":"2024-09-10T14:32:26.442290+0000","last_fullsized":"2024-09-10T14:32:26.442290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:26.442018+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.442018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:13.048162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:17.122653+0000","last_change":"2024-09-10T14:33:17.122653+0000","last_active":"2024-09-10T14:33:17.122653+0000","last_peered":"2024-09-10T14:33:17.122653+0000","last_clean":"2024-09-10T14:33:17.122653+0000","last_became_active":"2024-09-10T14:28:38.928014+0000","last_became_peered":"2024-09-10T14:28:38.928014+0000","last_unstale":"2024-09-10T14:33:17.122653+0000","last_undegraded":"2024-09-10T14:33:17.122653+0000","last_fullsized":"2024-09-10T14:33:17.122653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:33:17.122374+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:33:17.122374+0000","last_clean_scrub_stamp":"2024-09-10T14:33:17.122374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:34.225920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.183816+0000","last_change":"2024-09-10T14:33:01.183874+0000","last_active":"2024-09-10T14:33:01.183816+0000","last_peered":"2024-09-10T14:33:01.183816+0000","last_clean":"2024-09-10T14:33:01.183816+0000","last_became_active":"2024-09-10T14:28:30.880621+0000","last_became_peered":"2024-09-10T14:28:30.880621+0000","last_unstale":"2024-09-10T14:33:01.183816+0000","last_undegraded":"2024-09-10T14:33:01.183816+0000","last_fullsized":"2024-09-10T14:33:01.183816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:01.183629+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:01.183629+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.183629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:49:35.104259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.953816+0000","last_change":"2024-09-10T14:32:53.953816+0000","last_active":"2024-09-10T14:32:53.953816+0000","last_peered":"2024-09-10T14:32:53.953816+0000","last_clean":"2024-09-10T14:32:53.953816+0000","last_became_active":"2024-09-10T14:28:28.906339+0000","last_became_peered":"2024-09-10T14:28:28.906339+0000","last_unstale":"2024-09-10T14:32:53.953816+0000","last_undegraded":"2024-09-10T14:32:53.953816+0000","last_fullsized":"2024-09-10T14:32:53.953816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:53.953557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:53.953557+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.953557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:49.917322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.397408+0000","last_change":"2024-09-10T14:32:40.397408+0000","last_active":"2024-09-10T14:32:40.397408+0000","last_peered":"2024-09-10T14:32:40.397408+0000","last_clean":"2024-09-10T14:32:40.397408+0000","last_became_active":"2024-09-10T14:28:32.879771+0000","last_became_peered":"2024-09-10T14:28:32.879771+0000","last_unstale":"2024-09-10T14:32:40.397408+0000","last_undegraded":"2024-09-10T14:32:40.397408+0000","last_fullsized":"2024-09-10T14:32:40.397408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:40.397100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:40.397100+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.397100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:50.928172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"36'46","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.451198+0000","last_change":"2024-09-10T14:32:50.451198+0000","last_active":"2024-09-10T14:32:50.451198+0000","last_peered":"2024-09-10T14:32:50.451198+0000","last_clean":"2024-09-10T14:32:50.451198+0000","last_became_active":"2024-09-10T14:28:34.922091+0000","last_became_peered":"2024-09-10T14:28:34.922091+0000","last_unstale":"2024-09-10T14:32:50.451198+0000","last_undegraded":"2024-09-10T14:32:50.451198+0000","last_fullsized":"2024-09-10T14:32:50.451198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'46","last_scrub_stamp":"2024-09-10T14:32:50.450750+0000","last_deep_scrub":"36'46","last_deep_scrub_stamp":"2024-09-10T14:32:50.450750+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.450750+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:43.680846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.965177+0000","last_change":"2024-09-10T14:32:38.965177+0000","last_active":"2024-09-10T14:32:38.965177+0000","last_peered":"2024-09-10T14:32:38.965177+0000","last_clean":"2024-09-10T14:32:38.965177+0000","last_became_active":"2024-09-10T14:28:36.939697+0000","last_became_peered":"2024-09-10T14:28:36.939697+0000","last_unstale":"2024-09-10T14:32:38.965177+0000","last_undegraded":"2024-09-10T14:32:38.965177+0000","last_fullsized":"2024-09-10T14:32:38.965177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.964897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.964897+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.964897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:32.019878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"36'2","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:41.714584+0000","last_change":"2024-09-10T14:33:41.714646+0000","last_active":"2024-09-10T14:33:41.714584+0000","last_peered":"2024-09-10T14:33:41.714584+0000","last_clean":"2024-09-10T14:33:41.714584+0000","last_became_active":"2024-09-10T14:28:38.942932+0000","last_became_peered":"2024-09-10T14:28:38.942932+0000","last_unstale":"2024-09-10T14:33:41.714584+0000","last_undegraded":"2024-09-10T14:33:41.714584+0000","last_fullsized":"2024-09-10T14:33:41.714584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:41.714396+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:41.714396+0000","last_clean_scrub_stamp":"2024-09-10T14:33:41.714396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:58.627261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"36'12","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:34.464002+0000","last_change":"2024-09-10T14:32:34.464002+0000","last_active":"2024-09-10T14:32:34.464002+0000","last_peered":"2024-09-10T14:32:34.464002+0000","last_clean":"2024-09-10T14:32:34.464002+0000","last_became_active":"2024-09-10T14:28:30.890385+0000","last_became_peered":"2024-09-10T14:28:30.890385+0000","last_unstale":"2024-09-10T14:32:34.464002+0000","last_undegraded":"2024-09-10T14:32:34.464002+0000","last_fullsized":"2024-09-10T14:32:34.464002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-10T14:32:34.463639+0000","last_clean_scrub_stamp":"2024-09-10T14:32:34.463639+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:46.301912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.766808+0000","last_change":"2024-09-10T14:33:01.766808+0000","last_active":"2024-09-10T14:33:01.766808+0000","last_peered":"2024-09-10T14:33:01.766808+0000","last_clean":"2024-09-10T14:33:01.766808+0000","last_became_active":"2024-09-10T14:28:28.903136+0000","last_became_peered":"2024-09-10T14:28:28.903136+0000","last_unstale":"2024-09-10T14:33:01.766808+0000","last_undegraded":"2024-09-10T14:33:01.766808+0000","last_fullsized":"2024-09-10T14:33:01.766808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:01.766540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:01.766540+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.766540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:12.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.435925+0000","last_change":"2024-09-10T14:32:38.435925+0000","last_active":"2024-09-10T14:32:38.435925+0000","last_peered":"2024-09-10T14:32:38.435925+0000","last_clean":"2024-09-10T14:32:38.435925+0000","last_became_active":"2024-09-10T14:28:32.880485+0000","last_became_peered":"2024-09-10T14:28:32.880485+0000","last_unstale":"2024-09-10T14:32:38.435925+0000","last_undegraded":"2024-09-10T14:32:38.435925+0000","last_fullsized":"2024-09-10T14:32:38.435925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:38.435674+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.435674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:15.679874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"36'39","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.074597+0000","last_change":"2024-09-10T14:32:28.074597+0000","last_active":"2024-09-10T14:32:28.074597+0000","last_peered":"2024-09-10T14:32:28.074597+0000","last_clean":"2024-09-10T14:32:28.074597+0000","last_became_active":"2024-09-10T14:28:34.893326+0000","last_became_peered":"2024-09-10T14:28:34.893326+0000","last_unstale":"2024-09-10T14:32:28.074597+0000","last_undegraded":"2024-09-10T14:32:28.074597+0000","last_fullsized":"2024-09-10T14:32:28.074597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-10T14:32:28.074323+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.074323+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:22.414417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.062808+0000","last_change":"2024-09-10T14:32:20.062808+0000","last_active":"2024-09-10T14:32:20.062808+0000","last_peered":"2024-09-10T14:32:20.062808+0000","last_clean":"2024-09-10T14:32:20.062808+0000","last_became_active":"2024-09-10T14:28:36.913476+0000","last_became_peered":"2024-09-10T14:28:36.913476+0000","last_unstale":"2024-09-10T14:32:20.062808+0000","last_undegraded":"2024-09-10T14:32:20.062808+0000","last_fullsized":"2024-09-10T14:32:20.062808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:20.062623+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.062623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:35.638214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"36'5","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:38.641800+0000","last_change":"2024-09-10T14:33:38.641866+0000","last_active":"2024-09-10T14:33:38.641800+0000","last_peered":"2024-09-10T14:33:38.641800+0000","last_clean":"2024-09-10T14:33:38.641800+0000","last_became_active":"2024-09-10T14:28:38.940071+0000","last_became_peered":"2024-09-10T14:28:38.940071+0000","last_unstale":"2024-09-10T14:33:38.641800+0000","last_undegraded":"2024-09-10T14:33:38.641800+0000","last_fullsized":"2024-09-10T14:33:38.641800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-10T14:33:38.641611+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-10T14:33:38.641611+0000","last_clean_scrub_stamp":"2024-09-10T14:33:38.641611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:06:49.792288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"36'24","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:53.181182+0000","last_change":"2024-09-10T14:32:53.181182+0000","last_active":"2024-09-10T14:32:53.181182+0000","last_peered":"2024-09-10T14:32:53.181182+0000","last_clean":"2024-09-10T14:32:53.181182+0000","last_became_active":"2024-09-10T14:28:30.862335+0000","last_became_peered":"2024-09-10T14:28:30.862335+0000","last_unstale":"2024-09-10T14:32:53.181182+0000","last_undegraded":"2024-09-10T14:32:53.181182+0000","last_fullsized":"2024-09-10T14:32:53.181182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'24","last_scrub_stamp":"2024-09-10T14:32:53.180924+0000","last_deep_scrub":"36'24","last_deep_scrub_stamp":"2024-09-10T14:32:53.180924+0000","last_clean_scrub_stamp":"2024-09-10T14:32:53.180924+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:45.585973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.446414+0000","last_change":"2024-09-10T14:33:13.446414+0000","last_active":"2024-09-10T14:33:13.446414+0000","last_peered":"2024-09-10T14:33:13.446414+0000","last_clean":"2024-09-10T14:33:13.446414+0000","last_became_active":"2024-09-10T14:28:28.880789+0000","last_became_peered":"2024-09-10T14:28:28.880789+0000","last_unstale":"2024-09-10T14:33:13.446414+0000","last_undegraded":"2024-09-10T14:33:13.446414+0000","last_fullsized":"2024-09-10T14:33:13.446414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:13.446014+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:13.446014+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.446014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:22.972308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:19.813297+0000","last_change":"2024-09-10T14:33:19.813297+0000","last_active":"2024-09-10T14:33:19.813297+0000","last_peered":"2024-09-10T14:33:19.813297+0000","last_clean":"2024-09-10T14:33:19.813297+0000","last_became_active":"2024-09-10T14:29:08.792438+0000","last_became_peered":"2024-09-10T14:29:08.792438+0000","last_unstale":"2024-09-10T14:33:19.813297+0000","last_undegraded":"2024-09-10T14:33:19.813297+0000","last_fullsized":"2024-09-10T14:33:19.813297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:19.813063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:19.813063+0000","last_clean_scrub_stamp":"2024-09-10T14:33:19.813063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:44.798582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'15","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.479162+0000","last_change":"2024-09-10T14:32:44.479239+0000","last_active":"2024-09-10T14:32:44.479162+0000","last_peered":"2024-09-10T14:32:44.479162+0000","last_clean":"2024-09-10T14:32:44.479162+0000","last_became_active":"2024-09-10T14:28:34.926686+0000","last_became_peered":"2024-09-10T14:28:34.926686+0000","last_unstale":"2024-09-10T14:32:44.479162+0000","last_undegraded":"2024-09-10T14:32:44.479162+0000","last_fullsized":"2024-09-10T14:32:44.479162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-10T14:32:44.478972+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-10T14:32:44.478972+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.478972+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:24:49.335138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:20.385755+0000","last_change":"2024-09-10T14:32:20.385755+0000","last_active":"2024-09-10T14:32:20.385755+0000","last_peered":"2024-09-10T14:32:20.385755+0000","last_clean":"2024-09-10T14:32:20.385755+0000","last_became_active":"2024-09-10T14:28:36.940609+0000","last_became_peered":"2024-09-10T14:28:36.940609+0000","last_unstale":"2024-09-10T14:32:20.385755+0000","last_undegraded":"2024-09-10T14:32:20.385755+0000","last_fullsized":"2024-09-10T14:32:20.385755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-10T14:32:20.385473+0000","last_clean_scrub_stamp":"2024-09-10T14:32:20.385473+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:25.661393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:11.467356+0000","last_change":"2024-09-10T14:33:11.467356+0000","last_active":"2024-09-10T14:33:11.467356+0000","last_peered":"2024-09-10T14:33:11.467356+0000","last_clean":"2024-09-10T14:33:11.467356+0000","last_became_active":"2024-09-10T14:28:38.933352+0000","last_became_peered":"2024-09-10T14:28:38.933352+0000","last_unstale":"2024-09-10T14:33:11.467356+0000","last_undegraded":"2024-09-10T14:33:11.467356+0000","last_fullsized":"2024-09-10T14:33:11.467356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:11.467095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:11.467095+0000","last_clean_scrub_stamp":"2024-09-10T14:33:11.467095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:41.433173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.447355+0000","last_change":"2024-09-10T14:32:49.447355+0000","last_active":"2024-09-10T14:32:49.447355+0000","last_peered":"2024-09-10T14:32:49.447355+0000","last_clean":"2024-09-10T14:32:49.447355+0000","last_became_active":"2024-09-10T14:28:30.860950+0000","last_became_peered":"2024-09-10T14:28:30.860950+0000","last_unstale":"2024-09-10T14:32:49.447355+0000","last_undegraded":"2024-09-10T14:32:49.447355+0000","last_fullsized":"2024-09-10T14:32:49.447355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:49.447079+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:49.447079+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.447079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:01.531653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:05.854082+0000","last_change":"2024-09-10T14:33:05.854082+0000","last_active":"2024-09-10T14:33:05.854082+0000","last_peered":"2024-09-10T14:33:05.854082+0000","last_clean":"2024-09-10T14:33:05.854082+0000","last_became_active":"2024-09-10T14:28:28.885618+0000","last_became_peered":"2024-09-10T14:28:28.885618+0000","last_unstale":"2024-09-10T14:33:05.854082+0000","last_undegraded":"2024-09-10T14:33:05.854082+0000","last_fullsized":"2024-09-10T14:33:05.854082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:05.853820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:05.853820+0000","last_clean_scrub_stamp":"2024-09-10T14:33:05.853820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:14.746222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:35.954305+0000","last_change":"2024-09-10T14:32:35.954305+0000","last_active":"2024-09-10T14:32:35.954305+0000","last_peered":"2024-09-10T14:32:35.954305+0000","last_clean":"2024-09-10T14:32:35.954305+0000","last_became_active":"2024-09-10T14:28:32.882707+0000","last_became_peered":"2024-09-10T14:28:32.882707+0000","last_unstale":"2024-09-10T14:32:35.954305+0000","last_undegraded":"2024-09-10T14:32:35.954305+0000","last_fullsized":"2024-09-10T14:32:35.954305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:35.954067+0000","last_clean_scrub_stamp":"2024-09-10T14:32:35.954067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:56.841551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'47","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:24.005471+0000","last_change":"2024-09-10T14:32:24.005471+0000","last_active":"2024-09-10T14:32:24.005471+0000","last_peered":"2024-09-10T14:32:24.005471+0000","last_clean":"2024-09-10T14:32:24.005471+0000","last_became_active":"2024-09-10T14:28:34.888228+0000","last_became_peered":"2024-09-10T14:28:34.888228+0000","last_unstale":"2024-09-10T14:32:24.005471+0000","last_undegraded":"2024-09-10T14:32:24.005471+0000","last_fullsized":"2024-09-10T14:32:24.005471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-10T14:32:24.005077+0000","last_clean_scrub_stamp":"2024-09-10T14:32:24.005077+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:26.362032+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:23.075075+0000","last_change":"2024-09-10T14:32:23.075075+0000","last_active":"2024-09-10T14:32:23.075075+0000","last_peered":"2024-09-10T14:32:23.075075+0000","last_clean":"2024-09-10T14:32:23.075075+0000","last_became_active":"2024-09-10T14:28:36.923111+0000","last_became_peered":"2024-09-10T14:28:36.923111+0000","last_unstale":"2024-09-10T14:32:23.075075+0000","last_undegraded":"2024-09-10T14:32:23.075075+0000","last_fullsized":"2024-09-10T14:32:23.075075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:23.074819+0000","last_clean_scrub_stamp":"2024-09-10T14:32:23.074819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:52.669431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"36'8","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:13.801833+0000","last_change":"2024-09-10T14:33:13.801833+0000","last_active":"2024-09-10T14:33:13.801833+0000","last_peered":"2024-09-10T14:33:13.801833+0000","last_clean":"2024-09-10T14:33:13.801833+0000","last_became_active":"2024-09-10T14:28:38.930925+0000","last_became_peered":"2024-09-10T14:28:38.930925+0000","last_unstale":"2024-09-10T14:33:13.801833+0000","last_undegraded":"2024-09-10T14:33:13.801833+0000","last_fullsized":"2024-09-10T14:33:13.801833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:33:13.801585+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:33:13.801585+0000","last_clean_scrub_stamp":"2024-09-10T14:33:13.801585+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:09.632003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.350598+0000","last_change":"2024-09-10T14:32:46.350598+0000","last_active":"2024-09-10T14:32:46.350598+0000","last_peered":"2024-09-10T14:32:46.350598+0000","last_clean":"2024-09-10T14:32:46.350598+0000","last_became_active":"2024-09-10T14:28:30.855934+0000","last_became_peered":"2024-09-10T14:28:30.855934+0000","last_unstale":"2024-09-10T14:32:46.350598+0000","last_undegraded":"2024-09-10T14:32:46.350598+0000","last_fullsized":"2024-09-10T14:32:46.350598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:46.350348+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:46.350348+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.350348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:26.276494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"36'7","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:24.630407+0000","last_change":"2024-09-10T14:33:24.630407+0000","last_active":"2024-09-10T14:33:24.630407+0000","last_peered":"2024-09-10T14:33:24.630407+0000","last_clean":"2024-09-10T14:33:24.630407+0000","last_became_active":"2024-09-10T14:28:28.883626+0000","last_became_peered":"2024-09-10T14:28:28.883626+0000","last_unstale":"2024-09-10T14:33:24.630407+0000","last_undegraded":"2024-09-10T14:33:24.630407+0000","last_fullsized":"2024-09-10T14:33:24.630407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-10T14:33:24.630146+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-10T14:33:24.630146+0000","last_clean_scrub_stamp":"2024-09-10T14:33:24.630146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:54.341106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":16,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.460071+0000","last_change":"2024-09-10T14:32:37.460071+0000","last_active":"2024-09-10T14:32:37.460071+0000","last_peered":"2024-09-10T14:32:37.460071+0000","last_clean":"2024-09-10T14:32:37.460071+0000","last_became_active":"2024-09-10T14:28:32.885901+0000","last_became_peered":"2024-09-10T14:28:32.885901+0000","last_unstale":"2024-09-10T14:32:37.460071+0000","last_undegraded":"2024-09-10T14:32:37.460071+0000","last_fullsized":"2024-09-10T14:32:37.460071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:37.459813+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.459813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:14.821058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:26.028627+0000","last_change":"2024-09-10T14:32:26.028627+0000","last_active":"2024-09-10T14:32:26.028627+0000","last_peered":"2024-09-10T14:32:26.028627+0000","last_clean":"2024-09-10T14:32:26.028627+0000","last_became_active":"2024-09-10T14:28:34.894516+0000","last_became_peered":"2024-09-10T14:28:34.894516+0000","last_unstale":"2024-09-10T14:32:26.028627+0000","last_undegraded":"2024-09-10T14:32:26.028627+0000","last_fullsized":"2024-09-10T14:32:26.028627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-10T14:32:26.028252+0000","last_clean_scrub_stamp":"2024-09-10T14:32:26.028252+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:17.812152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:41.470597+0000","last_change":"2024-09-10T14:32:41.470597+0000","last_active":"2024-09-10T14:32:41.470597+0000","last_peered":"2024-09-10T14:32:41.470597+0000","last_clean":"2024-09-10T14:32:41.470597+0000","last_became_active":"2024-09-10T14:28:36.937343+0000","last_became_peered":"2024-09-10T14:28:36.937343+0000","last_unstale":"2024-09-10T14:32:41.470597+0000","last_undegraded":"2024-09-10T14:32:41.470597+0000","last_fullsized":"2024-09-10T14:32:41.470597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:41.470326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:41.470326+0000","last_clean_scrub_stamp":"2024-09-10T14:32:41.470326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:19.199667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:44.790358+0000","last_change":"2024-09-10T14:33:44.790414+0000","last_active":"2024-09-10T14:33:44.790358+0000","last_peered":"2024-09-10T14:33:44.790358+0000","last_clean":"2024-09-10T14:33:44.790358+0000","last_became_active":"2024-09-10T14:28:38.950066+0000","last_became_peered":"2024-09-10T14:28:38.950066+0000","last_unstale":"2024-09-10T14:33:44.790358+0000","last_undegraded":"2024-09-10T14:33:44.790358+0000","last_fullsized":"2024-09-10T14:33:44.790358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:44.790133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:44.790133+0000","last_clean_scrub_stamp":"2024-09-10T14:33:44.790133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:43.665086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:01.423435+0000","last_change":"2024-09-10T14:33:01.423435+0000","last_active":"2024-09-10T14:33:01.423435+0000","last_peered":"2024-09-10T14:33:01.423435+0000","last_clean":"2024-09-10T14:33:01.423435+0000","last_became_active":"2024-09-10T14:28:30.877137+0000","last_became_peered":"2024-09-10T14:28:30.877137+0000","last_unstale":"2024-09-10T14:33:01.423435+0000","last_undegraded":"2024-09-10T14:33:01.423435+0000","last_fullsized":"2024-09-10T14:33:01.423435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:33:01.423168+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:33:01.423168+0000","last_clean_scrub_stamp":"2024-09-10T14:33:01.423168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:28.296896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:10.110339+0000","last_change":"2024-09-10T14:33:10.110407+0000","last_active":"2024-09-10T14:33:10.110339+0000","last_peered":"2024-09-10T14:33:10.110339+0000","last_clean":"2024-09-10T14:33:10.110339+0000","last_became_active":"2024-09-10T14:28:28.875206+0000","last_became_peered":"2024-09-10T14:28:28.875206+0000","last_unstale":"2024-09-10T14:33:10.110339+0000","last_undegraded":"2024-09-10T14:33:10.110339+0000","last_fullsized":"2024-09-10T14:33:10.110339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:10.110141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:10.110141+0000","last_clean_scrub_stamp":"2024-09-10T14:33:10.110141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:18.775525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:32.935858+0000","last_change":"2024-09-10T14:32:32.935858+0000","last_active":"2024-09-10T14:32:32.935858+0000","last_peered":"2024-09-10T14:32:32.935858+0000","last_clean":"2024-09-10T14:32:32.935858+0000","last_became_active":"2024-09-10T14:28:32.883551+0000","last_became_peered":"2024-09-10T14:28:32.883551+0000","last_unstale":"2024-09-10T14:32:32.935858+0000","last_undegraded":"2024-09-10T14:32:32.935858+0000","last_fullsized":"2024-09-10T14:32:32.935858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:32.935608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:32.935608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:34.956315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:31.504474+0000","last_change":"2024-09-10T14:32:31.504474+0000","last_active":"2024-09-10T14:32:31.504474+0000","last_peered":"2024-09-10T14:32:31.504474+0000","last_clean":"2024-09-10T14:32:31.504474+0000","last_became_active":"2024-09-10T14:28:34.913183+0000","last_became_peered":"2024-09-10T14:28:34.913183+0000","last_unstale":"2024-09-10T14:32:31.504474+0000","last_undegraded":"2024-09-10T14:32:31.504474+0000","last_fullsized":"2024-09-10T14:32:31.504474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-10T14:32:31.504210+0000","last_clean_scrub_stamp":"2024-09-10T14:32:31.504210+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:27.467975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.434693+0000","last_change":"2024-09-10T14:32:55.434693+0000","last_active":"2024-09-10T14:32:55.434693+0000","last_peered":"2024-09-10T14:32:55.434693+0000","last_clean":"2024-09-10T14:32:55.434693+0000","last_became_active":"2024-09-10T14:28:36.944903+0000","last_became_peered":"2024-09-10T14:28:36.944903+0000","last_unstale":"2024-09-10T14:32:55.434693+0000","last_undegraded":"2024-09-10T14:32:55.434693+0000","last_fullsized":"2024-09-10T14:32:55.434693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:55.434450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:55.434450+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.434450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:41.855323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"36'7","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:42.737806+0000","last_change":"2024-09-10T14:33:42.737873+0000","last_active":"2024-09-10T14:33:42.737806+0000","last_peered":"2024-09-10T14:33:42.737806+0000","last_clean":"2024-09-10T14:33:42.737806+0000","last_became_active":"2024-09-10T14:28:38.948634+0000","last_became_peered":"2024-09-10T14:28:38.948634+0000","last_unstale":"2024-09-10T14:33:42.737806+0000","last_undegraded":"2024-09-10T14:33:42.737806+0000","last_fullsized":"2024-09-10T14:33:42.737806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-10T14:33:42.737623+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-10T14:33:42.737623+0000","last_clean_scrub_stamp":"2024-09-10T14:33:42.737623+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:55.011987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.357374+0000","last_change":"2024-09-10T14:32:45.357374+0000","last_active":"2024-09-10T14:32:45.357374+0000","last_peered":"2024-09-10T14:32:45.357374+0000","last_clean":"2024-09-10T14:32:45.357374+0000","last_became_active":"2024-09-10T14:28:30.855869+0000","last_became_peered":"2024-09-10T14:28:30.855869+0000","last_unstale":"2024-09-10T14:32:45.357374+0000","last_undegraded":"2024-09-10T14:32:45.357374+0000","last_fullsized":"2024-09-10T14:32:45.357374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:45.356988+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:45.356988+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.356988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:42.173829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.856166+0000","last_change":"2024-09-10T14:32:57.856228+0000","last_active":"2024-09-10T14:32:57.856166+0000","last_peered":"2024-09-10T14:32:57.856166+0000","last_clean":"2024-09-10T14:32:57.856166+0000","last_became_active":"2024-09-10T14:28:28.904039+0000","last_became_peered":"2024-09-10T14:28:28.904039+0000","last_unstale":"2024-09-10T14:32:57.856166+0000","last_undegraded":"2024-09-10T14:32:57.856166+0000","last_fullsized":"2024-09-10T14:32:57.856166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:57.855959+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:57.855959+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.855959+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:19.355814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:28.985098+0000","last_change":"2024-09-10T14:32:28.985098+0000","last_active":"2024-09-10T14:32:28.985098+0000","last_peered":"2024-09-10T14:32:28.985098+0000","last_clean":"2024-09-10T14:32:28.985098+0000","last_became_active":"2024-09-10T14:28:32.888981+0000","last_became_peered":"2024-09-10T14:28:32.888981+0000","last_unstale":"2024-09-10T14:32:28.985098+0000","last_undegraded":"2024-09-10T14:32:28.985098+0000","last_fullsized":"2024-09-10T14:32:28.985098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-10T14:32:28.984841+0000","last_clean_scrub_stamp":"2024-09-10T14:32:28.984841+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:32.529664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'41","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.464492+0000","last_change":"2024-09-10T14:32:52.464492+0000","last_active":"2024-09-10T14:32:52.464492+0000","last_peered":"2024-09-10T14:32:52.464492+0000","last_clean":"2024-09-10T14:32:52.464492+0000","last_became_active":"2024-09-10T14:28:34.913608+0000","last_became_peered":"2024-09-10T14:28:34.913608+0000","last_unstale":"2024-09-10T14:32:52.464492+0000","last_undegraded":"2024-09-10T14:32:52.464492+0000","last_fullsized":"2024-09-10T14:32:52.464492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-10T14:32:52.464237+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-10T14:32:52.464237+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.464237+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:29.213358+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:39.257759+0000","last_change":"2024-09-10T14:32:39.257759+0000","last_active":"2024-09-10T14:32:39.257759+0000","last_peered":"2024-09-10T14:32:39.257759+0000","last_clean":"2024-09-10T14:32:39.257759+0000","last_became_active":"2024-09-10T14:28:36.923478+0000","last_became_peered":"2024-09-10T14:28:36.923478+0000","last_unstale":"2024-09-10T14:32:39.257759+0000","last_undegraded":"2024-09-10T14:32:39.257759+0000","last_fullsized":"2024-09-10T14:32:39.257759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:39.257507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:39.257507+0000","last_clean_scrub_stamp":"2024-09-10T14:32:39.257507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:11.855142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:43.769486+0000","last_change":"2024-09-10T14:33:43.769556+0000","last_active":"2024-09-10T14:33:43.769486+0000","last_peered":"2024-09-10T14:33:43.769486+0000","last_clean":"2024-09-10T14:33:43.769486+0000","last_became_active":"2024-09-10T14:28:38.948600+0000","last_became_peered":"2024-09-10T14:28:38.948600+0000","last_unstale":"2024-09-10T14:33:43.769486+0000","last_undegraded":"2024-09-10T14:33:43.769486+0000","last_fullsized":"2024-09-10T14:33:43.769486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:43.769272+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:43.769272+0000","last_clean_scrub_stamp":"2024-09-10T14:33:43.769272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:29.094392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"36'16","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:37.967908+0000","last_change":"2024-09-10T14:32:37.967908+0000","last_active":"2024-09-10T14:32:37.967908+0000","last_peered":"2024-09-10T14:32:37.967908+0000","last_clean":"2024-09-10T14:32:37.967908+0000","last_became_active":"2024-09-10T14:28:30.884080+0000","last_became_peered":"2024-09-10T14:28:30.884080+0000","last_unstale":"2024-09-10T14:32:37.967908+0000","last_undegraded":"2024-09-10T14:32:37.967908+0000","last_fullsized":"2024-09-10T14:32:37.967908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-10T14:32:37.967539+0000","last_clean_scrub_stamp":"2024-09-10T14:32:37.967539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:44.664554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.362528+0000","last_change":"2024-09-10T14:33:02.362596+0000","last_active":"2024-09-10T14:33:02.362528+0000","last_peered":"2024-09-10T14:33:02.362528+0000","last_clean":"2024-09-10T14:33:02.362528+0000","last_became_active":"2024-09-10T14:28:28.876733+0000","last_became_peered":"2024-09-10T14:28:28.876733+0000","last_unstale":"2024-09-10T14:33:02.362528+0000","last_undegraded":"2024-09-10T14:33:02.362528+0000","last_fullsized":"2024-09-10T14:33:02.362528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:02.362272+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:02.362272+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.362272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:04.809531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:49.283518+0000","last_change":"2024-09-10T14:32:49.283518+0000","last_active":"2024-09-10T14:32:49.283518+0000","last_peered":"2024-09-10T14:32:49.283518+0000","last_clean":"2024-09-10T14:32:49.283518+0000","last_became_active":"2024-09-10T14:28:30.860426+0000","last_became_peered":"2024-09-10T14:28:30.860426+0000","last_unstale":"2024-09-10T14:32:49.283518+0000","last_undegraded":"2024-09-10T14:32:49.283518+0000","last_fullsized":"2024-09-10T14:32:49.283518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:49.283250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:49.283250+0000","last_clean_scrub_stamp":"2024-09-10T14:32:49.283250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:33.333958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:58.115744+0000","last_change":"2024-09-10T14:32:58.115819+0000","last_active":"2024-09-10T14:32:58.115744+0000","last_peered":"2024-09-10T14:32:58.115744+0000","last_clean":"2024-09-10T14:32:58.115744+0000","last_became_active":"2024-09-10T14:28:28.878347+0000","last_became_peered":"2024-09-10T14:28:28.878347+0000","last_unstale":"2024-09-10T14:32:58.115744+0000","last_undegraded":"2024-09-10T14:32:58.115744+0000","last_fullsized":"2024-09-10T14:32:58.115744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:58.115545+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:58.115545+0000","last_clean_scrub_stamp":"2024-09-10T14:32:58.115545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:53.150818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"36'10","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.415954+0000","last_change":"2024-09-10T14:33:02.416041+0000","last_active":"2024-09-10T14:33:02.415954+0000","last_peered":"2024-09-10T14:33:02.415954+0000","last_clean":"2024-09-10T14:33:02.415954+0000","last_became_active":"2024-09-10T14:28:30.876052+0000","last_became_peered":"2024-09-10T14:28:30.876052+0000","last_unstale":"2024-09-10T14:33:02.415954+0000","last_undegraded":"2024-09-10T14:33:02.415954+0000","last_fullsized":"2024-09-10T14:33:02.415954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:33:02.415764+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:33:02.415764+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.415764+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:30.721821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"36'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:27.738357+0000","last_change":"2024-09-10T14:33:27.738539+0000","last_active":"2024-09-10T14:33:27.738357+0000","last_peered":"2024-09-10T14:33:27.738357+0000","last_clean":"2024-09-10T14:33:27.738357+0000","last_became_active":"2024-09-10T14:28:28.892572+0000","last_became_peered":"2024-09-10T14:28:28.892572+0000","last_unstale":"2024-09-10T14:33:27.738357+0000","last_undegraded":"2024-09-10T14:33:27.738357+0000","last_fullsized":"2024-09-10T14:33:27.738357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:27.738113+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:27.738113+0000","last_clean_scrub_stamp":"2024-09-10T14:33:27.738113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:22.606292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.103739+0000","last_change":"2024-09-10T14:32:55.103798+0000","last_active":"2024-09-10T14:32:55.103739+0000","last_peered":"2024-09-10T14:32:55.103739+0000","last_clean":"2024-09-10T14:32:55.103739+0000","last_became_active":"2024-09-10T14:28:30.862963+0000","last_became_peered":"2024-09-10T14:28:30.862963+0000","last_unstale":"2024-09-10T14:32:55.103739+0000","last_undegraded":"2024-09-10T14:32:55.103739+0000","last_fullsized":"2024-09-10T14:32:55.103739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:55.103545+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:55.103545+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.103545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:16.603400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.145434+0000","last_change":"2024-09-10T14:33:00.145500+0000","last_active":"2024-09-10T14:33:00.145434+0000","last_peered":"2024-09-10T14:33:00.145434+0000","last_clean":"2024-09-10T14:33:00.145434+0000","last_became_active":"2024-09-10T14:28:28.877614+0000","last_became_peered":"2024-09-10T14:28:28.877614+0000","last_unstale":"2024-09-10T14:33:00.145434+0000","last_undegraded":"2024-09-10T14:33:00.145434+0000","last_fullsized":"2024-09-10T14:33:00.145434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:33:00.145242+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:33:00.145242+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.145242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:00.136739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"36'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:46.267228+0000","last_change":"2024-09-10T14:32:46.267294+0000","last_active":"2024-09-10T14:32:46.267228+0000","last_peered":"2024-09-10T14:32:46.267228+0000","last_clean":"2024-09-10T14:32:46.267228+0000","last_became_active":"2024-09-10T14:28:30.885908+0000","last_became_peered":"2024-09-10T14:28:30.885908+0000","last_unstale":"2024-09-10T14:32:46.267228+0000","last_undegraded":"2024-09-10T14:32:46.267228+0000","last_fullsized":"2024-09-10T14:32:46.267228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:46.267037+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:46.267037+0000","last_clean_scrub_stamp":"2024-09-10T14:32:46.267037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:01.415089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:50.246325+0000","last_change":"2024-09-10T14:32:50.246325+0000","last_active":"2024-09-10T14:32:50.246325+0000","last_peered":"2024-09-10T14:32:50.246325+0000","last_clean":"2024-09-10T14:32:50.246325+0000","last_became_active":"2024-09-10T14:28:28.906545+0000","last_became_peered":"2024-09-10T14:28:28.906545+0000","last_unstale":"2024-09-10T14:32:50.246325+0000","last_undegraded":"2024-09-10T14:32:50.246325+0000","last_fullsized":"2024-09-10T14:32:50.246325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:50.246061+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:50.246061+0000","last_clean_scrub_stamp":"2024-09-10T14:32:50.246061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:23.296600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.756326+0000","last_change":"2024-09-10T14:33:12.756384+0000","last_active":"2024-09-10T14:33:12.756326+0000","last_peered":"2024-09-10T14:33:12.756326+0000","last_clean":"2024-09-10T14:33:12.756326+0000","last_became_active":"2024-09-10T14:28:30.883940+0000","last_became_peered":"2024-09-10T14:28:30.883940+0000","last_unstale":"2024-09-10T14:33:12.756326+0000","last_undegraded":"2024-09-10T14:33:12.756326+0000","last_fullsized":"2024-09-10T14:33:12.756326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-10T14:33:12.756121+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-10T14:33:12.756121+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.756121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:21.421505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:09.806351+0000","last_change":"2024-09-10T14:33:09.806405+0000","last_active":"2024-09-10T14:33:09.806351+0000","last_peered":"2024-09-10T14:33:09.806351+0000","last_clean":"2024-09-10T14:33:09.806351+0000","last_became_active":"2024-09-10T14:28:28.898446+0000","last_became_peered":"2024-09-10T14:28:28.898446+0000","last_unstale":"2024-09-10T14:33:09.806351+0000","last_undegraded":"2024-09-10T14:33:09.806351+0000","last_fullsized":"2024-09-10T14:33:09.806351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:09.806154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:09.806154+0000","last_clean_scrub_stamp":"2024-09-10T14:33:09.806154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:49.758182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'14","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:03.148461+0000","last_change":"2024-09-10T14:33:03.148521+0000","last_active":"2024-09-10T14:33:03.148461+0000","last_peered":"2024-09-10T14:33:03.148461+0000","last_clean":"2024-09-10T14:33:03.148461+0000","last_became_active":"2024-09-10T14:28:30.880858+0000","last_became_peered":"2024-09-10T14:28:30.880858+0000","last_unstale":"2024-09-10T14:33:03.148461+0000","last_undegraded":"2024-09-10T14:33:03.148461+0000","last_fullsized":"2024-09-10T14:33:03.148461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:33:03.148265+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:33:03.148265+0000","last_clean_scrub_stamp":"2024-09-10T14:33:03.148265+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:12.040666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:52.369749+0000","last_change":"2024-09-10T14:32:52.369813+0000","last_active":"2024-09-10T14:32:52.369749+0000","last_peered":"2024-09-10T14:32:52.369749+0000","last_clean":"2024-09-10T14:32:52.369749+0000","last_became_active":"2024-09-10T14:28:28.910906+0000","last_became_peered":"2024-09-10T14:28:28.910906+0000","last_unstale":"2024-09-10T14:32:52.369749+0000","last_undegraded":"2024-09-10T14:32:52.369749+0000","last_fullsized":"2024-09-10T14:32:52.369749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:52.369554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:52.369554+0000","last_clean_scrub_stamp":"2024-09-10T14:32:52.369554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:48.344683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.924217+0000","last_change":"2024-09-10T14:32:44.924333+0000","last_active":"2024-09-10T14:32:44.924217+0000","last_peered":"2024-09-10T14:32:44.924217+0000","last_clean":"2024-09-10T14:32:44.924217+0000","last_became_active":"2024-09-10T14:28:30.886676+0000","last_became_peered":"2024-09-10T14:28:30.886676+0000","last_unstale":"2024-09-10T14:32:44.924217+0000","last_undegraded":"2024-09-10T14:32:44.924217+0000","last_fullsized":"2024-09-10T14:32:44.924217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:44.923988+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:44.923988+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.923988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:20:17.218205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:12.103117+0000","last_change":"2024-09-10T14:33:12.103188+0000","last_active":"2024-09-10T14:33:12.103117+0000","last_peered":"2024-09-10T14:33:12.103117+0000","last_clean":"2024-09-10T14:33:12.103117+0000","last_became_active":"2024-09-10T14:28:28.876861+0000","last_became_peered":"2024-09-10T14:28:28.876861+0000","last_unstale":"2024-09-10T14:33:12.103117+0000","last_undegraded":"2024-09-10T14:33:12.103117+0000","last_fullsized":"2024-09-10T14:33:12.103117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:33:12.102898+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:33:12.102898+0000","last_clean_scrub_stamp":"2024-09-10T14:33:12.102898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:00.368266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"36'10","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:56.900247+0000","last_change":"2024-09-10T14:32:56.900247+0000","last_active":"2024-09-10T14:32:56.900247+0000","last_peered":"2024-09-10T14:32:56.900247+0000","last_clean":"2024-09-10T14:32:56.900247+0000","last_became_active":"2024-09-10T14:28:30.867444+0000","last_became_peered":"2024-09-10T14:28:30.867444+0000","last_unstale":"2024-09-10T14:32:56.900247+0000","last_undegraded":"2024-09-10T14:32:56.900247+0000","last_fullsized":"2024-09-10T14:32:56.900247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:56.899972+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:56.899972+0000","last_clean_scrub_stamp":"2024-09-10T14:32:56.899972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:52:46.105631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:37.660678+0000","last_change":"2024-09-10T14:33:37.660738+0000","last_active":"2024-09-10T14:33:37.660678+0000","last_peered":"2024-09-10T14:33:37.660678+0000","last_clean":"2024-09-10T14:33:37.660678+0000","last_became_active":"2024-09-10T14:28:28.890721+0000","last_became_peered":"2024-09-10T14:28:28.890721+0000","last_unstale":"2024-09-10T14:33:37.660678+0000","last_undegraded":"2024-09-10T14:33:37.660678+0000","last_fullsized":"2024-09-10T14:33:37.660678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:37.660471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:37.660471+0000","last_clean_scrub_stamp":"2024-09-10T14:33:37.660471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:17.132064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:40.471594+0000","last_change":"2024-09-10T14:32:40.471594+0000","last_active":"2024-09-10T14:32:40.471594+0000","last_peered":"2024-09-10T14:32:40.471594+0000","last_clean":"2024-09-10T14:32:40.471594+0000","last_became_active":"2024-09-10T14:28:30.884736+0000","last_became_peered":"2024-09-10T14:28:30.884736+0000","last_unstale":"2024-09-10T14:32:40.471594+0000","last_undegraded":"2024-09-10T14:32:40.471594+0000","last_fullsized":"2024-09-10T14:32:40.471594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-10T14:32:40.471309+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-10T14:32:40.471309+0000","last_clean_scrub_stamp":"2024-09-10T14:32:40.471309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:19:15.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:04.134041+0000","last_change":"2024-09-10T14:33:04.134108+0000","last_active":"2024-09-10T14:33:04.134041+0000","last_peered":"2024-09-10T14:33:04.134041+0000","last_clean":"2024-09-10T14:33:04.134041+0000","last_became_active":"2024-09-10T14:28:28.875245+0000","last_became_peered":"2024-09-10T14:28:28.875245+0000","last_unstale":"2024-09-10T14:33:04.134041+0000","last_undegraded":"2024-09-10T14:33:04.134041+0000","last_fullsized":"2024-09-10T14:33:04.134041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:04.133848+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:04.133848+0000","last_clean_scrub_stamp":"2024-09-10T14:33:04.133848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:26.213488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"36'8","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:57.155550+0000","last_change":"2024-09-10T14:32:57.155550+0000","last_active":"2024-09-10T14:32:57.155550+0000","last_peered":"2024-09-10T14:32:57.155550+0000","last_clean":"2024-09-10T14:32:57.155550+0000","last_became_active":"2024-09-10T14:28:30.875283+0000","last_became_peered":"2024-09-10T14:28:30.875283+0000","last_unstale":"2024-09-10T14:32:57.155550+0000","last_undegraded":"2024-09-10T14:32:57.155550+0000","last_fullsized":"2024-09-10T14:32:57.155550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-10T14:32:57.155307+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-10T14:32:57.155307+0000","last_clean_scrub_stamp":"2024-09-10T14:32:57.155307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:46.880813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:06.835504+0000","last_change":"2024-09-10T14:33:06.835626+0000","last_active":"2024-09-10T14:33:06.835504+0000","last_peered":"2024-09-10T14:33:06.835504+0000","last_clean":"2024-09-10T14:33:06.835504+0000","last_became_active":"2024-09-10T14:28:28.888006+0000","last_became_peered":"2024-09-10T14:28:28.888006+0000","last_unstale":"2024-09-10T14:33:06.835504+0000","last_undegraded":"2024-09-10T14:33:06.835504+0000","last_fullsized":"2024-09-10T14:33:06.835504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:06.835209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:06.835209+0000","last_clean_scrub_stamp":"2024-09-10T14:33:06.835209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:28.914849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"36'18","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:00.785422+0000","last_change":"2024-09-10T14:33:00.785422+0000","last_active":"2024-09-10T14:33:00.785422+0000","last_peered":"2024-09-10T14:33:00.785422+0000","last_clean":"2024-09-10T14:33:00.785422+0000","last_became_active":"2024-09-10T14:28:30.882904+0000","last_became_peered":"2024-09-10T14:28:30.882904+0000","last_unstale":"2024-09-10T14:33:00.785422+0000","last_undegraded":"2024-09-10T14:33:00.785422+0000","last_fullsized":"2024-09-10T14:33:00.785422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-10T14:33:00.785175+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-10T14:33:00.785175+0000","last_clean_scrub_stamp":"2024-09-10T14:33:00.785175+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:55.820447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:55.906586+0000","last_change":"2024-09-10T14:32:55.906586+0000","last_active":"2024-09-10T14:32:55.906586+0000","last_peered":"2024-09-10T14:32:55.906586+0000","last_clean":"2024-09-10T14:32:55.906586+0000","last_became_active":"2024-09-10T14:28:28.904905+0000","last_became_peered":"2024-09-10T14:28:28.904905+0000","last_unstale":"2024-09-10T14:32:55.906586+0000","last_undegraded":"2024-09-10T14:32:55.906586+0000","last_fullsized":"2024-09-10T14:32:55.906586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:55.906312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:55.906312+0000","last_clean_scrub_stamp":"2024-09-10T14:32:55.906312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:50.502825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'16","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:02.817003+0000","last_change":"2024-09-10T14:33:02.817003+0000","last_active":"2024-09-10T14:33:02.817003+0000","last_peered":"2024-09-10T14:33:02.817003+0000","last_clean":"2024-09-10T14:33:02.817003+0000","last_became_active":"2024-09-10T14:28:30.883785+0000","last_became_peered":"2024-09-10T14:28:30.883785+0000","last_unstale":"2024-09-10T14:33:02.817003+0000","last_undegraded":"2024-09-10T14:33:02.817003+0000","last_fullsized":"2024-09-10T14:33:02.817003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-10T14:33:02.816746+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-10T14:33:02.816746+0000","last_clean_scrub_stamp":"2024-09-10T14:33:02.816746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:02.808243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":48,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:15.439718+0000","last_change":"2024-09-10T14:33:15.439782+0000","last_active":"2024-09-10T14:33:15.439718+0000","last_peered":"2024-09-10T14:33:15.439718+0000","last_clean":"2024-09-10T14:33:15.439718+0000","last_became_active":"2024-09-10T14:28:28.884238+0000","last_became_peered":"2024-09-10T14:28:28.884238+0000","last_unstale":"2024-09-10T14:33:15.439718+0000","last_undegraded":"2024-09-10T14:33:15.439718+0000","last_fullsized":"2024-09-10T14:33:15.439718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:15.439516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:15.439516+0000","last_clean_scrub_stamp":"2024-09-10T14:33:15.439516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:25:23.916159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'10","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.938587+0000","last_change":"2024-09-10T14:32:48.938587+0000","last_active":"2024-09-10T14:32:48.938587+0000","last_peered":"2024-09-10T14:32:48.938587+0000","last_clean":"2024-09-10T14:32:48.938587+0000","last_became_active":"2024-09-10T14:28:30.866631+0000","last_became_peered":"2024-09-10T14:28:30.866631+0000","last_unstale":"2024-09-10T14:32:48.938587+0000","last_undegraded":"2024-09-10T14:32:48.938587+0000","last_fullsized":"2024-09-10T14:32:48.938587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-10T14:32:48.938333+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-10T14:32:48.938333+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.938333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:04.086385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:36.656574+0000","last_change":"2024-09-10T14:33:36.656635+0000","last_active":"2024-09-10T14:33:36.656574+0000","last_peered":"2024-09-10T14:33:36.656574+0000","last_clean":"2024-09-10T14:33:36.656574+0000","last_became_active":"2024-09-10T14:28:28.879185+0000","last_became_peered":"2024-09-10T14:28:28.879185+0000","last_unstale":"2024-09-10T14:33:36.656574+0000","last_undegraded":"2024-09-10T14:33:36.656574+0000","last_fullsized":"2024-09-10T14:33:36.656574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:36.656381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:36.656381+0000","last_clean_scrub_stamp":"2024-09-10T14:33:36.656381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:13.674099+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"36'14","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:38.389144+0000","last_change":"2024-09-10T14:32:38.389144+0000","last_active":"2024-09-10T14:32:38.389144+0000","last_peered":"2024-09-10T14:32:38.389144+0000","last_clean":"2024-09-10T14:32:38.389144+0000","last_became_active":"2024-09-10T14:28:30.887412+0000","last_became_peered":"2024-09-10T14:28:30.887412+0000","last_unstale":"2024-09-10T14:32:38.389144+0000","last_undegraded":"2024-09-10T14:32:38.389144+0000","last_fullsized":"2024-09-10T14:32:38.389144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-10T14:32:38.388866+0000","last_clean_scrub_stamp":"2024-09-10T14:32:38.388866+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:28:33.424139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":35,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:48.422326+0000","last_change":"2024-09-10T14:32:48.422326+0000","last_active":"2024-09-10T14:32:48.422326+0000","last_peered":"2024-09-10T14:32:48.422326+0000","last_clean":"2024-09-10T14:32:48.422326+0000","last_became_active":"2024-09-10T14:28:28.912953+0000","last_became_peered":"2024-09-10T14:28:28.912953+0000","last_unstale":"2024-09-10T14:32:48.422326+0000","last_undegraded":"2024-09-10T14:32:48.422326+0000","last_fullsized":"2024-09-10T14:32:48.422326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:32:48.422047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:32:48.422047+0000","last_clean_scrub_stamp":"2024-09-10T14:32:48.422047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:26.220031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'6","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:51.999876+0000","last_change":"2024-09-10T14:32:51.999876+0000","last_active":"2024-09-10T14:32:51.999876+0000","last_peered":"2024-09-10T14:32:51.999876+0000","last_clean":"2024-09-10T14:32:51.999876+0000","last_became_active":"2024-09-10T14:28:30.861817+0000","last_became_peered":"2024-09-10T14:28:30.861817+0000","last_unstale":"2024-09-10T14:32:51.999876+0000","last_undegraded":"2024-09-10T14:32:51.999876+0000","last_fullsized":"2024-09-10T14:32:51.999876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:51.999608+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:51.999608+0000","last_clean_scrub_stamp":"2024-09-10T14:32:51.999608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:36.050316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:34.696623+0000","last_change":"2024-09-10T14:33:34.696785+0000","last_active":"2024-09-10T14:33:34.696623+0000","last_peered":"2024-09-10T14:33:34.696623+0000","last_clean":"2024-09-10T14:33:34.696623+0000","last_became_active":"2024-09-10T14:28:28.878422+0000","last_became_peered":"2024-09-10T14:28:28.878422+0000","last_unstale":"2024-09-10T14:33:34.696623+0000","last_undegraded":"2024-09-10T14:33:34.696623+0000","last_fullsized":"2024-09-10T14:33:34.696623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:33:34.696367+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:33:34.696367+0000","last_clean_scrub_stamp":"2024-09-10T14:33:34.696367+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:58.058808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:33:25.662294+0000","last_change":"2024-09-10T14:33:25.662353+0000","last_active":"2024-09-10T14:33:25.662294+0000","last_peered":"2024-09-10T14:33:25.662294+0000","last_clean":"2024-09-10T14:33:25.662294+0000","last_became_active":"2024-09-10T14:28:28.889676+0000","last_became_peered":"2024-09-10T14:28:28.889676+0000","last_unstale":"2024-09-10T14:33:25.662294+0000","last_undegraded":"2024-09-10T14:33:25.662294+0000","last_fullsized":"2024-09-10T14:33:25.662294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T14:33:25.662097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T14:33:25.662097+0000","last_clean_scrub_stamp":"2024-09-10T14:33:25.662097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:06.852054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"36'6","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:44.310500+0000","last_change":"2024-09-10T14:32:44.310500+0000","last_active":"2024-09-10T14:32:44.310500+0000","last_peered":"2024-09-10T14:32:44.310500+0000","last_clean":"2024-09-10T14:32:44.310500+0000","last_became_active":"2024-09-10T14:28:30.890311+0000","last_became_peered":"2024-09-10T14:28:30.890311+0000","last_unstale":"2024-09-10T14:32:44.310500+0000","last_undegraded":"2024-09-10T14:32:44.310500+0000","last_fullsized":"2024-09-10T14:32:44.310500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-10T14:32:44.310127+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-10T14:32:44.310127+0000","last_clean_scrub_stamp":"2024-09-10T14:32:44.310127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:59.596129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"36'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:54.134255+0000","last_change":"2024-09-10T14:32:54.134255+0000","last_active":"2024-09-10T14:32:54.134255+0000","last_peered":"2024-09-10T14:32:54.134255+0000","last_clean":"2024-09-10T14:32:54.134255+0000","last_became_active":"2024-09-10T14:28:28.879918+0000","last_became_peered":"2024-09-10T14:28:28.879918+0000","last_unstale":"2024-09-10T14:32:54.134255+0000","last_undegraded":"2024-09-10T14:32:54.134255+0000","last_fullsized":"2024-09-10T14:32:54.134255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-10T14:32:54.133994+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-10T14:32:54.133994+0000","last_clean_scrub_stamp":"2024-09-10T14:32:54.133994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:05.972266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T14:32:45.955850+0000","last_change":"2024-09-10T14:32:45.955850+0000","last_active":"2024-09-10T14:32:45.955850+0000","last_peered":"2024-09-10T14:32:45.955850+0000","last_clean":"2024-09-10T14:32:45.955850+0000","last_became_active":"2024-09-10T14:28:30.886792+0000","last_became_peered":"2024-09-10T14:28:30.886792+0000","last_unstale":"2024-09-10T14:32:45.955850+0000","last_undegraded":"2024-09-10T14:32:45.955850+0000","last_fullsized":"2024-09-10T14:32:45.955850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-10T14:32:45.955449+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-10T14:32:45.955449+0000","last_clean_scrub_stamp":"2024-09-10T14:32:45.955449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:58.286493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1530,"ondisk_log_size":1530,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":11,"seq":47244640330,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":750039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673034,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":162767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673034,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40532,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331308,"statfs":{"total":96636764160,"available":96595259392,"internally_reserved":0,"allocated":1052672,"data_stored":750219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":161599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T14:34:02.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T14:34:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e37e41640 1 Processor -- start 2024-09-10T14:34:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e37e41640 1 -- start start 2024-09-10T14:34:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e37e41640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e3012f390 0x7f1e30133a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:34:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e37e41640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e30098d50 con 0x7f1e3012e6f0 2024-09-10T14:34:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e37e41640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1e3006eba0 con 0x7f1e3012f390 2024-09-10T14:34:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e35bdd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1e3012e6f0 0x7f1e3012ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48376/0 (socket says 172.21.15.52:48376) 2024-09-10T14:34:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e35bdd640 1 -- 172.21.15.52:0/247736651 learned_addr learned my addr 172.21.15.52:0/247736651 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T14:34:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e353dc640 1 --2- 172.21.15.52:0/247736651 >> v2:172.21.15.52:3300/0 conn(0x7f1e3012f390 0x7f1e30133a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:34:02.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e34bdb640 1 -- 172.21.15.52:0/247736651 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623046899 0 0) 0x7f1e2c001120 con 0x7f1e3012e6f0 2024-09-10T14:34:02.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e34bdb640 1 -- 172.21.15.52:0/247736651 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e1c003530 con 0x7f1e3012e6f0 2024-09-10T14:34:02.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e34bdb640 1 -- 172.21.15.52:0/247736651 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 799639631 0 0) 0x7f1e1c003530 con 0x7f1e3012e6f0 2024-09-10T14:34:02.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e353dc640 1 -- 172.21.15.52:0/247736651 >> v1:172.21.15.52:6789/0 conn(0x7f1e3012e6f0 legacy=0x7f1e3012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:34:02.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.859+0000 7f1e353dc640 1 -- 172.21.15.52:0/247736651 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3006ed60 con 0x7f1e3012f390 2024-09-10T14:34:02.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e353dc640 1 --2- 172.21.15.52:0/247736651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012f390 0x7f1e30133a50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009740 tx=0x7f1e2401c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d847a1012c27cac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:34:02.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e34bdb640 1 -- 172.21.15.52:0/247736651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e240b0070 con 0x7f1e3012f390 2024-09-10T14:34:02.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e34bdb640 1 -- 172.21.15.52:0/247736651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e240ab400 con 0x7f1e3012f390 2024-09-10T14:34:02.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e34bdb640 1 -- 172.21.15.52:0/247736651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c001780 con 0x7f1e3012f390 2024-09-10T14:34:02.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- 172.21.15.52:0/247736651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012f390 msgr2=0x7f1e30133a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:34:02.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 --2- 172.21.15.52:0/247736651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012f390 0x7f1e30133a50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009740 tx=0x7f1e2401c290 comp rx=0 tx=0).stop 2024-09-10T14:34:02.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- 172.21.15.52:0/247736651 shutdown_connections 2024-09-10T14:34:02.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 --2- 172.21.15.52:0/247736651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012f390 0x7f1e30133a50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:34:02.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- 172.21.15.52:0/247736651 >> 172.21.15.52:0/247736651 conn(0x7f1e300a1030 msgr2=0x7f1e300a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:34:02.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- 172.21.15.52:0/247736651 shutdown_connections 2024-09-10T14:34:02.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- 172.21.15.52:0/247736651 wait complete. 2024-09-10T14:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 Processor -- start 2024-09-10T14:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- start start 2024-09-10T14:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012e6f0 0x7f1e3012f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30136b40 con 0x7f1e3012e6f0 2024-09-10T14:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e35bdd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012e6f0 0x7f1e3012f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e35bdd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012e6f0 0x7f1e3012f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51066/0 (socket says 172.21.15.52:51066) 2024-09-10T14:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e35bdd640 1 -- 172.21.15.52:0/2572525650 learned_addr learned my addr 172.21.15.52:0/2572525650 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T14:34:02.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e35bdd640 1 -- 172.21.15.52:0/2572525650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e30132e00 con 0x7f1e3012e6f0 2024-09-10T14:34:02.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e35bdd640 1 --2- 172.21.15.52:0/2572525650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012e6f0 0x7f1e3012f9d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c6b0 tx=0x7f1e2c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:34:02.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e227fc640 1 -- 172.21.15.52:0/2572525650 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c017070 con 0x7f1e3012e6f0 2024-09-10T14:34:02.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e227fc640 1 -- 172.21.15.52:0/2572525650 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0058e0 con 0x7f1e3012e6f0 2024-09-10T14:34:02.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e227fc640 1 -- 172.21.15.52:0/2572525650 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e2c005c40 con 0x7f1e3012e6f0 2024-09-10T14:34:02.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e30131d90 con 0x7f1e3012e6f0 2024-09-10T14:34:02.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.863+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e301300e0 con 0x7f1e3012e6f0 2024-09-10T14:34:02.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.867+0000 7f1e227fc640 1 -- 172.21.15.52:0/2572525650 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e2c01a070 con 0x7f1e3012e6f0 2024-09-10T14:34:02.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.867+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e30131120 con 0x7f1e3012e6f0 2024-09-10T14:34:02.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.867+0000 7f1e227fc640 1 --2- 172.21.15.52:0/2572525650 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e14035db0 0x7f1e14038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T14:34:02.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.867+0000 7f1e227fc640 1 -- 172.21.15.52:0/2572525650 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6336+0+0 (secure 0 0 0) 0x7f1e2c0485f0 con 0x7f1e3012e6f0 2024-09-10T14:34:02.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.867+0000 7f1e353dc640 1 --2- 172.21.15.52:0/2572525650 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e14035db0 0x7f1e14038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T14:34:02.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.867+0000 7f1e353dc640 1 --2- 172.21.15.52:0/2572525650 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e14035db0 0x7f1e14038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1e240ad000 tx=0x7f1e240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T14:34:02.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:02.871+0000 7f1e227fc640 1 -- 172.21.15.52:0/2572525650 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e30098d50 con 0x7f1e3012e6f0 2024-09-10T14:34:03.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.035+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1e3012ec80 con 0x7f1e3012e6f0 2024-09-10T14:34:03.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.039+0000 7f1e227fc640 1 -- 172.21.15.52:0/2572525650 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f1e2c007120 con 0x7f1e3012e6f0 2024-09-10T14:34:03.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.039+0000 7f1e227fc640 1 -- 172.21.15.52:0/2572525650 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1e2c00a660 con 0x7f1e3012e6f0 2024-09-10T14:34:03.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e14035db0 msgr2=0x7f1e14038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:34:03.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 --2- 172.21.15.52:0/2572525650 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e14035db0 0x7f1e14038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1e240ad000 tx=0x7f1e240a6000 comp rx=0 tx=0).stop 2024-09-10T14:34:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012e6f0 msgr2=0x7f1e3012f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T14:34:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 --2- 172.21.15.52:0/2572525650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012e6f0 0x7f1e3012f9d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00c6b0 tx=0x7f1e2c00cb70 comp rx=0 tx=0).stop 2024-09-10T14:34:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 shutdown_connections 2024-09-10T14:34:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 --2- 172.21.15.52:0/2572525650 >> [v2:172.21.15.151:6824/3605021146,v1:172.21.15.151:6825/3605021146] conn(0x7f1e14035db0 0x7f1e14038270 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:34:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 --2- 172.21.15.52:0/2572525650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e3012e6f0 0x7f1e3012f9d0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T14:34:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 >> 172.21.15.52:0/2572525650 conn(0x7f1e300a1030 msgr2=0x7f1e3009b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T14:34:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 shutdown_connections 2024-09-10T14:34:03.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T14:34:03.043+0000 7f1e37e41640 1 -- 172.21.15.52:0/2572525650 wait complete. 2024-09-10T14:34:03.064 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T14:34:03.064 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T14:34:03.064 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T14:34:03.064 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T14:34:03.153 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T14:34:03.154 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T14:34:03.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T14:34:03.242 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T14:34:03.242 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T14:34:03.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T14:34:07.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-10T14:34:07.898 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-10T14:34:07.898+0000 7fb56eb95640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-10T14:34:09.345 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T14:34:09.345 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T14:34:09.345 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T14:34:09.427 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T14:34:09.427 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T14:34:09.427 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T14:34:09.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T14:34:09.457 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T14:34:09.457 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T14:34:09.458 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T14:34:09.458 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T14:34:09.479 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T14:34:09.480 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T14:34:09.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-10T14:34:09.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T14:34:09.537 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T14:34:09.758 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:34:09.759 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T14:34:10.001 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:34:10.001 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T14:34:10.133 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:34:10.133 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T14:34:10.259 INFO:tasks.ceph:Archiving mon data... 2024-09-10T14:34:10.260 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116/data/mon.a.tgz 2024-09-10T14:34:10.260 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-10T14:34:10.266 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.4jXdGcNtoK 2024-09-10T14:34:10.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4jXdGcNtoK 2024-09-10T14:34:10.394 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.4jXdGcNtoK 2024-09-10T14:34:10.458 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.4jXdGcNtoK is 294KB 2024-09-10T14:34:10.516 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.4jXdGcNtoK 2024-09-10T14:34:10.521 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T14:34:10.522 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T14:34:10.567 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T14:34:10.626 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T14:34:10.631 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T14:34:10.631 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T14:34:10.633 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116/remote/smithi052/crash 2024-09-10T14:34:10.634 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T14:34:10.683 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116/remote/smithi151/crash 2024-09-10T14:34:10.684 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T14:34:10.696 INFO:tasks.ceph:Compressing logs... 2024-09-10T14:34:10.697 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T14:34:10.727 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T14:34:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24385.log 2024-09-10T14:34:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T14:34:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24385.log: 86.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.24385.log.gz -5 2024-09-10T14:34:10.749 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24423.log 2024-09-10T14:34:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23943.log 2024-09-10T14:34:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24605.log 2024-09-10T14:34:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23943.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24423.log.gz 2024-09-10T14:34:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24027.log 2024-09-10T14:34:10.751 INFO:teuthology.orchestra.run.smithi052.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23943.log.gz 2024-09-10T14:34:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24229.log 2024-09-10T14:34:10.753 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24605.log.gz 2024-09-10T14:34:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24136.log 2024-09-10T14:34:10.753 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24027.log.gz 2024-09-10T14:34:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23892.log 2024-09-10T14:34:10.753 INFO:teuthology.orchestra.run.smithi052.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24229.log.gz 2024-09-10T14:34:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24136.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T14:34:10.753 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24136.log.gz 2024-09-10T14:34:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23995.log 2024-09-10T14:34:10.754 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23892.log.gz 2024-09-10T14:34:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24359.log 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24844.log 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24359.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23995.log.gz 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24359.log.gz 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24683.log 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24449.log 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24844.log: /var/log/ceph/ceph-client.admin.24683.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24844.log.gz 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24553.log 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.24683.log.gz 2024-09-10T14:34:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24631.log 2024-09-10T14:34:10.757 INFO:teuthology.orchestra.run.smithi052.stderr: 86.4%/var/log/ceph/ceph-client.admin.24553.log: -- replaced with /var/log/ceph/ceph-client.admin.24449.log.gz 2024-09-10T14:34:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24657.log 2024-09-10T14:34:10.777 INFO:teuthology.orchestra.run.smithi052.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24553.log.gz 2024-09-10T14:34:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24579.log 2024-09-10T14:34:10.777 INFO:teuthology.orchestra.run.smithi052.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24631.log.gz 2024-09-10T14:34:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24870.log 2024-09-10T14:34:10.777 INFO:teuthology.orchestra.run.smithi052.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24657.log.gz 2024-09-10T14:34:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24033.log 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24579.log.gz 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24763.log 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24870.log.gz 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23969.log 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24033.log.gz 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24028.log 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24763.log.gz 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23654.log 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23969.log.gz 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24236.log 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24028.log.gz 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24475.log 2024-09-10T14:34:10.778 INFO:teuthology.orchestra.run.smithi052.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23654.log.gz 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24527.log 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24236.log.gz 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24129.log 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24475.log.gz 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24527.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.24527.log.gz 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23862.log 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24129.log.gz 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24818.log 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23862.log: gzip -5 --verbose -- 86.3% /var/log/ceph/ceph-client.admin.24894.log -- replaced with /var/log/ceph/ceph-client.admin.23862.log.gz 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24792.log 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24818.log: /var/log/ceph/ceph-client.admin.24894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24333.log 2024-09-10T14:34:10.779 INFO:teuthology.orchestra.run.smithi052.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24818.log.gz 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24894.log.gz 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24137.log 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24792.log.gz 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24333.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24333.log.gz 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24241.log 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.24137.log.gz 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24501.log 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.24241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24237.log 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24241.log.gz 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T14:34:10.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24501.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21422.log 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24501.log.gz 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22798.log 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.21422.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.24237.log.gz 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21422.log.gz 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24735.log 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24032.log 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22798.log: /var/log/ceph/ceph-client.admin.24735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24709.log 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.22798.log.gz 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.24735.log.gz 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22756.log 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24032.log.gz 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22686.log 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24709.log: /var/log/ceph/ceph-client.admin.22756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24126.log 2024-09-10T14:34:10.781 INFO:teuthology.orchestra.run.smithi052.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.24709.log.gz 2024-09-10T14:34:10.782 INFO:teuthology.orchestra.run.smithi052.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.22756.log.gz 2024-09-10T14:34:10.782 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23923.log 2024-09-10T14:34:10.782 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24126.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.22686.log.gz 2024-09-10T14:34:10.782 INFO:teuthology.orchestra.run.smithi052.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24126.log.gz 2024-09-10T14:34:10.782 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23923.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.23923.log.gz 2024-09-10T14:34:10.792 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39375.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73005.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.39375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36425.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.73005.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45275.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.39375.log.gz 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.36425.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37605.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.45275.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.73005.log.gz 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52945.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.37605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75955.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.52945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38785.log 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.36425.log.gz 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr:gzip/var/log/ceph/ceph-client.0.75955.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.45275.log.gz 2024-09-10T14:34:10.793 INFO:teuthology.orchestra.run.smithi151.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.67105.log 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.37605.log.gz 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.38785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67695.log 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.67105.log: -- /var/log/ceph/ceph-client.0.32891.log 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.52945.log.gz 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.67695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58255.log 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.32891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71825.log 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.38785.log.gz 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.58255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30531.log 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: 90.6%/var/log/ceph/ceph-client.0.71825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75365.log 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.67695.log.gz 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.32891.log.gz 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: 91.9%/var/log/ceph/ceph-client.0.30531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29224.log 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.67105.log.gz 91.7% -- replaced with /var/log/ceph/ceph-client.0.75955.log.gz 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-10T14:34:10.794 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.75365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88320.log 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55305.log 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr: 86.7% 91.5% -- replaced with /var/log/ceph/ceph-client.0.58255.log.gz 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.88320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55895.log 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29224.log.gz 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71825.log.gz 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% 91.6% -- replaced with /var/log/ceph/ceph-client.0.75365.log.gz -- replaced with /var/log/ceph/ceph-client.0.30531.log.gz 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29200.log 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.55305.log: /var/log/ceph/ceph-client.0.55895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84185.log 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62975.log 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29200.log.gz 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.84185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77719.log 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.62975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73595.log 2024-09-10T14:34:10.795 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55305.log.gz 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.77719.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.55895.log.gz 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.73595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80055.log 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84185.log.gz 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49405.log 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77719.log.gz 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.88320.log.gz 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.62975.log.gz 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83595.log 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.80055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79471.log 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.49405.log: /var/log/ceph/ceph-client.0.83595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31121.log 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.79471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64155.log 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.31121.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.73595.log.gz 2024-09-10T14:34:10.796 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.80055.log.gz 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.79471.log.gz 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49405.log.gz 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83595.log.gz 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61205.log 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.64155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40555.log 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.61205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42325.log 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.31121.log.gz 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.40555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53535.log 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64155.log.gz 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.42325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57075.log 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43505.log 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.53535.log: /var/log/ceph/ceph-client.0.57075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87725.log 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40555.log.gz 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.43505.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.42325.log.gz 92.8% -- replaced with /var/log/ceph/ceph-client.0.61205.log.gz 2024-09-10T14:34:10.797 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39965.log 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53535.log.gz 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.87725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85365.log 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.39965.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70645.log 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.43505.log.gz 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.57075.log.gz 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.85365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78887.log 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.70645.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87725.log.gz 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.78887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80645.log 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39965.log.gz 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45865.log 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.3.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85365.log.gz 2024-09-10T14:34:10.798 INFO:teuthology.orchestra.run.smithi151.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78887.log.gz 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37015.log 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.80645.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70645.log.gz 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:gzip/var/log/ceph/ceph-client.0.45865.log: -5 --verbose -- /var/log/ceph/ceph-client.0.72415.log 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.37015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48225.log 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.72415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41735.log 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.80645.log.gz 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.48225.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.45865.log.gz 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.37015.log.gz 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72415.log.gz 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48225.log.gz 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76545.log 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.41735.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.76545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61795.log 2024-09-10T14:34:10.799 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68285.log 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.61795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35245.log 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.41735.log.gz 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6%/var/log/ceph/ceph-client.0.68285.log: -- replaced with /var/log/ceph/ceph-client.0.76545.log.gz 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47635.log 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:gzip/var/log/ceph/ceph-client.0.35245.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29248.log 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.47635.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68285.log.gz 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63565.log 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35245.log.gz 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57665.log 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29248.log: 93.5% -- replaced with /var/log/ceph/ceph-client.0.61795.log.gz 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.63565.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.47635.log.gz 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.57665.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29248.log.gz 2024-09-10T14:34:10.800 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25057.log 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29176.log 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.25057.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63565.log.gz 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25057.log.gz 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57665.log.gz 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60025.log 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42915.log 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr: 85.9%/var/log/ceph/ceph-client.0.60025.log: -- replaced with /var/log/ceph/ceph-client.admin.29176.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.56485.log 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62385.log 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.56485.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60025.log.gz 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42915.log.gz 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56485.log.gz 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31711.log 2024-09-10T14:34:10.801 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.62385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81825.log 2024-09-10T14:34:10.802 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.31711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29272.log 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.81825.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.31711.log.gz 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62385.log.gz 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81825.log.gz 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35835.log 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74185.log 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr: 85.6%/var/log/ceph/ceph-client.0.35835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25033.log 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29272.log.gz 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.74185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81235.log 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25033.log: 85.7% 91.5% -- replaced with /var/log/ceph/ceph-client.0.35835.log.gz 2024-09-10T14:34:10.810 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25033.log.gz 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25081.log 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.81235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87135.log 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25081.log: 84.8% 91.7% -- replaced with /var/log/ceph/ceph-client.0.74185.log.gz 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25081.log.gz 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81235.log.gz 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83005.log 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.87135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54715.log 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.83005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32301.log 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.54715.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87135.log.gz 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34655.log 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.32301.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83005.log.gz 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54715.log.gz 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.32301.log.gz 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-10T14:34:10.811 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.34655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54125.log 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70055.log 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.54125.log: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.34655.log.gz 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64745.log 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2%/var/log/ceph/ceph-client.0.70055.log: -- replaced with /var/log/ceph/ceph-client.0.54125.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.48815.log 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.64745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34065.log 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.48815.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.70055.log.gz 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44095.log 2024-09-10T14:34:10.812 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.34065.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48815.log.gz 2024-09-10T14:34:10.816 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51765.log 2024-09-10T14:34:10.816 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64745.log.gz 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.44095.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34065.log.gz 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29941.log 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.51765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85955.log 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.29941.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44095.log.gz 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77135.log 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.85955.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51765.log.gz 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52355.log 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.29941.log.gz 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.77135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74775.log 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.52355.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.85955.log.gz 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69465.log 2024-09-10T14:34:10.817 INFO:teuthology.orchestra.run.smithi151.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.77135.log.gz 2024-09-10T14:34:10.818 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.74775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25105.log 2024-09-10T14:34:10.818 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.69465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44685.log 2024-09-10T14:34:10.818 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25105.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25105.log.gz 2024-09-10T14:34:10.818 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52355.log.gz 2024-09-10T14:34:10.818 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.74775.log.gz 2024-09-10T14:34:10.818 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50585.log 2024-09-10T14:34:10.819 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49995.log 91.6% 2024-09-10T14:34:10.819 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.69465.log.gz 2024-09-10T14:34:10.820 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.44685.log: /var/log/ceph/ceph-client.0.50585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60615.log 2024-09-10T14:34:10.820 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.49995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51175.log 2024-09-10T14:34:10.820 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.60615.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44685.log.gz 2024-09-10T14:34:10.820 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50585.log.gz 2024-09-10T14:34:10.820 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.49995.log.gz 2024-09-10T14:34:10.820 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60615.log.gz 2024-09-10T14:34:10.820 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65925.log 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.51175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78303.log 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.65925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68875.log 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.78303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65335.log 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.68875.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78303.log.gz 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.51175.log.gz 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65925.log.gz 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47045.log 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.65335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58845.log 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68875.log.gz 2024-09-10T14:34:10.823 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84775.log 2024-09-10T14:34:10.825 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.47045.log: /var/log/ceph/ceph-client.0.58845.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65335.log.gz 2024-09-10T14:34:10.825 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41145.log 2024-09-10T14:34:10.825 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.47045.log.gz 2024-09-10T14:34:10.825 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.84775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33475.log 2024-09-10T14:34:10.825 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.58845.log.gz 2024-09-10T14:34:10.825 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82415.log 2024-09-10T14:34:10.825 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.41145.log: /var/log/ceph/ceph-client.0.33475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46455.log 2024-09-10T14:34:10.827 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.82415.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84775.log.gz 2024-09-10T14:34:10.827 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86545.log 2024-09-10T14:34:10.827 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.41145.log.gz 2024-09-10T14:34:10.827 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.46455.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.33475.log.gz 2024-09-10T14:34:10.827 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82415.log.gz 2024-09-10T14:34:10.828 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59435.log 2024-09-10T14:34:10.828 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46455.log.gz 2024-09-10T14:34:10.828 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71235.log 2024-09-10T14:34:10.828 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.86545.log: /var/log/ceph/ceph-client.0.59435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38195.log 2024-09-10T14:34:10.829 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.71235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66515.log 2024-09-10T14:34:10.830 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.38195.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86545.log.gz 2024-09-10T14:34:10.830 INFO:teuthology.orchestra.run.smithi151.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.59435.log.gz 2024-09-10T14:34:10.831 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71235.log.gz 2024-09-10T14:34:10.831 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38195.log.gz 2024-09-10T14:34:10.832 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.66515.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.66515.log.gz 2024-09-10T14:34:10.852 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T14:34:10.954 INFO:teuthology.orchestra.run.smithi052.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T14:34:11.715 INFO:teuthology.orchestra.run.smithi151.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T14:34:11.852 INFO:teuthology.orchestra.run.smithi151.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T14:34:11.878 INFO:teuthology.orchestra.run.smithi052.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T14:34:11.880 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T14:34:11.880 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m1.151s 2024-09-10T14:34:11.880 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m1.326s 2024-09-10T14:34:11.880 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.082s 2024-09-10T14:34:11.967 INFO:teuthology.orchestra.run.smithi151.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T14:34:11.968 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-10T14:34:11.968 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m1.227s 2024-09-10T14:34:11.968 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m3.402s 2024-09-10T14:34:11.969 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.211s 2024-09-10T14:34:11.969 INFO:tasks.ceph:Archiving logs... 2024-09-10T14:34:11.972 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116/remote/smithi052/log 2024-09-10T14:34:11.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T14:34:12.189 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116/remote/smithi151/log 2024-09-10T14:34:12.334 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T14:34:12.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-10T14:34:12.873 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T14:34:12.884 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T14:34:12.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T14:34:12.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T14:34:12.943 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T14:34:12.954 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T14:34:12.954 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T14:34:12.957 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T14:34:12.968 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T14:34:12.968 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2024-09-10T14:34:12.969 INFO:teuthology.orchestra.run.smithi052.stdout:+hv01.front.sepi 67.205.162.81 3 u 33 64 377 0.066 -1.035 0.285 2024-09-10T14:34:12.969 INFO:teuthology.orchestra.run.smithi052.stdout:*hv02.front.sepi 63.231.80.2 3 u 35 64 377 0.087 -0.218 0.283 2024-09-10T14:34:12.969 INFO:teuthology.orchestra.run.smithi052.stdout:+hv03.front.sepi 74.6.168.72 3 u 26 64 377 0.102 +0.302 0.331 2024-09-10T14:34:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:34:12.970 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T14:34:12.970 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-10T14:34:12.970 INFO:teuthology.orchestra.run.smithi151.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.115 -2.168 1.099 2024-09-10T14:34:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.106 -1.344 1.090 2024-09-10T14:34:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:*hv03.front.sepi 74.6.168.72 3 u 35 64 377 0.057 -0.708 1.310 2024-09-10T14:34:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T14:34:12.971 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T14:34:12.980 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T14:34:12.980 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T14:34:12.988 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T14:34:12.996 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T14:34:13.005 INFO:teuthology.task.internal:Duration was 954.867062 seconds 2024-09-10T14:34:13.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T14:34:13.014 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T14:34:13.014 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T14:34:13.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T14:34:13.054 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T14:34:13.054 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T14:34:13.054 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T14:34:13.107 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-09-10T14:34:13.107 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T14:34:13.117 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T14:34:13.117 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T14:34:13.151 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T14:34:13.183 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T14:34:13.183 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T14:34:13.219 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T14:34:13.279 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T14:34:13.289 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T14:34:13.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T14:34:13.302 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T14:34:13.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T14:34:13.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T14:34:13.347 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T14:34:13.356 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-10T14:34:13.365 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-09-10T14:34:13.383 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T14:34:13.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T14:34:13.426 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T14:34:13.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T14:34:13.430 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T14:34:13.440 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T14:34:13.441 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116/remote/smithi052 2024-09-10T14:34:13.441 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T14:34:13.490 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899116/remote/smithi151 2024-09-10T14:34:13.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T14:34:13.511 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T14:34:13.512 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T14:34:13.531 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T14:34:13.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T14:34:13.570 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T14:34:13.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T14:34:13.580 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T14:34:13.580 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T14:34:13.583 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T14:34:13.586 INFO:teuthology.orchestra.run.smithi052.stdout: 658460 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 14:34 /home/ubuntu/cephtest 2024-09-10T14:34:13.607 INFO:teuthology.orchestra.run.smithi151.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 14:34 /home/ubuntu/cephtest 2024-09-10T14:34:13.608 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T14:34:13.619 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T14:34:13.642 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 954.8670620918274 flavor: default owner: scheduled_tchandra@teuthology success: true 2024-09-10T14:34:13.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T14:34:13.712 INFO:teuthology.run:pass